文章详情

题名 · 作者 · 摘要 · 关键词 · DOI · 参考文献

大型语言模型与学生在考试中的表现比较研究——以通义千问为例

凌达莲,冯诗颖,陈思楠,潘伟权

(玉林师范学院 数学与统计学院,广西 玉林 537000)

栏目:人工智能 · 第 2025 年第 12 期 · 页码:50-57,62 · 2096-4706(2025)12-0050-09 · 中图分类号:TP39;G434 · 文献标识码:A · DOI:10.19850/j.cnki.2096-4706.2025.12.011

摘要

研究聚焦于大型语言模型(LLM)驱动的AI聊天机器人——通义千问(Qwen),在教育评估中的应用潜力。基于2019—2023年某高校“概率论与数理统计”2 190道期末考题,8位教师对通义千问模型、优化后模型及学生答案进行双盲评分。结果显示,通义千问在选择题中表现稳定,而在解答题中有较大提升空间,特别是在经过Prompt Engineering优化后,其解答题表现显著提升。教师对AI生成内容的评分更为严格,评分受题型和答题主体的影响显著。该研究提供AI辅助教育评估的实证,强调更新标准与探索新模式的重要性。

关键词

LLM;通义千问;教育评估;AI辅助学习

参考文献

  1. [1] JURAFSKY D,MARTIN H J. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition with Language Models [M/OL].[2025-01-02].https://web.stanford.edu/~jurafsky/slp3.
  2. [2] RUMJAUN A,NAROD F. Social Learning Theory—Albert Bandura [M].Science Education in Theory and Practice: An Introductory Guide to Learning Theory,Cham:Springer,2025:85-99.
  3. [3] NABAVI R T. Bandura's Social Learning Theory and Social Cognitive Learning Theory [J].Theory of Developmental Psychology,2012,1(1):1-24.
  4. [4] MORGAN H. Howard Gardner's Multiple Intelligences Theory and his Ideas on Promoting Creativity [M]//REISMAN F. Celebrating Giants and Trailblazers: A-Z of Who's Who in Creativity Research and Related Fields.London:KIE Publications,2021:124-141.
  5. [5] MORGAN H. Maximizing Student Success with Differentiated Learning [J].the Clearing House: A Journal of Educational Strategies, Issues and Ideas, 2014,87(1):34-38.
  6. [6] HWANG G J,CHANG C Y. A Review of Opportunities and Challenges of Chatbots in Education [J].Interactive Learning Environments,2023,31(7):4099-4112.
  7. [7] CHIU T K F,MOORHOUSE B L,CHAI C S,et al. Teacher Support and Student Motivation to Learn with Artificial Intelligence (AI) Based Chatbot [J].Interactive Learning Environments,2024,32(7):3240-3256.
  8. [8] IDC.AI大模型技术能力评估报告 [R/OL].[2025-6-11].https://www.idc.com/getdoc.jsp?containerId=CHC49698923.
  9. [9] GIRAY L. Prompt Engineering with ChatGPT: A Guide for Academic Writers [J].Ann Biomed Engineering,2023,51(12):2629-2633.
  10. [10] GARTNER.5 Impactful Technologies from the Gartner Emerging Technologies and Trends Impact Radar for 2022 [EB/OL].(2021-12-08)[2025-06-11].https://www.gartner.com/en/articles/5-impactful-technologies-from-the-gartner-emerging-technologies-and-trends-impact-radar-for-2022.
  11. [11] 喻国明,苏健威.生成式人工智能浪潮下的传播革命与媒介生态——从ChatGPT到全面智能化时代的未来 [J].新疆师范大学学报:哲学社会科学版,2023,44(5):81-90.
  12. [12] FARROKHNIA M,BANIHASHEM S K,NOROOZI O,et al. A SWOT Analysis of ChatGPT: Implications for Educational Practice and Research [J].Innovations in Education and Teaching International,2024,61(3):460-474.
  13. [13] PRADANA M,ELISA H P,SYARIFUDDIN S. Discussing ChatGPT in Education: A Literature Review and Bibliometric Analysis [J].Cogent Education,2023,10(2):2243134.
  14. [14] 吴砥,吴河江.通用大模型教育应用的潜在风险及其规避——基于技术伦理的视角 [J].华东师范大学学报:教育科学版,2024,42(8):64-75.
  15. [15] 施周龙,赵飞燕.生成式人工智能赋能教育转型发展的思考 [J].教育进展,2024,14(5):950-956.
  16. [16] HUANG R,SHI L Y. Content Framework for Artificial Intelligence Literacy Instruction in China from a Global Perspective [J].Documentation,Information and Knowledge,2024,41(3):27-37.
  17. [17] 汪晨,刘永贵.基于生成式人工智能的教师自主学习模式探究——以ChatGPT为例 [J].软件导刊,2023,22(11):219-225.
  18. [18] FARAZOULI A,CERRATTO-PARGMAN T,BOLANDER-LAKSOV K,et al. Hello GPT! Goodbye Home Examination? An Exploratory Study of AI Chatbots Impact on University Teachers' Assessment Practices [J].Assessment and Evaluation in Higher Education,2024,49(3):363-375.
  19. [19] ADESHOLA I,ADEPOJU A P. The Opportunities and Challenges of ChatGPT in Education [J].Interactive Learning Environments,2024,32(10):6159-6172.
  20. [20] BAI J,BAI S,YANG S,et al. Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond [J/OL].arXiv:2308.12966 [cs.CV].[2025-06-11].https://arxiv.org/abs/2308.12966.

基金项目

2023年广西高等教育本科教学改革工程项目(2023JGB329);大学生创新创业训练计划项目(202110606020)

作者简介

凌达莲(2004.05—),女,汉族,广西北流人,本科在读,研究方向:统计学;冯诗颖(2004.05—),女,汉族,江苏淮安人,本科在读,研究方向:统计学;陈思楠(2001.10—),女,汉族,广西浦北人,本科在读,研究方向:统计学;通信作者:潘伟权(1980.12—),男,汉族,广西平南人,副教授,博士,研究方向:统计学、概率论与数理统计等课程教学与研究。