In the past years, ChatGPT has proven that it is capable of handling tasks in many domains. This includes education. For education, the public discourse so far has been dominated by the possible adverse effects ChatGPT might have, as ChatGPT allows students to mask work done by AI as their own. This study tries to show a positive application for ChatGPT that can help students improve their work and save educators time. This paper is one of the first to compare ChatGPT and language professionals in grading essays. Although some research has been done, this study separates itself by placing a more significant emphasis on prompt engineering. Using the same criteria for the human raters and GPT while doing Zero-Shot prompt engineering has also not been done in this form. By doing that, this study aims to prove that ChatGPT can be used as an Automatic Essay Scoring system that can deliver grades comparable to those of human raters. With ChatGPT available to everyone, this study could show educators and students what potential AI systems have in grading Essays. The focus on prompt engineering can also help to understand how better prompts can be used to unlock ChatGPT’s full potential.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Automated Essay Scoring with ChatGPT

  • Sebastian Maidl,
  • Annette Hautli-Janisz

摘要

In the past years, ChatGPT has proven that it is capable of handling tasks in many domains. This includes education. For education, the public discourse so far has been dominated by the possible adverse effects ChatGPT might have, as ChatGPT allows students to mask work done by AI as their own. This study tries to show a positive application for ChatGPT that can help students improve their work and save educators time. This paper is one of the first to compare ChatGPT and language professionals in grading essays. Although some research has been done, this study separates itself by placing a more significant emphasis on prompt engineering. Using the same criteria for the human raters and GPT while doing Zero-Shot prompt engineering has also not been done in this form. By doing that, this study aims to prove that ChatGPT can be used as an Automatic Essay Scoring system that can deliver grades comparable to those of human raters. With ChatGPT available to everyone, this study could show educators and students what potential AI systems have in grading Essays. The focus on prompt engineering can also help to understand how better prompts can be used to unlock ChatGPT’s full potential.