Automated scoring of open-ended constructed responses has become a mature technology that is widely used in English-language educational settings, including international assessments, such as TOEFL. Research on automated scoring in other languages is also rapidly developing. It might be tempting to consider the relevance of those developments for large-scale international assessments, including those conducted in multiple languages. Such considerations might benefit from being informed on the current state of scoring technologies and their important related aspects. In this chapter we describe the history and the present state of automated scoring technologies for written responses, with a distinction between essay scoring and content scoring. We outline the current technologies of such systems for scoring responses in English. We also present an overview of research on automated scoring for responses in other languages. Beyond the core technologies, we outline the advantages of automated scoring and the major lines of critique that had been expressed against it. We also describe the importance of additional aspects, such as validity, fairness, and dealing with atypical responses.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Automated Scoring of Open-Ended Written Responses: Possibilities and Challenges

  • Michael Flor,
  • Aoife Cahill

摘要

Automated scoring of open-ended constructed responses has become a mature technology that is widely used in English-language educational settings, including international assessments, such as TOEFL. Research on automated scoring in other languages is also rapidly developing. It might be tempting to consider the relevance of those developments for large-scale international assessments, including those conducted in multiple languages. Such considerations might benefit from being informed on the current state of scoring technologies and their important related aspects. In this chapter we describe the history and the present state of automated scoring technologies for written responses, with a distinction between essay scoring and content scoring. We outline the current technologies of such systems for scoring responses in English. We also present an overview of research on automated scoring for responses in other languages. Beyond the core technologies, we outline the advantages of automated scoring and the major lines of critique that had been expressed against it. We also describe the importance of additional aspects, such as validity, fairness, and dealing with atypical responses.