Automated Scoring of Open-Ended Written Responses: Possibilities and Challenges
摘要
Automated scoring of open-ended constructed responses has become a mature technology that is widely used in English-language educational settings, including international assessments, such as TOEFL. Research on automated scoring in other languages is also rapidly developing. It might be tempting to consider the relevance of those developments for large-scale international assessments, including those conducted in multiple languages. Such considerations might benefit from being informed on the current state of scoring technologies and their important related aspects. In this chapter we describe the history and the present state of automated scoring technologies for written responses, with a distinction between essay scoring and content scoring. We outline the current technologies of such systems for scoring responses in English. We also present an overview of research on automated scoring for responses in other languages. Beyond the core technologies, we outline the advantages of automated scoring and the major lines of critique that had been expressed against it. We also describe the importance of additional aspects, such as validity, fairness, and dealing with atypical responses.