Scholarlink

<p>Conversational agents have been designed to improve instruction quality and support student learning. In addition to their instructional use, they can be incorporated into assessment—conversation-based assessment (CBA). This study primarily introduces a CBA with selected-response and constructed-response tests as a formative assessment tool for higher education students, while also reporting student attitudes. CBA was designed using Rasa and deployed to Google Chat for students in two sections of an undergraduate-level course to use. Results show that CBA with both formats produces high standard performance measures and confidence scores for each student response. Most students reported positive attitudes toward CBA via the survey. Overall, accurate dialogue moves within CBA underscore its effectiveness in measuring higher education students’ knowledge and skill, while positive student attitudes toward CBA indicate the promise of conversational agents to enhance student assessment experiences by providing a more interactive assessment environment.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Advancing higher education students’ assessment experiences with conversational agents

  • 期刊论文

  • 发表日期：

    2025年2月28日

查看全文
  • Seyma Yildirim-Erbasli,
  • Okan Bulut,
  • Carrie Demmans Epp,
  • Ying Cui

摘要

Conversational agents have been designed to improve instruction quality and support student learning. In addition to their instructional use, they can be incorporated into assessment—conversation-based assessment (CBA). This study primarily introduces a CBA with selected-response and constructed-response tests as a formative assessment tool for higher education students, while also reporting student attitudes. CBA was designed using Rasa and deployed to Google Chat for students in two sections of an undergraduate-level course to use. Results show that CBA with both formats produces high standard performance measures and confidence scores for each student response. Most students reported positive attitudes toward CBA via the survey. Overall, accurate dialogue moves within CBA underscore its effectiveness in measuring higher education students’ knowledge and skill, while positive student attitudes toward CBA indicate the promise of conversational agents to enhance student assessment experiences by providing a more interactive assessment environment.