Integrating scientific rigor and practicality: developing a translation test to screen translation undergraduates’ ability in a public university in China
摘要
In China, it has long been a convention to integrate translation as one of the core language skills in foreign language teaching and assessment. Currently, most translation tests serve primarily as qualification examinations or components of broader foreign language proficiency tests, lacking a specialized instrument for evaluating undergraduate translation instruction. This study aims to develop a comprehensive translation test tailored for translation major undergraduates across different academic years to assess their translation ability. To achieve this goal, Design and Development Research (DDR) was employed, encompassing three phases: analysis, design and development, and evaluation. During the analysis phase, the Undergraduate Program for Translation Studies (UPTS) and three translation exams were meticulously reviewed to identify key components that should be included in the new translation test, such as objectives, structures, content, and marking scheme. In the design and development phase, a prototype translation test was developed and validated by experts to ensure content validity. A pilot study was conducted to verify the construct validity and reliability of the test, calculate the time required for completion, and assess inter-rater reliability through the marking of 182 participants’ translations by three independent raters. Based on the cut scores from the pilot test results, translation ability descriptors were established. In the evaluation phase, a main study involving 182 participants and in-depth interviews were conducted. Thematic analysis of the participants’ feedback revealed the challenges they faced and solutions they adopted, which informed refinements to the translation ability descriptors. The developed translation test provides teachers with a comprehensive understanding of students’ translation ability, enables personalized instruction based on individual student performance, and boosts overall teaching effectiveness for quality education.