A Multimodal Evaluation of Test Reliability and Validity Based on MTMM

Test evaluation plays vital roles in second language teaching, and hence requires more scientific and objective analysis methods. However, the domain of test analyses has not received enough attention, and this line research is mainly based on surface data analyses with traditional and simple methods. This leaves plenty of room to exploring the underlying potentials of examinations. In general, test evaluation needs analyses on various aspects with more advanced models. Against this backdrop, the present case study tries to explore the test reliability and validity from comprehensive and objective perspectives by including different statistical analyses models. It focuses on analyzing the tests on the aspects of score distribution, correlation, reliability and validity, etc., especially with factor analysis and multitrait-multimethod matrix (MTMM). According to the results, the present test does not perform well in reliability and has average validity. The test assessment method could offer implications to improving English test designs.