Development of a Scale for Evaluating Critical Thinking Proficiency Among Generation Z Users of ChatGPT

In response to the increasing use of ChatGPT among Generation Z students, this research aimed to develop a scale for evaluating their critical thinking proficiency while utilizing this AI language model. Employing a causal research methodology, data were collected through a questionnaire administered to 234 respondents, predominantly postgraduate students. The study reviewed existing literature, emphasizing the importance of critical thinking skills in navigating complex information landscapes, and highlighted the potential impact of ChatGPT on Generation Z learners. The research identified a gap in studies assessing critical thinking abilities specifically among ChatGPT users, prompting the development of a scale. Three main objectives were outlined: identifying variables for assessing critical thinking proficiency, developing a scale tailored to ChatGPT users, and examining user experiences. The study hypothesized the model's fit using structural equation modeling, which was subsequently validated through confirmatory factor analysis. Results indicated high reliability for the proposed scale, encompassing truth-seeking, open-mindedness, reflection, analyticity, and systematicity. Confirmatory factor analysis demonstrated a good fit for the model, rejecting the null hypothesis. The average critical thinking ability score among ChatGPT users was 3.78 out of 5, indicating a slightly above satisfactory level. The research delved into the user experience of ChatGPT among Generation Z, revealing positive perceptions regarding helpfulness (73%), accuracy (39%), linguistic proficiency (41%), coherence (43%), technical feasibility (36%), versatility (41%), and responsiveness (42%). In conclusion, this research successfully developed a scale to assess critical thinking proficiency among Generation Z users of ChatGPT. The findings suggest a positive user experience and a satisfactory level of critical thinking ability. The study contributes to the understanding of AI's impact on critical thinking skills and calls for further exploration of the integration of critical thinking competencies with AI tools in educational contexts.