<p>Despite the rapid proliferation of Artificial Intelligence (AI)certificate programs in higher education, systematic frameworks for evaluating their pedagogical transformation potential remain absent—in contrast to the rich literature on AI tool adoption, which seldom addresses how credentials reshape teaching at the program level—and existing assessments rely on unidimensional methods that overlook both expert judgment and cultural variation. Grounded in the Technological Pedagogical Content Knowledge (TPACK) framework, we employ a hybrid Analytic Hierarchy Process (AHP) and Fuzzy AHP (FAHP) methodology, supplemented by Monte Carlo (MC) simulation (<i>N</i> = 10,000) for robustness verification, drawing on structured pairwise ratings and fuzzy assessments from 18 domain experts across Chinese universities. We identify and prioritize five dimensions—curriculum design, instructional implementation, faculty expertise, technological support, and cross-cultural adaptability—and quantify their relative weights and perceived performance. We find a clear hierarchy in expert priorities: student AI competency achievement (weight = 0.1438, rank stability = 99.8%) and curriculum alignment with AI frontiers (weight = 0.1056, rank stability = 98.5%) emerge as the paramount strategic levers, whereas cross-cultural adaptability receives the lowest weight (0.0735), signaling a technology-first bias in early-stage credential development. Strikingly, faculty professional competence exhibits the largest gap between its perceived importance (weight = 0.1976) and current satisfaction (score = 3.2171)—a finding that challenges the widespread assumption that technological infrastructure is the primary barrier to AI education. By revealing a developmental asymmetry in which content knowledge (CK) outweighs integrated pedagogical capacity, these findings extend TPACK theory into the credential evaluation domain and offer a robust, expert-informed strategic roadmap with explicit guidance for international adaptation.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Evaluation indicator system for AI certificate programs

  • Zijing Wu,
  • Qiang Li

摘要

Despite the rapid proliferation of Artificial Intelligence (AI)certificate programs in higher education, systematic frameworks for evaluating their pedagogical transformation potential remain absent—in contrast to the rich literature on AI tool adoption, which seldom addresses how credentials reshape teaching at the program level—and existing assessments rely on unidimensional methods that overlook both expert judgment and cultural variation. Grounded in the Technological Pedagogical Content Knowledge (TPACK) framework, we employ a hybrid Analytic Hierarchy Process (AHP) and Fuzzy AHP (FAHP) methodology, supplemented by Monte Carlo (MC) simulation (N = 10,000) for robustness verification, drawing on structured pairwise ratings and fuzzy assessments from 18 domain experts across Chinese universities. We identify and prioritize five dimensions—curriculum design, instructional implementation, faculty expertise, technological support, and cross-cultural adaptability—and quantify their relative weights and perceived performance. We find a clear hierarchy in expert priorities: student AI competency achievement (weight = 0.1438, rank stability = 99.8%) and curriculum alignment with AI frontiers (weight = 0.1056, rank stability = 98.5%) emerge as the paramount strategic levers, whereas cross-cultural adaptability receives the lowest weight (0.0735), signaling a technology-first bias in early-stage credential development. Strikingly, faculty professional competence exhibits the largest gap between its perceived importance (weight = 0.1976) and current satisfaction (score = 3.2171)—a finding that challenges the widespread assumption that technological infrastructure is the primary barrier to AI education. By revealing a developmental asymmetry in which content knowledge (CK) outweighs integrated pedagogical capacity, these findings extend TPACK theory into the credential evaluation domain and offer a robust, expert-informed strategic roadmap with explicit guidance for international adaptation.