Background <p>Judges in figure skating are tasked with evaluating the technical quality of skaters’ performances using the grade of execution (GOE) score, a process that requires rapid integration of multiple technical and qualitative visual cues under time constraints, despite the inherently subjective nature of the evaluation criteria. Previous research suggests that judging accuracy is more impacted by previous experience as an athlete. However, the influence of judging experience on individual differences in evaluation remains unclear.</p> Aims <p>This study investigated whether novice judging experience reduces individual differences in figure skating jump evaluations.</p> Methods <p>Three certified judges and three skaters with similar athletic abilities evaluated 30 double Axel jumps from the 2019 World Championships using video-based judging. Participants assigned GOE scores and evaluated six GOE criteria while eye movements were recorded, and individual differences were analyzed using (1) judging accuracy, (2) gaze coordinates, and (3) intraclass correlations coefficients.</p> Results and Conclusions <p>Results indicated that novice judging experience was not associated with improved judging accuracy or reduced individual differences in final GOE scores.</p> <p>However, judging experience was associated with lower dispersion in gaze coordinates and higher intraclass correlations coefficients in GOE criterion-based evaluations. Notably, substantial individual variation persisted when evaluating jumps matched to music, suggesting a challenge for judge development programs.</p>