With the deepening development of educational informatization, the application of big data technology in the field of education is becoming increasingly widespread. In order to improve the quality and efficiency of the construction of famous teachers’ work, this study proposes an optimization strategy for the construction mechanism of famous teachers’ work in the city based on big data analysis. The study used a combination of quantitative and qualitative methods to conduct an in-depth analysis of the current status of the construction of famous teachers in the city by collecting and processing relevant data. The results showed that in the team of famous teachers in a certain city, the proportion of senior professional titles reached 70.3%, and the award rate for teaching achievements was as high as 80.2%. However, the distribution of famous teacher resources was uneven, with significant urban–rural differences. Through big data analysis, specific optimization strategies are proposed, including personalized training and development plans, rational allocation of resources, and improvement of performance evaluation systems. After the implementation of optimization, the effectiveness of the construction mechanism for famous teacher work has increased by 43.5%, the utilization rate of famous teacher resources has increased by 48.7%, the gap between urban and rural education resources has narrowed by 25.8%, and teacher satisfaction has increased by 27.8%. Research has shown that big data analysis can significantly enhance the scientificity and effectiveness of the construction of famous teachers in urban areas, and has important theoretical and practical significance for promoting educational equity and improving educational quality.