In the field of education in the 21st century, the rapid development of science and technology is profoundly affecting the change of teaching mode. As an important part of the education system, physical education is also seeking a development path that coincides with the times. The construction of the physical education teaching behavior model aims to quantify the teachers’ behavior, students’ reaction and teaching effect in the teaching process through scientific methods, so as to improve the teaching efficiency and quality. With the popularization of technologies such as big data, artificial intelligence and machine learning, we have an unprecedented opportunity to deeply understand and optimize the physical education teaching process. MATLAB simulation shows that under the condition of certain evaluation criteria, the accuracy of data and algorithms in analyzing the teaching behavior of physical education is accurate. The rationality of teaching behavior analysis is better than that of ordinary methods.