With the advent of the era of big data, mathematical modeling plays an increasingly important role in the field of science and technology and in real life. The goal of our country’s basic education curriculum reform is to build a quality education curriculum system. In the “Curriculum Standards”, relevant requirements are put forward for the teaching of mathematical modeling, but there are still some difficulties in the teaching. Based on in-depth learning, this paper carries out research on mathematical modeling teaching, and strives to find out the problems in mathematical modeling teaching and propose effective countermeasures, providing new practical basis and reference for the implementation of mathematical modeling teaching. Ant colony algorithm is a mathematical model that can be used to solve the route problem from one point to another in ant colony. The algorithm was first proposed by Bertsev in 1965. This is based on the idea that each ant has a specific task and works as a team. The task assigned to each ant depends on its position, speed and other factors. Ant colony algorithm can be used to solve many problems, such as routing, scheduling, pattern recognition, etc. In this paper, we will take ant s as an example to focus on how to use this method to solve mathematical problems.