A distributed optimization method is designed for the second-order multi-agent systems formation tracking problem. By analyzing the task requirements, we remodel the problem in the distributed optimization form with the introduction of the objective functions. Then, a distributed optimization control method is designed, in which the objective functions are all time-varying. The simulation experiments illustrate that our method is capable to construct the desired formation and maintain it for multi-agent systems fast while tracking the moving targets.