Multi-object tracking typically concentrates on the tracking of individual targets without taking into account the scenario where some of these targets are part of a formation. In this paper, we define a new task called multi-object formation tracking, which requires tracking the formation as a whole while simultaneously tracking individual targets within the formation. To tackle this challenge, we propose a new Multi-Object Formation Tracking method called MOFTrack, which is composed of three main components: (1) position search, which adaptively assigns different search ranges for targets of varying sizes, (2) trajectory validation, which addresses the issue of formation instability during target intersections, and (3) effective bit motion selection, which facilitates the rapid formation tracking of newly emerging targets while also mitigating the impact of trajectory loss on the collection of motion feature vectors. To measure the accuracy of formation tracking, we introduce a novel simulated aircraft formation dataset with formation numbers for small targets in remote sensing videos. In addition, we introduce a metric called Formation Accuracy, FACC. We categorize targets into three groups to assess performance across various target pixel sizes: extremely small, relatively small and small. We successfully implement online reliable tracking and formation assigning for multiple targets in remote sensing videos, achieving high FACC for all three categories of targets. Source code and dataset will be made publicly available.