Camera Movement Cancellation in Video Using Phase Congruency and an FFT-Based Technique

One of the interesting fields in video processing is motion detection and human action detection (HAR) in video. In some applications where both objects in the scene and the camera may be moving, camera movement cancellation is very important to increase accuracy in extracting motion features. HAR systems usually use image matching/registration algorithms to remove the camera movement. In these methods, the source (fixed) image frame is compared with moved image frame, and the best match is determined geometrically. In video processing, due to the existence of a set of frames, one can correct errors using previous data, but at the same time, it is needed a fast frame registration algorithm. According to the above explanations, this article proposes a method to detect and minimize camera movement in video using phase information. In addition to having the acceptable speed and the ability to be implemented online, the proposed method, by combining texture and phase congruency (PC), can significantly increase the accuracy of detecting the objects in the scene. The proposed method was implemented on a HAR dataset, which includes camera movement, and its ability to compensate for camera motion and pre-serve object motion was verified. Finally, the speed and accuracy of the proposed method were compared with a number of the latest image registration methods, and its efficiency in terms of camera movement cancellation and execution time is discussed.