In omnidirectional video-capturing systems, fixed virtual cameras significantly limit the system’s field of view (FoV) in observation. In this study, we realized virtual camera control to enable the viewpoints as virtual pan-tilt cameras by encoding the pan-tilt mirror trajectory with offsets. We also expanded the controllable range of viewpoints with pyramid offsets, which can separate the large offset into several sub-offset stages. In the experiment, we compared the viewpoint images captured in the maximum controlled ranges of the virtual camera and recorded the corresponding pan-tilt mirror trajectories. The proposed approach can effectively drive the virtual pan-tilt cameras in pitch and yaw, and with pyramid offsets, the controlled ranges for the experimental viewpoint can be extended from \(\pm 5^{\circ }\) to \(\pm 12^{\circ }\) . This improves the FoV of viewpoints in an omnidirectional video shooting system for better observation.