A Novel Bit Allocation Scheme of Rate Control Based on Video Saliency in HEVC

360° video can provide us with an immersive experience. However, because of the low bit rate control efficiency of 360° video, the visual objective quality of the reconstructed video will decline. The main reason for the decrease in visual objective quality is the lower bit allocated by some coding tree units (CTU). In this paper, the visual saliency map is integrated into the video encoder, and the 360° video saliency map is used to predict the bit allocation of the CTU to ensure a better visual experience. Panoramic video needs to be projected so as to be encoded in the traditional video encoder since the panoramic video is a sphere video. So, we also consider the weight of distortion after projection during the bit allocation. Experimental results of the all-intra coding structure have proven that the proposed algorithm has a BD-rate saving of −2.16% on average and BD-PSNR enhancement of 0.0815 dB compared to the HM anchor method.