Versatile Video Coding Of 360° Video Using Adaptive Resolution Change

• Published in: 2020 IEEE International Conference on Image Processing (ICIP) pp. 3398 - 3402
• Main Authors: Carreira, J., de Faria, Sergio M. M., Tavora, Luis M. N., Navarro, Antonio, Assuncao, Pedro A.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-10-2020
• Subjects: adaptive resolution change; Bit rate; Encoding; Omnidirectional video coding; Spatial resolution; Streaming media; Video coding; visual attention-based FoV resolution; Visualization
• ISSN: 2381-8549
• DOI: 10.1109/ICIP40778.2020.9190732

Encoding 360° video with ultra high spatial resolution requires high bitrates to guarantee acceptable QoE in video delivery services. However, since in general the full Field-of-View (FoV), i.e., 360°, is not required at once, a great deal of bandwidth can be saved if only a limited FoV is delivered, according to content relevancy or/and user demand. This work addresses this problem using the concept of Adaptive Resolution Change (ARC) defined in the forthcoming Versatile Video Coding (VVC) standard, by dynamically mapping the full FoV into multiple video frames with different spatial resolutions. Those FoVs attracting more visual attention are encoded with higher resolution while the others are encoded with lower resolution, thus without compromising the visual quality and resolution of the most relevant regions. The simulation results show that the proposed adaptive coding scheme is able to deliver high quality video for the most relevant FoV at any time instant, achieving a maximum bitrate reduction of 37.2%.