Efficient Deep Models for Real-Time 4K Image Super-Resolution. NTIRE 2023 Benchmark and Report

• Published in: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) pp. 1495 - 1521
• Main Authors: Conde, Marcos V., Zamfir, Eduard, Timofte, Radu, Motilla, Daniel, Liu, Cen, Zhang, Zexin, Peng, Yunbo, Lin, Yue, Guo, Jiaming, Zou, Xueyi, Chen, Yuyi, Liu, Yi, Hao, Jia, Yan, Youliang, Zhang, Yuanfan, Li, Gen, Sun, Lei, Kong, Lingshun, Bai, Haoran, Pan, Jinshan, Dong, Jiangxin, Tang, Jinhui, Ayazoglu, Mustafa, Bilecen, Bahri Batuhan, Li, Mingxi, Zhang, Yuhang, Fan, Xianjun, Sheng, Yankai, Sun, Long, Liu, Zibin, Gou, Weiran, Li, Shaoqing, Yi, Ziyao, Xiang, Yan, Kong, Dehui, Xu, Ke, Gankhuyag, Ganzorig, Yoon, Kihwan, Zhang, Jin, Yu, Gaocheng, Zhang, Feng, Wang, Hongbin, Zhou, Zhou, Chao, Jiahao, Gao, Hongfan, Gong, Jiali, Yang, Zhengfeng, Zeng, Zhenbing, Chen, Chengpeng, Guo, Zichao, Park, Anjin, Liu, Yuqing, Jia, Qi, Yu, Hongyuan, Yin, Xuanwu, Zuo, Kunlong, Zhang, Dongyang, Fu, Ting, Cheng, Zhengxue, Zhu, Shiai, Zhou, Dajiang, Yu, Weichen, Ge, Lin, Dong, Jiahua, Zou, Yajun, Wu, Zhuoyuan, Han, Binnan, Zhang, Xiaolin, Zhang, Heng, Shao, Ben, Zheng, Shaolong, Yin, Daheng, Chen, Baijun, Liu, Mengyang, Nistor, Marian-Sergiu, Chen, Yi-Chung, Huang, Zhi-Kai, Chiang, Yuan-Chun, Chen, Wei-Ting, Yang, Hao-Hsiang, Chang, Hua-En, Chen, I-Hsiang, Hsieh, Chia-Hsuan, Kuo, Sy-Yen, Vo, Tu, Yan, Qingsen, Zhu, Yun, Su, Jinqiu, Zhang, Yanning, Zhang, Cheng, Luo, Jiaying, Cho, Youngsun, Lee, Nakyung
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-06-2023
• Subjects: Benchmark testing; Digital art; Interpolation; Photography; Runtime; Superresolution; Training
• ISSN: 2160-7516
• DOI: 10.1109/CVPRW59228.2023.00154

This paper introduces a novel benchmark for efficient up-scaling as part of the NTIRE 2023 Real-Time Image Super-Resolution (RTSR) Challenge, which aimed to upscale images from 720p and 1080p resolution to native 4K (×2 and ×3 factors) in real-time on commercial GPUs. For this, we use a new test set containing diverse 4K images ranging from digital art to gaming and photography. We assessed the methods devised for 4K SR by measuring their runtime, parameters, and FLOPs, while ensuring a minimum PSNR fidelity over Bicubic interpolation. Out of the 170 participants, 25 teams contributed to this report, making it the most comprehensive benchmark to date and showcasing the latest advancements in real-time SR.