A Local and Non-Local Features Based Feedback Network on Super-Resolution

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 24; p. 9604
• Main Authors: Liu, Yuhao, Chu, Zhenzhong, Li, Bin
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 07-12-2022; MDPI
• Subjects: Algorithms; deep convolutional network; dense skip block; Feature maps; Feedback; feedback network; non-local self-attention; single-image super-resolution; deep convolutional network; dense skip block; feedback network; non-local self-attention; single-image super-resolution
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22249604

Recent advances in Single Image Super-Resolution (SISR) achieved a powerful reconstruction performance. The CNN-based network (both sequential-based and feedback-based) performs well in local features, while the self-attention-based network performs well in non-local features. However, single block cannot always perform well due to the realistic images always with multiple kinds of features. In order to take full advantage of different blocks on different features. We have chosen three different blocks cooperating to extract different kinds of features. Addressing this problem, in this paper, we propose a new Local and non-local features-based feedback network for SR (LNFSR): (1) The traditional deep convolutional network block is used to extract the local non-feedbackable information directly and non-local non-feedbackable information (needs to cooperate with other blocks). (2) The dense skip-based feedback block is use to extract local feedbackable information. (3) The non-local self-attention block is used to extract non-local feedbackable information and the based LR feature information. We also introduced the feature up-fusion-delivery blocks to help the features be delivered to the right block at the end of each iteration. Experiments show our proposed LNFSR can extract different kinds of feature maps by different blocks and outperform other state-of-the-art algorithms.