CVCC Model: Learning-Based Computer Vision Color Constancy with RiR-DSN Architecture

• Published in: Sensors (Basel, Switzerland) Vol. 23; no. 11; p. 5341
• Main Author: Choi, Ho-Hyoung
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 05-06-2023; MDPI
• Subjects: Accuracy; Computer vision; computer vision color constancy; Digital imaging; Feature maps; Hypotheses; Illumination; illumination estimation; Image processing; Image quality; Information flow; Machine vision; Neurons; Physics; RiR-DSN architecture; scene illuminant color; illumination estimation; RiR-DSN architecture; scene illuminant color; computer vision color constancy
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s23115341

To achieve computer vision color constancy (CVCC), it is vital but challenging to estimate scene illumination from a digital image, which distorts the true color of an object. Estimating illumination as accurately as possible is fundamental to improving the quality of the image processing pipeline. CVCC has a long history of research and has significantly advanced, but it has yet to overcome some limitations such as algorithm failure or accuracy decreasing under unusual circumstances. To cope with some of the bottlenecks, this article presents a novel CVCC approach that introduces a residual-in-residual dense selective kernel network (RiR-DSN). As its name implies, it has a residual network in a residual network (RiR) and the RiR houses a dense selective kernel network (DSN). A DSN is composed of selective kernel convolutional blocks (SKCBs). The SKCBs, or neurons herein, are interconnected in a feed-forward fashion. Every neuron receives input from all its preceding neurons and feeds the feature maps into all its subsequent neurons, which is how information flows in the proposed architecture. In addition, the architecture has incorporated a dynamic selection mechanism into each neuron to ensure that the neuron can modulate filter kernel sizes depending on varying intensities of stimuli. In a nutshell, the proposed RiR-DSN architecture features neurons called SKCBs and a residual block in a residual block, which brings several benefits such as alleviation of the vanishing gradients, enhancement of feature propagation, promotion of the reuse of features, modulation of receptive filter sizes depending on varying intensities of stimuli, and a dramatic drop in the number of parameters. Experimental results highlight that the RiR-DSN architecture performs well above its state-of-the-art counterparts, as well as proving to be camera- and illuminant-invariant.