How Distractor Objects Trigger Referential Overspecification: Testing the Effects of Visual Clutter and Distractor Distance

• Published in: Cognitive science Vol. 40; no. 7; pp. 1617 - 1647
• Main Authors: Koolen, Ruud, Krahmer, Emiel, Swerts, Marc
• Format: Journal Article
• Language: English
• Published: United States Wiley Subscription Services, Inc 01-09-2016
• Subjects: Adolescent; Adult; Algorithms; Attention - physiology; Cognition & reasoning; Color; Computational models; Cues; Definite reference; Distractor distance; Female; Humans; Linguistics; Male; Models, Theoretical; Overspecification; Pattern Recognition, Visual - physiology; Photic Stimulation; Visual clutter; Visual Perception - physiology; Visual stimuli; Young Adult; Distractor distance; Overspecification; Computational models; Definite reference; Visual clutter
• ISSN: 0364-0213; 1551-6709
• DOI: 10.1111/cogs.12297

In two experiments, we investigate to what extent various visual saliency cues in realistic visual scenes cause speakers to overspecify their definite object descriptions with a redundant color attribute. The results of the first experiment demonstrate that speakers are more likely to redundantly mention color when visual clutter is present in a scene as compared to when this is not the case. In the second experiment, we found that distractor type and distractor color affect redundant color use: Speakers are most likely to overspecify if there is at least one distractor object present that has the same type, but a different color than the target referent. Reliable effects of distractor distance were not found. Taken together, our results suggest that certain visual saliency cues guide speakers in determining which objects in a visual scene are relevant distractors, and which not. We argue that this is problematic for algorithms that aim to generate human‐like descriptions of objects (such as the Incremental Algorithm), since these generally select properties that help to distinguish a target from all objects that are present in a scene.