Integrating Eye-Gaze Data into CXR DL Approaches: A Preliminary study

This paper proposes a novel multimodal DL architecture incorporating medical images and eye-tracking data for abnormality detection in chest x-rays. Our results show that applying eye gaze data directly into DL architectures does not show superior predictive performance in abnormality detection ches...

Full description

Saved in:

Bibliographic Details
Published in:	2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) pp. 196 - 199
Main Authors:	Luis, Andre, Hsieh, Chihcheng, Nobre, Isabel Blanco, Sousa, Sandra Costa, Maciel, Anderson, Jorge, Joaquim, Moreira, Catarina
Format:	Conference Proceeding
Language:	English
Published:	IEEE 01-03-2023
Subjects:	Computer architecture Computing methodologies-Artificial intelligence-Computer vision-Computer vision problem Eye-Tracking-Human-centered computing-Virtual reality Conferences Gaze tracking Three-dimensional displays User interfaces Virtual reality X-ray imaging
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	This paper proposes a novel multimodal DL architecture incorporating medical images and eye-tracking data for abnormality detection in chest x-rays. Our results show that applying eye gaze data directly into DL architectures does not show superior predictive performance in abnormality detection chest X-rays. These results support other works in the literature and suggest that human-generated data, such as eye gaze, needs a more thorough investigation before being applied to DL architectures.
DOI:	10.1109/VRW58643.2023.00048