Triage-Bot: An Assistive Triage Framework

• Published in: 2024 IEEE International Conference on Digital Health (ICDH) pp. 138 - 140
• Main Authors: Sharma, Drishti, Rashno, Elyas, Zulkernine, Farhana, Khodary, Eyad El, Beninger, Max, Almeida, Ronan, Tao, Jing, Alaca, Furkan, Elgazzar, Khalid
• Format: Conference Proceeding
• Language: English
• Published: IEEE 07-07-2024
• Subjects: Automatic Speech Recognition; Canadian Triage and Acuity Scale; Electronic medical records; Oral communication; Passwords; photoplethysmography; Robot vision systems; Software; Speech processing; Speech recognition; TriageBot
• DOI: 10.1109/ICDH62654.2024.00033

Prompt delivery of healthcare services is critical for saving lives. Streamlining the collection of patients' health data through automation can minimize waiting times in emergency departments and enhance access to evidence-based care. We propose an innovative solution, Triage-Bot, which leverages the latest advancements in Artificial Intelligence to elevate the standard of patient care. Triage-Bot is a software as-a-service that allows patients or their caregivers to authenticate themselves by presenting their faces to the camera and also using a registered user ID and password. They can communicate about their health situation through voice, chat, and video conversations securely with the robot service to request medical attention. Moreover, Triage-Bot automatically captures vital signs from facial video. Voice data is converted to text to extract a concise summary of the patient's health condition, while emotions are detected from both text and video data. The processed patient information is linked to the patients' Electronic Medical Records to automatically classify the patients into one of the five severity level as defined by the Canadian Triage and Acuity Scale. Currently, we are working on the evaluation of the services by medical professionals.