Waver: Hands-Free Computing - A Fusion of AI-driven Gesture based Mouse and Voice Companion

With the advancements in technology in recent times, it is expected to see similar improvements in Human-Computer Interactions (HCI). The rise of fields such as AI and ML have provided a platform to create solutions to make the world of technology as inclusive and accessible as possible. This resear...

Full description

Saved in:

Bibliographic Details
Published in:	2023 6th International Conference on Advances in Science and Technology (ICAST) pp. 245 - 249
Main Authors:	Wazir, Yatharth, Shah, Siddhanth, Kaur, Tanisha, Tripathi, Sachin, Toradmalle, Dhanashree
Format:	Conference Proceeding
Language:	English
Published:	IEEE 08-12-2023
Subjects:	computer vision Detection algorithms hand gestures Human computer interaction Keyboards Mice Natural language processing Personal voice assistants speech recognition Switches Virtual Mouse voice assistant voice commands
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	With the advancements in technology in recent times, it is expected to see similar improvements in Human-Computer Interactions (HCI). The rise of fields such as AI and ML have provided a platform to create solutions to make the world of technology as inclusive and accessible as possible. This research paper will explore a system that incorporates an AI-powered hand gesture interface and a voice assistant to simulate a computer mouse, and various keyboard shortcuts and perform multiple voice-operated functions. By utilizing computer vision, hand detection algorithms, natural language processing, and voice-to-text algorithms, this system enables users to interact with computers and projectors remotely through movements of their hand and various inbuilt gestures, eliminating the need for physical peripherals. The system also addresses broader challenges, including the reduction of physical contact with shared devices, and offers additional functionalities such as tab switching, music playback, brightness, and volume control. This innovative approach has the potential to redefine human-computer interaction and make it more accessible than ever before.
DOI:	10.1109/ICAST59062.2023.10454959