AI Virtual Gesture PC Control

Abstract

In our research, we proposed an interactive computer system that can function without a physical keyboard, volume control, or mouse. This system can benefit everyone, especially paralysed people who struggle to use a physical keyboard, volume control, and mouse. We used computer vision to allow the user to type on a virtual keyboard with his fingertip and navigate to the mouse control system. Hand gesture recognition system acknowledged great attention in the recent few years because of its manifoldness applications and the ability to interact with machine efficiently through human computer interaction. We proposed a multi-modal interactive keyboard and mouse system that uses the device's camera to detect and track gestures to change the use of traditional keyboard, volume, and mouse. This is accomplished by employing a vision-based recognition technique and a hand gesture recognition technique to take inputs from a camera, with no additional hardware needs. Our system will allow the user to control their computer's keyboard, volume, and mouse using only their fingertip hand gestures. The major goal is to create an interactive virtual keyboard, volume control, and mouse system that will allow motion-impaired people to virtually connect with computers.