Mouse-less Interaction Using Augmented Reality

Authors

  • Sheetal Nilawar Student, Department of Computer Science Engineering, Vishwaniketan’s Institute of Management Entrepreneurship and Engineering Technology, Kumbhivali, Tal, Khalapur, Maharashtra, India
  • Yashswini Inamdar Student, Department of Computer Science Engineering, Vishwaniketan’s Institute of Management Entrepreneurship and Engineering Technology, Kumbhivali, Tal, Khalapur, Maharashtra, India
  • Charusheela Pandit Assistant Professor, Department of Computer Science Engineering, Vishwaniketan’s Institute of Management Entrepreneurship and Engineering Technology, Kumbhivali, Tal, Khalapur, Maharashtra, India

Keywords:

Mouse-less interaction, gestures, AR, sensors, fingers

Abstract

This project aims to revolutionize computer interaction in augmented reality environments by developing a mouse-less system operated by fingers in the air. The conventional use of physical mouse restricts user movement and immersion in virtual environments. The project's primary objectives revolve around tackling issues related to precision, response time, the identification of gestures, and the seamless integration of augmented reality. The proposed solution involves selecting appropriate motion tracking technologies and designing a hardware prototype that incorporates these technologies. Gesture recognition algorithms are developed to interpret finger movements captured by the motion tracking sensors. A wireless communication module is implemented to establish a real-time connection between the wireless mouse and the computer system. Finally, the developed mouse-less system is integrated with an augmented reality framework to enable interaction with virtual objects and user interfaces. The effectiveness and usability of the solution are evaluated through comprehensive demonstrations in various augmented reality applications and scenarios. This project aims to enhance the overall user experience in augmented reality and revolutionize the way users interact with computers. The wireless finger-operated mouse system has the potential to transform computer interaction and prepare the way for more immersive and natural augmented reality experiences.

References

Shukla Abhishek. AI Virtual Mouse Using Hand Gesture Recognition. Int J Res Publ Rev. 2022; 3(10): 168–173. 10.55248/gengpi.2022.3.10.13.

Nandwalkar J, Mandal Mahima, Khirari Amisha, Bhalchim Tejas. Control Mouse using Hand Gesture and Voice. Int J Res Appl Sci Eng Technol. 2023; 11(4): 3261–3268. 10.22214/ijraset.2023.50850.

Barot T, Karhadkar S. Development of platform independent hand gesture controlled wearable mouse. In 2018 IEEE 3rd International Conference for Convergence in Technology (I2CT). 2018 Apr 6; 1–5.

Tran DS, Ho NH, Yang HJ, Kim SH, Lee GS. Real-time virtual mouse system using RGB-D images and fingertip detection. Multimed Tools Appl. 2021 Mar; 80(7): 10473–90.

Shriram S, Nagaraj B, Jaya J, Shankar S, Ajay P. Deep learning-based real-time AI virtual mouse system using computer vision to avoid COVID-19 spread. J Healthc Eng. 2021 Oct 25; 2021: 8133076.

Kumar R, Gupta R, Faraz MS. Application and Designing of Wireless Mouse using Object Tracking. In 2019 IEEE 6th International Conference on Computing for Sustainable Global Development (INDIACom). 2019 Mar 13; 22–26.

Reddy KB, Fayazuddin Md, Manohar MJ, Tavanam V. Artificial Intelligence Based Virtual Mouse. Int J Comput Sci Mob Computing. 2022 Jan 30; 11(1): 25–35. ‌

Shraddha Gaikwad, Devansh Rane, et al. AI virtual mouse. International Research Journal of Engineering and Technology (IRJET). 2022; 9(5): 1293–1295.

Kavitha R, Janasruthi SU, Lokitha S, Tharani G. Hand Gesture Controlled Virtual Mouse Using Artifical Intelligence. Int J Adv Res Innov Ideas Educ (IJARIIE). 2023; 9(2): 307–320. Available from: https://ijariie.com/AdminUploadPdf/Hand_Gesture_Controlled_Virtual_Mouse_Using_Artificial_Intelligence__ijariie19380.pdf

Nikhil Srivastava. Invisible mouse: Interacting with computer systems without physical mouse. International Journal of Engineering Research & Technology (IJERT). 2012; 1(5): 1–4.

Mistry P, Maes P. Mouseless: a computer mouse as small as invisible. In CHI'11 Extended Abstracts on Human Factors in Computing Systems. 2011 May 7; 1099–1104.

Pradhan A, Deepak BB. Design of intangible interface for mouseless computer handling using hand gestures. Procedia Comput Sci. 2016 Jan 1; 79: 287–92.

Tejaswi D, Preethi G, Sirisha B, Swathi K, Priya DJ, Sravani G. Mouseless Cursor Using Facial Movements. J Eng Sci. 2023; 14(04): 443–454.

Grif HS, Farcas CC. Mouse cursor control system based on hand gesture. Procedia Technol. 2016 Jan 1; 22: 657–61.

Villar N, Izadi S, Rosenfeld D, Benko H, Helmes J, Westhues J, Hodges S, Ofek E, Butler A, Cao X, Chen B. Mouse 2.0: multi-touch meets the mouse. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. 2009 Oct 4; 33–42.

Published

2023-11-20

How to Cite

Nilawar, S. ., Inamdar, Y. ., & Pandit, C. . (2023). Mouse-less Interaction Using Augmented Reality. JOURNAL OF OPERATING SYSTEMS DEVELOPMENT &Amp; TRENDS, 10(2), 24–35. Retrieved from https://stmcomputers.stmjournals.com/index.php/JoOSDT/article/view/690