Published Paper Details:

Human-computer interaction is becoming more popular owing to its automaticity, naturalness, and user-friendly characteristics. An innovative approach to this explores by integrating artificial intelligence (AI) with hand gestures and voice commands to revolutionize human-computer interaction in game and virtual mouse, introducing voice-activated functionalities called proton. This system aims to reduce the need of physical device interaction by leveraging computer vision with OpenCV and Python, utilizing only a webcam as an input tool. Instead of using more expensive sensors, a simple webcam can identify the gesture and perform the action. The proposed framework allows users to perform game operations like left move, right move, up, stop. virtual mouse operations like left click, right click, double click, scrolling, drag and drop, volume control and brightness control through various hand gestures, and also users can perform find locations on Google Maps, check the current date and time, put Proton to wake it up, and exit the system, and perform tasks effortlessly through intuitive voice commands. Real-time applications, particularly in gaming, benefit from this approach, overcoming barriers associated with traditional input devices. Testing on games achieve human-computer interaction with minimal hardware requirements. This system integrates AI powered hand gestures and voice commands, demonstrates promising results in enhancing user experiences in virtual environments for gaming and mouse control. A significant advancement in human-computer interaction, providing an innovative and user-friendly interface. This seamless integration of AI and gesture control sets a new standard for efficiency, accessibility in interactive computing experiences.