Research Article | Open Access
Gesture Based Virtual I/O System
Pravinkumar Sonsare , Aryan Gupta , Shefali Jindal , Shruti Chittora , Sumeet Gedam and Sushant Dhote
Pages: 2982-2986
Abstract
This paper presents an advancement in the technology by replacing mechanical keyboard with Virtual Keyword.
The objective is to develop a virtual keyboard using hand/finger recognition which tracks the finger position on
the keyboard layout. Real time system is being developed by using camera to capture the stream of hand
gestures on keyboard printout. ArUco marker is then used to locate the orientation of keyboard in space in
camera's field of view. OpenCv library is further used for perspective transformation of frames. The frames
obtained are then used to detect the finger position with respect to the keyboard using Mediapipe. Keystroke are
then detected by the hover duration.
Keywords
Virtual Keyboard, Hand and Finger Detection, Keystroke Detection, ArUco Marker, Mediapipe, OpenCV