ardaonal / aivirtualmouse

AI based virtual mouse where the camera detects your hand and it used as a mouse

AIVirtualMouse

AI based virtual mouse where the camera detects your hand and it is used as a mouse. The HandTrackingModule can be used in any application where it requires hand detection. Libraries used were OpenCV for getting the frames and image processing, and Mediapipe for hand detection. Check out below images for more details.

Basic outline of how the frame looks like. The light blue rectangle is the region of interest where you move your index finger which moves the mouse on your screen.

When you only point your index finger up, it enables the movement of the mouse and the tip of your index finger is highlighted with color yellow.

When you point your index finger and your thumb, the movement of mouse stops and both of the fingers and their distances are drawn with color red.

If you get your thumb and index finger close to each other, the mouse clicks and this is displayed by color green on the thumb.