Overview:
This small software is a semester project for the course Data Structure and Algorithms. The software uses OpenCV libraries in C++ to detect a specific hand gesture and after that it assigns the control of the windows cursor to the movement of hand. In this software the this specific gesture is connecting the tip of index finger with the tip of thumb. In this position you got the control of the cursor. And when you show your palm (gesture vanished) the cursor will be controlled by mouse/touch-pad only. watch the video carefully for better understanding of the idea.
Video Demo:
Platform:
This small software is a semester project for the course Data Structure and Algorithms. The software uses OpenCV libraries in C++ to detect a specific hand gesture and after that it assigns the control of the windows cursor to the movement of hand. In this software the this specific gesture is connecting the tip of index finger with the tip of thumb. In this position you got the control of the cursor. And when you show your palm (gesture vanished) the cursor will be controlled by mouse/touch-pad only. watch the video carefully for better understanding of the idea.
Video Demo:
Windows 7 / 8 / 10
Download and Install:
1. Download the project .rar file from the this dropbox link.
2. Open Project in Visual Studio Professional. Make sure you have Opencv 3.2 libraries installed in C:\ directory and in Environment Variables.
3. Build and Run.
Solution Workflow:
- Capturing video from webcam
- Detection of hand and finger tips.
- Detecting the contour of the largest area.
- Comparing the radius of the contour with specific value (given in the code).
- If the radius lies in the range, assign the coordinates of the center of circle to cursor.
A look at Code:
Lets us have a quick overview of the code that what it is actually doing and how it is doing so.
- First of all some necessary libraries and header files to include.
- Global Variables, camframe (frame captured from the webcam), mainframe (processing will be done on this one, it is actually a copy of the camframe). canny_output (frame in which edges are detected). bsframe (frame after background subtraction if one wants to use bs).
- A point which gets the value of your current screen resolution.
- ratiox and ratioy varibles for the adjusting the ratio for the webcam image and your current screen (for the movement of cursor) which results in the matching the position of hand in image and cursor on screen.
- Some function prototypes.
- contour_hull function is where the main image processing comes in.
- GetDesktopResolution() is used to find the current screen resolution.
Working of the Code:
- Finding the screen resolution.
- Capturing frames from webcam in BGR (blue, green, red format) in camframe.
- Shift to mainframe (rest of the working on the mainframe).
- Converting to Grayscale.
- Apply Gaussian Blur (so that only major edges should remain to detect).
- Applying a certain threshold (controlled by the user).
- Using canny edge detector to find edges.
- Finding contours.
- Constructing Hulls from contours.
- Drawing the Hull of largest area on camframe.
- Drawing the defect points (finger tips).
- Drawing square and Circle around the largest Hull.
- Finding the radius of the circle and checking it for a certain range.
- If it lies in that range (25 < radius < 40) then assign the coordinates of the center of the circle after multiplying it with a proper factor (arise due to difference in webcam resolution and screen resolution) to the cursor using function SetCursorPos() of windows.h.
