Overview

 

The project mainly concerns about hand detection, gesture recognition.

The first part is hand detection. We assume the hand as the frontmost object facing the sensor, by thresholding the nearest depth position with a certain gap, we can obtain the approximate region of hand.

The second part is gesture recognition.

    We need to how to find our hand first. We had figured out a way that can let the computer automaticly find our hand without using other things.

    Then we put the image in to the matrix and plot it in the polar coordinate.After getting the distance-angle plot, we distinguish the peaks of the curves as the tips of the tester’s fingers. The number of the plots corresponds to the gesture. For example, 5 peaks represents paper, 2 peaks represents scissor and 0 peak represents rock. By this way, we detect the gesture of the tester and the tester can interact with the computer.