Difficulties
At the beginning of the project, we could not capture the image or export the data to Matlab. We have tried to use C++ and Python. But neither of them seems to be a feasible plan.After consulting Dr. Vikas and exploring, we can run C++ program to drive the camera in Matlab by Mex command.
The basic algorithm requires us to find the central point of the recognized hand so that we can determine the distances between the contour points and the central point.
The first problem is to isolate the hand from the surroundings.
The second problem is to determine the center of the isolated hand contour. We first computed the average and the medium of the coordinates of the contour points, however, the result turned out to deviate from the expected position.
Our plan is essentially the same as the original.
Things we learn:
Mex command in Matlab: The command to compile C++ program in Matlab. Since the driver program of the Xtion camera is of C++ and we need to run it in Matlab, we need to use the Mex command to compile the program.
The most fun thing in our project is the process of coming up with a new algorithm and testing its feasibility. For instance, in determining the central point of the hand, we first computed the average and the medium of the points on the hand, but the results was not as expected. After testing different methods, our result became better and better.