Gravity-implemented 3D drawing with leap Motion

Abstract

Leap Motion is a hand-tracking camera computer hardware that support hand and finger sensing as computer input without any actual contact with the computer. This kind of motion sensor provide a new concept of human interaction with the computers in different aspects such as interaction method, input dimension, or data interpretation. New motion sensing hardware peripherals improve the development of Human-Computer Interaction (H.C.I.), which is a study of the interfaces between users and computers. A contact free input can provide users a more natural computer interaction system without using any actual input peripherals so that it can provide a new mental model of H.C.I.. In this project, it aims to develop a 3D drawing program with the use of Leap Motion in Unity Platform. Users can create their own 3D drawing with the user of their hands and hand gestures. Meanwhile, they can interact with their drawing in a virtual spaces provided by the program while gravity is provided to simulate a real object interaction. Another aims of the project is to learn the recognition of different hand gestures through the mechanism of hand tracking in Leap Motion. Different gestures provide several input signal as to interact with the system such as clicking button, changing interface mode. These kinds of gestures can be distinguished with the parameters provided by hand sensor and it is hoped to learn the relationship of hand gestures and the parameters such as finger distances, hand acceleration, hand normal or furthermore. As the results, more further application can come up with the research such as keyboard and mouse free user interface or more hand sensing interaction application.