For the class Virtual Technology I was tasked to do research into a subject of choice, related to virtual or augmented reality. During that time the team has been discussing the idea of having gesture recognition in the training simulation as a means of communicating with other characters. Gestures and poses to block passengers from passing, beckoning passengers to move over here or sending them somewhere else. We have discussed this concept with the KLM aswell and they mentioned that it would not have any priority to the training but could be an extra functionality towards pushing the realism of the training. Gesture recognition in virtual reality is relatively new and not a lot of information is available as of yet. A few games have implemented a basic version of gesture recognition where the players can wave at a character and the character will wave back. Another example, Left-Hand Path, takes it a step further and implemented different motions to cast different spells. This would require a form of recognizing the different motions of the controllers and compare them to a library of pre-set motions. After having done some research into available tools and examples (the full research can be found at the bottom of this entry in pdf-format) I called upon the VR Technology teacher, Juriaan, to discuss gesture recognition. Juriaan mentioned that there is a distinct difference between gestures and poses. A pose defines a stationary, single frame, stature. Like crossing arms in front of you. A gesture is a series of poses over time. A motion like beckoning. Looking for a gesture would require having knowledge of the position and orientation of the controllers and having to compare these to pre-set values of a gesture. A problem with this is the decrepancy in margins of the motions. Someone could make a beckoning motion while having the controller pointed downards while it is meant to trigger an event when it is pointing forwards. It's a difficult task to make a clear difference between when something is a gesture or an accident. For the time being I have set this aside as more pressing mathers are at hand. However, we still keep the idea in tha back of our heads should the project be at a state it is finished and we have spare time to explore gesture recognition more. Gesture Recognition in Virtual Reality
Comments are closed.
|