spacecraft-automation-using-gesture-and-voice-recognition

We have developed a new technique for Spacecrafts, to control a computer application via gesture and voice as an input. It will enable the astronauts to connect to the main computer and the main computer will respond to gestures and voice commands. This is a unique way for data and applications to be swiped/transferred between the wearable devices and the main computer. The two inputs work in concert with each other and independently.

This project is solving the SpaceGloVe: Spacecraft Gesture and Voice Commanding challenge.

Description

In space environment, where communication with your computer is not as easy on in earthly environment, astronauts find difficulty to control various thing over computer. There is a need of a new technique that will help astronauts to communicate to the space craft’s computer. His important thing is here is that the technique should be designed by keeping in mind the conditions of the space environment. It is not possible to simply implement the earthy communication techniques in the space. How to solve the problem? By using the current state of the art technology, it is possible to design a whole new technique that addresses the basics of the discussed problem. As listed on NASA challenge website, the have challenges us to implement this new technique using gesture and voice control over the spacecraft’s computer. But? Is there any further solution that can solve the problem completely? In a long run? If we only limit ourselves to implement gestures using wearable device accelerometer and vice control, that limits the astronauts to have a wearable device. We have now a new solution that is independent of the wearable tech. However, it can also take input from the wearable devices. We have developed an image processing based algorithm that process the hand gesture made by an astronauts and then give output. We have developed a “Sign language”. Currently, because of tight schedule, we have only developed 5 gestures. Both wearable device and image recognition system works in parallel enabling the astronauts to take control over their computer completely.


Project Information


License: GNU General Public License version 3.0 (GPL-3.0)


Source Code/Project URL: https://github.com/exen-pk/spaceglove


Resources


Team



Loading...
×
Loading...
×