This project is solving the SpaceGloVe: Spacecraft Gesture and Voice Commanding challenge. Description
Inputs from smartphone: Gyroscope, Accelerometer, Altimeter, and Touchscreen display.
The navigation system uses two sets of controls: determine direction of where spacecraft will move in x, y, and z space, and the rotation of the spacecraft (yaw, pitch, roll). Each of the controls determine the 6 degrees by a calculated value from the gyroscope and accelerometer to establish the exact position of the smartphone and a "gas" button to initiate each control. The controls are transmitted using IP-based network to a web server the provides the front-end interface for a space environment to navigate.
The voice command system translates speech to text and can be used to issue control commands without selecting options on the menu.
Technology: • FireBase - Data transport from app via internet to web server • ThreeJS - 3D interface • Google Now - Voice to text translation • Java - Android application and navigation logic • CSS, HTML, Bootstrap - Web front-end interface
License: MIT license (MIT)
Source Code/Project URL: https://github.com/zachverb/Space-Glove
Deployed site: - https://fiery-inferno-6630.firebaseapp.com/
Web Interface - https://github.com/opakhnyuk/Space_glove_web_interface/
Functional Requirements Document - https://drive.google.com/file/d/0B4MLNV0Eoq95TlYwdkkxMFpyWjQ/view?usp=sharing