Prototype of a motion-sensing bluetooth remote for Android apps.
Already have an account? Log in.
To make the experience fit your profile, pick a username and tell us what interests you.
MPU6050 DevBoard is used to sense rotational and translational motion of device. Signals are processed with ESP32 to calculate roll, pitch, yaw and position, converted to binary and sent via Bluetooth Low Energy.
Position and rotation can be reset by holding down the pushbutton, a red LED indicates readiness.
Circuit schematic:
Code for ESP32 and Android App can be found in attached github repositories. CAD files for casing are attached below.
Oberteil.stlTop part of casingStandard Tesselated Geometry - 162.19 kB - 09/23/2019 at 23:41 |
|
|
Unterteil.stlBottom part of casingStandard Tesselated Geometry - 214.93 kB - 09/23/2019 at 23:41 |
|
An Android App was created with which the user can activate Bluetooth, pair and connect with the device. By click on "Simulate" a virtual 3D plane is drawn that can be moved and rotated by the controller.
The code can also be found in the Github repository.
Software for ESP32: Gather motion data from gyroscope and accelerometer (translational acceleration in x/y/z and rotation rate around x/y/z). Calculate X/Y/Z position and roll/pitch/yaw angles by integrating over time. Drift of roll and pitch angles is corrected by accelerometer measurements.
The data is compressed and sent via Bluetooth Low Energy in short intervalls. Arduino Code for the ESP32 can be found in attached Github repository.
Designed a rudimentary two-part casing for better handling of the remote for 3D printing. STL files of top and bottom part are attached. Breadboard with powerbank is glued to the bottom part, top part can be loosely plugged.
This is the first setup to test components and functionality. Basically ESP32 and MPU6050 devboards on a breadboard with some LEDs and a button for input/output. ESP hooked up to a small powerbank for easy wireless access.
Thanks for your question! I added some more details and a video :)
Basically, right now the device senses motion, calculates position/rotation and sends them via Bluetooth. We developed an Android app to receive the signals and manipulate a 3D plane based on the remote input.
The plan is to develop a VR app for Google cardboard. The motion remote can then function as a controller since the phone is not available as a controller when it's inside the headset.
Will this support gestures? I always liked the idea of being able to "throw" a command from one device to another.
What do you mean by "throw"?
As of now it broadcasts rotational and translational motion to an Android device. The corresponding app could be surely adapted to support more complex gestures.
Imagine you're standing before a monitor with a smartphone, and you do a big sweep up the screen toward the monitor, and the content on the phone ends up on the monitor. You've "thrown" it there. Kind of like that. I've seen it in a few near-future sci-fi shows, and thought it would be cool to actually implement.
Ahh, now I get it. That would be awesome :)
Thanks for your input!
Simon Rihm
Christoph Tack
What it actually do.?