A few years ago, I created an embedded project that supported gesture interaction, allowing users to flip pages by swiping left or right. However, one problem that always bothered me was that traditional gesture sensors relied on optical signals, meaning they had to remain unobstructed. This required cutting a hole to expose the sensor, which didn’t look aesthetically pleasing. So, I wondered: is there a way to hide the gesture sensor while maintaining good performance? This was a challenge I had never been able to solve.

Now, as I set out to create another fun interactive project, I started searching again for a gesture sensor that met my requirements. Not only did I find one, but it was also far more powerful—offering higher sensitivity, greater accuracy, and even precise 3D spatial tracking of hand movements. With this, I could incorporate even more creative interactions into my project.

In the end, I successfully integrated a gesture sensor that can detect movements through solid objects. It uses the I2C protocol, making it relatively easy to interface with a microcontroller. The complex algorithms are pre-configured and stored in the sensor’s firmware, allowing the microcontroller to detect gestures with simple I2C communication.

My videos primarily focus on storytelling and are aimed at a general audience. As a result, I haven’t covered every technical detail, but I will open-source all the materials and provide reference resources.

I hope you enjoy this video and that it serves as a helpful reference for those with similar ideas and needs.

Open Source Link:

https://github.com/RealCorebb/bbGesture

It includes PCB designs, demo software, and Arduino examples. If you want to learn more about the principles and chip details, relevant sensor chip information is provided at the bottom.