Hello again!
I realize that the other documentation aside from the first update were not written by me, because we decided it would be faster for each person to document what they did.
So here's mine. I tagged each thing with [feature], [bug], or [comment] respectively, just for easy classification if skimming!
- I went from doing documentation to being ̶a̶ ̶s̶l̶a̶v̶e̶ ̶t̶o̶ ̶t̶h̶e̶ ̶n̶e̶u̶r̶a̶l̶ ̶n̶e̶t̶w̶o̶r̶k̶ the principal data collector for the gesture recognition model. [joke, comment]
- The Arduino Uno Q™ examples Howie found were good, but the model in the example didn't ship with the required gestures, so we used it as a blueprint, but ultimately trained our own model. [comment]
- The model was trained on 450+ pictures of gestures in the three possible gestures (confirm, skip, stop/pause), and each gesture was captured in different parts of the frame, as well as various lighting conditions to make the model EXTREMELY robust, hitting a mAP@50 value of 0.94 across our validation and testing dataset, as well as remarkably good performance in the real world. (i spent way too long collecting data) [feature]

- Despite being an image-only model, it recognizes fluid gestures (the swipe) with extremely high accuracy (in our tests, only ~1 in 10 even had a misclassified gesture at all) [feature]
- It also has a secondary feature, where if necessary, the model will function (although not as well) with a secondary skip gesture with a thumbs to the side in place of the swipe gesture (in situations where doing a swipe might be hard due to weight) [bug wait no its a feature]
- This took 11+ retrains, starting at a mAP score of ~0.5 at the very start and eventually reaching this monster [feature, comment]
- Our model, when run on the hardware, runs at an average of 175 ms latency, which is well within reasonable bounds, given the requirement was "few hundred milliseconds". [feature]
- I actually learned way more about training models doing this sprint despite having used Edge Impulse before! [comment]
I will be writing the final log soon, and it was genuinely great coming here for 2 days to work on this!
Chaaruhaas Kandregula
Discussions
Become a Hackaday.io Member
Create an account to leave a comment. Already have an account? Log In.