Introducing a revolutionary device for the visually impaired, designed to help them navigate daily life with greater ease and independence.
The proposed device is engineered to assist in locating items on a dining table, such as a fork, without the need for assistance from a sighted person. With the help of AI, the location of the fork on the table was identified through the mobile camera. Once detected, the device employs motors to indicate the direction of the object - forward, backward, left, or right - giving the user a clear understanding of where the fork is located in relation to their position.
This device has the potential to greatly enhance the quality of life for those with visual impairments, allowing them to enjoy their meals with greater independence and confidence.
The hardware design is straightforward. The flappers will be installed on the motors and pressed on the user's arm gently and repeatedly to indicate the direction to move. The device will be separated into the following modules:
left flapper
right flapper
forward and backward flapper
controller module
All the modules would be installed onto the elastic band eventually to make the device portable and easy to use.
As this is still the POC stage, the battery is not included and the wirings would be handled afterward.
To indicate in which direction the arm should move in text
Object Detection:
Yolo has been chosen for object detection. In comparison with CNN or typical machine learning method, Yolo would give better performance in terms of speed, accuracy and flexibility.
The following is the learning and testing results: