I had a reading module I made long ago, it worked but only with hard coded path images. Now that the ZED is all set up, I have the reading module boot up zed_snap.py and then get the image path of the image taken. Pytesseract a optical character recognition (OCR) tool then attempts to read what is in the image. It does indeed work the robot can now read stuff put in front of it. It will need so fine tuning, like maybe the ability to scale the image up, stabilize and also just block just the text/book page removing any background noise. Goal is a kid can hold up a book and it can read to them...
*Forgot to mention it has no understanding of what it is reading it is just reading what it can find in the image...but still!
The reading module and zed snap python programs can be found here- https://github.com/thedocdoc/Sophie/tree/main
Positives:
- Did I mention that it works!
Negatives:
- The text needs to be larger or the book held closer to the ZED camera
- It like black text on white background more
- It gets a bit confused about background stuff, or images in a book
Discussions
Become a Hackaday.io Member
Create an account to leave a comment. Already have an account? Log In.