Close
0%
0%

Tiny Machine Vision Module for Robots

This is a low-resolution machine vision module suitable for small robots or Arduino projects

fkrfFKRF
Following
Liked Like project

Just one more thing

To make the experience fit your profile, pick a username and tell us what interests you.

Pick an awesome username
hackaday.io/
Your profile's URL: hackaday.io/username. Max 25 alphanumeric characters.
Pick a few interests
Projects that share your interests
People that share your interests

We found and based on your interests.

Choose more interests.

OK, I'm done! Skip
Similar projects worth following
1.3k views
0 comments
14 followers
View Gallery
This is a simple to use machine vision module designed for applications such as mobile robotic projects. It is quite similar to the Pixy2, OpenMV and other similar projects, but with a smaller physical dimensions. It requires a 5V power source with around 150mA of current, and can be interfaced via UART port at 57600 bps to external hardware such as your custom controller, Arduino or Raspberry Pi. The maximum resolution and frame rate of the on-board camera is 640X480 and 30 fps, but for now I actually use a lower resolution and frame rate at 160x120 (via sub-sampling) and 20 fps. I use this module on my so-called 'insect robots', from what I gathered most insects and small creatures can get around with low-resolution biological eyes. I built this project as a way to learn the low-level intricacy of interfacing a CMOS camera to a micro-controller, and also as a fun way to learn the principles behind image processing. The latest version can even support a neural network.

1. A description of the journey in building this machine vision module can be found in the blog post:

https://fkeng.blogspot.com/2016/01

2. A description of incorporating convolution neural network (CNN) for real-time image processing can be found in this blog post:

https://fkeng.blogspot.com/2020/06/implementing-custom-convolutional.html


3. A video showing the machine vision module in action with Arduino Uno:

https://www.youtube.com/watch?v=m4_Zu8Dx1Ik

4. Another video showing connection to TFT LCD display and running a custom CNN (convolutional Neural Network) algorithm for obstacle detection.

https://www.youtube.com/watch?v=05gwL2VL5t0


5. The component list below shows the important components.  The rest are just generic surface mount resistors, capacitors, LEDs and crystal.  I use 1% tolerance for all resistors, and 5-10% tolerance for all capacitors.  Refer to Github site for full schematic.

  • 1 × ATSAMS70J20A 32-bits ARM Cortex-M7 micro-controller, 64 pins LQFP, Microchip Technologies. Source: Mouser, Farnell or Microchip Direct
  • 1 × TCM8320MD VGA CMOS camera module. Ex-stock from EIO.com (https://eio.com/products/toshiba-tcm8230md-cmos-camera-640x480?_pos=1&_sid=926c82c59&_ss=r)
  • 1 × LP2985-33DBVR Power Management ICs / Linear Voltage Regulators and LDOs, 3.3V 150mA. Texas Instruments
  • 1 × LP2985AIM5X-2.8/NOPB Power Management ICs / Linear Voltage Regulators and LDOs, 2.8V 150mA, Texas Instruments
  • 1 × MCP1703AT-1502E/CB Power Management ICs / Linear Voltage Regulators and LDOs, 1.5V 250mA, Microchip Technology

View all 7 components

  • Updated quick start guide (QSG)

    FKRF • 12/06/2020 at 06:22 • 0 comments

    1. Added the description of the PCB layers in the QSG.

    2. Added slides to describe the ability to save the displayed image on the MVM Monitoring Software in raw or bitmap format on the computer, and also to retrieve the saved image using routines developed in MATLAB, Scilab or Python. This is useful if we want to develop some image processing algorithms to the captured image from the MVM.

  • Support for TFT LCD Display

    FKRF • 11/02/2020 at 09:43 • 0 comments

    2 Nov 2020:

    Added support for 320x240 QVGA LCD display.  Please see project details above.

  • WiFi link with ESP8266 [Update Nov 2021]

    FKRF • 09/22/2020 at 07:08 • 0 comments

    The present version send the image data to a remote computer for viewing the image captured by the module via Bluetooth module or USB-to-Serial converter.  Currently I am experimenting with using the popular ESP8266 to broadcast the image data to the remote computer via WiFi, using TCP or UDP protocols.  The ESP8266 will functions as a server, with a client software running on the PC.

    Nov 2021: Finally have time to re-look into this project. I have create a firmware version that can support ESP8266. This allows MVM V1.5C to stream images to a remote computer via WiFi connectivity. Currently I am using TCP protocol, with ESP8266 configured as a TCP server, while the remote computer works as a TCP client. Updated the codes on GitHub.

  • Convolution Neural Network Support

    FKRF • 07/04/2020 at 05:42 • 0 comments

    1 July 2020:

    Added a small convolution neural network (CNN) process into the latest source code (Image Processing Algorithm 4).  For now the CNN process is used to classify a small region of the image frame in gray scale for identifying obstacles. For details see https://fkeng.blogspot.com/2020/06/implementing-custom-convolutional.html

View all 4 project logs

Enjoy this project?

Share

Discussions

Similar Projects

The ESP32-CAM is a very small camera module with the ESP32-S chip that costs approximately $10
Project Owner Contributor

Esp32 Cam Testing in Local Server

hariramanil810hariramanil810

To determine the type and amount of adulteration in a given substance using Image Processing.
Project Owner Contributor

AI based Adulteration Detector

gvigneshG.Vignesh

A lightweight module providing high speed WiFi data transfer. Native support for most uC. Clean and easy to use. ESP8266 based.
Project Owner Contributor

AirCore - Plug n' Play Wireless Serial

cristian-dobreCristian Dobre

Building a digital large format camera
Project Owner Contributor

Large Format Camera

jimmycalzenjimmy.c.alzen

Does this project spark your interest?

Become a member to follow this project and never miss any updates

Going up?

About Us Contact Hackaday.io Give Feedback Terms of Use Privacy Policy Hackaday API

© 2024 Hackaday

Yes, delete it Cancel

Report project as inappropriate

You are about to report the project "Tiny Machine Vision Module for Robots", please tell us the reason.

Send message

Your application has been submitted.

Remove Member

Are you sure you want to remove yourself as a member for this project?

Project owner will be notified upon removal.