• Tensorflow lite object detection

    Theo • 05/11/2023 at 10:08 • 0 comments

    Tensorflow lite provides an object detection example for android here which we used to help us integrate object detection into our android app. In this video we show video streaming from the ESP32 over Bluetooth, and object detection correctly identifying a cup.

    As the next steps we want to add text detection, and optical character recognition, to allow things such as food boxes to be identified.

  • Bluetooth video with ESP32

    Theo • 05/09/2023 at 16:07 • 0 comments

    The aim is to use an ESP32 for image capture and data transmission to the smartphone using Bluetooth.

    In order to ensure that the data rate was acceptable, a proof of concept was created using an ESP32 camera dev board.  We could not find any examples of Bluetooth camera data transfer using the ESP32 but we were able to produce a simple demo based on the Bluetooth serial port example provided by Espressif. Using the esp32-camera library, we were able to get a quite reasonable frame rate over Bluetooth to an android smartphone at VGA resolution.
    I have made the Bluetooth camera code for the ESP32 available here.

    Code for receiving the video stream on Android is available here.