Skip to content

This is intended for displaying camera feed and FOMO(object detection model) results to TFT for Esp32-S3

Notifications You must be signed in to change notification settings

San279/object-detect-FOMO-TFT-Esp32

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

63 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FOMO-object-detect-TFT-Esp32

ฉบับไทย

This project was intended for displaying camera feed and inference results of FOMO object detection model by Edge Impulse to TFT screen. The Hardware were provided by Wireless Solution Asia. To run this project users must obtain a model from Edge Impulse.

- Before using this repository please obtain a model from FOMO and set up TFT and camera properly before running this project

alt text


What you'll need

  • Arduino IDE, preferably the latest ones, but older versions will still do the job.
  • ESP32-S3 is preferable but older version will do just fine.
  • ST7789 or any TFT screens.
  • OV2640 camera or any OV series.

Project files descriptions

  • FOMO_object_detect_TFT.ino - Containes Arduino codes displaying camera feed and FOMO results to TFT screens.

How to install and run the project

1. Download the zip file and extract it to Arduino directory.

alt text


2. Open Fomo_object_detect_TFT.ino, under tools change your Board to "ESP32S3 Dev Module" and PSRAM to "OPI PSRAM".

alt text



3. Add the zip folder of the trained model obtained from Edge Impulse to Arduino IDE.

alt text

alt text



4. Connect pin no.1 of the Esp32 to a push button.

  • if you're using AIOT board, simply connect I/O port 1 to any push button.
    alt text

  • if you do not have AIoT board, connect I/O pin 1 of Esp32 to one leg of a push button and other leg to 3v. alt text



    5. Open FOMO_object_detect_TFT.ino and match the name of project in Edge Impulse with header file in line 24.

    alt text



    6. Upload the code, this process might take up to 30 minutes, and you're Done!!

    alt text



Project features

  • User can change resolution of the camera when the push button is pressed. The avaiable resolution is as follow.

  • 96 X 96

    alt text


  • QQVGA 160 X 120

    alt text


  • 176 X 144

    alt text


  • 240 X 176

    alt text


  • 240 X 240

    alt text


  • 320 X 240

    alt text


Credit

Thanks to WIRELESS SOLUTION ASIA CO.,LTD for providing AIOT board to support this project. Also thanks to Bodmer / TFT_eSPI for the TFT libraries. Scripted used for Esp32 FOMO object detection inferencing were provided by Edge Impulse.