esp-idf-video-streaming

Capture video from a USB camera using ESP-IDF.

This example demonstrates how to:

• Capture video from a USB camera using the USB Host UVC Driver. https://components.espressif.com/components/espressif/usb_host_uvc
• Stream videos over WiFi using the built-in HTTP server.
• Supports plugging and unplugging USB cameras.

This example enumerates the attached camera descriptors, negotiates the selected resolution and FPS, and starts capturing video.

I based it on this official example.

Change from official example

• Changed Network connection by example_connect to WiFi connection by handler.

• Supported VideoStreaming format of UncompressedFormat.
  This will allow you to use Logitech C270n and Microsoft LifeCam.
  Conversion from UVC_FRAME_FORMAT_YUYV to JPEG used this.

• Changed from TCP transmission to HTTP transmission.
  I base it on this.

Hardware Required

ESP32-S2/ESP32-S3

This example requires any ESP32-S2 or ESP32-S3 with external PSRAM and exposed USB connector attached to USB camera.
ESP module without external PSRAM will fail to initialize.
I used this board.

Note for ESP32S2
In earlier versions of the ESP32-S2 chip, USB transfers can cause SPI data contamination (esp32s2>=ECO1 and esp32s3 do not have this bug).
Software workaround is here.

Stable power supply

USB cameras consume a lot of electricity.
If the power supplied to the USB port is insufficient, the camera will not operate and ESP32 resets.

USB Type-A Femail connector

Breakout boards are available from AliExpress or eBay.

USB camera with UVC support

Here is a list of USB cameras that support UVC that work with FreeBSD.
From what I've researched, ESP-IDF has limited USB support.
For example, the Logitech C615 works with Linux, but not with ESP-IDF.
I tested with these cameras.

• Logitech C270n -> Success
• Logitech C615 -> Fail
• Logitech QuickCam Pro 9000 -> Fail
• PAPALOOK AF925 -> Fail
• Microdia(Very old model) -> Success
• Microdia MSI Starcam Racer -> Success
• Microsoft LifeCam NX6000 -> Fail
• Microsoft LifeCam Cinema -> Success
• Microsoft LifeCam Studio -> Success
• Microsoft LifeCam HD3000 -> Success
• Microsoft LifeCam HD5000 -> Success

It is very hard to find a camera that works with ESP-IDF.
On this document says that these cameras work with ESP-IDF.

• Logitech C980
• CANYON CNE-CWC2

When usb support provided by ESP-IDF is updated, this issue may eliminate the problem.
Detail is here.

Software Required

esp-idf v5.0 or later.
A compilation error occurs in ESP-IDF Ver4.

Wireing

ESP BOARD          USB CONNECTOR (type A)
                         +--+
5V        -------------> | || VCC
[GPIO19]  -------------> | || D-
[GPIO20]  -------------> | || D+
GND       -------------> | || GND
                         +--+

Installation

git clone https://github.com/nopnop2002/esp-idf-video-streaming
cd esp-idf-video-streaming
idf.py set-target {esp32s2/esp32s3}
idf.py menuconfig
idf.py flash monitor

Configuration

Some cameras need to change frame size, frame rate and frame format.

How to use

• Build and flash firmware to esp32.

• Connect the USB camera at this timing.
  

• For available USB cameras, device information will be displayed and video streaming will begin.
  

• For unavailable USB cameras, you will see an error like this.
  

• Start your browser and enter the ESP32 IP address and port number in the address bar.
  You can use mDNS instead of ESP32 IP addresses.
  

• Streaming example : Some cameras have Auto Focus available.
  

Limitations

• At 320x240, 30FPS is the maximum rate regardless of camera capabilities.
• At 640x480, 15FPS is the maximum rate regardless of camera capabilities.

Using ESP32-CAM development board

You can use this repository.

References

https://github.com/nopnop2002/esp-idf-video-snapshot