Skip to content

3D Object detection using Yolo and the ZED in Python and C++

License

Notifications You must be signed in to change notification settings

PhiAbs/zed-yolo

 
 

Repository files navigation

Stereolabs ZED - YOLO 3D

This package lets you use YOLO (v2 or v3) to detect pedestrians.

The left image will be used to display the detected pedestrians alongside the position relative to the camera.

Prerequisites

  • Ubuntu 16.04 or Ubuntu 18.04
  • ZED SDK and its dependencies (CUDA)

Installation

refer to the readme in the yolo_pedestrian_detector folder

ROS integration

The image with the marked pedestrians as well as a vector containing all detected persons (spencer_tracking_msgs::DetectedPersons) are published on the two following topics:

  • /zed_yolo_detected_persons/image
  • /zed_yolo_detected_persons

There are two different launch files available. One uses a very lightweight YOLOv3 model which is able to run at around 18 FPS on an nvidia jetson agx xavier board. The other launch file uses a heavier YOLOv3 model with slightly better detection accuracy. It is recommended to use the lightweight model.

lighweight model:

  • roslaunch yolo_pedestrian_detector pedestrian_detector_tiny.launch

normal model:

  • roslaunch yolo_pedestrian_detector pedestrian_detector.launch

The weight files can be downloaded from here:

place the weights files in here: libdarknet/weights

About

3D Object detection using Yolo and the ZED in Python and C++

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • C 75.4%
  • Cuda 10.6%
  • C++ 7.1%
  • Python 5.5%
  • Batchfile 0.5%
  • Makefile 0.3%
  • Other 0.6%