Skip to content
This repository was archived by the owner on Feb 5, 2022. It is now read-only.
Amar Maksumić edited this page Jan 7, 2020 · 52 revisions

Vision Goals 2020

Stream high fps and resolution video to the driver station Detect the loading bay, power port, and balls and send distance values to the RoboRio

Roadblocks

Pre-build season

Pipeline gstreamer issues in C++

Build Season

Pre-build issues continue, spurs change to Python for Jetson Nano Decision to attempt using Tensorflow and JupiterLabs for Machine learning (continue developing previous python detection methods as a backup)

Accomplishments

Refined last years vision prototype that was in python to work on power port and loading bay, now also checks for vertices as well Can open camera in python

TODO

Decide and get documentation for Flask vs Gstreamer for our current set-up and choose one for driver station streaming Create networktables Still investigating issues with framerate on Jetson Nano, find cause (GPU?) Object detection for power port, ball, and loading bay(focusing on tensorflow but one person can still work on adapting and refining previous methods of vision detection just in case) Calculate target distance and needed robot adjustments

Timeline

Tuesday 1/7/20

Research flask and gstreamer Program choice to work on the Jetson to send video to driver station One person can work on object detection

Resources

Flask streaming with opencv https://www.pyimagesearch.com/2019/09/02/opencv-stream-video-to-web-browser-html-page/

Gstreamer https://gstreamer.freedesktop.org/documentation/?gi-language=c https://github.com/madams1337/python-opencv-gstreamer-examples

Tensorflow https://www.pyimagesearch.com/2019/05/06/getting-started-with-the-nvidia-jetson-nano/

Network Tables https://github.com/robotpy/pynetworktables/blob/master/pynetworktables/table.py

2020 Hylo Wren Roadmap Wiki

Make sure to check out the 2020 20/20 Vision Repo and Wiki as well!

FRC Team 2601 | Steel Hawks
steelhawks.net

Clone this wiki locally