-
Notifications
You must be signed in to change notification settings - Fork 0
13.4 AI CC Jnano
24.0803 (0625)
Epic 4 deals with "advanced" AI.
Part 13 deals with AI on the Jnano (Gdrive folder).
Section 13.4 deals with AI on Jetson Nano CC (companion computer).
- Get copters into air (FPV and Pixhawk) (epics 1+2)
- Add basic AI to Pixhawk (epic 3), flight test
- Simulation (SIH) test (first third of epic 4)
-
Section 13.4 AI on JNano (last third of epic 4) / subsection 13.4-1 Nvidia AI tutorials. These have not been easy to get running, but recently (24.0802) had some amazing success... the Nano and the Nvidia software has really impressed me (even an amateur like myself can get this stuff running)
-
Document 13.4-1_.docx. Describes (WIP) my steps in replicating Nvidia tutorials. The highlighted sections in the diagram below document what i did (my docx organizes and explains the details much better than the nvidia github/docs)
-
In particular 13.4-1_.docx section "S3E3 (TERRY) 24.0802-0803" is interesting. It shows how I retrained a dataset and tested successfully 24.0802-0803. This was an amazingly complex and long process, and it worked (thanks to Dusty of Nvidia).
This doc shows my attempt to duplicate the basic quick start. I could not get it working. The narrator strikes me as a non-tech person who is following a script.
24.0110-0116. 920s working. Whorter AI (congress). Face, eyes, OpenCV.
Haarcascades Nano. Working examples. 24.0110-0118.
$500 Orin Nano. Move up to this after getting first copter in the air with Jetson Nano AI.
2022.02 PX4 VIO Setup with Jetson Nano and Intel T265 - Auterion VIO Fork Dennis Baldwin
https://www.youtube.com/watch?v=Brkk0ZmnGgs
This is an in-depth tutorial of how to get VIO up and running on a Pixhawk-based drone from NXP. It's the HoverGames drone with some modifications to incorporate a Jetson Nano and Intel T265 Realsense camera for indoor vision positioning. I encourage you to review the gist I created linked below, as well as the chapters feature of YouTube to jump to various sections of this video. Please leave any comments or questions below if you're working through this setup. I'll be happy to help!
2024.0802 Wiki, Gdrive, Youtube, ZiptieAI.com, ZiptieAI docs. The author is looking for a job!
- The race 24.0712
- Why (you need) ZiptieAI
- Why (I created) ZiptieAI
- Wiki organization (6 epics)
- Blog (latest)
- Conferences 24.0801
(0) Reference
EPIC 1 - Build/fly FPV drone
(1) FPV simulators (inav notes 0608)
- 2.0 Technical overviews
- 2.1 MVP (min viable platform)
- 2.2 GPS
- 2.3 Video
- 2.4 Carbon frame
- 2.5 Missions
- 2.6 Tuning (new)
- 2.7 Post-crash rebuild 24.0620
(3) SBeeF405/BF (1b)
(4) SBeeF405/AP (1c)
EPIC 2 - Build/fly Pixhawk drone
(5) Pix6c/PX4 (2a)
(6) Pix6c/AP (2b)
EPIC 3 - Add AI to Pixhawk drone
(7) AI cc + cam
(8a) AI Nano PX4
(8b) AI Nano AP
(8c) AI PI PX4
(8d) AI PI AP
EPIC 4 – Advanced AI
- 9.0 SIH NANO/PX4 24.0703 (WORKS!)
(11) FC FW Mavlink API (via CC/GCS APIs) (5.3)
- 13.1 AI Ubuntu
- 13.2 AI PI5
- 13.3 AI PI4
- 13.4 AI Jetson Nano 24.0731
- 13.5 AI STM 24.0430
- 13.6 AI study
EPIC 5 – Advanced platforms
(14) Firmware dev (5)
(16) Special projects (5.6,5.5)
EPIC 6 – PITS (Pie in the sky)
(10) (skip) SITL (total sim) (1) (was E4)
- 10.1 SITL AP Core (SITL, Gaz, ROS)
- 10.2 SITL AP C++ mission as ROS node
- 10.3 SITL AP AI Yolo obj recog
- 10.4 SITL AP Lidar obj avoid
- 10.5 SITL AP Drone swarm
- 10.6 SITL AP Flight planners
- 10.7 SITL PX4 Core (SITL, Gaz, ROS)
(14b) Matlab (was E5/4(HITL))
(12) ROS (+ROSMAV) (was E4)