Skip to content

13.4 AI CC Jnano

terrytaylorbonn edited this page Aug 2, 2024 · 22 revisions

24.0803 (0625)

Epic 4 deals with "advanced" AI.

Part 13 deals with AI on the Jnano (Gdrive folder).

Section 13.4 deals with AI on Jetson Nano CC (companion computer).


Document 13.4-1 covers Nvidia tutorials (by Dusty, a real expert)

For the first 6 months of 2024, I focused (more or less) on the following

  • Get copters into air (FPV and Pixhawk) (epics 1+2)
  • Add basic AI to Pixhawk (epic 3), flight test
  • Simulation (SIH) test (first third of epic 4)

A few weeks ago I arrived in Ukraine and have been working on

  • Section 13.4 AI on JNano (last third of epic 4) / subsection 13.4-1 Nvidia AI tutorials. These have not been easy to get running, but recently (24.0802) had some amazing success... the Nano and the Nvidia software has really impressed me (even an amateur like myself can get this stuff running)

  • Document 13.4-1_.docx. Describes (WIP) my steps in replicating Nvidia tutorials. The highlighted sections in the diagram below document what i did (my docx organizes and explains the details much better than the nvidia github/docs)

  • In particular 13.4-1_.docx section "S3E3 (TERRY) 24.0802-0803" is interesting. It shows how I retrained a dataset and tested successfully 24.0802-0803. This was an amazingly complex and long process, and it worked (thanks to Dusty of Nvidia).

    image


13.4-1b_babu_v02_24.0321.docx.

This doc shows my attempt to duplicate the basic quick start. I could not get it working. The narrator strikes me as a non-tech person who is following a script.

13.4-2_ai-nvidia_(wh)_v07_24.0110.docx

24.0110-0116. 920s working. Whorter AI (congress). Face, eyes, OpenCV.

13.4-3_pymavlink_haar_NANO_v24_24.0212.docx

Haarcascades Nano. Working examples. 24.0110-0118.

13.4_ai_orin_nano_v01_24.0316.docx (future)

$500 Orin Nano. Move up to this after getting first copter in the air with Jetson Nano AI.






NOTES =============================================

2022.02 PX4 VIO Setup with Jetson Nano and Intel T265 - Auterion VIO Fork Dennis Baldwin

https://www.youtube.com/watch?v=Brkk0ZmnGgs

This is an in-depth tutorial of how to get VIO up and running on a Pixhawk-based drone from NXP. It's the HoverGames drone with some modifications to incorporate a Jetson Nano and Intel T265 Realsense camera for indoor vision positioning. I encourage you to review the gist I created linked below, as well as the chapters feature of YouTube to jump to various sections of this video. Please leave any comments or questions below if you're working through this setup. I'll be happy to help!

image

Home

Getting into the air ASAP

(0) Reference


EPIC 1 - Build/fly FPV drone

(1) FPV simulators (inav notes 0608)

(2) SBeeF405/INAV (1a)

(3) SBeeF405/BF (1b)

(4) SBeeF405/AP (1c)


EPIC 2 - Build/fly Pixhawk drone

(5) Pix6c/PX4 (2a)

(6) Pix6c/AP (2b)


EPIC 3 - Add AI to Pixhawk drone

(7) AI cc + cam

(8a) AI Nano PX4

(8b) AI Nano AP

(8c) AI PI PX4

(8d) AI PI AP


EPIC 4 – Advanced AI

(9a) SIH (frame+world sim)

(11) FC FW Mavlink API (via CC/GCS APIs) (5.3)

(13) CC AI (+ Mavlink) (2)


EPIC 5 – Advanced platforms

(14) Firmware dev (5)

(15) Mission platforms (6b)

(16) Special projects (5.6,5.5)


EPIC 6 – PITS (Pie in the sky)

(9b) HITL (frame+world sim)

(10) (skip) SITL (total sim) (1) (was E4)

(14b) Matlab (was E5/4(HITL))

(12) ROS (+ROSMAV) (was E4)


Clone this wiki locally