Skip to content

My drone simulation with AI project

terrytaylorbonn edited this page Mar 13, 2024 · 27 revisions

("drone simulation with AI" = the drone is simulated, but the AI runs on actual PI4/Nano hardware with a real camera)

I am actively looking for a job (contract or full-time)

terrytaylorbonn@gmail.com

This wiki

This wiki (a work in progress) is a public example of my technical research and documentation skills (the deliverables of the documentation projects I have worked on for the past 9 years were not public).

This wiki details how to simulate Ardupilot/PX4 drones (quadcopters). The simulation is connected to an Nvidia Jetson Nano or Raspberry PI4 companion (onboard) computer (CC) and a camera. The primary focus is on

  • Flight simulation
  • CC mission programming (autonomous drone flight)
  • CC AI (object recognition)

The OS and languages used are primarily

  • Linux (Ubuntu)
  • Python
  • C++, C

I started this project in November 2023. I had no previous drone or AI experience. I am working alone with no assistance.

Documentation

My previous technical writing assignments

The main requirements for my previous technical writing assignments were the following:

  • Major documentation updates (technical and conceptual)
  • New documentation tools and workflows
  • Work independently (minimal assistance from the development and management teams)

This was how I successfully completed those assignments:

  1. I took ownership of the documents. I went to work quickly, collecting existing documentation and learning existing documentation processes. I used the product, studied competitor products, and documented in detail all my activities.
  2. I kept the documentation processes as simple and effective as possible. Eventually someone else would have to take over my work.
  3. I published my plans and draft docs for the internal target audience (dev and product management), making sure that stakeholders could easily see what direction the documentation was going.
  4. I focused on frequent udpated deliverables and long-term goals.
  5. At the end of the assignment, I facilitated a smooth handover of all deliverables.

Home

Getting into the air ASAP

(0) Reference


EPIC 1 - Build/fly FPV drone

(1) FPV simulators (inav notes 0608)

(2) SBeeF405/INAV (1a)

(3) SBeeF405/BF (1b)

(4) SBeeF405/AP (1c)


EPIC 2 - Build/fly Pixhawk drone

(5) Pix6c/PX4 (2a)

(6) Pix6c/AP (2b)


EPIC 3 - Add AI to Pixhawk drone

(7) AI cc + cam

(8) AI CC+FW

(9a) SIH (frame+world sim)


EPIC 4 – Basic Autonomy

(13) CC AI (+ Mavlink) (2)

(11) FC_Mavlink_API (via CC/GCS APIs) (5.3)

(13c) CC autonomy algorithms


EPIC 5 – Advanced Autonomy

(20) Kalman KK (+Python,vectornav)

(14) Firmware dev (5)

(22) AI


EPIC 6 – Project management 24.0903


EPIC 7 – Mission platforms / special projects

(15) Mission platforms (6b)

(16) Special projects (5.6,5.5)


EPIC 8 – PITS (Pie in the sky)

(12) ROS (+ROSMAV) (was E4)

(14b) Matlab (was E5/4(HITL))

(9b) HITL (frame+world sim)

(10) (skip) SITL (total sim) (1) (was E4)

Clone this wiki locally