Skip to content

Project sites

terrytaylorbonn edited this page Jun 21, 2024 · 58 revisions

24.0621

ZiptieAI overview

  • Sites
  • Motivation (for creating ZiptieAI)
  • Phases (~6 phases of this project)

Sites

There are 4 main sites for the ZiptieAI project:

  • This wiki. The most up-to-date info.
  • Gdrive. Contains the core step-by-step (draft) documents (.docx) that provide the detailed info required to DIY.
  • ZiptieAI webpage. A short overview page.
  • Docs website. Drone/AI process documentation site. For now this is just a skeleton site (its out-of-date).

Motivation (for creating ZiptieAI)

1 New career focus on AI

I had to change jobs a few years ago because of the DoD "vaccination" mandate. I then worked on 2 6-month contracts (both extended to a year) for 2 different companies where my work was slowly micromanaged into something I could not claim as my own work.

I needed a change. I started focusing on AI in October 2023. I was impressed with API's that made it possible to "easily" use some very complex algorithms (that worked amazingly well).

2 AI drones (AI on a ziptie'd quadcopter)

I was in Ukraine in late 2023 and was impressed by Ukrainian drone development. I started exploring drone simulation while in Ukraine. I assumed that building an actual drone (back in the USA) would be the easy part (wrong). The basic concept was:

  • Ziptie drones: Front-line Ukrainian soldiers often use zip ties to configure a drone package. My focus is on learning the components (HW and SW) that can quickly be "ziptied" together for any mission. Below: A zip tie drone on the cover of The Economist.

    image

  • AI: Lost connection to the drone pilot? Carry on without him. Want to swarm the target? No problem, send an intelligent group of drones to do the job. You implement the AI routines on a companion computer (a PI4/5 or Nvidia Jetson mounted on the drone that sends flight commands to the drone flight controller). Below: AI object recognition running in a simulator (part 1 Total simulation shows how to this step-by-step).

    image

3 Not so fast....

But building/flying the drones has taken much longer than expected. Its really difficult to get things working unless you are really deep into the tech. AI is much more complex, but the AI APIs are well done. By contrast much of the drone tech is

  • Open source with
  • Chinese components

My activities for the first half of 2024 were were 80% drone and 20% AI.

4 Turning this into a job

I started working on ZiptieAI in December 2023. Great experience. But my hope has been to create something that will help me land a good job. That might be a challenge.

The author of the excellent "Intelligent drone simulation" video series (Total simulation) said (5 years ago) that he stopped for working with drones for a while because he ran out of money. Apparently there was not a lot of money to be made in open-source drones (drones were not a profession, just a hobby).

The reason for that is probably because most professional applications of drones require a lot of re-development of many of the open source components. There was a period during the early stages of Ukraine war where there was a big market for "ziptied" drones, but that period will soon be over. The Ukrainians have formed private companies that are doing what western companies did ~5 years ago, namely switching to more customized development.

Which leaves me where? Its my hope that (with ZiptieAI as a personal project that demonstrates my qualifications) I could land a job (preferably working with drones) as a

  • Product manager/owner
  • Tech writer

Phases (~6)

(just a rough plan; the future phases will undoubtedly differ from this plan)

I have reorganized the wiki probably once a month for the first half of 2024. I would find something in the internet I could get to work, document my steps, and as a result I understood one more piece of the puzzle that was the big picture concepts. And how to organize this wiki. It was a long process.

But as of June 2024, the wiki reorg was more or less complete. It was then I started to focus on phases. I came up with 3 main phases for the ZiptieAI project. Phase 1 is nearing completion right now (24.0621).

Phase 1 (epics 1-3): Basic build/fly/document at least 1 platform variant for epics 1-3 (2024.01-06)

What was originally the first part (phase 1) of this wiki (what I worked on in late 2023) is shown below in grey boxes (what is now epic 3 content). This happened because

  • I could not get my original plan target systems to work.
  • I understood better what a newcomer needs to focus on (for example, FPV simulators and actually flying FPV drone, NOT total simulation (SITL, Gazebo and ROS).

image

Phase 2: Clean up the docs 023.06-2024.09

  • Clean up the step-by-step directions in the Gdrive docx's (take what are sometimes basically messy lab notes and distill into clean docx's)
  • Update concepts (you have to have hands-on experience to write the concepts)
  • Clean up references (concepts, tech refs, etc)

Phase 3 (epics 1-3): Ardupilot (and Betaflight again) (other firmware?)

image

Phase 4 (epic 3): ROS + AI + SITL/HITL

image

Phase 5 (epic 3): Firmware / (Pixhawk) APIs

image

Phase 6 (epic 4): Mission platforms / special projects

image

Home

Getting into the air ASAP

(0) Reference


EPIC 1 - Build/fly FPV drone

(1) FPV simulators (inav notes 0608)

(2) SBeeF405/INAV (1a)

(3) SBeeF405/BF (1b)

(4) SBeeF405/AP (1c)


EPIC 2 - Build/fly Pixhawk drone

(5) Pix6c/PX4 (2a)

(6) Pix6c/AP (2b)


EPIC 3 - Add AI to Pixhawk drone

(7) AI cc + cam

(8a) AI Nano PX4

(8b) AI Nano AP

(8c) AI PI PX4

(8d) AI PI AP


EPIC 4 – Advanced AI

(9a) SIH (frame+world sim)

(11) FC FW Mavlink API (via CC/GCS APIs) (5.3)

(13) CC AI (+ Mavlink) (2)


EPIC 5 – Advanced platforms

(14) Firmware dev (5)

(15) Mission platforms (6b)

(16) Special projects (5.6,5.5)


EPIC 6 – PITS (Pie in the sky)

(9b) HITL (frame+world sim)

(10) (skip) SITL (total sim) (1) (was E4)

(14b) Matlab (was E5/4(HITL))

(12) ROS (+ROSMAV) (was E4)



Clone this wiki locally