Vision Pilot 1.0 is an open source L2 ADAS system which enables warning and actively safety features as well as hands free autopilot using a single 2MP camera. Vision Pilot serves as an open and customizable software substrate which can help automotive OEMs and Tier-1 suppliers save time, money, and resources whilst acquiring technology ownership and sovereignty. This release enables the following production-ready features:
ACC - autonomous cruise control
FCW - forward collision warning
AEB - autonomous emergency braking
LKAS - lane keep assist
LDW - lane departure warning
ISA - intelligent speed assist
Autopilot - single-lane hands-free highway autopilot
It leverages three open-source AI models developed by the Autoware Foundation:
AutoSpeed - Closest in-path object detection
AutoSteer - Ego path future waypoint detection
AutoDrive - End to End distance/in-path object presence detection and road curvature estimation
The Vision Pilot 1.0 release also features cross modal AI fusion alongside trajectory planning for a safe and introspectable driving policy.
The system supports deployment without middleware and provides interfaces to integrate with ROS2-based systems.
Vision Pilot 1.0 can be deployed on low-cost, mass-market automotive chipsets in the 3-5 INT8 TOPs range to achieve a complete pipeline speed of over 10 FPS.
Contributions
@m-zain-khawaja along with the team @atanasko, @pranavdoma, and @TranHuuNhatHuy
