Cross-platform, customizable ML solutions for live and streaming media.

[CVPR'23] Universal Instance Perception as Object Discovery and Retrieval

Teach-Repeat-Replan: A Complete and Robust System for Aggressive Flight in Complex Environments

Perception toolkit for sim2real training and validation in Unity

Visual SLAM/odometry package based on NVIDIA-accelerated cuVSLAM

⚡️The spatial perception framework for rapidly building smart robots and spaces

An open-source computer vision framework to build and deploy apps in minutes

Platform for Situated Intelligence

An OpenAI gym wrapper for CARLA simulator

Modular autonomous driving platform running on the CARLA simulator and real-world vehicles.

LSD (LiDAR SLAM & Detection) is an open source perception architecture for autonomous vehicle/robotic

Fast, efficient and accurate multi-resolution, multi-sensor 3D occupancy mapping

(CVPR 2022) A minimalist, mapless, end-to-end self-driving stack for joint perception, prediction, planning and control.

Simulations for TurtleBot3

Notebook-based book "Introduction to Robotics and Perception" by Frank Dellaert and Seth Hutchinson

Unity's privacy-preserving human-centric synthetic data generator

[ICRA 2022] CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulation

Object detection / tracking / fusion based on Apollo r3.0.0 perception module in ROS

A complete end-to-end demonstration in which we collect training data in Unity and use that data to train a deep neural network to predict the pose of a cube. This model is then deployed in a simulated robotic pick-and-place task.

[ECCV2024 Oral🔥] Official Implementation of "GiT: Towards Generalist Vision Transformer through Universal Language Interface"