Skip to content
/ M-BEV Public

[AAAI24]This is the implementation for the paper M-BEV: Masked BEV Perception for Robust Autonomous Driving

Notifications You must be signed in to change notification settings

Sranc3/M-BEV

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

M-BEV: Masked BEV Perception for Robust Autonomous Driving (AAAI 2024)

Demo for M-BEV

[AAAI 2024] M-BEV: This repo is the implementation of "M-BEV: Masked BEV Perception for Robust Autonomous Driving "

M-BEV is a perception framework to improve the robustness for camera-based autonomous driving methods. We develop a novel Masked View Reconstruction (MVR) module in our M-BEV. It mimics various missing cases by randomly masking features of different camera views, then leverages the original features of these views as self-supervision, and reconstructs the masked ones with the distinct spatio-temporal context across camera views. Via such a plug-and-play MVR, our M-BEV is capable of learning the missing views from the resting ones, and thus well generalized for robust view recovery and accurate perception in the testing.

Preparation

This implementation is built upon detr3d and petrv2. Follow their instructions to prepare for the Envirorments, besides you need to install timm and torchvision.

Fast inference

You can download the ckpts and put the models in the ckpts folder, then modify the config file according to your environment

tools/dist_test.sh projects/configs/petrv2/petrv2_vovnet_gridmask_mbev_p4_800x320.py /ckpts/mebv.pth 8 --eval bbox
tools/dist_test.sh projects/configs/petrv2/petrv2_vovnet_gridmask_p4_800x320.py /ckpts/petrv2.pth 8 --eval bbox

Acknowledgement

Many thanks to the authors of mmdetection3d, detr3d and petr.

About

[AAAI24]This is the implementation for the paper M-BEV: Masked BEV Perception for Robust Autonomous Driving

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published