EDMP: Ensemble-of-Costs Guided Diffusion For Motion Planning

Kallol Saha ^*1, Vishal Mandadi ^*1, Jayaram Reddy ^*1, Ajit Srikanth ¹, Aditya Agarwal ², Bipasha Sen ², Arun Kumar Singh ³, Madhava Krishna ¹,

¹International Institute of Information Technology, Hyderabad, ²MIT, ³University of Tartu

^*denotes equal contribution

This is the official implementation of the paper "EDMP: Ensemble-of-Costs Guided Diffusion For Motion Planning", which is currently under review

For more details and results, visit our project page and read our paper.

Code Release plan

1. Serial Version
   1. All the classifiers are run in serial
   2. Release Status: Beta version out
2. Parallel version
   1. Classifiers will be run in parallel
   2. Release status: Will be out by 25th December, 2023

Setting up

1. Clone this repository with all the submodules

   git clone --recurse-submodules https://github.com/vishal-2000/EDMP.git

2. Move to robofin folder and change the branch to v0.0.1

   cd robofin
   git checkout v0.0.1

3. Install robofin

   pip install geometrout==0.0.3.4
   pip install urchin
   cd robofin
   pip install -e .

4. Install other necessary packages

   pip install torch torchvision h5py einops autolab_core wandb scipy

5. Download the datasets from link to './datasets' folder. This would look like:

   ./datasets/*_solvable_problems.pkl

   Where * is a placeholder for all the three datasets - global, hybrid, and both
6. Download the models folder from link and unzip it in the main folder.
7. Final directory structure must look like:

.
├── benchmark
│   └── cfgs
├── datasets
│   └── __pycache__
├── diffusion
│   ├── models
│   │   └── __pycache__
│   └── __pycache__
├── guides
│   └── cfgs
├── lib
│   └── __pycache__
├── models
│   └── TemporalUNetModel255_N50
├── mpinets
│   ├── __pycache__
│   └── third_party
│       └── __pycache__
├── robofin
│   └── robofin
│       ├── kinematics
│       ├── pointcloud
│       │   └── cache
│       │       └── franka
│       ├── standalone_meshes
│       └── urdf
│           ├── franka_panda
│           │   ├── hd_meshes
│           │   │   ├── collision
│           │   │   └── visual
│           │   └── meshes
│           │       ├── collision
│           │       └── visual
│           └── panda_hand
│               └── meshes
│                   ├── collision
│                   └── visual
└── urdfs

Running Inference

Inference configurations can be set using the config files placed in the benchmark folder (./benchmark/cfgs/cfg1.yaml). A custom config file can be created following syntax similar to the files in the benchmark/cfgs directory

To run inference:

python infer_serial.py -c <config_folder_location>

For example:

python infer_serial.py -c ./benchmark/cfgs/cfg1.yaml

Adding custom guides

New custom guides can be added into the ./guides/cfgs/ folder, following syntax similar to the other files in that folder. In order to include this guide during inference, please add the guide number (where the number must match the number on the file name, i.e., ./guides/cfgs/guide10.yaml has guide number == 10 (also change the index number in the file according to the guide number)).

You can control the number of guides you want to run in parallel, and what guides you want to run in parallel using the config file in benchmark folder. For example, in ./benchmark/cfgs/cfg1.yaml, setting the guides parameter to the following will run the inference script with the guides 1, 2, and 3.

guides: [1, 2, 3]

Results

• For replicating the results shown in the paper, please use cfg ./benchmark/cfgs/cfg1.yaml

Citation

If you find our work useful in your research, please cite:

@misc{saha2023edmp,
      title={EDMP: Ensemble-of-costs-guided Diffusion for Motion Planning}, 
      author={Kallol Saha and Vishal Mandadi and Jayaram Reddy and Ajit Srikanth and Aditya Agarwal and Bipasha Sen and Arun Singh and Madhava Krishna},
      year={2023},
      eprint={2309.11414},
      archivePrefix={arXiv},
      primaryClass={cs.RO}
}

Contact

Kallol Saha: kallolsaha1752001@gmail.com
Vishal Mandadi: vishal.mandadi@students.iiit.ac.in
Jayaram Reddy: jayaram.reddy@research.iiit.ac.in