Skip to content

dingthuang/SD-Net

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation In Bin-picking Scenarios

This is the code of pytorch version for paper: [Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation In Bin-picking Scenarios]

Overview of SD-Net architecture.

Illustration of the SD-Net architecture for 6DoF Pose Estimation in stacked scenarios. Alt text We omit the domain adaptation framework, for brevity and more details can be found in :Alt text.

Qualitative results

Evaluation Siléane dataset Alt text Alt text Evaluation Parametric dataset Alt text Alt text

Getting Started

1. Preparation

Please clone the repository locally:

git clone https://github.com/TAO-TAO-TAO-TAO-TAO/SD-Net.git

Install the environment:

Install Pytorch. It is required that you have access to GPUs. The code is tested with Ubuntu 16.04/18.04, CUDA 10.0 and cuDNN v7.4, python3.6. Our backbone PointNet++ is borrowed from pointnet2. .Compile the CUDA layers for PointNet++, which we used in the backbone network:

cd tools\Sparepart\train.py
python train.py install

Install the following Python dependencies (with pip install):

matplotlib
opencv-python
plyfile
'trimesh>=2.35.39,<2.35.40'
'networkx>=2.2,<2.3'
torch==1.1.0
torchvision==0.3.0
sklearn
h5py
nibabel

2. Train SD-Net

cd tools\Sparepart\train.py
python train.py install

3. Evaluation on the custom data

Dataset Siléane dataset is available at here. Parametric dataset is available at here. Fraunhofer IPA Bin-Picking dataset is available at here.

Evaluation metric The python code of evaluation metric is available at here.

Citation

If you find our work useful in your research, please consider citing:

@article{din2024SD-Net,
title={SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation In Bin-picking Scenarios},
author={Ding-Tao Huang, En-Te Lin, Lipeng Chen2, Li-Fu Liu1, Long Zeng},
journal={arXiv preprint arXiv},
year={2024}
}

Contact

If you have any questions, please feel free to contact the authors.

Ding-Tao Huang: hdt22@mails.tsinghua.edu.cn

En-Te Lin: linet22@mails.tsinghua.edu.cn

Li-Fu Liu: llf23@mails.tsinghua.edu.cn

About

Overview of SD-Net architecture.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 77.1%
  • Cuda 12.4%
  • C++ 8.9%
  • C 1.6%