Skip to content

Simulated garment dataset for virtual try-on

Notifications You must be signed in to change notification settings

isantesteban/vto-dataset

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Simulated garment dataset for virtual try-on

This repository contains the dataset used in the following papers:

  • Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On (CVPR 2021) [Project website] [Video]

  • Learning-Based Animation of Clothing for Virtual Try-On (Eurographics 2019) [Project website] [Video]

Dataset

Teaser

The data is generated used a modified version of ARCSim and sequences from the CMU Motion Capture Database converted to SMPL format in SURREAL. Each simulated sequence is stored as a .pkl file that contains the following data:

Key Description Dimension
shapes SMPL shape coefficients [num_frames, 10]
poses SMPL pose coefficients [num_frames, 75]
vertices Vertices of the simulated garment [num_frames, num_vertices, 3]
faces Faces of the garment [num_faces, 3]
sequence Sequence identifier
subject Subject identifier
conf ARCSim configuration

Sequences

The dataset contains a diverse selection of motions:

Motion Sequence ID
Walking 07_02, 91_62, 91_33, 91_36, 91_19, 91_12, 76_11, 73_09, 46_01, 111_14, 105_05, 104_17
Running 128_02, 128_03, 128_04, 128_05, 128_06, 128_07, 108_11, 108_12, 108_27, 104_04, 104_53, 104_54
Jumping 01_01, 91_61, 91_38, 49_04, 108_16, 108_17, 108_18, 108_20, 13_13, 02_04
Arm movements 55_27, 54_24, 40_12, 144_26, 144_30, 135_09, 132_54, 111_20, 111_37, 02_05
Torso movements 63_25, 144_28, 111_02, 108_22, 26_11, 135_07
Dancing 05_20, 55_12, 131_03, 111_05
Others 76_05, 104_11

Extract meshes

Requirements: python3, numpy-1.21.3

To extract the simulated garment meshes as .obj run the following script:

python extract_meshes.py tshirt/simulations/tshirt_shape00_01_01.pkl

Same for the dress:

python extract_meshes.py dress/simulations/dress_shape00_01_01.pkl

Citation

If you find this dataset useful please cite our work:

@article {santesteban2021garmentcollisions,
    journal = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    title = {{Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On}},
    author = {Santesteban, Igor and Thuerey, Nils and Otaduy, Miguel A and Casas, Dan},
    year = {2021}
}
@article {santesteban2019virtualtryon,
    journal = {Computer Graphics Forum (Proc. Eurographics)},
    title = {{Learning-Based Animation of Clothing for Virtual Try-On}},
    author = {Santesteban, Igor and Otaduy, Miguel A. and Casas, Dan},
    year = {2019},
    ISSN = {1467-8659},
    DOI = {10.1111/cgf.13643}
}

About

Simulated garment dataset for virtual try-on

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages