README.md

{Text ↔️ Pose} Retrieval Model

⚠️ In what follows, command lines are assumed to be launched from ./src/text2pose.

Model overview

Possible inputs: 3D human pose, pose description.

🔮 Demo

To look at a ranking of poses (resp. descriptions) referenced in PoseScript by relevance to your own input description (resp. chosen pose), using a pretrained model, run the following:

bash retrieval/script_retrieval.sh 'demo' </path/to/model.pth>

🚅 Train

📝 Modify the variables at the top of the bash script to specify the desired model & training options.

Then use the following command:

bash retrieval/script_retrieval.sh 'train' <training phase: pretrain|finetune> <seed number>

Note for the finetuning step: In the script, pretrained defines the nickname of the pretrained model. The mapping between nicknames and actual model paths is given by shortname_2_model_path.txt. This means that if you train a model and intend to use its weights to train another, you should first write its path in shortname_2_model_path.txt, give it a nickname, and write this nickname in front of the pretrained argument in the script. The nickname will appear in the path of the finetuned model.

🎯 Evaluate

Use the following command (test on PoseScript-H2):

bash retrieval/script_retrieval.sh 'eval' </path/to/model.pth>