Skip to content

Releases: sxyu/avatar

Prelease 0.0.1

29 Dec 19:07
Compare
Choose a tag to compare
Prelease 0.0.1 Pre-release
Pre-release

Switch to more standard npz format for SMPL via cnpy, as opposed to weird ad-hoc PCD/text format.
Support Kinect V2.
(This is a release of quite old code so data can be included, as response to demand, I would recommend you use the latest source code along with the data files linked here)

Required Data

Due to repeated requests I decided to put the required data in a zip. This contains SMPL neutral model from SMPLify as well as the CMU mocap dataset and a program to extract it. One may consider replacing the CMU mocap with the newer AMASS pose database.

https://drive.google.com/file/d/1SA_yCkazr0aKKh_WQ9yy5X0qGn0T9VnC/view?usp=sharing
Extract this zip into <project root>/data, so that data/avatar-model/model.npz exists.

Please accept the license of http://smplify.is.tue.mpg.de/. The SMPL model is provided for non-commercial uses only.

Random tree models

Download and place (from the attachments below)

  • tree.150k.refine.srtr random tree model,
  • tree.150k.refine.srtr.partmap random tree part map (allowing detected body part != SMPL body part),
    in the build directory.

Sample dataset

Sample AZ Kinect dataset:
https://drive.google.com/file/d/1LPX8FI62p7gIRbfandUE9LgZ6fy4LToL/view

To run with this sample data:
./demo [insert path]/conference-room [insert path]/tree.150k.refine.srt -i 20
Note that in older versions demo was called bgsubtract. This has been changed to reflect the true functionality. -i 20 skips some initial frames where the human is not in view.

It has been reported that on some systems the program crashes because model.npz fails to load.
In that case, you can try the attached version (model.npz) and replace the one in data/avatar-model

If you own an Azure Kinect or Kinect V2, live-demo starts a live demo program.

ext_background.jpg is some background image for AR live demo. You may optionally put it in the build directory. This can be replaced with any image and can be used by pressing 3 in the program.
Given image is from https://pixabay.com/illustrations/sunrise-space-outer-space-globe-1756274/

Prerelease 0.0.0

18 Nov 00:53
Compare
Choose a tag to compare
Prerelease 0.0.0 Pre-release
Pre-release
Added depth camera + data recording capability