Skip to content
πŸœπŸ€πŸ’πŸšΆ A full system for robust 3D markerless tracking
Python Shell
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github/ISSUE_TEMPLATE Update issue templates Aug 4, 2019
anipose bump version Jan 3, 2020
docs Fixes for code review 1 Dec 12, 2019
.gitignore Initial commit for calib pattern manual verify feature Dec 10, 2019
LICENSE add LGPLv3 license Jan 14, 2019
README.md add hand demo Aug 31, 2019
config.toml add option for an initial calibration file Aug 2, 2019
release.sh add simple release script Feb 6, 2019
setup.py

README.md

Anipose

PyPI version DOI License: LGPL v3

Anipose is a framework for scalable DeepLabCut-based analysis. It supports both 2d and 3d tracking, handles calibration and processing all files within a group of folders.

The name Anipose comes from Animal Pose, but it also sounds like "any pose".

Getting started

  1. Setup DeepLabCut by following the instructions here
  2. Install Anipose through pip: pip install anipose

Documentation

Demos

Videos of flies by Evyn Dickinson (slowed 5x), Tuthill Lab

Videos of hand by Katie Rupp

Why this project?

DeepLabCut is great for training a network to track features in a video, and to run it on a small set of videos.

However, in practice, to accommodate our experiments, we found that we need to write custom code to iterate through folders and videos. Different experimental runs tended to be placed in different folders, and processing this structured data can quickly get overwhelming. This problem is compounded if one wants to do 3D tracking, where many more videos are generated and organization of these is critical for processing data.

Hence, we created Anipose, which places the DeepLabCut feature analysis into a pipeline, organizing the results into folders and autodetecting all the files that need to be processed.

For 2D tracking, Anipose can:

  • track all videos in a group of folders
  • detect, remove, and interpolate bad tracking
  • make videos labeled with the 2D tracked points and lines, and filtered points
  • aggregate all the 2D data into one file (easier to analyze further)

For 3D tracking, Anipose can:

  • process calibration videos per session (or per experiment, as needed)
  • handle triangulation from multiple videos to get 3D points
  • generate 3D videos from 3D points
  • compute angles in 3D
  • aggregate all 3D data and angles into one file (for easier analysis)

References

Here are some references for DeepLabCut and other things this project relies upon:

  • Mathis et al, 2018, "DeepLabCut: markerless pose estimation of user-defined body parts with deep learning"
  • Insafutdinov et al, 2016, "DeeperCut: A Deeper, Stronger, and Faster Multi-Person Pose Estimation Model"
  • Romero-Ramirez et al, 2018, "Speeded up detection of squared fiducial markers"
  • Garrido-Jurado et al, 2016, "Generation of fiducial marker dictionaries using Mixed Integer Linear Programming"
You can’t perform that action at this time.