Skip to content

YNCris/SBeA_release

Repository files navigation

SBeA_release

The release version of SBeA.
Linked paper: Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework

1. The demo of SBeA

Multi-animal tracking cross species

Tracking mice

image

Tracking parrots

image

Tracking dogs

image
Notes:
Blue color: animal 1
Red color: animal 2
Masks: the segmentation of them
Bounding boxes: generated by the maximum external boxes of masks
Left: Video capture with multi-view cameras
Center: Cropped identities
Right: 3D poses with identities of multiple animals

Social behavior clustering of mice autism model

image
Notes:
Left three frames: the free-social interactions of three group of mice
WT: Wild type mouse
KO: Shank3B knockout mouse
Right: social behavior atlas with distance map
Circle: current social behavior module of left three groups
Trace: previous social behavior modules last 100 frames

2. The tutorials of SBeA

SBeA_tracker
SBeA_mapper