Skip to content

v2.0: cartoon landmark model v2

Choose a tag to compare

@zenonLEE zenonLEE released this 02 Nov 07:02
· 1 commit to d80b8bc362203803623dfc9612b3c4a56c1db3db since this release

Cartoon face landmark model v2 (68 points), fine-tuned from the v1 model on cartoon and caricature faces plus a small share of in-house real-face video frames (details in the README).

For inference it is a drop-in replacement for v1: the weights are in checkpoint["net"], so pass the file with --pretrained_weight.

  • File: mdfld_cartoon_v2.pkl, 69,027,997 bytes
  • SHA-256: f061f616133fe0d2497093037af2a8ff6968fb898016188282fd0f914ae9d65e

CariFace test set: 1,560 caricatures with CariFace's ground truth. The images were not used for training, but their labels were used to tune the pseudo-labelling settings. NME is in % of the outer eye-corner distance; lower is better.

Crop (v1 → v2) All 68 Eyes Mouth Eye failure rate
demo.py crop, 1 pass 7.81 → 6.43 4.57 → 3.80 6.44 → 4.88 6.8% → 5.1%
Tight crop, 2 passes 8.31 → 7.63 3.82 → 3.17 6.30 → 4.73 3.3% → 1.7%

With the tight crop the eyebrows get worse (12.33 → 13.63). All face regions, the crops, the training data and the known limitations are in the README under Cartoon model v2. Research use only.