Skip to content

v3.0: cartoon landmark model v3 (DINOv3 features)

Latest

Choose a tag to compare

@zenonLEE zenonLEE released this 06 Nov 06:47

Cartoon face landmark model v3 (68 points): the v2 network with frozen DINOv3 ViT-B/16 features added to the input of its hourglass stack through a small adapter (1.6 M parameters), trained with more cartoon data (synthetic anime faces, new pseudo-labels) and distilled from the same design with DINOv3 ViT-L/16. It is the default model of the mdfld pip package 3.0.0; --model v2 keeps the smaller, faster v2.

  • File: mdfld_cartoon_v3.torchscript.pt (TorchScript, fp32), 419,214,809 bytes
  • SHA-256: dc5de1817397fb0f8eed113b971ea367e21bf7fb09ab22dff11181bf7cd0a337
  • Input: (N, 3, 256, 256) BGR face crops, pixel / 255 × 2 − 1; output: (N, 68, 2) in [−1, 1] (same interface as the v2 TorchScript file).

With the package's three-pass crop:

Test set v2 v3
CariFace test, 1,560 caricatures: NME (%) 5.03 4.64
CariFace test: faces with NME above 10% 3.6% 2.0%
Real faces, 313 held-out video frames (automatic labels): NME (%) 1.74 1.69
Synthetic anime, 1,462 held-out generated faces (layout labels): NME (%) 6.30 5.09
Anime illustrations, 980 held-out images: disagreement above 15% with an anime face detector 10.5% 6.1%

v3 is about 2 × slower on a GPU (71 vs 38 ms per face on an RTX 4090 D) and 4.6 × on a CPU. On first download the package prints a notice about the DINOv3 License. Regions, protocol, training data and limitations: README, Cartoon model v3.

License. Research use only. The v3 file contains DINOv3 weights and is distributed under the DINOv3 License (attached as LICENSE_DINOv3.md), in addition to the MDFLD terms of use.