How to eliminate head jitter in data preprocessing?

[fastcode3d]

Thank you very much for your work.
I downloaded Registered Data, Unposed Data, and Unposed Cleaned Data.
What are the operations in the data preprocessing stage?
How to eliminate the jitter of the head and finally get Unposed Cleaned Data?

[TimoBolkart]

We use a method similar to the sequential registration method described in the FLAME paper to register the raw 3D head scans. The resulting data are denoted as Registered Data.
We then unpose all registered meshes. This is done by fitting FLAME to each mesh, followed by removing effects of global rotation, translation, and head rotation around the neck. These data are denoted as Unposed Data.
Finally, to get the Unposed Cleaned Data, we fix for each sequence (within the Unposed Data) the neck boundary vertices and the ear vertices to a fixed locatio, and apply to the region around the eyes a Gaussian filtering (across the sequence) to mitigate capture noise.
Does this answer your question?

[fastcode3d]

Yes, thank you very much.

[SaltedSlark]

@TimoBolkart Hello, I want upose my custom mesh produced by MICA reconstrucrion, I want to konw how to remove effects of global rotation, translation, and head rotation around the neck.

[TimoBolkart]

Hello, you will need to get the FLAME parameters (i.e., translation, rotation, pose, identity, and expression parameters) for your sequence. If one has only meshes in FLAME mesh topology given, one can for instance get this with the fit_3D_mesh script. However, if you get the FLAME meshes with some FLAME tracker, e.g., from monocular videos, it is best to adapt this tracker to directly output the FLAME parameters per frame.

To unpose the data, you only need to zero out the parameters for translation, global rotation, and neck rotation, which are the first six parameters of the pose vector, and feed these changed parameters into the FLAME model (i.e., running the forward pass of the model with the changed parameters) and output the resulting mesh.

[SaltedSlark]

@TimoBolkart Thanks so much for your reply, I will try it.

[SaltedSlark]

@TimoBolkart Hello bro, when I export the predicted mesh into ply file(vertice is predicted by the model and faces is from FLAME_sample.ply ) and I open it in meshlab, I got this:

What's wrong?