-
Notifications
You must be signed in to change notification settings - Fork 275
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
basic information about ply file #47
Comments
I downloaded a 3d model and tried it. It turned out to be ValueError: Cannot feed value of shape (357, 1499814, 3, 1) for Tensor 'VOCA/Inputs_decoder/template_placeholder:0', which has shape '(?, 5023, 3, 1)'. |
see #43 The only thing I found was to use Ringnet repo to pass an image and have it generate a 3D new model. We are in the realm of "programmers" vs "artists". Thx for this issue, it might bring more attention to the problem. |
@mbdash |
I havn't tried RingNet https://github.com/soubhiksanyal/RingNet I am also looking at this repo https://github.com/leventt/surat |
It seems there is some confusion about the mesh input to VOCA. As described in the readme, VOCA animates static templates in FLAME topology. Such templates can be obtained by fitting FLAME to scans, images, or by sampling the FLAME shape space. This means the input mesh must be in semantic correspondence to the FLAME template. Sampling the FLAME shape space for instance can give you an almost infinite amount of templates that can be animated by VOCA. If you want to get a particular scan into FLAME topology (as we did for the scan on Winston Churchill), you can for instance read Section 4.2 of the FLAME paper how this is done. Long story short, this is an optimization problem where one minimizes the difference between the mesh surface of the FLAME surface and the scan. We could potentially release VOCA compatible meshes for 1200 subjects obtained by scanning them. I would need to check with the dataset owners though if this is feasible. Would that help anybody? |
@TimoBolkart thank you for the information. For the problem of using a hand modeled 3D mesh, I think what would help the most is any code related on how to accomplish 4.2:
I think a good solution is to figure out how to solve the
But for an arbitrary 3D Model (obj, fbx, ply, etc) made in 3DSmax, Blender or other 3D software instead of a scan mesh. Some ppl, (I mean myself) aren't smart enough to implement the beautiful equations in the section 4.2. It would give an approximate FLAME version of the source mesh which should be acceptable. As for releasing the 1200 subject dataset, it might be interesting and give some options but with potential legal / license issues. |
@TimoBolkart I checked that the output of the voca model is an obj file containing only the values of v and f. If I have an obj file (containing only the values of v and f) and then convert it into a ply file, can I do anything about it You can rewrite the obj file containing vf, vn, etc. into the obj file output by the model. At this time, I also have the corresponding mtl file and texture png. Is there any method for reference? Thank you. |
I created a template with 3Dmax and saved it as an obj file without texture information. Finally, I used a tool convert obj into a ply file. Does the generated ply file meet the input requirements of voca? Thanks.
The text was updated successfully, but these errors were encountered: