Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can I use the existing code to do expression transfer #6

Closed
lsx0101 opened this issue Apr 9, 2023 · 12 comments
Closed

Can I use the existing code to do expression transfer #6

lsx0101 opened this issue Apr 9, 2023 · 12 comments

Comments

@lsx0101
Copy link

lsx0101 commented Apr 9, 2023

Thanks for your solution for headless trainging, it works well.
In the Supplemental Document->B. Applications, the expression transfer results are attractive. Is it possible to do expression transfer with the existing code?

@Zielon
Copy link
Owner

Zielon commented Apr 9, 2023

Yes, the current code supports it, however, I did not upload the relative expression generation script. I maybe release this part as well. You just need to have the corresponding transforms.json file and meshes.

@lsx0101
Copy link
Author

lsx0101 commented Apr 9, 2023

Yes, the current code supports it, however, I did not upload the relative expression generation script. I maybe release this part as well. You just need to have the corresponding transforms.json file and meshes.

thanks for your answer. I also wanna know how to render images with existing checkpoints.

@Zielon
Copy link
Owner

Zielon commented Apr 9, 2023

You can use "render_from_snapshot": true # For --no-gui option to directly render sequences from the config.

@Zielon Zielon closed this as completed Apr 9, 2023
@lsx0101
Copy link
Author

lsx0101 commented Apr 10, 2023

You can use "render_from_snapshot": true # For --no-gui option to directly render sequences from the config.

I use "render_from_snapshot":true, and set the --scene, --no-gui, --snapshot, It seems nothing happens.

And after I train a scene, the max_steps is fixed. I change the max_steps and use --snapshot, the traing shows the initial max_steps.

@Zielon
Copy link
Owner

Zielon commented Apr 10, 2023

You are right there was a bug. Now it is fixed, you can also specify render_novel_trajectory option in this mode.

@Zielon Zielon reopened this Apr 10, 2023
@Zielon Zielon closed this as completed Apr 10, 2023
@lsx0101
Copy link
Author

lsx0101 commented Apr 10, 2023

You are right there was a bug. Now it is fixed, you can also specify render_novel_trajectory option in this mode.

It doesn't seem to work.

@Zielon
Copy link
Owner

Zielon commented Apr 10, 2023

I am using:

--config insta.json --scene data/obama/transforms_test.json --snapshot data/obama/snapshot.msgpack --no-gui

{
	"parent": "main.json",
	"max_steps": 33000,
	"max_cached_bvh": 4000,
	"max_images_gpu": 1700,
	"use_dataset_cache": true,
	"render_novel_trajectory": false,
	"render_from_snapshot": true
}

The output should be in ./data/obama/experiments/insta/debug/overlay if you need more trajectories use "render_novel_trajectory": true

@lsx0101
Copy link
Author

lsx0101 commented Apr 10, 2023

I am using:

--config insta.json --scene data/obama/transforms_test.json --snapshot data/obama/snapshot.msgpack --no-gui

{
	"parent": "main.json",
	"max_steps": 33000,
	"max_cached_bvh": 4000,
	"max_images_gpu": 1700,
	"use_dataset_cache": true,
	"render_novel_trajectory": false,
	"render_from_snapshot": true
}

The output should be in ./data/obama/experiments/insta/debug/overlay if you need more trajectories use "render_novel_trajectory": true

I use the same config, the code only outputs after training. When I try to render reults again, nothing appears.

@Zielon
Copy link
Owner

Zielon commented Apr 10, 2023

Hmm, have you pulled the newest changes and rebuilt the project?

@alchemician
Copy link

@lsx0101 it is just replacing the previous files in the debug/overlay folder

@lsx0101
Copy link
Author

lsx0101 commented Jun 24, 2023

@lsx0101 it is just replacing the previous files in the debug/overlay folder

it works, but the rendering quality is not as good as training expressions

@oijoijcoiejoijce
Copy link

I'm gettin these results; imperfect rendering and transfer, is anyone getting better output?

Studio_Project_V3.mp4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants