Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase MUNIT resolution with Pix2Pix HD #105

Open
gcosne opened this issue Sep 23, 2019 · 4 comments
Open

Increase MUNIT resolution with Pix2Pix HD #105

gcosne opened this issue Sep 23, 2019 · 4 comments
Assignees
Projects
Milestone

Comments

@gcosne
Copy link
Member

gcosne commented Sep 23, 2019

In Pix2Pix HD, the authors use a second generator to upsample the image x4 times. We would keep the main generator architecture with 256x256 resolution.

Herewith Pix2Pix HD generator architecture:
image

@gcosne gcosne self-assigned this Sep 23, 2019
@gcosne gcosne added this to To do in CCAI Status via automation Sep 23, 2019
@gcosne gcosne added this to the 2019 milestone Sep 23, 2019
@gcosne
Copy link
Member Author

gcosne commented Sep 23, 2019

We aim to integrate The local enhancer G2: in MUNIT architecture, the code based on resnetblock is similar. (Syntactically different but same Resnet.)

To do:

  • Decide if we want x2 times local enhancer, one for each domain ? Or a common one.
  • Plug local enhancer and one MUNIT autoencoder
  • Understand the fine tuning used in PIX2PIX HD

@vict0rsch
Copy link
Contributor

@51N84D you see, that's why it's good to have issues and follow-up on them because ideas come back around but this one has no conclusion so its usefulness is crippled... :p

@51N84D
Copy link
Member

51N84D commented Apr 7, 2020

Haha yes, I see your point. I actually have this implemented locally and it runs, but haven't put too much effort into producing good results

@vict0rsch
Copy link
Contributor

I trust you this is only a temporary situation ;) close this issue when you've come to a conclusion (especially the so-called Jason-trick and max res of GSV being 640px)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
CCAI Status
  
To do
Development

No branches or pull requests

3 participants