Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

what does this line mean in README? #16

Closed
illtellyoulater opened this issue Apr 6, 2022 · 2 comments
Closed

what does this line mean in README? #16

illtellyoulater opened this issue Apr 6, 2022 · 2 comments

Comments

@illtellyoulater
Copy link

A weight of 1 will sample images that match the prompt roughly as well as images usually match prompts like that in the training set.

I can't wrap my head around this sentence. Could you please explain it with different wording? Thanks!

@crowsonkb
Copy link
Owner

One recurring problem we have with text to image models is that our paired image/text datasets just aren't as good as we would like. The images and captions rarely match very well. So we use this "classifier-free guidance" trick to sample conditional on stronger image/caption matching than was typical in the training set. If you use 1 the image will tend to match the caption about as well as images matched captions in the training set.

@illtellyoulater
Copy link
Author

many thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants