Skip to content

Conversation

@felix-yuxiang
Copy link
Contributor

Update a blog post on diffusion distillation.

@felix-yuxiang
Copy link
Contributor Author

Some more issues to be fixed. Suggested by @qiyan98

  • Zero-tangent loss: position of trainable model, when should it be inside the total derivative or outside? Namely, how should we apply JVP to the trainable/offline model?
  • explain the details of l_2 with cosine loss?
  • How does AYF convert to vanilla FM loss when s->t? mention s->t is indicating taking a limit
  • MMD loss inside IMM, are both outputs of $f$ functions differentiable?

@lrjconan lrjconan merged commit e9bd01b into DSL-Lab:master Sep 3, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants