Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unary patch embeddings #201

Closed
brunosan opened this issue Mar 28, 2024 · 0 comments
Closed

Unary patch embeddings #201

brunosan opened this issue Mar 28, 2024 · 0 comments
Assignees

Comments

@brunosan
Copy link
Member

We have a ticket when I open the issue of rescitting the neck of the Unet from a bundle of embeddings, one per band, to just one, and currently we can outpout the average, average per group, or each embedding. Keeping the raw embedding seemed too big, but this blog post on unary embeddings, suggest that transforming the raw patch embeddigns to unary migh be a new solution.

Filing to test.

They see a reduction of accuracy but also a vast increase in performance.

image

@brunosan brunosan self-assigned this Mar 28, 2024
@brunosan brunosan closed this as not planned Won't fix, can't repro, duplicate, stale Apr 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant