Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

what if using sampling when cut edge in svd? #29

Open
hzhangxyz opened this issue Nov 21, 2022 · 0 comments
Open

what if using sampling when cut edge in svd? #29

hzhangxyz opened this issue Nov 21, 2022 · 0 comments
Labels

Comments

@hzhangxyz
Copy link
Member

when try to cut edge in svd, do not sort singular values from larger to less, sampling it based on singular value instead, which may solve local minimum for blocked tensor.

hzhangxyz added a commit that referenced this issue Nov 29, 2022
Which use a "temperature" to cut dimension, if temperature=0, it equals to
remain cut. In higher temperature, it has more possibility to choose a smaller
singular value, This may be useful for blocked tensor, which erasing a symmetry
may be much more harmful than cutting a larger singular. Inside a single block,
smaller singular is always cutted earlier than larger one, so this commit does
not affect no symmetry tensor.
hzhangxyz added a commit that referenced this issue Jan 2, 2023
Which use a "temperature" to cut dimension, if temperature=0, it equals to
remain cut. In higher temperature, it has more possibility to choose a smaller
singular value, This may be useful for blocked tensor, which erasing a symmetry
may be much more harmful than cutting a larger singular. Inside a single block,
smaller singular is always cutted earlier than larger one, so this commit does
not affect no symmetry tensor.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Todo
Development

When branches are created from issues, their pull requests are automatically linked.

1 participant