New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

duplicate mean values during mask initialization #45

Closed

czhang99 opened this issue Jan 10, 2024 · 2 comments

czhang99 commented Jan 10, 2024

Observed duplicated initializations when initializing the mean value for masking variables. Is one of them preferred over the other?

https://github.com/princeton-nlp/LLM-Shearing/blob/3560a877e2833c3da393923be0bd6753b6ef1c6d/llmshearing/models/l0_module.py#L45-L46C17

Contributor

xiamengzhou commented Jan 11, 2024

Hii! Check out here issue #3 for an details answer!

Author

czhang99 commented Jan 11, 2024 •

edited

Loading

thanks for the reference issue ticket. well-explained in #3. closing the issue.

czhang99 closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment