Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Trouble reproducing Genomics Benchmark Result #37

Closed
yair-schiff opened this issue Dec 20, 2023 · 2 comments
Closed

Trouble reproducing Genomics Benchmark Result #37

yair-schiff opened this issue Dec 20, 2023 · 2 comments

Comments

@yair-schiff
Copy link

Hello,

Thank you for the great work and repo!

I am trying to reproduce the HyenaDNA column of Table 4.1 (GenomicsBenchmark). I am using the weights from LongSafari/hyenadna-tiny-1k-seqlen. However, I am unable to reproduce the results.

Would it be possible for you to specify which hyperparms from Table A.3 (screenshot below) were used for each of the datasets in this benchmark:
Screenshot 2023-12-19 at 10 49 24 PM
@yair-schiff yair-schiff mentioned this issue Dec 20, 2023
Closed
@exnx
Copy link
Collaborator

exnx commented Dec 20, 2023

Sorry we don't have those readily available.

@yair-schiff
Copy link
Author

Thanks for the reply!

@exnx exnx closed this as completed Dec 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@exnx @yair-schiff