Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

please evaluate the performance over multiple seeds #47

Closed
thlautenschlaeger opened this issue Sep 17, 2021 · 1 comment
Closed

please evaluate the performance over multiple seeds #47

thlautenschlaeger opened this issue Sep 17, 2021 · 1 comment

Comments

@thlautenschlaeger
Copy link

In the README down below, the performance evaluations are done only on a single seed.
Please evaluate over multiple seeds because as of now the results can be random and are thus not comparable.

@quantumiracle
Copy link
Owner

I appreciate your suggestion. However, as this is not an officially released repo (I didn't spend much time on maintaining this), I will not provide thorough evaluation of algorithms. Please feel free to do this by yourself (it should be quite straightforward with a bash script passing random seeds into some arguments for running, since each algorithm script is independent), and I welcome such contribution in this repo if you have done that! Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants