Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tests for reproducibility of stochastic results #651

Closed
drvinceknight opened this issue Jul 8, 2016 · 0 comments
Closed

Add tests for reproducibility of stochastic results #651

drvinceknight opened this issue Jul 8, 2016 · 0 comments
Assignees

Comments

@drvinceknight
Copy link
Member

I'd like to add a property based test similar to https://github.com/Nikoleta-v3/Axelrod/blob/635/axelrod/tests/integration/test_matches.py but that checks that when setting a seed we get the same results for stochastic strategies (those tests there only check for 'well behaved deterministic' strategies. I have a hunch that this isn't actually true as we're not setting numpy's seed...

If that's the case and both seeds need to be set, we should document how to get reproducible results and either:

  1. Indicate that you should set both seeds (numpy and stdlib);
  2. Write a little helper function that does this (and just document it: axelrod.seed() or something like that...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant