Skip to content
This repository has been archived by the owner on Apr 6, 2021. It is now read-only.

Reproducable HAL game runs and Increase no. of Trials run by CI #14

Merged
merged 6 commits into from
Jan 22, 2021

Conversation

mrzzy
Copy link
Owner

@mrzzy mrzzy commented Jan 22, 2021

How to reproduce runs:

With this we should be able to reproduce runs:

  • seeing this result report we see that Trial 1, Team A lost
================================================================================
Results Report (TeamA wins-TeamB wins [RNG Seed]):
Trial 1: 860-1160 [258257236788031661]
Trial 2: 1980-690 [681771073087336176]
Trial 3: 1550-1340 [5506946166510917166]
================================================================================
  • we can reproduce by checking out the same git commit and setting the seed:
env REAL_TIME=False RANDOM_SEED=258257236788031661 python HAL.py

REAL_TIME=False ensures that the game runs at a identical frame rate.

What changed?

Implement Reproducible Trials as defined #13
Closes: #13

Increase no. of Trials run by CI to increase confidence in statistics computed.

  • Master: 41 to 81
  • PRs: 41 to 51.

@mrzzy mrzzy added ci/cd ok-to-test Enables PR CI Pipeline labels Jan 22, 2021
@mrzzy mrzzy self-assigned this Jan 22, 2021
@mrzzy mrzzy added this to In progress in AIG Assignment via automation Jan 22, 2021
@joeltio
Copy link
Collaborator

joeltio commented Jan 22, 2021

LGTM 👍

@mrzzy mrzzy merged commit b8c13d2 into master Jan 22, 2021
AIG Assignment automation moved this from In progress to Done Jan 22, 2021
@mrzzy mrzzy deleted the feat/reproduce-runs branch January 22, 2021 04:25
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
ci/cd ok-to-test Enables PR CI Pipeline
Projects
Development

Successfully merging this pull request may close these issues.

Reproducing Game Trial Runs
2 participants