Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Number of strategies per user #13

Closed
cornelg7 opened this issue May 20, 2021 · 4 comments
Closed

Number of strategies per user #13

cornelg7 opened this issue May 20, 2021 · 4 comments

Comments

@cornelg7
Copy link

Are we allowed to submit multiple strategies?

@Quadrapod
Copy link

Quadrapod commented May 20, 2021

Probably not for quite a few reasons.

The google form simply doesn't allow duplicate submissions.

Allowing multiple submissions per user would somewhat undermine the experiment's goal of finding out something about individuals and their personal biases when approaching a game theory type problem.

The tournament setting will involve all the submissions competing against one another in one giant pool which has O(n+9)^2 execution time. Allowing just one additional submission per participant would significantly hamper the execution time.

Because all the submissions are in the same pool and your performance is judged on an average it allows exploitation of the system by having multiple submissions interact. In an extreme case consider if I submitted a thousand scripts which all listened for the first 10 inputs like a password then if the got it right always cooperate otherwise always defect. That way against competitors who didn't know the password their average score would go down and against your own scripts who did know their average score would go up.

There's just no reasonable way multiple submissions can be allowed I think.

@D0V4HKIIN
Copy link

i was thinking of putting my strategies in a zip file i can upload them all at once together so he can clearly see they don't have weird password recognition.

@Quadrapod
Copy link

Password recognition was an extreme case. All that you have to do is submit strategies which have a better interaction with each other than the average to get an advantage. For example you could submit 4 detective style strategies that look for different things and a TFT style strategy that defects first. The basic detective is forgiving of early defection during the testing phase so your TFT will do better than average against them. Hence you've given yourself an advantage with reasonable looking strategies.

As well the google form specifically limits you to a .py file as your submission.

@carykh
Copy link
Owner

carykh commented May 21, 2021

Yeah, only one strategy per Gmail account is allowed. (Since you can only fill out the form once.) There are already a lot more strategies than I expected, so I wanna make sure everyone has an equal shot at winning!

@carykh carykh closed this as completed May 21, 2021
valadaptive added a commit to valadaptive/PrisonersDilemmaTournament that referenced this issue May 25, 2021
Make list of strategy folders dynamic
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants