Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NOT A COPY OF #34] We need an official statement about "colluding" or "handshake" strategies. #40

Closed
shadowleafy opened this issue May 21, 2021 · 11 comments

Comments

@shadowleafy
Copy link

The focus of the prisoner's dilemma is that both sides should be attempting to get the highest score, with no prior communication. Colluding strategies completely break this premise, allowing people to get ~4.5 scores with essentially no effort. Ban collusion.

@nobody5050
Copy link

See #34

@shadowleafy
Copy link
Author

See #34

It's not that hard to make ~100-ish google alts. There's nothing stopping someone from doing it. It has to be banned or the contest will be ruined.

@nekiwo
Copy link

nekiwo commented May 21, 2021

Yeah we need some official word on this

@shadowleafy
Copy link
Author

Yeah we need some official word on this

Agreed. Should I rename the ticket so it doesn't just look like a duplicate of #34?

@shadowleafy shadowleafy changed the title "Cheating / Colluding" strategies should be banned. [NOT A COPY OF #34] We need an official statement about "colluding" or "handshake" strategies. May 21, 2021
@cai-lw
Copy link

cai-lw commented May 21, 2021

I have a feeling that the rules were made intentionally vague. Maybe tempting people to cheat is also part of the research.

Also it really isn't hard to prevent cheaters from actually claiming the money. They can just read the code of the top performers and require them to explain their code. Even in case of uninterpretable code like a neural network they can still ask for training data and training code.

@duckboycool
Copy link

There's this from the FAQ on the announcement video in terms of an official statement.

Q: Can't people flood the pool with dumb strategies that boost their own true strategy?
A: Perhaps! But, my Google submission Form only allows for one submission per Gmail account. So, if you have multiple Gmail accounts, I think you could submit multiple, but I'm hoping Google has been hampering down on bot accounts over the last decade or so!

@shadowleafy
Copy link
Author

I have a feeling that the rules were made intentionally vague. Maybe tempting people to cheat is also part of the research.

Also it really isn't hard to prevent cheaters from actually claiming the money. They can just read the code of the top performers and require them to explain their code. Even in case of uninterpretable code like a neural network they can still ask for training data and training code.

Fair enough. I still would like an official response that isn't "it's discouraged" for winning the competition.

@duckboycool Saw that, but the way it's worded is vauge and seems to suggest that it's plausible but cary thinks it can't be abused. This thread is about how it could be abused.

@nobody5050
Copy link

I believe Cary made a comment in 34 discouraging it

@nobody5050
Copy link

Never mind I was mistaken

@carykh
Copy link
Owner

carykh commented May 22, 2021

Yeah, colluding strategies are not allowed! When I'm reading through the strategies, if I see strategies putting arbitrary codes to check for friendly opponents who are in the same collusion, then I'll disqualify those strategies.

I'll put a QnA entry about that in the YouTube description now.

@shadowleafy
Copy link
Author

Yeah, colluding strategies are not allowed! When I'm reading through the strategies, if I see strategies putting arbitrary codes to check for friendly opponents who are in the same collusion, then I'll disqualify those strategies.

I'll put a QnA entry about that in the YouTube description now.

Thank you for the response! I will be closing this now.

yasirroni pushed a commit to yasirroni/PrisonersDilemmaTournament that referenced this issue May 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants