Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dynamic number of players in multi-players simulations (for static number of arms and static problem) ? #124

Open
pratayaa opened this issue Apr 25, 2018 · 2 comments
Assignees
Labels
enhancement I have to improve something which already works not too badly multi-player For multi-player bandits simulations non-stationary For non-stationary bandits simulations question Things I'm not sure how to solve

Comments

@pratayaa
Copy link

pratayaa commented Apr 25, 2018

Thank you for your help and support, just one more thing i want to ask- How we can change number of USERS dynamically for satic number of arms ?

@Naereen
Copy link
Member

Naereen commented Apr 25, 2018

OK, first of all, this is ridiculous, it has to stop. Please, use a SHORT title, and edit the text box when you raise a new issue.

@Naereen Naereen added enhancement I have to improve something which already works not too badly question Things I'm not sure how to solve labels Apr 25, 2018
@Naereen Naereen self-assigned this Apr 25, 2018
@Naereen Naereen changed the title Thank you for your help and support, just one more thing i want to ask- How we can change number of USERS dynamically for satic number of arms ? Dynamic number of players in multi-players simulations (for static number of arms and static problem) ? Apr 25, 2018
@Naereen
Copy link
Member

Naereen commented Apr 25, 2018

Then to answer, I didn't implement this either.

It would be very similar to the task lists I gave on issue #123, but even easier: the number M(t) of players is (usually) always bounded between 1 and K (nb of arms).
It shouldn't be too hard for the Evaluator/MAB/Result classes, but regarding algorithms, you have to think about what you want to model: sleeping users or arrivals/departures.

  • "Sleeping users" refers to where there is M_max (e.g., K) users playing the game, but at each time, only a subset gets to play (and receive rewards). This should be quite easy to do, as it does not need any change from the algorithms side (some users just don't receive any feedback nor take decision at some step, but they are not even aware of it!)
  • "Arrivals/departures" is harder, as an arrival means a new algorithm has to be initialized.

I am also interested in this extension, but like for #123, I cannot take some time right now to code it myself.
So either you try to implement all this yourself, try to do some simulations, and when it works fine, submit a pull request (then I'll try and probably merge); or you forget about it until at least a few weeks... Sorry to be too busy!

@Naereen Naereen added multi-player For multi-player bandits simulations non-stationary For non-stationary bandits simulations labels Oct 7, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement I have to improve something which already works not too badly multi-player For multi-player bandits simulations non-stationary For non-stationary bandits simulations question Things I'm not sure how to solve
Development

No branches or pull requests

2 participants