New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to handle dynamic amount of states? #139

Closed
rubenaster opened this Issue Nov 13, 2017 · 2 comments

Comments

Projects
None yet
3 participants
@rubenaster

rubenaster commented Nov 13, 2017

At first I wanted to thank you for this great ML-pipeline, playing around with it is really great!

So, what I’ve noticed is that agents have a list of states with a fixed size, which is ok when you have a constant environment like 1 ball and 1 platform which tries to keep the ball on it or in my case you have a platform and a pong-like ball.

But how about having enemies which spawn dynamically? Or when these enemies shoot bullets? We’d need a dynamic list of states for that or pre-define a list of states which can be filled up as needed. How would you implement this scenario?

@awjuliani

This comment has been minimized.

Show comment
Hide comment
@awjuliani

awjuliani Nov 14, 2017

Collaborator

Hi @rubenaster,

As it currently stands, you are right that the state size needs to be fixed. In the case of dynamic number of enemies, one way to deal with this is to send only information about the n closest enemies, or n most relevant object within a scene. We are currently working on ways to relax this requirement, but it will take some time and experimentation.

Collaborator

awjuliani commented Nov 14, 2017

Hi @rubenaster,

As it currently stands, you are right that the state size needs to be fixed. In the case of dynamic number of enemies, one way to deal with this is to send only information about the n closest enemies, or n most relevant object within a scene. We are currently working on ways to relax this requirement, but it will take some time and experimentation.

@unityjeffrey

This comment has been minimized.

Show comment
Hide comment
@unityjeffrey

unityjeffrey Mar 28, 2018

Contributor

Thanks for reaching out to us. Hopefully you were able to resolve your issue. We are closing this due to inactivity, but if you need additional assistance, feel free to reopen the issue.

Contributor

unityjeffrey commented Mar 28, 2018

Thanks for reaching out to us. Hopefully you were able to resolve your issue. We are closing this due to inactivity, but if you need additional assistance, feel free to reopen the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment