Missing connector in Cartpole example?

[gdommergue]

Hi @krumiaa

2 questions:

Just recently purchased MindMaker: Deep Reinforcement Learning (SingleNode) from UE marketplace and had a look at your Cartpole example, it seems a connector is missing in cart_BP?

Also, from my understanding, the "Done" boolean is used to notify the RL engine that the current episode has ended, is that correct?

Thanks.

[krumiaa]

Apologies for the confusion, the DONE node is not necessary for the proper functioning of the example. You don’t need to connect it. The demo will automatically close once the number of training or eval episodes is reached. I experimented with being able to break training prior to reaching the full number of training episodes by implementing a Boolean break. Think I left this in there in the event someone wanted to play around with doing the same. I should have commented that in the blueprints, will do so in an update. Thanks for bringing this to my attention.

[gdommergue]

Thanks for your reply.
I still don't understand how you handle the end of each episode? In Unity ML Agent, for instance, you can call EndEpisode() to let the AI know that the episode is over.
Should i set Done=True to do that?

[krumiaa]

After the make observations blueprint function completes, it passes that data back to mindmaker learning engine, completing the episode. After this another episode automatically begins, it basically waits in a holding pattern for the blueprint to pass back reward and observation data. you could break from it at any time by changing the make observations blueprint function, otherwise it continues looping until the specified number of training or eval episodes is completed