How to generate demo.pkl file?

[sukritiverma1996]

Hello,

I am having a bit of trouble understanding the format of the demo.pkl file in your code. It seems to have the dimensions of [5, 200, 3] for Cartpole and [100,50,3] for Reacher. I suppose the last dimension = 3 is for [obs, act, new-obs] but I am unable to understand the purpose of having 2 more dimensions instead of just 1.

Could you share a code snippet on how to generate these .pkl files given a trained model?