Are .pkl files necessary?

[Carmenliang]

Hi,

It's an interesting research!

I want to reproduce the results of this paper, but I am still confused about the details. In breakout dataset, a video file contains not only the images, but also 4 .pkl files. How do these files initialize? If I use custom datasets, are these four files necessary?

Thanks

[willi-menapace]

Dear Carmenliang,
each video in addition to its frames may possess data which may be used for evaluation purposes. This data is typically present only in the case of synthetic datasets (eg. Breakout) and is replaced by placeholders in real datasets (eg. Tennis). The content of the pkl files is the following:

actions.pkl: list with an integer for each frame corresponding to the real action happened in that frame if known, replace by 0 otherwise
rewards.pkl: list with an integer for each frame corresponding to rewards that are obtained for doing a certain action in that frame, replace by 0.0 otherwise. Currently unused
dones.pkl: list with an boolean for each frame set to True if that frame corresponds to the end of an episode, put to False if unknown.
metadata.pkl: list with a dictionary for each frame containing any additional information that may be needed for evaluation purposes. Set to a list of empty dictionaries if no additional information is needed

If you are creating a custom dataset you can set the contents of these files to the default values explained above.

Best,
Willi