.ipynb_checkpoints folder crashes training

[zhuliyi0]

Jupiter Notebook may auto-create this cache folder inside datset folder, it may contain images and caption files. Better to exclude this folder.

[zhuliyi0]

for now I just use this to delete all trash before run:

find . -type d -name ".ipynb_checkpoints" -exec rm -r {} \;

[bghira]

what is the crash trace?

[bghira]

i've added a simple workaround to the startup scripts. set PROTECT_JUPYTER_FOLDERS to any value if you wish to handle it yourself. i didn't want to add a list of arbitrary things to start excluding, to the dataset manager. this seems like it should be handled outside of the whole process tbh