Linking to the discussion in this thread:
https://support.prodi.gy/t/db-in-command-cant-handle-blank-lines-in-jsonl/2126/3
It would be useful to be able to define whether or not there should be a blank line appended to a file when using write_jsonl.
I have the scenario where I want to append to a single file using srsly, and it already adds a new line at the end of the file, so there does not need to be a new line written first when appending to the file.
There is an option in read_jsonl to ignore blank lines, which could also be an option for db-in in prodigy, but it would be a good idea anyway to write a single continuous file with multiple appends.
Linking to the discussion in this thread:
https://support.prodi.gy/t/db-in-command-cant-handle-blank-lines-in-jsonl/2126/3
It would be useful to be able to define whether or not there should be a blank line appended to a file when using write_jsonl.
I have the scenario where I want to append to a single file using srsly, and it already adds a new line at the end of the file, so there does not need to be a new line written first when appending to the file.
There is an option in read_jsonl to ignore blank lines, which could also be an option for db-in in prodigy, but it would be a good idea anyway to write a single continuous file with multiple appends.