-
Notifications
You must be signed in to change notification settings - Fork 49
Closed
Labels
Description
This system provides a generator to lazy read JSONL files with each line a separate definition. JSONL files are files with newline delimited JSON blobs and typically very large. This package provides a generator that allows a line by line parse reducing memory complexity for large data demand projects such as those for training deep learning models.
Author: Paul Landes
License: MIT
Source: https://github.com/plandes/cl-jsonl