Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to use isjon with Jsonl, ndjson ? #96

Closed
dinhanhx opened this issue Jun 9, 2023 · 5 comments
Closed

Is it possible to use isjon with Jsonl, ndjson ? #96

dinhanhx opened this issue Jun 9, 2023 · 5 comments
Labels
question Further information is requested

Comments

@dinhanhx
Copy link

dinhanhx commented Jun 9, 2023

Pretty much the title,
For more context, please see https://jsonlines.org/ http://ndjson.org/

@dinhanhx dinhanhx added the question Further information is requested label Jun 9, 2023
@rtobar
Copy link

rtobar commented Jun 9, 2023

Yes.

I'd appreciate you raised the issue with more information like the template suggests though, otherwise I don't know what you've tried (if you have tried anything at all) or why things aren't clear.

@jpmckinney
Copy link

It definitely works with JSONL and NDJSON. Just set multiple_values=True https://pypi.org/project/ijson/#options-1

Or, read one line at a time and pass each line to ijson. I do that so that I can parallelize parsing.

@dinhanhx
Copy link
Author

dinhanhx commented Jun 9, 2023

Yes.

I'd appreciate you raised the issue with more information like the template suggests though, otherwise I don't know what you've tried (if you have tried anything at all) or why things aren't clear.

I'm sorry about that. I will follow the template.

@dinhanhx
Copy link
Author

dinhanhx commented Jun 9, 2023

It definitely works with JSONL and NDJSON. Just set multiple_values=True https://pypi.org/project/ijson/#options-1

Or, read one line at a time and pass each line to ijson. I do that so that I can parallelize parsing.

Oh wow, I must have left that part out. Thanks

@rtobar
Copy link

rtobar commented Jun 14, 2023

Closing as the question has been clarified.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants