jsonarray loader

[su77ungr]

originated #47

Hi, is it possible to add a jsonarray loader (for huge json file)? And what about output stream functionality of ChatGpt? Is it possible to have a similar chunked response stream to reduce chatbot response time? Thanks William

[hippalectryon-0]

I think we should split this into two different issues. (btw I don't understand what the second part refers to)

For the Json: there's a JSONLoader, but it requires an explicit jq schema.

[williamspindox]

It would also be interesting to have a custom dictionary to understand the meaning of some acronyms, like json's keys name or corporate terms in value field (to be used later for all sources). Thanks

[su77ungr]

adding this for research: https://github.com/microsoft/guidance/blob/main/notebooks/applications/jsonformer.ipynb