Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,18 @@ The JSON loader use [JSON pointer](https://github.com/janl/node-jsonpointer) to

### No JSON pointer example

The most simple way of using it, is to specify no JSON pointer.
The most simple way of using it is to specify no JSON pointer.
The loader will load all strings it finds in the JSON object.

Example JSON file:

```json
{
"texts": ["This is a sentence.", "This is another sentence."]
"texts": ["This is a sentence.", "This is another sentence."],
"nestedTexts": {
"one": "This is a sentence nested in an object.",
"two": "This is another sentence nested in an object."
}
}
```

Expand All @@ -28,28 +32,28 @@ const docs = await loader.load();
/*
[
Document {
"metadata": {
"blobType": "application/json",
"line": 1,
"source": "blob",
},
"pageContent": "This is a sentence.",
pageContent: 'This is a sentence.',
metadata: { source: 'example.json', line: 1 }
},
Document {
pageContent: 'This is another sentence.',
metadata: { source: 'example.json', line: 2 }
},
Document {
"metadata": {
"blobType": "application/json",
"line": 2,
"source": "blob",
},
"pageContent": "This is another sentence.",
pageContent: 'This is a sentence nested in an object.',
metadata: { source: 'example.json', line: 3 }
},
Document {
pageContent: 'This is another sentence nested in an object.',
metadata: { source: 'example.json', line: 4 }
}
]
*/
```

### Using JSON pointer example

You can do a more advanced scenario by choosing which keys in your JSON object you want to extract string from.
You can choose which keys in your JSON object you want to extract strings from.

In this example, we want to only extract information from "from" and "surname" entries.

Expand Down Expand Up @@ -86,21 +90,16 @@ const docs = await loader.load();
/*
[
Document {
"metadata": {
"blobType": "application/json",
"line": 1,
"source": "blob",
},
"pageContent": "BD 2023 SUMMER",
pageContent: 'LinkedIn Job',
metadata: { source: 'example.json', line: 1 }
},
Document {
"metadata": {
"blobType": "application/json",
"line": 2,
"source": "blob",
},
"pageContent": "LinkedIn Job",
pageContent: 'LinkedIn Job2',
metadata: { source: 'example.json', line: 2 }
},
...
Document {
pageContent: 'bob',
metadata: { source: 'example.json', line: 3 }
}
]
```