Skip to content

[Hold] [DS 111] Mongodb source #279

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 5 commits into from
Closed

[Hold] [DS 111] Mongodb source #279

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
073321b
Created MongoDB source template
mateusz-kuprowski Oct 11, 2024
5c6bc9a
Added source docs
mateusz-kuprowski Oct 11, 2024
3def5e6
Apply suggestions from code review
Paul-Cornell Oct 11, 2024
b590607
Update snippets/general-shared-text/mongodb-platform.mdx
Paul-Cornell Oct 11, 2024
415a98c
Update platform/sources/mongodb.mdx
Paul-Cornell Oct 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions mint.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -434,6 +434,7 @@
"pages": [
"platform/sources/overview",
"platform/sources/azure-blob-storage",
"platform/sources/mongodb",
"platform/sources/s3"
]
},
Expand Down
1 change: 1 addition & 0 deletions platform/connectors.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ The Unstructured Platform supports connecting to the following source and destin
## Sources

- [Azure](/platform/sources/azure-blob-storage)
- [MongoDB](/platform/sources/mongodb)
- [S3](/platform/sources/s3)

If your source is not listed here, you might still be able to connect Unstructured to it through scripts or code by using the
Expand Down
26 changes: 26 additions & 0 deletions platform/sources/mongodb.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
---
title: MongoDB
---

Ingest your files into Unstructured from MongoDB.

You'll need:

import MongoDBPrerequisites from '/snippets/general-shared-text/mongodb.mdx';

<MongoDBPrerequisites />

To create the source connector:

1. On the sidebar, click **Connectors**.
2. Click **Sources**.
3. Click **Add new**.
4. Give the connector some unique **Name**.
5. In the **Provider** area, click **MongoDB**.
6. Click **Continue**.
7. Follow the on-screen instructions to fill in the fields as described later on this page.
8. Click **Save and Test**.

import MongoDBFields from '/snippets/general-shared-text/mongodb-platform.mdx';

<MongoDBFields />
1 change: 1 addition & 0 deletions platform/sources/overview.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ To create a source connector:
4. Fill in the fields according to your connector type. To learn how, click your connector type in the following list:

- [Azure](/platform/sources/azure-blob-storage)
- [MongoDB](/platform/sources/mongodb)
- [S3](/platform/sources/s3)

5. Click **Save and Test**.
Expand Down
3 changes: 2 additions & 1 deletion snippets/general-shared-text/mongodb-platform.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,4 +3,5 @@ Fill in the following fields:
- **Name** (_required_): A unique name for this connector.
- **URI** (_required_): The MongoDB instance connection URI.
- **Database** (_required_): The name of the database on the instance.
- **Collection**: The name of the collection within the database.
- **Collection**: The name of the collection within the database.
- **Batch size**: The maximum number of documents per insertion. If this field is blank, the default is 150. Applies to the MongoDB source connector only.