Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions mint.json
Original file line number Diff line number Diff line change
Expand Up @@ -463,6 +463,7 @@
"platform/destinations/azure-cognitive-search",
"platform/destinations/databricks-volumes",
"platform/destinations/delta-table",
"platform/destinations/elasticsearch",
"platform/destinations/google-cloud",
"platform/destinations/milvus",
"platform/destinations/mongodb",
Expand Down
1 change: 1 addition & 0 deletions platform/connectors.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@ If your source is not listed here, you might still be able to connect Unstructur
- [Astra DB](/platform/destinations/astradb)
- [Azure Cognitive Search](/platform/destinations/azure-cognitive-search)
- [Delta Table](/platform/destinations/delta-table)
- [Elasticsearch](/platform/destinations/elasticsearch)
- [Google Cloud Storage](/platform/destinations/google-cloud)
- [Milvus](/platform/destinations/milvus)
- [MongoDB](/platform/destinations/mongodb)
Expand Down
1 change: 1 addition & 0 deletions platform/destinations/overview.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@ To create a destination connector:
- [Astra DB](/platform/destinations/astradb)
- [Azure Cognitive Search](/platform/destinations/azure-cognitive-search)
- [Delta Table](/platform/destinations/delta-table)
- [Elasticsearch](/platform/destinations/elasticsearch)
- [Google Cloud Storage](/platform/destinations/google-cloud)
- [Milvus](/platform/destinations/milvus)
- [MongoDB](/platform/destinations/mongodb)
Expand Down
14 changes: 3 additions & 11 deletions snippets/general-shared-text/elasticsearch-platform.mdx
Original file line number Diff line number Diff line change
@@ -1,14 +1,6 @@
Fill in the following fields:

- **Name** (_required_): A unique name for this connector.
- **URL** (_required_): The Elasticsearch cluster URL.
- **Batch Size** (_required_): The size limit (in bytes) for each batch of items.
- **Index Name** (_required_): The name of the index in the Elasticsearch cluster.
- **Username**: The username for the Elasticsearch cluster, if basic authentication is enabled.
- **Password**: The password associated with the username.
- **Cloud ID**: If using Elastic Cloud, the Cloud ID.
- **API Key**: The Elastic Cloud API key for authentication, if this method is used.
- **API Key ID**: The ID associated with the Elastic Cloud API key.
- **Bearer Auth**: The bearer token for authentication, if this method is used.
- **CA Certs**: The path to the Certificate Authority (CA) file on the instance, if this method is used.
- **SSL Assert Fingerprint**: The certificate fingerprint, if this method is used.
- **Host** (_required_): The endpoint URL for the target cluster.
- **Index Name** (_required_): The name of the target index in the cluster.
- **API Key** (_required_): The Elastic Cloud API key for the target cluster.
24 changes: 14 additions & 10 deletions snippets/general-shared-text/elasticsearch.mdx
Original file line number Diff line number Diff line change
@@ -1,18 +1,20 @@
The Elasticsearch prerequisites:
The Elasticsearch prerequisites.

- An Elasticsearch instance, such as an [Elastic Cloud](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#hosted-elasticsearch-service) service instance...
- For the [Unstructured Platform](/platform/overview), only Elastic Cloud instances are supported.
- For [Unstructured Ingest](/ingestion/overview), Elastic Cloud instances and self-manged Elasticsearch instances are supported.
- For Elastic Cloud, you will need an [Elastic Cloud service instance](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#hosted-elasticsearch-service).

<iframe
width="560"
height="315"
src="https://www.youtube.com/embed/-bmVLeEti1Q"
src="https://www.youtube.com/embed/HEYIFC7uOus"
title="YouTube video player"
frameborder="0"
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture"
allowfullscreen
></iframe>

...or a [self-managed Elasticsearch](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#elasticsearch-deployment-options) instance.
- For self-managed Elasticsearch, you will need a [self-managed Elasticsearch instance](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#elasticsearch-deployment-options).

<iframe
width="560"
Expand All @@ -24,7 +26,7 @@ The Elasticsearch prerequisites:
allowfullscreen
></iframe>

- The name of the index on the instance. See [Create index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-create-index.html) and [Get index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-index.html).
- You will need the name of the index on the instance. See [Create index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-create-index.html) and [Get index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-index.html).

The Elasticsearch index that you use must have a schema that is compatible with the schema of the documents
that Unstructured produces for you. Unstructured cannot provide a schema that is guaranteed to work in all
Expand Down Expand Up @@ -94,8 +96,10 @@ The Elasticsearch prerequisites:
allowfullscreen
></iframe>

- If you're connecting to an Elastic Cloud instance, the Cloud ID and API key. To get these, see your Elasticsearch Service web console.
- If you're connecting to a self-managed instance, the instance's hostname and port number. See [Networking](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-network.html).
- If you're using basic authentication to the instance, the user's name and password.
- If you're using token-based authentication to the instance, the bearer token or API key for the instance. See [Token-based authentication services](https://www.elastic.co/guide/en/elasticsearch/reference/current/token-authentication-services.html) and [Create API key](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-create-api-key.html).
- If you're using certificate, the path to the Certificate Authority (CA) file on the instance, and the certificate fingerprint. See [SSL certificate API](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-ssl.html) and [Where can I see my Certificate Fingerprint?](https://discuss.elastic.co/t/where-can-i-see-my-certificate-fingerprint/319335/3).
- For Elastic Cloud, you will need the Elastic Cloud service instance's API key. If you are using Unstructured Ingest, you will also need the instance's Cloud ID. To get these, see your Elasticsearch Service web console.
- For self-managed Elasticsearch, you will need:

- The self-managed instance's hostname and port number. See [Networking](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-network.html).
- If you're using basic authentication to the self-managed instance, the user's name and password.
- If you're using token-based authentication to the self-managed instance, the bearer token or API key for the instance. See [Token-based authentication services](https://www.elastic.co/guide/en/elasticsearch/reference/current/token-authentication-services.html) and [Create API key](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-create-api-key.html).
- If you're using certificate authentication to the self-managed instance, the path to the Certificate Authority (CA) file on the instance, and the certificate fingerprint. See [SSL certificate API](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-ssl.html) and [Where can I see my Certificate Fingerprint?](https://discuss.elastic.co/t/where-can-i-see-my-certificate-fingerprint/319335/3).