diff --git a/mint.json b/mint.json index ea052af2..6edf55b8 100644 --- a/mint.json +++ b/mint.json @@ -463,6 +463,7 @@ "platform/destinations/azure-cognitive-search", "platform/destinations/databricks-volumes", "platform/destinations/delta-table", + "platform/destinations/elasticsearch", "platform/destinations/google-cloud", "platform/destinations/milvus", "platform/destinations/mongodb", diff --git a/platform/connectors.mdx b/platform/connectors.mdx index 695c825a..7af50d6d 100644 --- a/platform/connectors.mdx +++ b/platform/connectors.mdx @@ -26,6 +26,7 @@ If your source is not listed here, you might still be able to connect Unstructur - [Astra DB](/platform/destinations/astradb) - [Azure Cognitive Search](/platform/destinations/azure-cognitive-search) - [Delta Table](/platform/destinations/delta-table) +- [Elasticsearch](/platform/destinations/elasticsearch) - [Google Cloud Storage](/platform/destinations/google-cloud) - [Milvus](/platform/destinations/milvus) - [MongoDB](/platform/destinations/mongodb) diff --git a/platform/destinations/overview.mdx b/platform/destinations/overview.mdx index 160fa6ea..e640a14a 100644 --- a/platform/destinations/overview.mdx +++ b/platform/destinations/overview.mdx @@ -20,6 +20,7 @@ To create a destination connector: - [Astra DB](/platform/destinations/astradb) - [Azure Cognitive Search](/platform/destinations/azure-cognitive-search) - [Delta Table](/platform/destinations/delta-table) + - [Elasticsearch](/platform/destinations/elasticsearch) - [Google Cloud Storage](/platform/destinations/google-cloud) - [Milvus](/platform/destinations/milvus) - [MongoDB](/platform/destinations/mongodb) diff --git a/snippets/general-shared-text/elasticsearch-platform.mdx b/snippets/general-shared-text/elasticsearch-platform.mdx index 6cfb704d..fa027d22 100644 --- a/snippets/general-shared-text/elasticsearch-platform.mdx +++ b/snippets/general-shared-text/elasticsearch-platform.mdx @@ -1,14 +1,6 @@ Fill in the following fields: - **Name** (_required_): A unique name for this connector. -- **URL** (_required_): The Elasticsearch cluster URL. -- **Batch Size** (_required_): The size limit (in bytes) for each batch of items. -- **Index Name** (_required_): The name of the index in the Elasticsearch cluster. -- **Username**: The username for the Elasticsearch cluster, if basic authentication is enabled. -- **Password**: The password associated with the username. -- **Cloud ID**: If using Elastic Cloud, the Cloud ID. -- **API Key**: The Elastic Cloud API key for authentication, if this method is used. -- **API Key ID**: The ID associated with the Elastic Cloud API key. -- **Bearer Auth**: The bearer token for authentication, if this method is used. -- **CA Certs**: The path to the Certificate Authority (CA) file on the instance, if this method is used. -- **SSL Assert Fingerprint**: The certificate fingerprint, if this method is used. \ No newline at end of file +- **Host** (_required_): The endpoint URL for the target cluster. +- **Index Name** (_required_): The name of the target index in the cluster. +- **API Key** (_required_): The Elastic Cloud API key for the target cluster. \ No newline at end of file diff --git a/snippets/general-shared-text/elasticsearch.mdx b/snippets/general-shared-text/elasticsearch.mdx index 11bff22f..f57b8dbe 100644 --- a/snippets/general-shared-text/elasticsearch.mdx +++ b/snippets/general-shared-text/elasticsearch.mdx @@ -1,18 +1,20 @@ -The Elasticsearch prerequisites: +The Elasticsearch prerequisites. -- An Elasticsearch instance, such as an [Elastic Cloud](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#hosted-elasticsearch-service) service instance... +- For the [Unstructured Platform](/platform/overview), only Elastic Cloud instances are supported. +- For [Unstructured Ingest](/ingestion/overview), Elastic Cloud instances and self-manged Elasticsearch instances are supported. +- For Elastic Cloud, you will need an [Elastic Cloud service instance](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#hosted-elasticsearch-service). - ...or a [self-managed Elasticsearch](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#elasticsearch-deployment-options) instance. +- For self-managed Elasticsearch, you will need a [self-managed Elasticsearch instance](https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html#elasticsearch-deployment-options). -- The name of the index on the instance. See [Create index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-create-index.html) and [Get index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-index.html). +- You will need the name of the index on the instance. See [Create index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-create-index.html) and [Get index](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-index.html). The Elasticsearch index that you use must have a schema that is compatible with the schema of the documents that Unstructured produces for you. Unstructured cannot provide a schema that is guaranteed to work in all @@ -94,8 +96,10 @@ The Elasticsearch prerequisites: allowfullscreen > -- If you're connecting to an Elastic Cloud instance, the Cloud ID and API key. To get these, see your Elasticsearch Service web console. -- If you're connecting to a self-managed instance, the instance's hostname and port number. See [Networking](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-network.html). -- If you're using basic authentication to the instance, the user's name and password. -- If you're using token-based authentication to the instance, the bearer token or API key for the instance. See [Token-based authentication services](https://www.elastic.co/guide/en/elasticsearch/reference/current/token-authentication-services.html) and [Create API key](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-create-api-key.html). -- If you're using certificate, the path to the Certificate Authority (CA) file on the instance, and the certificate fingerprint. See [SSL certificate API](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-ssl.html) and [Where can I see my Certificate Fingerprint?](https://discuss.elastic.co/t/where-can-i-see-my-certificate-fingerprint/319335/3). \ No newline at end of file +- For Elastic Cloud, you will need the Elastic Cloud service instance's API key. If you are using Unstructured Ingest, you will also need the instance's Cloud ID. To get these, see your Elasticsearch Service web console. +- For self-managed Elasticsearch, you will need: + + - The self-managed instance's hostname and port number. See [Networking](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-network.html). + - If you're using basic authentication to the self-managed instance, the user's name and password. + - If you're using token-based authentication to the self-managed instance, the bearer token or API key for the instance. See [Token-based authentication services](https://www.elastic.co/guide/en/elasticsearch/reference/current/token-authentication-services.html) and [Create API key](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-create-api-key.html). + - If you're using certificate authentication to the self-managed instance, the path to the Certificate Authority (CA) file on the instance, and the certificate fingerprint. See [SSL certificate API](https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-ssl.html) and [Where can I see my Certificate Fingerprint?](https://discuss.elastic.co/t/where-can-i-see-my-certificate-fingerprint/319335/3). \ No newline at end of file