diff --git a/snippets/general-shared-text/delta-table-platform.mdx b/snippets/general-shared-text/delta-table-platform.mdx new file mode 100644 index 00000000..ede6b003 --- /dev/null +++ b/snippets/general-shared-text/delta-table-platform.mdx @@ -0,0 +1,3 @@ +Fill in the following fields: + +- **Name** (_required_): A unique name for this connector. \ No newline at end of file diff --git a/snippets/general-shared-text/delta-table.mdx b/snippets/general-shared-text/delta-table.mdx new file mode 100644 index 00000000..2833985d --- /dev/null +++ b/snippets/general-shared-text/delta-table.mdx @@ -0,0 +1,30 @@ +The Delta Table prerequisites: + +- The path to the Delta Table: + + - For AWS, this path takes the format `s3:///` + - For Azure, this path takes the format `abfss://@.dfs.core.windows.net/` + - For GCP, this path takes the format `gs:///` + + A few ways to get this path include: + + - Running the Databricks SQL statement `SHOW CREATE TABLE ;`. Look for the `Location` field in the output. + This field will contain the path to the Delta Table specified by ``. + - Running the Databricks SQL statement `SHOW CREATE TABLE `;. This will display the `CREATE TABLE` statement, + which will include the `LOCATION` clause. This clause will contain the path to the Delta Table specified by ``. + - Running the following PySpark code in a Databricks notebook. This will print the path to the Delta Table specified by ``. + + ```python + deltaTable = DeltaTable.forName(spark, "") + location = deltaTable.location() + print(location) + ``` + +- The storage options to access the Delta Table: + + - For AWS, this is the AWS access key ID and its corresponding AWS secret access key, which have access to the backing Amazon S3 bucket. + - For Azure, this is the [SAS token (recommended)](https://learn.microsoft.com/azure/ai-services/translator/document-translation/how-to-guides/create-sas-tokens), + [access key](https://learn.microsoft.com/azure/storage/common/storage-account-keys-manage#view-account-access-keys), or + [connection string](https://learn.microsoft.com/azure/storage/common/storage-configure-connection-string#configure-a-connection-string-for-an-azure-storage-account) + for the backing Azure Storage account. + - For GCP, this is the JSON content of a Google Cloud service account key that has the necessary permissions to access the specified Google Cloud bucket. The service account key must have at least the **Storage Object Viewer** role to ensure proper access permissions. [Create a service account key](https://cloud.google.com/iam/docs/keys-create-delete#creating). [Assign a role](https://cloud.google.com/storage/docs/access-control/iam). \ No newline at end of file