Skip to content

Databricks updates #5549

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Oct 17, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 12 additions & 0 deletions src/_data/catalog/warehouse.yml
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,18 @@ items:
url: 'https://cdn.filepicker.io/api/file/Vk6iFlMvQeynbg30ZEtt'
categories:
- Warehouses
- display_name: Databricks Delta Lake
slug: databricks-delta-lake
name: catalog/warehouses/databricks-delta-lake
description: ''
url: connections/storage/catalog/databricks-delta-lake
status: PRIVATE_BETA
logo:
url: 'https://images.ctfassets.net/h6ufgtwb6nv1/4vYEAgYz6nGLC9F64Jxeb6/fcf3ecdae5386f806ae72eb39ce07094/db.svg?w=256&q=75'
mark:
url: ''
categories:
- Warehouses
- display_name: Google Cloud Storage
slug: google-cloud-storage
name: catalog/warehouses/google-cloud-storage
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,5 @@
---
title: Databricks Delta Lake Destination (AWS Setup)
beta: true
hidden: true
---

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,5 @@
---
title: Databricks Delta Lake Destination (Azure Setup)
beta: true
hidden: true
---

Expand All @@ -10,7 +9,7 @@ With the Databricks Delta Lake Destination, you can ingest event data from Segme

This page will help you use the Databricks Delta Lake Destination to sync Segment events into your Databricks Delta Lake built on Azure (ADLS Gen 2).


> info "Databricks Delta Lake Destination in Public Beta"
> The Databricks Delta Lake Destination is in public beta, and Segment is actively working on this integration. [Contact Segment](https://segment.com/help/contact/){:target="_blank"} with any feedback or questions.

Expand Down Expand Up @@ -70,7 +69,7 @@ Segment uses the service principal to access your Databricks workspace APIs as w
```
az ad sp create --id fffa5b05-1da5-4599-8360-cc2684bcdefb
```

### Step 3: Update or create an ADLS Gen2 storage container

The ADLS Gen2 storage container is where Segment lands your Delta Lake files.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
---
title: Databricks Delta Lake
beta: true
redirect_from:
- '/connections/warehouses/catalog/databricks-delta-lake/'
---

Setup docs coming soon!
5 changes: 5 additions & 0 deletions src/connections/storage/catalog/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,11 @@ layout: catalog
<p class="thumbnail-integration__label">Beta</p>
{% endif %}
</div>
<div>
{% if warehouse.status == 'PRIVATE_BETA' %}
<p class="thumbnail-integration__label">Private Beta</p>
{% endif %}
</div>
</a>
</div>
{% endif %}
Expand Down