Skip to content

Commit

Permalink
Add databricks to index.rst (#939)
Browse files Browse the repository at this point in the history
* Add databricks to index.rst

Signed-off-by: Kevin Su <pingsutw@gmail.com>

* Dask plugin docs (#929)

* Add documentation for `dask` integration

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Fix typos in `pyspark_pi.py`

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Fix typo in `dask_example.py`

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Fix typos

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Update docs after `flyteidl` change

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add documentation on interruptible behavior

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Address PR feedback

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Small fixes

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add requirement files for dask

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add git to Dockerfile

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add note about local execution

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* minor typos

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Co-authored-by: Niels Bantilan <niels.bantilan@gmail.com>

* fix up index

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

---------

Signed-off-by: Kevin Su <pingsutw@gmail.com>
Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Co-authored-by: bstadlbauer <11799671+bstadlbauer@users.noreply.github.com>
Co-authored-by: Niels Bantilan <niels.bantilan@gmail.com>
  • Loading branch information
3 people committed Feb 8, 2023
1 parent 6dc7b76 commit 8c96962
Show file tree
Hide file tree
Showing 3 changed files with 13 additions and 0 deletions.
3 changes: 3 additions & 0 deletions cookbook/docs/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -120,6 +120,7 @@ class CustomSorter(FileNameSortKey):
"sql_alchemy.py",
"whylogs_example.py",
## Kubernetes
"dask.py",
"pod.py",
"dask_example.py",
"pyspark_pi.py",
Expand Down Expand Up @@ -328,6 +329,7 @@ def __call__(self, filename):
"../integrations/gcp/bigquery",
"../integrations/external_services/hive",
"../integrations/external_services/snowflake",
"../integrations/external_services/databricks",
"../integrations/external_services/airflow",
"../core/extend_flyte",
"../larger_apps",
Expand Down Expand Up @@ -372,6 +374,7 @@ def __call__(self, filename):
"auto/integrations/gcp/bigquery",
"auto/integrations/external_services/hive",
"auto/integrations/external_services/snowflake",
"auto/integrations/external_services/databricks",
"auto/integrations/external_services/airflow",
"auto/core/extend_flyte",
"auto/larger_apps",
Expand Down
1 change: 1 addition & 0 deletions cookbook/docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -428,6 +428,7 @@ auto/integrations/aws/athena/index
auto/integrations/aws/batch/index
auto/integrations/external_services/hive/index
auto/integrations/external_services/snowflake/index
auto/integrations/external_services/databricks/index
auto/integrations/gcp/bigquery/index
auto/integrations/external_services/airflow/index
```
9 changes: 9 additions & 0 deletions cookbook/docs/integrations.rst
Original file line number Diff line number Diff line change
Expand Up @@ -249,6 +249,15 @@ the Flyte task that use the respective plugin.

---

.. link-button:: auto/integrations/external_services/databricks/index
:type: ref
:text: Databricks
:classes: btn-block stretched-link
^^^^^^^^^^^^
Run Databricks jobs in your workflows.

---

.. link-button:: auto/integrations/gcp/bigquery/index
:type: ref
:text: BigQuery
Expand Down

0 comments on commit 8c96962

Please sign in to comment.