Skip to content

Add docs on how to set custom dependencies (e.g. forDbtCLI task) and how to cache them #475

@anna-geller

Description

@anna-geller

Feature description

Examples:

id: dbtGitDockerDuckDB
namespace: blueprint

tasks:
  - id: dbt
    type: io.kestra.core.tasks.flows.WorkingDirectory
    tasks:
    - id: cloneRepository
      type: io.kestra.plugin.git.Clone
      url: https://github.com/kestra-io/dbt-demo
      branch: main

    - id: dbt-build
      type: io.kestra.plugin.dbt.cli.DbtCLI
      runner: DOCKER
      docker:
        image: python:3.11-slim
      beforeCommands:
        - pip install dbt-bigquery==1.5.0
      profiles: |
        ...
      commands:
        - dbt deps
        - dbt build

Add example installing these into venv and caching venv folder:

  - id: working_dir
    type: io.kestra.core.tasks.flows.WorkingDirectory
    cache:
      patterns:
        - venv/**
      ttl: PT30D

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions