Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

expose dlt commands to notebooks as magics + improve colab experience #502

Open
rudolfix opened this issue Jul 18, 2023 · 0 comments
Open
Labels
good first issue Good for newcomers

Comments

@rudolfix
Copy link
Collaborator

Background
See how sql-mesh is doing that. amazing: https://sqlmesh.readthedocs.io/en/stable/reference/notebook/
if we do that we allow our users to easily add verified sources in notebooks and inspect working pipelines. we may also think about some notebook-specific magic ie. showing current config and secrets

Tasks

    • add magics for init, pipeline and other commands
    • there's a known limitation on Colab - their file editor cannot show files starting with . the result is that users do not see the .dlt folder with secrets and configs. we should solve this somehow. ie. by dlt init that detects running on colab (there's a helper) and then creates a link ie. _dlt that is visible
    • add a demo colab notebook and documentation to reference section of the docs
@rudolfix rudolfix changed the title expose dlt commands to notebooks as magics expose dlt commands to notebooks as magics + improve colab experience Sep 28, 2023
@rudolfix rudolfix added the good first issue Good for newcomers label Nov 11, 2023
@Vasilije1990 Vasilije1990 self-assigned this Nov 17, 2023
@rudolfix rudolfix assigned burnash and unassigned Vasilije1990 Feb 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
Status: Todo
Development

No branches or pull requests

3 participants