You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To speed up the compilation from Ibis models to SQL, we could do it for only the models which are relevant for the current dbt command, i.e. we could use the selector syntax with --select and --exclude. We'd need to cache the schemas of the Ibis expressions between runs so that schemas of upstream Ibis dependencies which are not selected are available.
However, we can't use dbt list --select ... to tell us which models to compile as dbt does not know about the Ibis models until they have been compiled to SQL.
-> This needs to wait until there is a better plugin support in dbt so that Ibis models can directly participate in the dbt dag without being first compiled to sql.
The text was updated successfully, but these errors were encountered:
To speed up the compilation from Ibis models to SQL, we could do it for only the models which are relevant for the current dbt command, i.e. we could use the selector syntax with
--select
and--exclude
. We'd need to cache the schemas of the Ibis expressions between runs so that schemas of upstream Ibis dependencies which are not selected are available.However, we can't use
dbt list --select ...
to tell us which models to compile as dbt does not know about the Ibis models until they have been compiled to SQL.-> This needs to wait until there is a better plugin support in dbt so that Ibis models can directly participate in the dbt dag without being first compiled to sql.
The text was updated successfully, but these errors were encountered: