Skip to content

Feat: Support model selection for backfilling when running a plan against a dev environment#1692

Merged
izeigerman merged 1 commit intomainfrom
feat-select-models-for-backfill-in-plan
Nov 10, 2023
Merged

Feat: Support model selection for backfilling when running a plan against a dev environment#1692
izeigerman merged 1 commit intomainfrom
feat-select-models-for-backfill-in-plan

Conversation

@izeigerman
Copy link
Contributor

No description provided.

@izeigerman izeigerman requested a review from a team November 10, 2023 17:33
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can this support multiple? should it be models?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

plurals?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, see --select-model and --restate-model. Multiple entires in CLI look like following:

sqlmesh plan --backfill-model model_a --backfill-model "<expression>"

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need to be so strict?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I strongly believe so. Why would anyone want to backfill prod partially?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you never know

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with being strict here unless we hear a good use case. The product is opinionated about characteristics that make up prod and we so far this seems like a good bet.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so this will select all models upstream of models selected to ensure the chain is proper right

Copy link
Contributor Author

@izeigerman izeigerman Nov 10, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that's right

@izeigerman izeigerman force-pushed the feat-select-models-for-backfill-in-plan branch from f81204f to a1b5950 Compare November 10, 2023 17:46
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why was this removed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it was mentioned twice

@tobymao
Copy link
Contributor

tobymao commented Nov 10, 2023

this is a breaking change because you're changing user facing cli

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

does this support special syntax?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For example did we decide to not support a syntax for saying directly modified only?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Depends on what you mean by a special syntax. If you mean +, *, etc. then yes. If you mean directly modified, then no. I realized supporting directly modified doesn't have much value.

@izeigerman izeigerman force-pushed the feat-select-models-for-backfill-in-plan branch from a1b5950 to 8fe8cec Compare November 10, 2023 20:40
@izeigerman izeigerman merged commit a942ef7 into main Nov 10, 2023
@izeigerman izeigerman deleted the feat-select-models-for-backfill-in-plan branch November 10, 2023 20:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants