Skip to content

Feat: Gateway configuration BREAKING CHANGE#807

Merged
izeigerman merged 2 commits intomainfrom
gateway-config
May 4, 2023
Merged

Feat: Gateway configuration BREAKING CHANGE#807
izeigerman merged 2 commits intomainfrom
gateway-config

Conversation

@izeigerman
Copy link
Contributor

This PR introduces a new configuration entity: "gateway". Thanks to this new entity users are now able to configure different combinations of connection and scheduler configurations and easily switch between them in the CLI.

Additionally, this change decouples the connection used for model evaluation from the connection used to write and read the SQLMesh state. This means that users can now configure external databases to store SQLMesh state instead of using their data warehouse for this purpose.

Note: Support for external state connections for Airflow is out of this update's scope. It will be added in a follow-up PR.

@izeigerman izeigerman requested review from a team, crericha, eakmanrq and tobymao May 3, 2023 20:52
@CLAassistant
Copy link

CLAassistant commented May 3, 2023

CLA assistant check
All committers have signed the CLA.

self._scheduler = self.config.scheduler
self.connection = connection
self.test_connection = test_connection
self.gateway = gateway
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just so you're aware of the implications on line 219, and also with self.gateway, we're making t he assumption that multi repo works with one gateway

@izeigerman izeigerman merged commit 70b6a0b into main May 4, 2023
@izeigerman izeigerman deleted the gateway-config branch May 4, 2023 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants