Add support for pydantic 2

[jamiedemaria]

What's the use case?

update the resources and config system to support pydantic 2

Ideas of implementation

No response

Additional information

No response

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

[lainiwa]

Pydantic v2 also contains v1 functionality, so likely Dagster could be updated to be v2-compatible just by editing imports: pydantic v2 docs.

[mjclarke94]

Is there any update on this? @lainiwa 's suggestion might be a nice intermediate approach whilst resources/config are updated to make use of the new features.

We have an interfaces library which is decoupled from dagster, but aren't able to bump that to pydantic 2 whilst some environments need both dagster and our interfaces tool.

[zaneselvans]

There's also the helpful little utility https://github.com/pydantic/bump-pydantic which can make many of the changes required to migrate from v1 to v2 automatically.

[emanueledomingo]

Hi guys, do you have an ETA for this?

[benpankow]

Hi all, just wanted to let you know that this is is something we're actively taking a look at - it's a bit too early to provide an ETA, but we will keep you updated as this proceeds. Since we rely on some of Pydantic's internals, it means we unfortunately can't rely solely on the compatibility layer.

[aeturrell]

I've run into this as an issue, great to know it's under active consideration.

[ttamg]

Any update on this move to pydantic v2 please?

[benpankow]

The relevant compat layer will be shipping with Dagster 1.5.5 on October 26