ImportError: cannot import name 'GetCoreSchemaHandler' from 'pydantic' while using presidio-analyzer

[usman61]

I am getting the import error while using presidio-analyzer in my databricks notebook.

given below is the basic getting started code for presidio-analyzer. surprisingly, it works on my local machine.
I have python 3.11 and tried with several versions of presidio-analyzer and pydantic but nothing works.

_pip install presidio-analyzer_

from presidio_analyzer import AnalyzerEngine

analyzer = AnalyzerEngine()

results = analyzer.analyze(text="My phone number is 212-555-5555",
                           entities=["PHONE_NUMBER"],
                           language='en')
print(results)

[omri374]

Have you explicitly downloaded the spacy en_core_web_lg model?

[usman61]

yes I have explicitly downloaded the spacy model en_core_web_lg
but I am facing the issue due to Pydantic in my Databricks env

[omri374]

is there an option in databricks to show the installed packages? e.g. %pip freeze? If yes, please share the list here. My hunch is that databricks runtime uses pydantic, but the version it uses does not match the versions required by spacy (from spacy: pydantic>=1.7.4,!=1.8,!=1.8.1,<3.0.0)

I would suggest to pin pydantic: %pip install "pydantic>=2.6,<3.0" --force-reinstall, and reinstall spacy: %pip install --force-reinstall "spacy>=3.7,<4.0"