[Bug]: !pip install fastdup -Uq not working in Google colab #373
Description
What happened?
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. ipython 7.34.0 requires jedi>=0.16, which is not installed. google-colab 1.0.0 requires google-auth==2.38.0, but you have google-auth 2.29.0 which is incompatible. google-colab 1.0.0 requires requests==2.32.3, but you have requests 2.32.4 which is incompatible. thinc 8.3.6 requires numpy<3.0.0,>=2.0.0, but you have numpy 1.26.4 which is incompatible. firebase-admin 6.9.0 requires httpx[http2]==0.28.1, but you have httpx 0.26.0 which is incompatible. dataproc-spark-connect 0.8.3 requires tqdm>=4.67, but you have tqdm 4.66.3 which is incompatible. datasets 4.0.0 requires pyarrow>=15.0.0, but you have pyarrow 14.0.1 which is incompatible. umap-learn 0.5.9.post2 requires scikit-learn>=1.6, but you have scikit-learn 1.5.0 which is incompatible. pydrive2 1.21.3 requires cryptography<44, but you have cryptography 44.0.1 which is incompatible. pydrive2 1.21.3 requires pyOpenSSL<=24.2.1,>=19.1.0, but you have pyopenssl 25.1.0 which is incompatible. opencv-contrib-python 4.12.0.88 requires numpy<2.3.0,>=2; python_version >= "3.9", but you have numpy 1.26.4 which is incompatible. google-genai 1.27.0 requires httpx<1.0.0,>=0.28.1, but you have httpx 0.26.0 which is incompatible. bigframes 2.12.0 requires pyarrow>=15.0.2, but you have pyarrow 14.0.1 which is incompatible. opencv-python 4.12.0.88 requires numpy<2.3.0,>=2; python_version >= "3.9", but you have numpy 1.26.4 which is incompatible. cudf-polars-cu12 25.6.0 requires polars<1.29,>=1.25, but you have polars 0.20.0 which is incompatible.
What did you expect to see?
I was just expecting the example colab notebooks to run off-the-shelf
What version of fastdup were you runnning on?
'2.14'
What version of Python were you running on?
Python 3.9
Operating System
Operating System: Linux OS Release: 6.1.123+ OS Version: #1 SMP PREEMPT_DYNAMIC Sun Mar 30 16:01:29 UTC 2025
Reproduction steps
The colab notebook example shared here: https://colab.research.google.com/github/visual-layer/fastdup/blob/main/examples/finding-removing-duplicates.ipynb#scrollTo=8e6dd3e6-0f72-456b-9b16-2e53d5d5c099
Relevant log output
``ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
ipython 7.34.0 requires jedi>=0.16, which is not installed.
google-colab 1.0.0 requires google-auth==2.38.0, but you have google-auth 2.29.0 which is incompatible.
google-colab 1.0.0 requires requests==2.32.3, but you have requests 2.32.4 which is incompatible.
thinc 8.3.6 requires numpy<3.0.0,>=2.0.0, but you have numpy 1.26.4 which is incompatible.
firebase-admin 6.9.0 requires httpx[http2]==0.28.1, but you have httpx 0.26.0 which is incompatible.
dataproc-spark-connect 0.8.3 requires tqdm>=4.67, but you have tqdm 4.66.3 which is incompatible.
datasets 4.0.0 requires pyarrow>=15.0.0, but you have pyarrow 14.0.1 which is incompatible.
umap-learn 0.5.9.post2 requires scikit-learn>=1.6, but you have scikit-learn 1.5.0 which is incompatible.
pydrive2 1.21.3 requires cryptography<44, but you have cryptography 44.0.1 which is incompatible.
pydrive2 1.21.3 requires pyOpenSSL<=24.2.1,>=19.1.0, but you have pyopenssl 25.1.0 which is incompatible.
opencv-contrib-python 4.12.0.88 requires numpy<2.3.0,>=2; python_version >= "3.9", but you have numpy 1.26.4 which is incompatible.
google-genai 1.27.0 requires httpx<1.0.0,>=0.28.1, but you have httpx 0.26.0 which is incompatible.
bigframes 2.12.0 requires pyarrow>=15.0.2, but you have pyarrow 14.0.1 which is incompatible.
opencv-python 4.12.0.88 requires numpy<2.3.0,>=2; python_version >= "3.9", but you have numpy 1.26.4 which is incompatible.
cudf-polars-cu12 25.6.0 requires polars<1.29,>=1.25, but you have polars 0.20.0 which is incompatible.``Attach a screenshot [Optional]
No response
Contact Details [Optional]
No response