distutils is removed in Python 3.12 #2869

cclauss · 2023-06-13T14:12:56Z

EDIT: This issue was closed via nodejs/gyp-next#214 which is available in node-gyp v10+.

distutils is deprecated with removal planned for Python 3.12. See the What’s New entry for more information.

Our only current use of Python distutils is at:

node-gyp/gyp/pylib/gyp/input.py

Line 19 in 33391db

from distutils.version import StrictVersion

node-gyp/gyp/pylib/gyp/input.py

Line 1186 in 33391db

env = {"__builtins__": {}, "v": StrictVersion}

As discussed in https://stackoverflow.com/questions/11887762, we should replace distutils.version.StrictVersion with packaging.version.parse.

The text was updated successfully, but these errors were encountered:

cclauss · 2023-07-24T13:54:43Z

@rzhao271 or @dhruvmanila -- Any interest in fixing this one?

rzhao271 · 2023-07-26T16:22:49Z

I'm interested, though it'll have to be on my own time.

cclauss · 2023-07-26T18:47:39Z

#2888 Needs help to pass test…

cclauss · 2023-08-25T14:01:53Z

This is becoming more urgent now that Python 3.12 is a release candidate.

https://docs.python.org/dev/whatsnew/3.12.html
misc: Add Python v3.12 to the testing #2862 demonstrates the problem
Replace uses of python distutils library #2888 is not yet a solution

sibelius · 2023-08-31T10:56:16Z

this is breaking for me

cclauss · 2023-08-31T11:06:28Z

Py3.12 is still pre-release. Please try to copy the pylib/gyp/input.py changes from nodejs/gyp-next#201 and let us know if that unblocks you.

nikolay · 2023-10-02T22:53:27Z

@cclauss Python 3.12 got released and now node-gyp works no more!

rzhao271 · 2023-10-02T23:05:30Z

The upstream fix still hasn't been merged nodejs/gyp-next#197

Steveorevo · 2023-10-04T00:24:37Z

This is also broken for me. Simply create an electron forge app and then attempt to use something trivial like:

require('deasync').sleep(1000);
console.log('Hello world');

I'm greeted with:

File node_modules\node-gyp\gyp\pylib\gyp\input.py", line 19, in <module>
  from distutils.version import StrictVersion
  ModuleNotFoundError: No module named 'distutils'
  Error: `gyp` failed with exit code: 1
  
An unhandled rejection has occurred inside Forge:
Error: node-gyp failed to rebuild '... \resources\app\node_modules\deasync'

cclauss · 2023-10-04T17:34:53Z

@rzhao271 @dhruvmanila @zooba Node.js node-gyp is still broken on Python 3.12 on Windows. See these attempts to fix #2869 (comment). I am not a Windows person so I cannot debug.

jurijsk · 2023-10-04T19:03:29Z

Python 3.12 released on Oct 2nd and got it by default with other tooling and nothing is working now because distutils is removed

nikolay · 2023-10-04T19:22:54Z

@jurijsk It's sad, as we knew Python was removing it and have done nothing about it!

pplmx · 2023-10-16T09:45:51Z

Any progress? On Windows, node-gyp cannot work on Python 3.12 now.

GorlikItsMe · 2023-10-17T08:29:27Z

Same issue here (Windows, python 3.12.0)

birdzai · 2023-10-17T23:32:27Z

Doesn't work on Mac either

iki · 2023-10-18T07:58:45Z

The upstream fix still hasn't been merged nodejs/gyp-next#197

@rzhao271 upstream was merged since that

🤖 Release is at https://github.com/nodejs/gyp-next/releases/tag/v0.15.1 🌻

cclauss · 2023-10-18T08:05:29Z

I will work on vendoring in packaging today.

cclauss · 2023-10-18T23:24:46Z

EDIT: This advice was for node-gyp < v10 but is not required for later versions.

If some of you are frustrated then please do python3 -m pip install packaging and report back here if that fixes things.

Other activities blocked vendoring effort today but I will dig in with my first coffee tomorrow.

nzikic · 2023-10-19T14:57:32Z

If some of you are frustrated then please do python3 -m pip install packaging and report back here if that fixes things.

Other activities blocked vendoring effort today but I will dig in with my first coffee tomorrow.

This fixes the issue for me, thanks!

nodejs/node-gyp#2869

* Fix compilation Amends commit 7f70d25. * CI: Workaround node-gyp issue nodejs/node-gyp#2869

* recipes using node-gyp-native fail to build after python3 was updated to 3.12 in: https://git.openembedded.org/openembedded-core/commit/?id=716d82352545d3667a658b69d65d6127678dd150 * we need the fix from: nodejs/node-gyp#2869 Signed-off-by: Martin Jansa <martin.jansa@gmail.com>

:Release Notes: recipes using node-gyp-native fail to build after python3 was updated to 3.12 in: https://git.openembedded.org/openembedded-core/commit/?id=716d82352545d3667a658b69d65d6127678dd150 :Detailed Notes: we need the fix from: nodejs/node-gyp#2869 Fixes: nodejs-module-webos-sysbus http://gecko.lge.com:8000/Errors/Details/763462 nodejs-module-webos-pmlog http://gecko.lge.com:8000/Errors/Details/763463 nodejs-module-webos-dynaload http://gecko.lge.com:8000/Errors/Details/763464 Traceback (most recent call last): File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/gyp_main.py", line 42, in <module> import gyp # noqa: E402 ^^^^^^^^^^ File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 9, in <module> import gyp.input File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/pylib/gyp/input.py", line 19, in <module> from distutils.version import StrictVersion ModuleNotFoundError: No module named 'distutils' :Testing Performed: Only build tested. :QA Notes: No change to image. :Issues Addressed: [WRP-29491] Create GPVB with Yocto 5.0 Scarthgap Change-Id: I5bbcf7246499edfaa6141890c70d0a7a257be36f

* recipes using node-gyp-native fail to build after python3 was updated to 3.12 in: https://git.openembedded.org/openembedded-core/commit/?id=716d82352545d3667a658b69d65d6127678dd150 * we need the fix from: nodejs/node-gyp#2869 Signed-off-by: Martin Jansa <martin.jansa@gmail.com>

:Release Notes: recipes using node-gyp-native fail to build after python3 was updated to 3.12 in: https://git.openembedded.org/openembedded-core/commit/?id=716d82352545d3667a658b69d65d6127678dd150 :Detailed Notes: we need the fix from: nodejs/node-gyp#2869 Fixes: nodejs-module-webos-sysbus http://gecko.lge.com:8000/Errors/Details/763462 nodejs-module-webos-pmlog http://gecko.lge.com:8000/Errors/Details/763463 nodejs-module-webos-dynaload http://gecko.lge.com:8000/Errors/Details/763464 Traceback (most recent call last): File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/gyp_main.py", line 42, in <module> import gyp # noqa: E402 ^^^^^^^^^^ File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 9, in <module> import gyp.input File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/pylib/gyp/input.py", line 19, in <module> from distutils.version import StrictVersion ModuleNotFoundError: No module named 'distutils' :Testing Performed: Only build tested. :QA Notes: No change to image. :Issues Addressed: [WRP-29491] Create GPVB with Yocto 5.0 Scarthgap Change-Id: I5bbcf7246499edfaa6141890c70d0a7a257be36f

martin-braun · 2024-01-27T20:46:22Z

EDIT: This advice was for node-gyp < v10 but is not required for later versions.

If some of you are frustrated then please do python3 -m pip install packaging and report back here if that fixes things.

Other activities blocked vendoring effort today but I will dig in with my first coffee tomorrow.

Wasn't working for me in the case of installing @signalapp/better-sqlite3, but doing pip install setuptools solved it for me.

WiseLibs/better-sqlite3#1093

voidmain443 · 2024-02-02T05:26:16Z

I am using python3.12 for venv and I have a same problem with execute pandas_datareader.

cclauss · 2024-02-02T07:53:58Z

Please look at your error log and ensure it contains the line gyp info using node-gyp@10.0.1.

Some have said that pip install setuptools is a quick fix.

https://github.com/pydata/pandas-datareader has not been released to PyPI since 2021 and is currently failing its Continuous Integration tests so you will need to seek help on that repo...

Future release(s) of pandas-datareader pydata/pandas-datareader#977 (comment)

:Release Notes: recipes using node-gyp-native fail to build after python3 was updated to 3.12 in: https://git.openembedded.org/openembedded-core/commit/?id=716d82352545d3667a658b69d65d6127678dd150 :Detailed Notes: we need the fix from: nodejs/node-gyp#2869 Fixes: nodejs-module-webos-sysbus http://gecko.lge.com:8000/Errors/Details/763462 nodejs-module-webos-pmlog http://gecko.lge.com:8000/Errors/Details/763463 nodejs-module-webos-dynaload http://gecko.lge.com:8000/Errors/Details/763464 Traceback (most recent call last): File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/gyp_main.py", line 42, in <module> import gyp # noqa: E402 ^^^^^^^^^^ File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 9, in <module> import gyp.input File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/pylib/gyp/input.py", line 19, in <module> from distutils.version import StrictVersion ModuleNotFoundError: No module named 'distutils' :Testing Performed: Only build tested. :QA Notes: No change to image. :Issues Addressed: [WRP-29491] Create GPVB with Yocto 5.0 Scarthgap Change-Id: I5bbcf7246499edfaa6141890c70d0a7a257be36f

federicoWax · 2024-02-15T03:38:49Z

pip install setuptools

Tengo dos semanas buscando el bug porque no podia correr tensorflow/tfjs muchas gracias!

I've been looking for this solution for two weeks because I couldn't run tensorflow/tfjs, thank you very much!

:Release Notes: recipes using node-gyp-native fail to build after python3 was updated to 3.12 in: https://git.openembedded.org/openembedded-core/commit/?id=716d82352545d3667a658b69d65d6127678dd150 :Detailed Notes: we need the fix from: nodejs/node-gyp#2869 Fixes: nodejs-module-webos-sysbus http://gecko.lge.com:8000/Errors/Details/763462 nodejs-module-webos-pmlog http://gecko.lge.com:8000/Errors/Details/763463 nodejs-module-webos-dynaload http://gecko.lge.com:8000/Errors/Details/763464 Traceback (most recent call last): File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/gyp_main.py", line 42, in <module> import gyp # noqa: E402 ^^^^^^^^^^ File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 9, in <module> import gyp.input File "nodejs-module-webos-dynaload/3.0.2-4/recipe-sysroot-native/usr/lib/node_modules/node-gyp/gyp/pylib/gyp/input.py", line 19, in <module> from distutils.version import StrictVersion ModuleNotFoundError: No module named 'distutils' :Testing Performed: Only build tested. :QA Notes: No change to image. :Issues Addressed: [WRP-29491] Create GPVB with Yocto 5.0 Scarthgap Change-Id: I5bbcf7246499edfaa6141890c70d0a7a257be36f

RubTalha · 2024-02-27T09:11:33Z

https://stackoverflow.com/a/76691103/13086128

cclauss · 2024-02-27T10:24:01Z

This issue was closed via nodejs/gyp-next#214 which is available in node-gyp v10+.

This was referenced Jun 13, 2023

misc: Add Python v3.12 to the testing #2862

Closed

Add Python 3.12 beta 1 to testing nodejs/gyp-next#196

Closed

punkeel mentioned this issue Jun 27, 2023

🐛 BUG: create cloudflare fails on better-sqlite3 (with python 3.12) cloudflare/workers-sdk#3531

Closed

AdamMajer mentioned this issue Aug 10, 2023

distutils package deprecation warning in configure.py nodejs/node#42186

Open

PF4Public mentioned this issue Sep 13, 2023

net-im/element-desktop: not py3.12 compatible, doesn't respect PYTHON_TARGETS PF4Public/gentoo-overlay#247

Closed

triallax mentioned this issue Oct 11, 2023

nodejs FTBFS with Python 3.12 void-linux/void-packages#46592

Closed

bertyhell mentioned this issue Oct 11, 2023

Warn about Python v3.12 not working on windows #2912

Closed

4 tasks

hovancik mentioned this issue Oct 13, 2023

Improve DND detection across platforms hovancik/stretchly#1383

Merged

cclauss mentioned this issue Oct 18, 2023

nodejs-windows: python -m pip install packaging nodejs/gyp-next#213

Closed

per1234 mentioned this issue Oct 19, 2023

Correct conditional logic for publishing steps of build workflow arduino/arduino-ide#2261

Merged

kittaakos mentioned this issue Oct 19, 2023

CI: Windows builds must pin Python to 3.11 eclipse-theia/theia#13008

Closed

orgads added a commit to orgads/isolated-vm that referenced this issue Jan 16, 2024

CI: Workaround node-gyp issue

955d2a2

nodejs/node-gyp#2869

laverdet pushed a commit to laverdet/isolated-vm that referenced this issue Jan 16, 2024

CI: Workaround node-gyp issue (#439)

c96a618

* Fix compilation Amends commit 7f70d25. * CI: Workaround node-gyp issue nodejs/node-gyp#2869

yfdyh000 mentioned this issue Jan 19, 2024

npm install sqlite3 fail if prebuilt unreachable and Python v3.12 is installed TryGhost/node-sqlite3#1752

Open

greysoh mentioned this issue Jan 20, 2024

CustomTkinter not compatible with Python 3.12 blockbusterkit6/Youtube-downloader-GUI#2

Closed

cclauss mentioned this issue Jan 23, 2024

[DOCS] The latest version of python (3.12) doesn't support node-gyp #7161 #2966

Closed

moeller0 mentioned this issue Jan 25, 2024

flent and python 3.12 tohojo/flent#296

Closed

martin-braun mentioned this issue Jan 27, 2024

[BUG] Windows: better-sqlite3 can't be compiled, because distutils is missing oxen-io/session-desktop#3013

Closed

3 tasks

edisonyan mentioned this issue Feb 1, 2024

Unable to install in the Python 3.12 curlconverter/curlconverter#628

Open

JonasBa mentioned this issue Feb 2, 2024

build(ci): Bump action dependencies for node profiling getsentry/sentry-javascript#10473

Merged

bimalkjha mentioned this issue Feb 4, 2024

Node ibm_db Installation Error with Python 3.12 ibmdb/node-ibm_db#981

Closed

nodejs locked as resolved and limited conversation to collaborators Feb 27, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

distutils is removed in Python 3.12 #2869

distutils is removed in Python 3.12 #2869

cclauss commented Jun 13, 2023 •

edited

Loading

cclauss commented Jul 24, 2023

rzhao271 commented Jul 26, 2023

cclauss commented Jul 26, 2023

cclauss commented Aug 25, 2023 •

edited

Loading

sibelius commented Aug 31, 2023

cclauss commented Aug 31, 2023 •

edited

Loading

nikolay commented Oct 2, 2023

rzhao271 commented Oct 2, 2023

Steveorevo commented Oct 4, 2023 •

edited

Loading

cclauss commented Oct 4, 2023 •

edited

Loading

jurijsk commented Oct 4, 2023

nikolay commented Oct 4, 2023

pplmx commented Oct 16, 2023 •

edited

Loading

GorlikItsMe commented Oct 17, 2023

birdzai commented Oct 17, 2023

iki commented Oct 18, 2023

cclauss commented Oct 18, 2023 •

edited

Loading

cclauss commented Oct 18, 2023 •

edited

Loading

nzikic commented Oct 19, 2023

martin-braun commented Jan 27, 2024

voidmain443 commented Feb 2, 2024

cclauss commented Feb 2, 2024 •

edited

Loading

federicoWax commented Feb 15, 2024 •

edited by cclauss

Loading

RubTalha commented Feb 27, 2024

cclauss commented Feb 27, 2024 •

edited

Loading

distutils is removed in Python 3.12 #2869

distutils is removed in Python 3.12 #2869

Comments

cclauss commented Jun 13, 2023 • edited Loading

EDIT: This issue was closed via nodejs/gyp-next#214 which is available in node-gyp v10+.

cclauss commented Jul 24, 2023

rzhao271 commented Jul 26, 2023

cclauss commented Jul 26, 2023

cclauss commented Aug 25, 2023 • edited Loading

sibelius commented Aug 31, 2023

cclauss commented Aug 31, 2023 • edited Loading

nikolay commented Oct 2, 2023

rzhao271 commented Oct 2, 2023

Steveorevo commented Oct 4, 2023 • edited Loading

cclauss commented Oct 4, 2023 • edited Loading

jurijsk commented Oct 4, 2023

nikolay commented Oct 4, 2023

pplmx commented Oct 16, 2023 • edited Loading

GorlikItsMe commented Oct 17, 2023

birdzai commented Oct 17, 2023

iki commented Oct 18, 2023

cclauss commented Oct 18, 2023 • edited Loading

cclauss commented Oct 18, 2023 • edited Loading

nzikic commented Oct 19, 2023

martin-braun commented Jan 27, 2024

voidmain443 commented Feb 2, 2024

cclauss commented Feb 2, 2024 • edited Loading

federicoWax commented Feb 15, 2024 • edited by cclauss Loading

RubTalha commented Feb 27, 2024

cclauss commented Feb 27, 2024 • edited Loading

cclauss commented Jun 13, 2023 •

edited

Loading

cclauss commented Aug 25, 2023 •

edited

Loading

cclauss commented Aug 31, 2023 •

edited

Loading

Steveorevo commented Oct 4, 2023 •

edited

Loading

cclauss commented Oct 4, 2023 •

edited

Loading

pplmx commented Oct 16, 2023 •

edited

Loading

cclauss commented Oct 18, 2023 •

edited

Loading

cclauss commented Oct 18, 2023 •

edited

Loading

cclauss commented Feb 2, 2024 •

edited

Loading

federicoWax commented Feb 15, 2024 •

edited by cclauss

Loading

cclauss commented Feb 27, 2024 •

edited

Loading