Python misbehaves when installed in / (patch attached)

[chrisarachsyscom]

BPO	1653457
Nosy	@iritkatriel
Dependencies	bpo-1644987: ./configure --prefix=/ breaks, won't build C modules
Files	Python-2.5.rootpath.patch: Patch for getpath.c

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2021-12-07.22:17:00.906>
created_at = <Date 2007-02-06.17:08:40.000>
labels = ['extension-modules', 'type-bug', 'build']
title = 'Python misbehaves when installed in / (patch attached)'
updated_at = <Date 2021-12-08.15:08:10.741>
user = 'https://bugs.python.org/chrisarachsyscom'

bugs.python.org fields:

activity = <Date 2021-12-08.15:08:10.741>
actor = 'chris@arachsys.com'
assignee = 'none'
closed = True
closed_date = <Date 2021-12-07.22:17:00.906>
closer = 'iritkatriel'
components = ['Build', 'Extension Modules']
creation = <Date 2007-02-06.17:08:40.000>
creator = 'chris@arachsys.com'
dependencies = ['1644987']
files = ['2294']
hgrepos = []
issue_num = 1653457
keywords = ['patch']
message_count = 7.0
messages = ['31197', '109877', '110024', '116605', '407977', '407979', '408015']
nosy_count = 3.0
nosy_names = ['chris@arachsys.com', 'schmir', 'iritkatriel']
pr_nums = []
priority = 'normal'
resolution = 'out of date'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue1653457'
versions = ['Python 3.1', 'Python 2.7', 'Python 3.2']

[chrisarachsyscom]

reduce() in getpath.c chops down a path to the empty string rather than to /. As a result, if you build python with --prefix='' in the usual way for software to be installed into /, it tries to find its libraries in the current directory instead of in /lib:

$ python
Could not find platform independent libraries <prefix>
Could not find platform dependent libraries <exec_prefix>
Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]
'import site' failed; use -v for traceback
Python 2.5 (r25:51908, Feb 6 2007, 16:15:42)
[GCC 3.4.3] on linux2
Type "help", "copyright", "credits" or "license" for more information.

>>

This is fixed by the attached patch.

$ python
Python 2.5 (r25:51908, Feb 6 2007, 16:19:38)
[GCC 3.4.3] on linux2
Type "help", "copyright", "credits" or "license" for more information.

>>

[BreamoreBoy]

I think the patch should be looked at very carefully as I guess that the reduce function is called all over the place.

[chrisarachsyscom]

Fortunately reduce() is static within getpath.c, so it should only be
necessary to check the handful of callers in there. I've done this, and
am reasonably sure it doesn't break anything.

In addition, I've given this patch quite a bit of empirical testing, at least under linux/glibc. This has been a persistent bug in Python since
2004 or earlier, and I've needed the attached fix on our Python builds
on all our production servers since then, rebasing for every release
from 2.4 to the new 2.7. (Our machines don't have legacy /usr dirs so
Python is installed to /bin and /lib.)

The exact patch I'm using right now against 2.7 is attached, but it's
essentially identical to the one I submitted originally against Python
2.4, and later against Python 2.5.

[BreamoreBoy]

Can someone with a Linux box try the latest patch please.

[iritkatriel]

getpath.c has been rewritten (see bpo-45582). reduce is no longer there.

[chrisarachsyscom]

Irit Katriel <iritkatriel@gmail.com> added the comment:

getpath.c has been rewritten (see bpo-45582). reduce is no longer there.

Gosh, this is one I originally reported back in the late 1990s and then
again mid-2000s! I've carried a patch in my distribution to make python
work in /bin and /lib/python for over 25 years - it'll feel like end of an
era to finally be able to drop that local patch. Thanks!

(Presumably this will land in Python 11 rather than get backported?)

Best wishes,
Chris.

[iritkatriel]

(Presumably this will land in Python 11 rather than get backported?)

I believe so.

it'll feel like end of an era to finally be able to drop that local patch.

You should mark the occasion somehow, it's not everyday you say goodbye to a 25 year old patch!