Cannot build 2.7 with --enable-unicode=no

[amauryfa]

BPO	17979
Nosy	@malemburg, @amauryfa, @ezio-melotti, @serhiy-storchaka
Files	re_nounicode.patch

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = 'https://github.com/serhiy-storchaka'
closed_at = <Date 2013-05-21.19:59:39.453>
created_at = <Date 2013-05-14.23:27:00.945>
labels = ['extension-modules', 'expert-regex', 'type-bug', 'expert-unicode', 'build']
title = 'Cannot build 2.7 with --enable-unicode=no'
updated_at = <Date 2013-05-21.19:59:39.452>
user = 'https://github.com/amauryfa'

bugs.python.org fields:

activity = <Date 2013-05-21.19:59:39.452>
actor = 'serhiy.storchaka'
assignee = 'serhiy.storchaka'
closed = True
closed_date = <Date 2013-05-21.19:59:39.453>
closer = 'serhiy.storchaka'
components = ['Build', 'Extension Modules', 'Regular Expressions', 'Unicode']
creation = <Date 2013-05-14.23:27:00.945>
creator = 'amaury.forgeotdarc'
dependencies = []
files = ['30290']
hgrepos = []
issue_num = 17979
keywords = ['patch']
message_count = 10.0
messages = ['189255', '189273', '189277', '189314', '189445', '189447', '189448', '189449', '189780', '189781']
nosy_count = 6.0
nosy_names = ['lemburg', 'amaury.forgeotdarc', 'ezio.melotti', 'mrabarnett', 'python-dev', 'serhiy.storchaka']
pr_nums = []
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue17979'
versions = ['Python 2.7']

[amauryfa]

python2.7 can't be compiled with --enable-unicode=no
Because of a crash in the re module. It's a regression from 2.7.3.

$ ./python -c 'import re; re.compile("([a-zA-Z][a-zA-Z0-9_]+)\s*=\s*(.*)")'
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/amauryfa/python/cpython2.7/Lib/re.py", line 190, in compile
    return _compile(pattern, flags)
  File "/home/amauryfa/python/cpython2.7/Lib/re.py", line 240, in _compile
    p = sre_compile.compile(pattern, flags)
  File "/home/amauryfa/python/cpython2.7/Lib/sre_compile.py", line 533, in compile
    groupindex, indexgroup
RuntimeError: invalid SRE code

The cause is in sre.h: when Py_USING_UNICODE is false, SRE_CODE is defined as "unsigned long" instead of "unsigned short"!

When this is fixed, the following modules did not compile:
_io _json _sqlite3 _ssl _testcapi
Which modules are supposed to work without unicode?

[malemburg]

Please note that the official way to build Python without Unicode
support is (see http://bugs.python.org/issue445762):

./configure --disable-unicode

See http://bugs.python.org/issue8767 for the most recent set of fixes
that were supplied to make it work again in Python 2.7.4.

If the above doesn't work, it's a bug (as well) - and has been for
quite a few releases. Technically, --disable-unicode is mapped to
--enable-unicode=no by configure.

I guess we'd need a buildbot to check whether --disable-unicode still
works, i.e. produces a Python version that compiles and passes
the basic tests.

[serhiy-storchaka]

I can't reproduce this when build with --disable-unicode.

[amauryfa]

Can't build here with after "./configure --disable-unicode".
Serhiy, which OS did you try? I'm running Debian 64bit, with gcc 4.6.3

[serhiy-storchaka]

Ubuntu 32-bit, gcc 4.6.3. The bug requires 64 bit.

This patch should fix it.

[malemburg]

On 17.05.2013 13:11, Serhiy Storchaka wrote:

Serhiy Storchaka added the comment:

Ubuntu 32-bit, gcc 4.6.3. The bug requires 64 bit.

This patch should fix it.

int and long are the same size on Linux 64-bit platforms.

You probably want to use "short" instead.

[malemburg]

On 17.05.2013 13:42, Marc-Andre Lemburg wrote:

Marc-Andre Lemburg added the comment:

On 17.05.2013 13:11, Serhiy Storchaka wrote:
>
> Serhiy Storchaka added the comment:
>
> Ubuntu 32-bit, gcc 4.6.3. The bug requires 64 bit.
>
> This patch should fix it.

int and long are the same size on Linux 64-bit platforms.

Sorry, scratch that. It's the same on Windows x64, not Linux x64.

You probably want to use "short" instead.

This should still be safer.

[serhiy-storchaka]

SRE_CODE should be at least 32-bit for support of long regexpes.

[python-dev]

New changeset 8408eed151eb by Serhiy Storchaka in branch '2.7':
Issue bpo-17979: Fixed the re module in build with --disable-unicode.
http://hg.python.org/cpython/rev/8408eed151eb