future unicode literals and r'\u'

[pooryorick]

BPO	5447
Nosy	@benjaminp, @florentx
Superseder	bpo-2570: backport 3.0-style \u/\U processing in raw strings when unicode_literals is imported from future
Files	raw-unicode-literals.patch

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2010-04-01.11:44:21.581>
created_at = <Date 2009-03-08.20:11:31.466>
labels = ['interpreter-core', 'type-feature']
title = "future unicode literals and r'\\u'"
updated_at = <Date 2010-04-01.11:45:37.808>
user = 'https://bugs.python.org/pooryorick'

bugs.python.org fields:

activity = <Date 2010-04-01.11:45:37.808>
actor = 'flox'
assignee = 'none'
closed = True
closed_date = <Date 2010-04-01.11:44:21.581>
closer = 'flox'
components = ['Interpreter Core']
creation = <Date 2009-03-08.20:11:31.466>
creator = 'pooryorick'
dependencies = []
files = ['13280']
hgrepos = []
issue_num = 5447
keywords = ['patch']
message_count = 4.0
messages = ['83326', '83327', '83363', '102084']
nosy_count = 4.0
nosy_names = ['pooryorick', 'benjamin.peterson', 'zhirsch', 'flox']
pr_nums = []
priority = 'normal'
resolution = 'duplicate'
stage = None
status = 'closed'
superseder = '2570'
type = 'enhancement'
url = 'https://bugs.python.org/issue5447'
versions = ['Python 2.7']

[pooryorick]

from __future__ import unicode_literals
print(r'\u.bug')

SyntaxError: (unicode error) truncated \uXXXX

[benjaminp]

This happens with unicode literals even without "from __future__ import
unicode_literals" because raw strings still have \u escapes interpreted.
This isn't true in 3.0, so it would be nice to disable it with
unicode_literals.

[zhirsch]

I've hit this, too, and it's annoyed me. So here's a patch against trunk
that should fix it.

The idea is: whenever unicode_literals are turned on (or the -U command
line flag is passed), to convert r"\u" to "\u005c\u0075" and r"\U" to
"\u005c\u0055" for every string literal in the source file before
passing the string to PyUnicode_DecodeRawUnicodeEscape.

[florentx]

Duplicate of bpo-2570.