ord() doesn't show complete UNICODE

[AlecTaylor]

BPO	11833
Nosy	@ezio-melotti

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2011-04-12.05:36:00.398>
created_at = <Date 2011-04-12.03:42:42.662>
labels = ['type-bug', 'invalid', 'expert-unicode']
title = "ord() doesn't show complete UNICODE"
updated_at = <Date 2011-04-12.05:36:00.397>
user = 'https://bugs.python.org/AlecTaylor'

bugs.python.org fields:

activity = <Date 2011-04-12.05:36:00.397>
actor = 'ezio.melotti'
assignee = 'none'
closed = True
closed_date = <Date 2011-04-12.05:36:00.398>
closer = 'ezio.melotti'
components = ['Unicode']
creation = <Date 2011-04-12.03:42:42.662>
creator = 'AlecTaylor'
dependencies = []
files = []
hgrepos = []
issue_num = 11833
keywords = []
message_count = 4.0
messages = ['133560', '133561', '133564', '133565']
nosy_count = 2.0
nosy_names = ['ezio.melotti', 'AlecTaylor']
pr_nums = []
priority = 'normal'
resolution = 'not a bug'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue11833'
versions = ['Python 2.6', 'Python 2.5', 'Python 3.1', 'Python 2.7', 'Python 3.2', 'Python 3.3', 'Python 3.4']

[AlecTaylor]

Unfortunately ord() doesn't show complete UNICODE. This can cause incorrectness problems.

>>> ord('—')
151
>>> ord('¥')
165

Proof: Type Alt+0151, then type Alt+151. They should give you — and ù respectively.

Please correct the UNICODE numbering.

Thanks,

Alec Taylor

[ezio-melotti]

For the chars you pasted, on Python 3 I get:
>>> ord('—')  # U+2014 EM DASH
8212
>>> ord('¥')  # U+00A5 YEN SIGN
165

If I type alt+8212 I get '—' and if I type alt+0165 I get '¥'.
What version of Python are you using and on what OS?

[AlecTaylor]

Python 2.7.1, Win7 64-bit

[ezio-melotti]

The problem is not with ord() but with the stdin encoding used by the windows terminal.
If you write a non-ASCII character (e.g. '¥') in the windows terminal with Python 2 without using the u'' prefix, it will be encoded with the encoding specified by sys.stdin.encoding. If this encoding is a single-byte encoding (e.g. cp850) the result for non-ASCII character might be misleading.
If you want the correct result use ord(u'—') and ord(u'¥').