Convert test_tokenize to unittests

[serhiy-storchaka]

BPO	25317
Nosy	@pitrou, @ericvsmith, @ezio-melotti, @voidspace, @meadori, @serhiy-storchaka
Files	test_tokenize.patch

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = 'https://github.com/serhiy-storchaka'
closed_at = <Date 2015-10-06.15:56:23.201>
created_at = <Date 2015-10-05.09:37:57.732>
labels = ['type-feature', 'tests']
title = 'Convert test_tokenize to unittests'
updated_at = <Date 2015-10-06.15:56:23.201>
user = 'https://github.com/serhiy-storchaka'

bugs.python.org fields:

activity = <Date 2015-10-06.15:56:23.201>
actor = 'serhiy.storchaka'
assignee = 'serhiy.storchaka'
closed = True
closed_date = <Date 2015-10-06.15:56:23.201>
closer = 'serhiy.storchaka'
components = ['Tests']
creation = <Date 2015-10-05.09:37:57.732>
creator = 'serhiy.storchaka'
dependencies = []
files = ['40680']
hgrepos = []
issue_num = 25317
keywords = ['patch']
message_count = 3.0
messages = ['252312', '252317', '252399']
nosy_count = 7.0
nosy_names = ['pitrou', 'eric.smith', 'ezio.melotti', 'michael.foord', 'meador.inge', 'python-dev', 'serhiy.storchaka']
pr_nums = []
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'enhancement'
url = 'https://bugs.python.org/issue25317'
versions = ['Python 2.7', 'Python 3.4', 'Python 3.5', 'Python 3.6']

[serhiy-storchaka]

A large part of test_tokenize is doctests. Doctests are less powerful than unittests, and error reporting in doctests is less informative than in unittests. Proposed patch converts doctests to unittests.

[ericvsmith]

+1

[python-dev]

New changeset 7b2af8ee6dfa by Serhiy Storchaka in branch '2.7':
Issue bpo-25317: Converted doctests in test_tokenize to unittests.
https://hg.python.org/cpython/rev/7b2af8ee6dfa

New changeset d272f3cbae05 by Serhiy Storchaka in branch '3.4':
Issue bpo-25317: Converted doctests in test_tokenize to unittests.
https://hg.python.org/cpython/rev/d272f3cbae05

New changeset bff40616d2a5 by Serhiy Storchaka in branch '3.5':
Issue bpo-25317: Converted doctests in test_tokenize to unittests.
https://hg.python.org/cpython/rev/bff40616d2a5

New changeset 66d239660997 by Serhiy Storchaka in branch 'default':
Issue bpo-25317: Converted doctests in test_tokenize to unittests.
https://hg.python.org/cpython/rev/66d239660997