Skip to content

Commit

Permalink
closes bpo-37758: Extend unicodedata checksum tests to cover all of U…
Browse files Browse the repository at this point in the history
…nicode. (GH-15125)

Unicode has grown since Python first gained support for it,
when Unicode itself was still rather new.

This pair of test cases was added in commit 6a20ee7 back in 2000,
and they haven't needed to change much since then.  But do change
them to look beyond the Basic Multilingual Plane (range(0x10000))
and cover all 17 planes of Unicode's final form.

This adds about 5 seconds to the test suite's runtime.  Mark the
tests as CPU-using accordingly.
  • Loading branch information
gnprice authored and benjaminp committed Sep 12, 2019
1 parent a65678c commit 6954be8
Showing 1 changed file with 8 additions and 5 deletions.
13 changes: 8 additions & 5 deletions Lib/test/test_unicodedata.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,17 +11,18 @@
import sys
import unicodedata
import unittest
from test.support import open_urlresource, script_helper
from test.support import open_urlresource, requires_resource, script_helper


class UnicodeMethodsTest(unittest.TestCase):

# update this, if the database changes
expectedchecksum = '9129d6f2bdf008a81c2476e5b5127014a62130c1'
expectedchecksum = 'e728278035eb76cf92d86f07852266b0433f16a5'

@requires_resource('cpu')
def test_method_checksum(self):
h = hashlib.sha1()
for i in range(0x10000):
for i in range(sys.maxunicode + 1):
char = chr(i)
data = [
# Predicates (single char)
Expand Down Expand Up @@ -69,12 +70,14 @@ class UnicodeFunctionsTest(UnicodeDatabaseTest):

# Update this if the database changes. Make sure to do a full rebuild
# (e.g. 'make distclean && make') to get the correct checksum.
expectedchecksum = 'c44a49ca7c5cb6441640fe174ede604b45028652'
expectedchecksum = '4bcbf9df344114b1ebc95b904f4352dd250dff7e'

@requires_resource('cpu')
def test_function_checksum(self):
data = []
h = hashlib.sha1()

for i in range(0x10000):
for i in range(sys.maxunicode + 1):
char = chr(i)
data = [
# Properties
Expand Down

0 comments on commit 6954be8

Please sign in to comment.