Skip to content

Unicode Test Suite v1.0

Choose a tag to compare

View all tags
@amrali-eg amrali-eg released this 03 Aug 16:33
· 13 commits to main since this release
v1.0
d93922c
social_banner

Unicode Test Suite v1.0

Initial public release.

Highlights

  • Deterministic, reproducible benchmark corpus
  • ~1,300 verified test files
  • 51 Unicode and legacy encodings
  • Automatic post-generation verification
  • SHA-256 integrity verification
  • Stable document identifiers
  • Machine-readable manifest
  • Cross-platform corpus
  • MIT licensed generator

See the README for complete documentation.

Downloads

UnicodeTestSuite-v1.0.zip

Pre-generated benchmark corpus, ready for immediate use.

Contents:

  • Complete Unicode Test Suite corpus
  • ~1,300 verified test files
  • Manifest.csv
  • Manifest.sqlite
  • MasterHashes.sha256
  • CorpusCertificate.txt
  • Statistics.txt

No generation is required.

UnicodeTestSuiteGenerator-v1.0.zip

Generator source code used to build the corpus.

Contents:

  • GenerateCorpus.py
  • Generator source
  • Built-in canonical documents
  • Documentation
  • MIT License

Running the generator reproduces the corpus deterministically. The generated files and SHA-256 hashes are expected to be bit-identical to those included in UnicodeTestSuite-v1.0.zip.

Assets 4
Loading