Skip to content

Latest commit

 

History

History
66 lines (52 loc) · 5.15 KB

_pub_2012_06_perlunicook-further-resources.md

File metadata and controls

66 lines (52 loc) · 5.15 KB
Raw

{ "slug" : "/pub/2012/06/perlunicook-further-resources.html", "description" : "This series has shown you several features of Unicode by example, as well as several techniques for working with Unicode correctly and easily with recent releases of Perl 5. By now you know more than many programmers do about Unicode,...", "draft" : null, "authors" : [ "tom-christiansen" ], "tags" : [], "thumbnail" : "/images/_pub_2012_04_perlunicook-standard-preamble/unicode.jpg", "date" : "2012-06-29T06:00:01-08:00", "categories" : "unicode", "image" : null, "title" : "Perl Unicode Cookbook: Further Resources" }

This series has shown you several features of Unicode by example, as well as several techniques for working with Unicode correctly and easily with recent releases of Perl 5. By now you know more than many programmers do about Unicode, but your journey to mastery continues.

Perl 5 includes several pieces of documentation which explain Unicode and Perl's Unicode support. See [perlunicode]({{<mcpan "perlunicode" >}}), [perluniprops]({{<mcpan "perluniprops" >}}), [perlre]({{<mcpan "perlre" >}}), [perlrecharclass]({{<mcpan "perlrecharclass" >}}), [perluniintro]({{<mcpan "perluniintro" >}}), [perlunitut]({{<mcpan "perlunitut" >}}) and [perlunifaq]({{<mcpan "perlunifaq" >}}).

Perl 5 and the CPAN provide several modules and distributions to allow the effective use of Unicode. As of Perl 5.16, many of these are in the core library. Many of them work just as well with earlier versions of Perl 5, though for the best and most correct support for Unicode as a whole, consider using Perl 5.14 or 5.16.

These modules include:

  • [PerlIO]({{<mcpan "PerlIO" >}})
  • [DB_File]({{<mcpan "DB_File" >}})
  • [DBM_Filter]({{<mcpan "DBM_Filter" >}})
  • [DBM_Filter::utf8]({{<mcpan "DBM_Filter::utf8" >}})
  • [Encode]({{<mcpan "Encode" >}})
  • [Encode::Locale]({{<mcpan "Encode::Locale" >}})
  • [Unicode::UCD]({{<mcpan "Unicode::UCD" >}})
  • [Unicode::Normalize]({{<mcpan "Unicode::Normalize" >}})
  • [Unicode::GCString]({{<mcpan "Unicode::GCString" >}})
  • [Unicode::LineBreak]({{<mcpan "Unicode::LineBreak" >}})
  • [Unicode::Collate]({{<mcpan "Unicode::Collate" >}})
  • [Unicode::Collate::Locale]({{<mcpan "Unicode::Collate::Locale" >}})
  • [Unicode::Unihan]({{<mcpan "Unicode::Unihan" >}})
  • [Unicode::CaseFold]({{<mcpan "Unicode::CaseFold" >}})
  • [Unicode::Tussle]({{<mcpan "Unicode::Tussle" >}})
  • [Lingua::JA::Romanize::Japanese]({{<mcpan "Lingua::JA::Romanize::Japanese" >}})
  • [Lingua::ZH::Romanize::Pinyin]({{<mcpan "Lingua::ZH::Romanize::Pinyin" >}})
  • [Lingua::KO::Romanize::Hangul]({{<mcpan "Lingua::KO::Romanize::Hangul" >}})

The CPAN distribution [Unicode::Tussle]({{<mcpan "Unicode::Tussle" >}}) module includes many command-line programs to help with working with Unicode, including these programs to fully or partly replace standard utilities: tcgrep instead of egrep, uniquote instead of cat -v or hexdump, uniwc instead of wc, unilook instead of look, unifmt instead of fmt, and ucsort instead of sort. For exploring Unicode character names and character properties, see its uniprops, unichars, and uninames programs. It also supplies these programs, all of which are general filters that do Unicode-y things: unititle and unicaps; uniwide and uninarrow; unisupers and unisubs; nfd, nfc, nfkd, and nfkc; and uc, lc, and tc.

Finally, see the published Unicode Standard (page numbers are from version 6.0.0), including these specific annexes and technical reports:

Tom Christiansen <tchrist@perl.com> wrote this series, with occasional kibbitzing from Larry Wall and Jeffrey Friedl in the background.

Most of these examples came from the current edition of the "Camel Book"; that is, from the 4th Edition of Programming Perl, Copyright © 2012 Tom Christiansen et al., 2012-02-13 by O'Reilly Media. The code itself is freely redistributable, and you are encouraged to transplant, fold, spindle, and mutilate any of the examples in this series however you please for inclusion into your own programs without any encumbrance whatsoever. Acknowledgement via code comment is polite but not required.

Previous: ℞ 44: Demo of Unicode Collation and Printing

Series Index: The Standard Preamble