public
Description: BSD licensed charset/encoding converter library with more function than libiconv
Homepage:
Clone URL: git://github.com/buganini/bsdconv.git
name age message
file Makefile Tue Sep 29 10:15:14 -0700 2009 remove obsolete aliases.map [buganini]
file Makefile.win Sun Sep 20 12:37:19 -0700 2009 put target meta back for header file [buganini]
file README Sun Oct 11 04:34:16 -0700 2009 win32 build can be found at github download pag... [buganini]
directory addons/ Mon Oct 12 07:50:29 -0700 2009 use raw:raw for default conversion [Buganini]
directory codecs/ Wed Oct 21 14:23:43 -0700 2009 improve inter/LOWER inter/UPPER support upside... [buganini]
directory src/ Sun Oct 11 03:24:01 -0700 2009 put license in each source file, new license is... [buganini]
directory wrapper/ Sun Oct 11 04:23:24 -0700 2009 bump version [buganini]
README
Table format:
from<tab>to

Internal encoding:
* Should be as unicoded as possible
* BSDCONV special chars are prefixed with 00
  * 0000 is used by RAW
* UNICODE is prefixed with 01
* CNS11643 is prefixed with 02

NOTICE:
Though many charset encoding is ascii-compatible,
 ascii is excluded from their codecs to provide flexibility.

--
Compiling & Installation (FreeBSD):
make
sudo make install

--
Run:
Convert traditional chinese big5 to simplified chinese utf-8
> bsdconv big5,ascii:chs:utf-8,ascii in.txt out.txt

Convert traditional chinese utf-8 to simplified chinese utf-8
> bsdconv utf-8,ascii:zhtw_normalize:cht:utf-8,ascii in.txt out.txt

Convert big5 data, traditional chinese to simplified chinese, 
CRLF/CR/LF to CRLF, to big5 data, translate simplified chinese words, which are
not in big5, to HTML entities
> bsdconv big5,ascii:chs,win:cp950,ascii,htmlentity in.txt out.txt

Very useful for migrating MySQL DB from Big5 to UTF-8
> bsdconv htmlentity,big5-5c,big5,ascii:utf-8,ascii in.sql out.sql

More example:
> bsdconv big5,ascii:nl2br:ascii,html-img in.txt out.htm
#html-img is actually ASCII-HTML-UNICODE-IMG

> bsdconv ascii,utf-8:ascii,ascii-html-cns11643-img in.txt out.htm
#if you prefer to use glyph image from http://www.cns11643.gov.tw

Maintain inter map:
> bsdconv bsdconv_keyword,bsdconv:bsdconv_keyword,utf-8,ascii MAP.txt edit.tmp
> vi edit.tmp
> bsdconv bsdconv_keyword,ascii,utf-8:bsdconv_keyword,bsdconv edit.tmp MAP.txt

--
WINDOWS:
http://github.com/buganini/bsdconv/downloads
Download and extract it, then goto build/ and run mk_table.bat
then copy everythings in build/ to c:\bsdconv\

--
If you want to install to directory other than default path
set BSDCONV_PATH environment variable to your path