[PATCH] Complete GB18030 charmap

[Bruno Haible]

Andreas Schwab wrote:
> > How did you develop the patch?
>
> From ICU
> (http://source.icu-project.org/repos/icu/data/trunk/charset/source/gb18030
> and
> http://source.icu-project.org/repos/icu/icu/trunk/source/data/mappings/gb18030.ucm)
>
> > What testing did you do with this patch?
>
> tst-tables.sh tests for consistency.

I have also tested this patch, checking the conversion table in both
directions (extracted through the attached programs) against the one that
will be used in the next release of libiconv.

The patch is perfect. It contains irreversible mappings
in the multibyte -> Unicode direction, for backward compatibility:

0x95329031	U+20087
0x95329033	U+20089
0x95329730	U+200CC
0x9536B937	U+215D7
0x9630BA35	U+2298F
0x9635B630	U+241FE

GNU libiconv also contains the following irreversible mappings
in the multibyte -> Unicode direction, also for backward compatibility:

0x82359037	U+9FB4
0x82359038	U+9FB5
0x82359039	U+9FB6
0x82359130	U+9FB7
0x82359131	U+9FB8
0x82359132	U+9FB9
0x82359133	U+9FBA
0x82359134	U+9FBB
0x84318236	U+FE10
0x84318237	U+FE11
0x84318238	U+FE12
0x84318239	U+FE13
0x84318330	U+FE14
0x84318331	U+FE15
0x84318332	U+FE16
0x84318333	U+FE17
0x84318334	U+FE18
0x84318335	U+FE19

These byte sequences can be contained in text files that were created
with previous versions of libiconv. But glibc did not support these byte
sequences (I tested glibc 2.9 and 2.11), therefore it is not really needed
that the glibc converter contains them.

In other words, thanks Andreas for having cleaned up the long standing
issues with this converter!

Bruno

-------------- next part --------------
A non-text attachment was scrubbed...
Name: table-from.c
Type: text/x-csrc
Size: 5534 bytes
Desc: not available
URL: <http://sourceware.org/pipermail/libc-alpha/attachments/20120513/9a666787/attachment.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: table-to.c
Type: text/x-csrc
Size: 3177 bytes
Desc: not available
URL: <http://sourceware.org/pipermail/libc-alpha/attachments/20120513/9a666787/attachment-0001.bin>