[Python-3000] How will unicode get used?
david.nospam.hopwood at blueyonder.co.uk
Thu Sep 21 21:41:54 CEST 2006
Fredrik Lundh wrote:
> David Hopwood wrote:
>>For example, "ö" can be represented either as the precomposed character U+00F6,
>>or as "o" followed by a combining diaeresis (U+006F U+0308).
> normalization is a good thing, though:
> (it would probably be a good idea to turn unicodedata.normalize into a
> method for the new unicode string type).
Normalization is certainly a good thing to support. But that's orthogonal to
my point above -- that some abstract characters are representable by sequences
of more than one code point, which must not be split, and that avoidance of such
splitting automatically also avoids splitting within a code point representation.
Note that some abstract characters needed for living languages are representable
*only* by combining sequences.
David Hopwood <david.nospam.hopwood at blueyonder.co.uk>
More information about the Python-3000