[Python-Dev] PEP 393 Summer of Code Project

[Stephen J. Turnbull]

Antoine Pitrou writes:

 > Sorry, what is a conformant UTF-16 array op?

For starters, one that doesn't ever return lone surrogates, but rather
interprets surrogate pairs as Unicode code points as in UTF-16.  (This
is not a Unicode standard definition, it's intended to be suggestive
of why many app writers will be distressed if they must use Python
unicode/str in a narrow build without a fairly comprehensive library
that wraps the arrays in operations that treat unicode/str as an array
of code points.)