[Python-ideas] Py3 unicode impositions

Stephen J. Turnbull stephen at xemacs.org
Mon Feb 13 07:30:34 CET 2012

Sorry for the self-reply, but this should be clarified.

Stephen J. Turnbull writes:

 > know.  I occasionally get asked by Japanese people why files I send in
 > UTF-8 are broken; it invariably turns out that they sent me a file in
 > Shift JIS that contained a non-JIS (!) character and my software
 > translated it to REPLACEMENT CHARACTER before sending as UTF-8.

Ie, the breakage that you're likely to encounter in using UTF-8
wherever possible is *very* minor, and typically related to somebody
else failing to conform to standards.

More information about the Python-ideas mailing list