[I18n-sig] PEP 263 and Japanese native encodings

[Martin v. Loewis]

"M.-A. Lemburg" <mal@lemburg.com> writes:

> Martin's patch leaves these "minor" issues to the tokenizer 
> and that's good :-) 
> 
> I only wanted to give a very simple
> example of what the original idea was when I added "ASCII
> compatible encoding" to the PEP -- basically to simplify
> the coding parsing part.

In my implementation, the "ASCII superset" restriction is stronger,
though: the tokenizer needs to find the end of a string without
decoding it. That is not possible for some of the encodings that pass
your "ASCII superset" test.

Regards,
Martin