[issue14811] compile fails - UTF-8 character decoding

[Serhiy Storchaka]

Serhiy Storchaka <storchaka at gmail.com> added the comment:

Function decoding_fgets (Parser/tokenizer.c) reads line in buffer of fixed size 8192 (line truncated to size 8191) and then fails because line is cut in the middle of a multibyte UTF-8 character.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue14811>
_______________________________________