[ python-Bugs-719888 ] tokenize module w/ coding cookie

[SourceForge.net]

Bugs item #719888, was opened at 2003-04-11 21:24
Message generated for change (Comment added) made by loewis
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=105470&aid=719888&group_id=5470

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: Unicode
Group: Python 2.3
Status: Open
Resolution: None
Priority: 5
Submitted By: Barry A. Warsaw (bwarsaw)
>Assigned to: Nobody/Anonymous (nobody)
Summary: tokenize module w/ coding cookie

Initial Comment:
The tokenize module should honor the coding cookie in a
file, probably so that it returns Unicode strings with
decoded characters.

----------------------------------------------------------------------

>Comment By: Martin v. Löwis (loewis)
Date: 2006-04-12 10:02

Message:
Logged In: YES 
user_id=21627

I don't think I will do anything about this anytime soon, so
unassigning myself.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=105470&aid=719888&group_id=5470