Guido van Rossum wrote: > Are you opposed changing tokenize? If so, why (apart from > compatibility)? ISTM that it would be a good thing if it reported > everything except horizontal whitespace. it would be a good thing if it could, optionally, be made to report horizontal whitespace as well. </F>