Python "robots.txt" parser broken since 2003

Terry Reedy tjreedy at
Sun Apr 22 06:51:39 CEST 2007

"John Nagle" <nagle at> wrote in message 
news:FvtWh.11824$YL5.6282 at
| This was reported in 2003, and a patch was uploaded in 2005, but the 
| never made it into Python 2.4 or 2.5.

If the patch is still open, perhaps you could review it.


More information about the Python-list mailing list