[Python-Dev] Re: [Python-checkins] CVS: python/dist/src/Lib robotparser.py,1.10,1.11

[Michael Hudson]

"Martin v. L?wis" <loewis@users.sourceforge.net> writes:

> Update of /cvsroot/python/python/dist/src/Lib
> In directory usw-pr-cvs1:/tmp/cvs-serv31559/Lib
> 
> Modified Files:
> 	robotparser.py 
> Log Message:
> Correct various errors: 
> - Use substring search, not re search for user-agent and paths. 
> - Consider * entry last. Unquote, then requote URLs. 
> - Treat empty Disallow as "allow everything". 
> Add test cases. Fixes #523041

I can't tell and Martin's not sure whether this is appropriate for the
2.2.1 branch.  What do others think?

Cheers,
M.

-- 
  Some people say that a monkey would bang out the complete works
  of Shakespeare on a typewriter give an unlimited amount of time.
  In the meantime, what they would probably produce is a valid
  sendmail configuration file.                    -- Nicholas Petreley