[issue15851] Lib/robotparser.py doesn't accept setting a user agent string, instead it uses the default.

[karl]

karl added the comment:

Mark,

The code is using urllib for demonstrating the issue with wikipedia and other sites which are blocking python-urllib user agents because it is used by many spam harvesters.

The proposal is about giving a possibility in robotparser lib to add a feature for setting up the user-agent.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue15851>
_______________________________________