[issue21469] False positive hazards in robotparser

[Raymond Hettinger]

Changes by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
stage:  -> test needed
title: Hazards in robots.txt parser -> False positive hazards in robotparser

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue21469>
_______________________________________