[issue35922] robotparser crawl_delay and request_rate do not work with no matching entry

[Tal Einat]

Tal Einat <taleinat at gmail.com> added the comment:


New changeset 8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668 by Tal Einat (Rémi Lapeyre) in branch 'master':
bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)
https://github.com/python/cpython/commit/8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________