[New-bugs-announce] [issue12355] Crawler doesn't follow redirection

Filip Gruszczyński report at bugs.python.org
Fri Jun 17 22:13:32 CEST 2011

New submission from Filip Gruszczyński <gruszczy at gmail.com>:

When looking at issue #12348 I have noticed following behaviour:

from packaging.pypi.simple import Crawler
c = Crawler()

Traceback (most recent call last):
  File "test_crawl.py", line 3, in <module>
  File "/home/gruszczy/Projects/python/Lib/packaging/pypi/simple.py", line 192, in get_releases
    raise ProjectNotFound

This is because when request for /simple/webob/ is made 301 is returned to /simple/WebOb/ and HttpError raised, which is silenced and returned:

        except urllib.error.HTTPError as v:
            return v

Wouldn't it be good to do something about? How about crawler following redirects?

assignee: tarek
components: Distutils2
messages: 138547
nosy: alexis, eric.araujo, gruszczy, tarek
priority: normal
severity: normal
status: open
title: Crawler doesn't follow redirection
type: crash
versions: Python 3.3

Python tracker <report at bugs.python.org>

More information about the New-bugs-announce mailing list