(Just a little follow up: we were able to continue and complete syncing with PyPI after removing the "pypps_reader" line from the bandersnatch "todo" file)



On Fri, May 2, 2014 at 11:38 PM, Trishank Kuppusamy <trishank@nyu.edu> wrote:
Hi,

We wonder whether this problem has happened again. This is what we've been seeing with bandersnatch:

2014-05-02 23:26:18,983 ERROR: Error syncing package: pypps_reader@1079144
Traceback (most recent call last):
    self.sync_simple_page()
    '/simple/{0}/'.format(self.quoted_name), self.serial)
    r = self.session.get(path, timeout=self.timeout, **kw)
    return self.request('GET', url, **kwargs)
    resp = self.send(prep, **send_kwargs)
    history = [resp for resp in gen] if allow_redirects else []
    raise TooManyRedirects('Exceeded %s redirects.' % self.max_redirects)
TooManyRedirects: Exceeded 30 redirects.

This is what we see with curl:

HTTP/1.1 301 Moved Permanently
Date: Sat, 03 May 2014 03:33:50 GMT
Server: Apache
Location: /simple/pypps_reader/
Cache-Control: max-age=86400, public
Strict-Transport-Security: max-age=31536000; includeSubDomains
Accept-Ranges: bytes
Age: 20147

...

HTTP/1.1 301 Moved Permanently
Date: Sat, 03 May 2014 03:33:50 GMT
Server: Apache
Location: /simple/pypps-reader/
Cache-Control: max-age=86400, public
Strict-Transport-Security: max-age=31536000; includeSubDomains
Accept-Ranges: bytes
Age: 20148
Connection: close

curl: (47) Maximum (50) redirects followed

Would you please help us diagnose this?

Thanks for your time,
The TUF team


On Mon, Feb 24, 2014 at 11:22 PM, Donald Stufft <donald@stufft.io> wrote:
Should be fixed now.

On Feb 24, 2014, at 9:14 PM, Robert Collins <robertc@robertcollins.net> wrote:

> This url is redirecting to itself, causing bandersnatch to fail, and
> thus its never updating its serial, so its pulling gradually larger
> and larger datasets.
> https://pypi.python.org/simple/Mopidy-TuneIn
> Reusing existing connection to pypi.python.org:443.
> HTTP request sent, awaiting response...
>  HTTP/1.1 301 Moved Permanently
>  Date: Tue, 25 Feb 2014 02:14:48 GMT
>  Server: Apache
>  Location: /simple/Mopidy-TuneIn/
>  Cache-Control: max-age=86400, public
>  Strict-Transport-Security: max-age=31536000
>  Content-Length: 0
>  Accept-Ranges: bytes
>  Age: 8204
>  Keep-Alive: timeout=10, max=31
>  Connection: Keep-Alive
>
>
> -Rob
>
> --
> Robert Collins <rbtcollins@hp.com>
> Distinguished Technologist
> HP Converged Cloud
> _______________________________________________
> Distutils-SIG maillist  -  Distutils-SIG@python.org
> https://mail.python.org/mailman/listinfo/distutils-sig


-----------------
Donald Stufft
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA


_______________________________________________
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig