bandersnatch failing on https://pypi.python.org/simple/Mopidy-TuneIn/
This url is redirecting to itself, causing bandersnatch to fail, and thus its never updating its serial, so its pulling gradually larger and larger datasets. https://pypi.python.org/simple/Mopidy-TuneIn Reusing existing connection to pypi.python.org:443. HTTP request sent, awaiting response... HTTP/1.1 301 Moved Permanently Date: Tue, 25 Feb 2014 02:14:48 GMT Server: Apache Location: /simple/Mopidy-TuneIn/ Cache-Control: max-age=86400, public Strict-Transport-Security: max-age=31536000 Content-Length: 0 Accept-Ranges: bytes Age: 8204 Keep-Alive: timeout=10, max=31 Connection: Keep-Alive
-Rob
Should be fixed now.
On Feb 24, 2014, at 9:14 PM, Robert Collins robertc@robertcollins.net wrote:
This url is redirecting to itself, causing bandersnatch to fail, and thus its never updating its serial, so its pulling gradually larger and larger datasets. https://pypi.python.org/simple/Mopidy-TuneIn Reusing existing connection to pypi.python.org:443. HTTP request sent, awaiting response... HTTP/1.1 301 Moved Permanently Date: Tue, 25 Feb 2014 02:14:48 GMT Server: Apache Location: /simple/Mopidy-TuneIn/ Cache-Control: max-age=86400, public Strict-Transport-Security: max-age=31536000 Content-Length: 0 Accept-Ranges: bytes Age: 8204 Keep-Alive: timeout=10, max=31 Connection: Keep-Alive
-Rob
-- Robert Collins rbtcollins@hp.com Distinguished Technologist HP Converged Cloud _______________________________________________ Distutils-SIG maillist - Distutils-SIG@python.org https://mail.python.org/mailman/listinfo/distutils-sig
----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
Hi,
We wonder whether this problem has happened again. This is what we've been seeing with bandersnatch:
2014-05-02 23:26:18,983 ERROR: Error syncing package: pypps_reader@1079144 Traceback (most recent call last): File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/bandersnatch/package.py", line 70, in sync self.sync_simple_page() File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/bandersnatch/package.py", line 112, in sync_simple_page '/simple/{0}/'.format(self.quoted_name), self.serial) File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/bandersnatch/master.py", line 43, in get r = self.session.get(path, timeout=self.timeout, **kw) File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/requests/sessions.py", line 369, in get return self.request('GET', url, **kwargs) File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/requests/sessions.py", line 354, in request resp = self.send(prep, **send_kwargs) File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/requests/sessions.py", line 473, in send history = [resp for resp in gen] if allow_redirects else [] File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/requests/sessions.py", line 104, in resolve_redirects raise TooManyRedirects('Exceeded %s redirects.' % self.max_redirects) TooManyRedirects: Exceeded 30 redirects.
This is what we see with curl:
$ curl -IL https://pypi.python.org/simple/pypps_reader HTTP/1.1 301 Moved Permanently Date: Sat, 03 May 2014 03:33:50 GMT Server: Apache Location: /simple/pypps_reader/ Cache-Control: max-age=86400, public Strict-Transport-Security: max-age=31536000; includeSubDomains Accept-Ranges: bytes Age: 20147
...
HTTP/1.1 301 Moved Permanently Date: Sat, 03 May 2014 03:33:50 GMT Server: Apache Location: /simple/pypps-reader/ Cache-Control: max-age=86400, public Strict-Transport-Security: max-age=31536000; includeSubDomains Accept-Ranges: bytes Age: 20148 Connection: close
curl: (47) Maximum (50) redirects followed
Would you please help us diagnose this?
Thanks for your time, The TUF team
On Mon, Feb 24, 2014 at 11:22 PM, Donald Stufft donald@stufft.io wrote:
Should be fixed now.
On Feb 24, 2014, at 9:14 PM, Robert Collins robertc@robertcollins.net wrote:
This url is redirecting to itself, causing bandersnatch to fail, and thus its never updating its serial, so its pulling gradually larger and larger datasets. https://pypi.python.org/simple/Mopidy-TuneIn Reusing existing connection to pypi.python.org:443. HTTP request sent, awaiting response... HTTP/1.1 301 Moved Permanently Date: Tue, 25 Feb 2014 02:14:48 GMT Server: Apache Location: /simple/Mopidy-TuneIn/ Cache-Control: max-age=86400, public Strict-Transport-Security: max-age=31536000 Content-Length: 0 Accept-Ranges: bytes Age: 8204 Keep-Alive: timeout=10, max=31 Connection: Keep-Alive
-Rob
-- Robert Collins rbtcollins@hp.com Distinguished Technologist HP Converged Cloud _______________________________________________ Distutils-SIG maillist - Distutils-SIG@python.org https://mail.python.org/mailman/listinfo/distutils-sig
Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
Distutils-SIG maillist - Distutils-SIG@python.org https://mail.python.org/mailman/listinfo/distutils-sig
(Just a little follow up: we were able to continue and complete syncing with PyPI after removing the "pypps_reader" line from the bandersnatch "todo" file)
On Fri, May 2, 2014 at 11:38 PM, Trishank Kuppusamy trishank@nyu.eduwrote:
Hi,
We wonder whether this problem has happened again. This is what we've been seeing with bandersnatch:
2014-05-02 23:26:18,983 ERROR: Error syncing package: pypps_reader@1079144 Traceback (most recent call last): File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/bandersnatch/package.py", line 70, in sync self.sync_simple_page() File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/bandersnatch/package.py", line 112, in sync_simple_page '/simple/{0}/'.format(self.quoted_name), self.serial) File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/bandersnatch/master.py", line 43, in get r = self.session.get(path, timeout=self.timeout, **kw) File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/requests/sessions.py", line 369, in get return self.request('GET', url, **kwargs) File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/requests/sessions.py", line 354, in request resp = self.send(prep, **send_kwargs) File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/requests/sessions.py", line 473, in send history = [resp for resp in gen] if allow_redirects else [] File "/home/trishank/ pypi.updateframework.com/virtual_python/local/lib/python2.7/site-packages/requests/sessions.py", line 104, in resolve_redirects raise TooManyRedirects('Exceeded %s redirects.' % self.max_redirects) TooManyRedirects: Exceeded 30 redirects.
This is what we see with curl:
$ curl -IL https://pypi.python.org/simple/pypps_reader HTTP/1.1 301 Moved Permanently Date: Sat, 03 May 2014 03:33:50 GMT Server: Apache Location: /simple/pypps_reader/ Cache-Control: max-age=86400, public Strict-Transport-Security: max-age=31536000; includeSubDomains Accept-Ranges: bytes Age: 20147
...
HTTP/1.1 301 Moved Permanently Date: Sat, 03 May 2014 03:33:50 GMT Server: Apache Location: /simple/pypps-reader/ Cache-Control: max-age=86400, public Strict-Transport-Security: max-age=31536000; includeSubDomains Accept-Ranges: bytes Age: 20148 Connection: close
curl: (47) Maximum (50) redirects followed
Would you please help us diagnose this?
Thanks for your time, The TUF team
On Mon, Feb 24, 2014 at 11:22 PM, Donald Stufft donald@stufft.io wrote:
Should be fixed now.
On Feb 24, 2014, at 9:14 PM, Robert Collins robertc@robertcollins.net wrote:
This url is redirecting to itself, causing bandersnatch to fail, and thus its never updating its serial, so its pulling gradually larger and larger datasets. https://pypi.python.org/simple/Mopidy-TuneIn Reusing existing connection to pypi.python.org:443. HTTP request sent, awaiting response... HTTP/1.1 301 Moved Permanently Date: Tue, 25 Feb 2014 02:14:48 GMT Server: Apache Location: /simple/Mopidy-TuneIn/ Cache-Control: max-age=86400, public Strict-Transport-Security: max-age=31536000 Content-Length: 0 Accept-Ranges: bytes Age: 8204 Keep-Alive: timeout=10, max=31 Connection: Keep-Alive
-Rob
-- Robert Collins rbtcollins@hp.com Distinguished Technologist HP Converged Cloud _______________________________________________ Distutils-SIG maillist - Distutils-SIG@python.org https://mail.python.org/mailman/listinfo/distutils-sig
Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
Distutils-SIG maillist - Distutils-SIG@python.org https://mail.python.org/mailman/listinfo/distutils-sig
participants (4)
-
Donald Stufft -
Robert Collins -
Trishank Karthik Kuppusamy -
Trishank Kuppusamy