<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br><div><div>On May 29, 2013, at 5:18 AM, Marius Gedminas <<a href="mailto:marius@pov.lt">marius@pov.lt</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">On Wed, May 29, 2013 at 11:03:39AM +0200, Lennart Regebro wrote:<br><blockquote type="cite">On Wed, May 29, 2013 at 10:19 AM, Marius Gedminas <<a href="mailto:marius@pov.lt">marius@pov.lt</a>> wrote:<br><blockquote type="cite">Could it be that recent PyPI CDN changes broke zc.buildout somehow?<br>Witness this:<br><br> $ wget <a href="http://downloads.buildout.org/2/bootstrap.py">http://downloads.buildout.org/2/bootstrap.py</a><br><br> $ cat buildout.cfg<br> [buildout]<br> parts = zodbbrowser<br> [zodbbrowser]<br> recipe = zc.recipe.egg<br><br> $ python bootstrap.py<br><br> $ bin/buildout<br> Error: Couldn't find a distribution for 'zodbbrowser'.<br></blockquote><br>Works for me.<br></blockquote><br>Works for me too, now.<br><br><br>Interesting detail: when buildout was failing, and I tried<br><br> curl <a href="http://pypi.python.org/simple/zodbbrowser/">http://pypi.python.org/simple/zodbbrowser/</a><br><br>all I got was a bunch of binary garbage. To be fair, curl -I showed<br>Content-encoding: gzip, and piping curl to zcat showed the HTML just<br>fine. But the interesting thing is that when I try this now, I get raw<br>HTML.<br><br>Can it be that buildout doesn't handle Content-Encoding: gzip?<br><br>I was also looking at raw HTTP requests with ngrep, and saw that<br>buildout issued something like<br><br> GET /simple/zodbbrowser HTTP/forgotwhichversionsadly<br> Host: ...<br> Accept-Encoding: identity<br> User-Agent: blah blah distribute 0.6.44 blah blah Python/urllib<br><br>That "Accept-Encoding" header kind of hints that distribute can't handle<br>gzipped index pages. So maybe Varnish or nginx or something on the CDN<br>side was misconfigured and ignored the Accept-Encoding? But why would<br>pip/easy_install work then -- they use distribute too!? (Or was I<br>accidentally using a virtualenv that had setuptools instead of<br>distribute? Python packaging aargh.)<br><br><br>Another possibly interesting detail: I made a release of zodbbrowser<br>0.11.0 this morning. Buildout was unable to get it right after that,<br>and this condition lasted for several hours (from 07:40 UTC until some<br>point between 08:20 and 09:00 UTC).<br><br>The Zope Windows buildbot had a couple of similar intermittent errors<br>(buildout was unable to find a distribution of some package) that went<br>away when the build job was retried after 24 hours. Could it be that<br>something about the PyPI CDN causes new package releases to be gzipped<br>for an hour or so, and then revert to plain HTML?<br><br>I'm tempted to do a test, something like<br><br> curl -I <a href="http://pypi.python.org/simple/somepackage/">http://pypi.python.org/simple/somepackage/</a><br> cd ~/src/somepackage && fullrelease # zest.releaser FTW<br> curl -I <a href="http://pypi.python.org/simple/somepackage/">http://pypi.python.org/simple/somepackage/</a><br><br>if I can find some package ready for a new release.<br><br>Marius Gedminas<br>-- <br>We'll show a small example here with one user calling another. (Under<br>international treaties describing technical papers these users must be called<br>"Alice" and "Bob".)<br> -- Anthony Baxter<br>_______________________________________________<br>Distutils-SIG maillist - <a href="mailto:Distutils-SIG@python.org">Distutils-SIG@python.org</a><br><a href="http://mail.python.org/mailman/listinfo/distutils-sig">http://mail.python.org/mailman/listinfo/distutils-sig</a><br></blockquote></div><br><div>The cache timeout is an hour unless modifications are made to the package which triggers a cache invalidation.</div><div><br></div><div>I bet there is a missing Vary for the encoding. I'll check and get back to you.</div><div>
<div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><br class="Apple-interchange-newline">-----------------</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">Donald Stufft</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA</div>
</div>
<br></body></html>