[Distutils] [Infrastructure] Good news everyone, PyPI is behind a CDN

[Donald Stufft]

On May 26, 2013, at 2:00 PM, Jim Fulton <jim at zope.com> wrote:

> On Sun, May 26, 2013 at 1:39 PM, Donald Stufft <donald at stufft.io> wrote:
>> 
>> On May 26, 2013, at 1:34 PM, Noah Kantrowitz <noah at coderanger.net> wrote:
>> 
>> </farnsworth>
>> 
>> but seriously, at long last today it was my honor to throw the DNS switch to
>> move PyPI to the Fastly caching CDN. I would like to thank Donald Stufft for
>> doing much of the heavy lifting on the PyPI side, and to Fastly for
>> graciously offering to host us. What does this mean for everyone? Well the
>> biggest change is PyPI should get a whole lot faster. There are two major
>> downsides however. There will now be a delay of several minutes in some
>> cases between updating a package and having it be installable, and download
>> counts will now be even more incorrect than they were before. The PyPI
>> admins are discussing what to do about download counts long-term, but for
>> now we all feel that the performance and availability benefits outweigh the
>> loss. If anyone has any questions, or hears anything about issues with PyPI
>> please don't hesitate to contact me.
> 
> This is great news! Is this just the downloads? Or does it include
> the simple index too?

Default Policy is Not to Cache (To handle logged in or dynamic pages since PyPI doesn't have the proper Vary headers).

/simple/.* Has a policy for it to cache for 10minutes (If I recall correctly)

/packages/.* Has a policy for it to cache for 1 hour (If I recall correctly)

So they are both cached, but because we aren't invalidating the cache yet the simple index has a low timeout so there is only a short wait required for a new upload to be available.

> 
> Jim
> 
> -- 
> Jim Fulton
> http://www.linkedin.com/in/jimfulton


-----------------
Donald Stufft
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/distutils-sig/attachments/20130526/58ed6318/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 841 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: <http://mail.python.org/pipermail/distutils-sig/attachments/20130526/58ed6318/attachment-0001.pgp>