<html><head/><body><html><head></head><body>Reponding from my phone quickly before this gets any further, will write more later. Plan is to have pypi move package download links to a new hostname (probably <a href="http://pypi-download.python.org">pypi-download.python.org</a>) and then throw that behind fastly. This sidesteps 100% of issues with dynamic pages, etc. Simple index with be handled secondarily.<br><br><div class="gmail_quote">Jim Fulton <jim@zope.com> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<pre style="white-space: pre-wrap; word-wrap:break-word; font-family: sans-serif; margin-top: 0px">On Thu, Feb 28, 2013 at 5:39 AM, Jesse Noller <jnoller@gmail.com> wrote:<br /><blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #729fcf; padding-left: 1ex;">Thread fork.<br /><br />Anyway. I know we have at least 1 major rep of a cloud provider on the list, and I have at least one off in my pocket.<br /><br />I'd like to start discussing (completely ignoring past efforts and discussion which got bogged down) how we can start distributing the package data we host via CDN rather than the mirroring system.</blockquote><br />Woohoo!!!<br /><br />One issue is how to keep the relatively dynamic stuff up to date.<br />One option is to bypass the CDN for dynamic content, but a better<br />approach might be to use CDN-provided invalidation APIs.<br /><br />I'm mainly thinking of the simple index pages, which are relatively<br />static, but, wh
en they
change, you want to get the change quickly.<br />Ideally, when there's an update to package, PyPI would<br />invalidate the index page. Everything should have a really long<br />cache interval.<br /><br />BTW, we use CloudFront fairly extensively for media. We get a lot<br />more origin requests than we expected, given the cache intervals<br />we'd set. (It was still a big win for us.)<br /><br />Jim<br /></pre></blockquote></div></body></html></body></html>