[Catalog-sig] hash tags

M.-A. Lemburg mal at egenix.com
Fri Mar 8 23:04:24 CET 2013

On 08.03.2013 22:47, Donald Stufft wrote:
> On Mar 8, 2013, at 4:45 PM, "M.-A. Lemburg" <mal at egenix.com> wrote:
>> On 08.03.2013 22:33, Donald Stufft wrote:
>>> On Mar 8, 2013, at 4:28 PM, "M.-A. Lemburg" <mal at egenix.com> wrote:
>>>> BTW: If we go with the CDN caching model for external files, we'd
>>>> pull the download page links directly on the /simple/ index
>>>> page - as files, not external links.
>>> We cannot download and rehost (even if we call it a cache) external files without getting permission from their owners to do so.
>> Well, in the CDN version of the /simple/ dir, they would look
>> like files hosted on the CDN. The download pages would still
>> be feeding the CDN, though.
> I'm unsure what you're saying here. If it involves downloading files hosted outside of PyPI and putting it on a PSF controlled CDN it's a non starter.

My idea was to have PyPI send a redirect to the external URL
when getting a request for the file, so we could avoid hosting
the files and instead just have the CDN cache them for a certain
time period.

However, I've now read up on the CloudFront docs, which point
out that the CDN won't follow the redirect, but simply forward
it to the user, bypassing the CDN:


I suspect other CDNs to work in the same way, so the redirect
idea doesn't work.

We'd have to use a proxy solution on the PyPI server to make the
caching CDN work, but that will likely cause more legal problems
than the plain caching of content on the way to the user.

Marc-Andre Lemburg

Professional Python Services directly from the Source  (#1, Mar 07 2013)
>>> Python Projects, Consulting and Support ...   http://www.egenix.com/
>>> mxODBC.Zope/Plone.Database.Adapter ...       http://zope.egenix.com/
>>> mxODBC, mxDateTime, mxTextTools ...        http://python.egenix.com/

::::: Try our mxODBC.Connect Python Database Interface for free ! ::::::

   eGenix.com Software, Skills and Services GmbH  Pastor-Loeh-Str.48
    D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
           Registered at Amtsgericht Duesseldorf: HRB 46611

More information about the Catalog-SIG mailing list