[Catalog-sig] Time for a static cheeseshop mirror for easy_install?

A.M. Kuchling amk at amk.ca
Mon Apr 9 16:46:30 CEST 2007


On Sat, Apr 07, 2007 at 12:44:56PM -0400, Phillip J. Eby wrote:
> I don't know whether this will actually solve any problems the cheeseshop 
> itself is having; it may be that ill-behaved web spiders are at fault, or 
> something else altogether.  

In this recent case, two different spiders were crawling the wiki very
quickly, the machine's load average was in the 70s, and the
out-of-memory killer was killing off PostgreSQL processes.

I don't think the load caused from people running easy_install is
especially high -- it's certainly not a source of problems -- but
making static pages would still be good to make mirroring the package
archive more useful.  Right now people could mirror
http://cheeseshop.python.org/packages/, but there's nothing there for
easy_install or for human readers; it's just a tree of package
directories.

--amk


More information about the Catalog-sig mailing list