[Catalog-sig] Time for a static cheeseshop mirror for easy_install?
amk at amk.ca
Mon Apr 9 16:46:30 CEST 2007
On Sat, Apr 07, 2007 at 12:44:56PM -0400, Phillip J. Eby wrote:
> I don't know whether this will actually solve any problems the cheeseshop
> itself is having; it may be that ill-behaved web spiders are at fault, or
> something else altogether.
In this recent case, two different spiders were crawling the wiki very
quickly, the machine's load average was in the 70s, and the
out-of-memory killer was killing off PostgreSQL processes.
I don't think the load caused from people running easy_install is
especially high -- it's certainly not a source of problems -- but
making static pages would still be good to make mirroring the package
archive more useful. Right now people could mirror
http://cheeseshop.python.org/packages/, but there's nothing there for
easy_install or for human readers; it's just a tree of package
More information about the Catalog-sig