[Catalog-sig] PyPI down?
sridharr at activestate.com
Tue Jan 12 05:37:29 CET 2010
On 1/11/2010 1:45 PM, Terry Reedy wrote:
> On 1/11/2010 3:41 PM, Chris Withers wrote:
>> Martin v. Löwis wrote:
>>>> Anyone know whassup with PyPI?
>>> Works fine for me.
>> I'm still seeing really variable performance and only from PyPI. The
>> main python website and all other websites I've tried are fine.
>> Are there any site load stats easily accessible? I wonder if someone is
>> maybe spidering PyPI in an antisocial way or some such...
> Currently, (4:18 est, Delaware, USA) I have gotten several pages with 1
> sec response.
The PyPM mirror program runs at 0100hrs PST (= 0400hrs EST). What it
does is to redownload the latest version of packages released in last
two days (as reported by the `changelog` XMLRPC API). The download part
is equivalent to running "easy_install $pkgname" sequentially - except
duplicates are handled - for each of those packages and their
dependencies. Only one XMLRPC API call is made per day.
I believe z3c.pypimirror - and soon PEP 381 - works in a similar fashion
(except for less sophisticated scrapping logic).
It is not clear to me how this could overload the server. Does this
happen everyday at the same time interval?
 apologies for not setting the user-agent string properly; I will get
around to doing it tomorrow
More information about the Catalog-SIG