[Catalog-sig] PyPI optimization?

Richard Jones richardjones@optushome.com.au
Fri, 25 Apr 2003 21:00:41 +1000


--Boundary-02=_pVRq+OlxpOMiyok
Content-Type: text/plain;
  charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Content-Description: signed data
Content-Disposition: inline

On Friday 25 April 2003 08:07 pm, Thomas Wouters wrote:
> Well, the machine is a lot heavier loaded now than it was before PyPI was
> really used; the load used to be ~0.05, it's now hovering around 0.8,
> sometimes as high as 1.5. That isn't terribly high, though, as this is a
> dual CPU machine, and Apache for one isn't slowed down by it. I believe
> it's PyPI doing heavy I/O, or perhaps some form of locking, as the python
> processes aren't using that much CPU either.

I haven't looked at the hits that PyPI is getting - does creosote have any =
web=20
stats automatically generated?

Perhaps it would be a good idea to switch to an RDBMS that is more=20
multi-user-friendly. Gerhard, is your offer to do this still open? The=20
backend of pypi is all in the store module, and it's quite simple. It'll=20
probably work out of the box on postgresql/mysql.


   Richard

--Boundary-02=_pVRq+OlxpOMiyok
Content-Type: application/pgp-signature
Content-Description: signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.1 (GNU/Linux)

iD8DBQA+qRVprGisBEHG6TARAn4AAJ97hsb28VY0wL9BCsP3CbMdB3uTdwCfbz4e
UIM/uaU7OIX5SQtLBzkIca4=
=IL+m
-----END PGP SIGNATURE-----

--Boundary-02=_pVRq+OlxpOMiyok--