[Python-Dev] Multigigabyte memory usage in the OpenIndiana Buildbot

Jesus Cea jcea at jcea.es
Fri Sep 9 17:14:18 CEST 2011


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 08/09/11 09:18, Antoine Pitrou wrote:
> Ok, I've added "-j4", let's how that works.

It is not helping. it is taking tons of memory yet.

>> Another option would be to have a single Python process and 
>> "fork" for each test. That would launch each test in a separate 
>> process without requiring a full python interpreter launching 
>> each time. Is this the way "-j" is implemented
> 
> It uses subprocess actually, so fork() + exec() is used.

Yes, does it but fork for each test or simply launch 4 processes, each
doing 1/4 of the tests?.

>> BTW, the (nice and helpful) OpenIndiana folks have told me a few 
>> hours ago that they would increase my swap limit to 16GB. I am 
>> now waiting for this change to be done.
> 
> Good news :)

16GB of swap activated a few minutes ago. Thanks, Jon and Alastair :-)
(OpenIndiana guys). Launching buildbots now and crossing fingers...

- -- 
Jesus Cea Avion                         _/_/      _/_/_/        _/_/_/
jcea at jcea.es - http://www.jcea.es/     _/_/    _/_/  _/_/    _/_/  _/_/
jabber / xmpp:jcea at jabber.org         _/_/    _/_/          _/_/_/_/_/
.                              _/_/  _/_/    _/_/          _/_/  _/_/
"Things are not so easy"      _/_/  _/_/    _/_/  _/_/    _/_/  _/_/
"My name is Dump, Core Dump"   _/_/_/        _/_/_/      _/_/  _/_/
"El amor es poner tu felicidad en la felicidad de otro" - Leibniz
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQCVAwUBTmotSplgi5GaxT1NAQIHEwQAhcKKUerwx++/egmYRO86z5XmgiWh/chz
j3xNcMau7L2pxqymEUwfQKihXrYS58ocTiRBEyHAl3vMOouRwgS8joT2eQugfjux
Cy+Rglw+4yg99n+eGwF0z4QxbEljuBJFIrR/+BKeN0sBdT/n1/PZIkN/cWMLDk8t
bw1FtxfSW6s=
=F0er
-----END PGP SIGNATURE-----


More information about the Python-Dev mailing list