[Python-Dev] Multigigabyte memory usage in the OpenIndiana Buildbot

Jesus Cea jcea at jcea.es
Fri Sep 9 17:14:07 CEST 2011


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 08/09/11 09:18, Antoine Pitrou wrote:
> Ok, I've added "-j4", let's how that works.

It is not helping. it is taking tons of memory yet.

>> Another option would be to have a single Python process and
>> "fork" for each test. That would launch each test in a separate
>> process without requiring a full python interpreter launching
>> each time. Is this the way "-j" is implemented
> 
> It uses subprocess actually, so fork() + exec() is used.

Yes, does it but fork for each test or simply launch 4 processes, each
doing 1/4 of the tests?.

>> BTW, the (nice and helpful) OpenIndiana folks have told me a few
>> hours ago that they would increase my swap limit to 16GB. I am
>> now waiting for this change to be done.
> 
> Good news :)

16GB of swap activated a few minutes ago. Thanks, Jon and Alastair :-)
(OpenIndiana guys). Launching buildbots now and crossing fingers...

- -- 
Jesus Cea Avion                         _/_/      _/_/_/        _/_/_/
jcea at jcea.es - http://www.jcea.es/     _/_/    _/_/  _/_/    _/_/  _/_/
jabber / xmpp:jcea at jabber.org         _/_/    _/_/          _/_/_/_/_/
.                              _/_/  _/_/    _/_/          _/_/  _/_/
"Things are not so easy"      _/_/  _/_/    _/_/  _/_/    _/_/  _/_/
"My name is Dump, Core Dump"   _/_/_/        _/_/_/      _/_/  _/_/
"El amor es poner tu felicidad en la felicidad de otro" - Leibniz
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQCVAwUBTmotPplgi5GaxT1NAQKUzQP/Qm+lyCQeldL1XEkkq1EHY5C/hKvMDz9i
qOV29iai/hkeqRWY2Fiu4vSfNTDAEil9eEIJQMGmUyYOMCrfOEoDCYzr+xTWfnNu
EWzI6mEe8XWIUicGDAf/dbUEk11wtSrtXA09G0Q5oQWg0b6auQHYv5vhZITwDWSO
h9rLBnZ0ZHI=
=8Mpw
-----END PGP SIGNATURE-----


More information about the Python-Dev mailing list