[SciPy-User] Tests filling up RAM on Linux

[Daπid]

Hi,

Running the scipy tests I get a sudden increase in memory usage, using more
than the 16 GB or RAM I have, and thus freezing the computer for a few
seconds twice, along with several test failures. It is reproducible every
time. I have attached the output of the tests:

$ nosetests scipy > test_stdout 2> test_stderr

I have also monitored the input with vmstat:

$ vmstat -n 1 > testing_vmstat

The first freeze occurs between 130 and 160 s, and the second, shorter,
occurs I believe at 350 s.

Scipy was installed via pip on a Fedora 20 box and linked against ATLAS
compiled from the official rpm.

In [2]: scipy.__version__
Out[2]: '0.14.0'
In [3]: scipy.show_config()
atlas_threads_info:
    libraries = ['lapack', 'ptf77blas', 'ptcblas', 'atlas']
    library_dirs = ['/usr/lib64/atlas-sse3']
    define_macros = [('ATLAS_INFO', '"\\"3.8.4\\""')]
    language = f77
    include_dirs = ['/usr/include']
blas_opt_info:
    libraries = ['ptf77blas', 'ptcblas', 'atlas']
    library_dirs = ['/usr/lib64/atlas-sse3']
    define_macros = [('ATLAS_INFO', '"\\"3.8.4\\""')]
    language = c
    include_dirs = ['/usr/include']
atlas_blas_threads_info:
    libraries = ['ptf77blas', 'ptcblas', 'atlas']
    library_dirs = ['/usr/lib64/atlas-sse3']
    define_macros = [('ATLAS_INFO', '"\\"3.8.4\\""')]
    language = c
    include_dirs = ['/usr/include']
openblas_info:
  NOT AVAILABLE
lapack_opt_info:
    libraries = ['lapack', 'ptf77blas', 'ptcblas', 'atlas']
    library_dirs = ['/usr/lib64/atlas-sse3']
    define_macros = [('ATLAS_INFO', '"\\"3.8.4\\""')]
    language = f77
    include_dirs = ['/usr/include']
openblas_lapack_info:
  NOT AVAILABLE
lapack_mkl_info:
  NOT AVAILABLE
blas_mkl_info:
  NOT AVAILABLE
mkl_info:
  NOT AVAILABLE

$ python
Python 2.7.5 (default, Sep 25 2014, 13:57:38)
[GCC 4.8.3 20140911 (Red Hat 4.8.3-7)] on linux2
Type "help", "copyright", "credits" or "license" for more information.


Fedora has updated Python today [1], and I don't remember this happening
before; but I am not sure. My laptop has the same configuration, but with
Scipy 0.15.0.dev-704b554 and the tests don't use more than a 4% of the
memory.



/David.

[1] http://koji.fedoraproject.org/koji/buildinfo?buildID=580875
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.scipy.org/pipermail/scipy-user/attachments/20141001/8d53ae6f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: test_stderr
Type: application/octet-stream
Size: 520673 bytes
Desc: not available
URL: <http://mail.scipy.org/pipermail/scipy-user/attachments/20141001/8d53ae6f/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: test_stdout
Type: application/octet-stream
Size: 196958 bytes
Desc: not available
URL: <http://mail.scipy.org/pipermail/scipy-user/attachments/20141001/8d53ae6f/attachment-0001.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: plotter.py
Type: text/x-python
Size: 826 bytes
Desc: not available
URL: <http://mail.scipy.org/pipermail/scipy-user/attachments/20141001/8d53ae6f/attachment.py>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: testing_vmstat
Type: application/octet-stream
Size: 67694 bytes
Desc: not available
URL: <http://mail.scipy.org/pipermail/scipy-user/attachments/20141001/8d53ae6f/attachment-0002.obj>