Hello all, Running the scipy tests in sequence: scipy.test() then, after the previous test finished without errors or failures I run: scipy.test('full') some tests fails (see below). Exiting and starting a new python session and executing only the test suite: scipy.test('full') No failures or errors are reported. The test ends with: ... ---------------------------------------------------------------------- Ran 5832 tests in 423.039s OK (KNOWNFAIL=14, SKIP=42) <nose.result.TextTestResult run=5832 errors=0 failures=0> What could be the problem?. Can we trust these tests results? Is there a way to run these failed tests individually so one can make sure the scipy system is working properly? perhaps an especific hard example could be usefull. Sergio
$ python_gnu Python 2.7.2 (default, Apr 18 2012, 13:06:38) [GCC 4.6.1] on linux3 Type "help", "copyright", "credits" or "license" for more information.
scipy.test('full')
Running unit tests for scipy NumPy version 1.6.1 NumPy is installed in /home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/si te-packages/numpy SciPy version 0.10.1 SciPy is installed in /home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/si te-packages/scipy Python version 2.7.2 (default, Apr 18 2012, 13:06:38) [GCC 4.6.1] nose version 1.1.2
..... ====================================================================== ERROR: test_iv_cephes_vs_amos_mass_test (test_basic.TestBessel) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/special/tests/test_basic.py", line 1642, in test_iv_cephes_vs_amos_mass_test c1 = special.iv(v, x) RuntimeWarning: divide by zero encountered in iv ====================================================================== FAIL: test_mio.test_mat4_3d ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/no se/case.py", line 197, in runTest self.test(*self.arg) File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/io/matlab/tests/test_mio.py", line 740, in test_mat4_3d stream, {'a': arr}, True, '4') File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu mpy/testing/utils.py", line 1008, in assert_raises return nose.tools.assert_raises(*args,**kwargs) AssertionError: DeprecationWarning not raised ====================================================================== FAIL: Regression test for #651: better handling of badly conditioned ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/signal/tests/test_filter_design.py", line 34, in test_bad_filter assert_raises(BadCoefficients, tf2zpk, [1e-15], [1.0, 1.0]) File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu mpy/testing/utils.py", line 1008, in assert_raises return nose.tools.assert_raises(*args,**kwargs) AssertionError: BadCoefficients not raised ---------------------------------------------------------------------- Ran 5832 tests in 252.953s FAILED (KNOWNFAIL=14, SKIP=42, errors=1, failures=2) <nose.result.TextTestResult run=5832 errors=1 failures=2> scipy.test('full') scipy.test() ====================================================================== FAIL: test_mio.test_mat4_3d ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/no se/case.py", line 197, in runTest self.test(*self.arg) File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/io/matlab/tests/test_mio.py", line 740, in test_mat4_3d stream, {'a': arr}, True, '4') File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu mpy/testing/utils.py", line 1008, in assert_raises return nose.tools.assert_raises(*args,**kwargs) AssertionError: DeprecationWarning not raised ====================================================================== FAIL: Regression test for #651: better handling of badly conditioned ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/signal/tests/test_filter_design.py", line 34, in test_bad_filter assert_raises(BadCoefficients, tf2zpk, [1e-15], [1.0, 1.0]) File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu mpy/testing/utils.py", line 1008, in assert_raises return nose.tools.assert_raises(*args,**kwargs) AssertionError: BadCoefficients not raised ---------------------------------------------------------------------- Ran 5101 tests in 40.225s
On Fri, Apr 20, 2012 at 6:53 PM, Sergio Rojas <sergio_r@mail.com> wrote:
Hello all,
Running the scipy tests in sequence:
scipy.test() then, after the previous test finished without errors or failures I run: scipy.test('full') some tests fails (see below).
Exiting and starting a new python session and executing only the test suite:
scipy.test('full')
No failures or errors are reported. The test ends with: ... ---------------------------------------------------------------------- Ran 5832 tests in 423.039s OK (KNOWNFAIL=14, SKIP=42) <nose.result.TextTestResult run=5832 errors=0 failures=0>
What could be the problem?. Can we trust these tests results?
Python's default behavior is to raise warnings from the same place in the code only once. So when you re-run the tests it doesn't raise those warnings. The tests check that a warning is raised. Hence the failures.
Is there a way to run these failed tests individually so one can make sure the scipy system is working properly? perhaps an especific hard example could be usefull.
See http://readthedocs.org/docs/nose/en/latest/usage.html#selecting-tests
Ralf
Sergio
$ python_gnu Python 2.7.2 (default, Apr 18 2012, 13:06:38) [GCC 4.6.1] on linux3 Type "help", "copyright", "credits" or "license" for more information.
scipy.test('full')
Running unit tests for scipy NumPy version 1.6.1 NumPy is installed in /home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/si te-packages/numpy SciPy version 0.10.1 SciPy is installed in /home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/si te-packages/scipy Python version 2.7.2 (default, Apr 18 2012, 13:06:38) [GCC 4.6.1] nose version 1.1.2
.....
====================================================================== ERROR: test_iv_cephes_vs_amos_mass_test (test_basic.TestBessel) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/special/tests/test_basic.py", line 1642, in test_iv_cephes_vs_amos_mass_test c1 = special.iv(v, x) RuntimeWarning: divide by zero encountered in iv
====================================================================== FAIL: test_mio.test_mat4_3d ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/no se/case.py", line 197, in runTest self.test(*self.arg) File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/io/matlab/tests/test_mio.py", line 740, in test_mat4_3d stream, {'a': arr}, True, '4') File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu mpy/testing/utils.py", line 1008, in assert_raises return nose.tools.assert_raises(*args,**kwargs) AssertionError: DeprecationWarning not raised
====================================================================== FAIL: Regression test for #651: better handling of badly conditioned ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/signal/tests/test_filter_design.py", line 34, in test_bad_filter assert_raises(BadCoefficients, tf2zpk, [1e-15], [1.0, 1.0]) File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu mpy/testing/utils.py", line 1008, in assert_raises return nose.tools.assert_raises(*args,**kwargs) AssertionError: BadCoefficients not raised
---------------------------------------------------------------------- Ran 5832 tests in 252.953s
FAILED (KNOWNFAIL=14, SKIP=42, errors=1, failures=2) <nose.result.TextTestResult run=5832 errors=1 failures=2>
scipy.test('full') scipy.test()
====================================================================== FAIL: test_mio.test_mat4_3d ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/no se/case.py", line 197, in runTest self.test(*self.arg) File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/io/matlab/tests/test_mio.py", line 740, in test_mat4_3d stream, {'a': arr}, True, '4') File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu mpy/testing/utils.py", line 1008, in assert_raises return nose.tools.assert_raises(*args,**kwargs) AssertionError: DeprecationWarning not raised
====================================================================== FAIL: Regression test for #651: better handling of badly conditioned ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc ipy/signal/tests/test_filter_design.py", line 34, in test_bad_filter assert_raises(BadCoefficients, tf2zpk, [1e-15], [1.0, 1.0]) File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu mpy/testing/utils.py", line 1008, in assert_raises return nose.tools.assert_raises(*args,**kwargs) AssertionError: BadCoefficients not raised
---------------------------------------------------------------------- Ran 5101 tests in 40.225s
_______________________________________________ SciPy-User mailing list SciPy-User@scipy.org http://mail.scipy.org/mailman/listinfo/scipy-user
participants (2)
-
Ralf Gommers -
Sergio Rojas