[Numpy-discussion] problem in running test(nose) with numpy/scipy

Bruce Southey bsouthey at gmail.com
Mon Oct 31 09:39:54 EDT 2011


On 10/31/2011 08:31 AM, Olivier Delalleau wrote:
> If you google around "einsum hang", it looks like this is a problem 
> with Intel compiler with the -O3 flag.
> See this thread in particular: 
> http://comments.gmane.org/gmane.comp.python.numeric.general/43168
> It looks like there may be more issues too...
>
> -=- Olivier
>
> 2011/10/30 akshar bhosale <akshar.bhosale at gmail.com 
> <mailto:akshar.bhosale at gmail.com>>
>
>     hi,
>
>     i have installed numpy (1.6.0) and scipy (0.9). , nose version is 1.0
>     i have intel cluster toolkit installed on my system. (11/069
>     version and mkl 10.3). i have machine having intel xeon processor
>     and rhel 5.2 x86_64 platform. i have installed it with intel
>     compilers.
>     when i execute numpy.test and scipy.test, it hangs .
>     numpy.test(verbose=3)
>
>     Running unit tests for numpy
>     NumPy version 1.6.0
>     NumPy is installed in
>     /home/akshar/Python-2.6/lib/python2.6/site-packages/numpy
>     Python version 2.6 (r26:66714, May 29 2011, 15:10:47) [GCC 4.1.2
>     20071124 (Red Hat 4.1.2-42)]
>     nose version 1.0.0
>     nose.config: INFO: Excluding tests matching ['f2py_ext',
>     'f2py_f90_ext', 'gen_ext', 'pyrex_ext', 'swig_ext']
>     nose.selector: INFO: /home/akshar/Python-2.6/lib/
>     python2.6/site-packages/numpy/core/multiarray.so is executable;
>     skipped
>     nose.selector: INFO:
>     /home/akshar/Python-2.6/lib/python2.6/site-packages/numpy/core/scalarmath.so
>     is executable; skipped
>     nose.selector: INFO:
>     /home/akshar/Python-2.6/lib/python2.6/site-packages/numpy/core/umath.so
>     is executable; skipped
>     nose.selector: INFO:
>     /home/akshar/Python-2.6/lib/python2.6/site-packages/numpy/core/multiarray_tests.so
>     is executable; skipped
>     nose.selector: INFO:
>     /home/akshar/Python-2.6/lib/python2.6/site-packages/numpy/core/umath_tests.so
>     is executable; skipped
>     nose.selector: INFO:
>     /home/akshar/Python-2.6/lib/python2.6/site-packages/numpy/fft/fftpack_lite.so
>     is executable; skipped
>     nose.selector: INFO:
>     /home/akshar/Python-2.6/lib/python2.6/site-packages/numpy/linalg/lapack_lite.so
>     is executable; skipped
>     nose.selector: INFO:
>     /home/akshar/Python-2.6/lib/python2.6/site-packages/numpy/random/mtrand.so
>     is executable; skipped
>     test_api.test_fastCopyAndTranspose ... ok
>     test_arrayprint.TestArrayRepr.test_nan_inf ... ok
>     test_str (test_arrayprint.TestComplexArray) ... ok
>     Ticket 844. ... ok
>     test_blasdot.test_blasdot_used ... ok
>     test_blasdot.test_dot_2args ... ok
>     test_blasdot.test_dot_3args ... ok
>     test_blasdot.test_dot_3args_errors ... ok
>     test_creation (test_datetime.TestDateTime) ... ok
>     test_creation_overflow (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_as (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_bday (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_day (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_fs (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_hour (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_minute (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_month (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_second (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_week (test_datetime.TestDateTime) ... ok
>     test_divisor_conversion_year (test_datetime.TestDateTime) ... ok
>     test_hours (test_datetime.TestDateTime) ... ok
>     test_from_object_array (test_defchararray.TestBasic) ... ok
>     test_from_object_array_unicode (test_defchararray.TestBasic) ... ok
>     test_from_string (test_defchararray.TestBasic) ... ok
>     test_from_string_array (test_defchararray.TestBasic) ... ok
>     test_from_unicode (test_defchararray.TestBasic) ... ok
>     test_from_unicode_array (test_defchararray.TestBasic) ... ok
>     test_unicode_upconvert (test_defchararray.TestBasic) ... ok
>     test_it (test_defchararray.TestChar) ... ok
>     test_equal (test_defchararray.TestComparisons) ... ok
>     test_greater (test_defchararray.TestComparisons) ... ok
>     test_greater_equal (test_defchararray.TestComparisons) ... ok
>     test_less (test_defchararray.TestComparisons) ... ok
>     test_less_equal (test_defchararray.TestComparisons) ... ok
>     test_not_equal (test_defchararray.TestComparisons) ... ok
>     test_equal (test_defchararray.TestComparisonsMixed1) ... ok
>     test_greater (test_defchararray.TestComparisonsMixed1) ... ok
>     test_greater_equal (test_defchararray.TestComparisonsMixed1) ... ok
>     test_less (test_defchararray.TestComparisonsMixed1) ... ok
>     test_less_equal (test_defchararray.TestComparisonsMixed1) ... ok
>     test_not_equal (test_defchararray.TestComparisonsMixed1) ... ok
>     test_equal (test_defchararray.TestComparisonsMixed2) ... ok
>     test_greater (test_defchararray.TestComparisonsMixed2) ... ok
>     test_greater_equal (test_defchararray.TestComparisonsMixed2) ... ok
>     test_less (test_defchararray.TestComparisonsMixed2) ... ok
>     test_less_equal (test_defchararray.TestComparisonsMixed2) ... ok
>     test_not_equal (test_defchararray.TestComparisonsMixed2) ... ok
>     test_count (test_defchararray.TestInformation) ... ok
>     test_endswith (test_defchararray.TestInformation) ... ok
>     test_find (test_defchararray.TestInformation) ... ok
>     test_index (test_defchararray.TestInformation) ... ok
>     test_isalnum (test_defchararray.TestInformation) ... ok
>     test_isalpha (test_defchararray.TestInformation) ... ok
>     test_isdigit (test_defchararray.TestInformation) ... ok
>     test_islower (test_defchararray.TestInformation) ... ok
>     test_isspace (test_defchararray.TestInformation) ... ok
>     test_istitle (test_defchararray.TestInformation) ... ok
>     test_isupper (test_defchararray.TestInformation) ... ok
>     test_len (test_defchararray.TestInformation) ... ok
>     test_rfind (test_defchararray.TestInformation) ... ok
>     test_rindex (test_defchararray.TestInformation) ... ok
>     test_startswith (test_defchararray.TestInformation) ... ok
>     test_capitalize (test_defchararray.TestMethods) ... ok
>     test_center (test_defchararray.TestMethods) ... ok
>     test_decode (test_defchararray.TestMethods) ... ok
>     test_encode (test_defchararray.TestMethods) ... ok
>     test_expandtabs (test_defchararray.TestMethods) ... ok
>     test_isdecimal (test_defchararray.TestMethods) ... ok
>     test_isnumeric (test_defchararray.TestMethods) ... ok
>     test_join (test_defchararray.TestMethods) ... ok
>     test_ljust (test_defchararray.TestMethods) ... ok
>     test_lower (test_defchararray.TestMethods) ... ok
>     test_lstrip (test_defchararray.TestMethods) ... ok
>     test_partition (test_defchararray.TestMethods) ... ok
>     test_replace (test_defchararray.TestMethods) ... ok
>     test_rjust (test_defchararray.TestMethods) ... ok
>     test_rpartition (test_defchararray.TestMethods) ... ok
>     test_rsplit (test_defchararray.TestMethods) ... ok
>     test_rstrip (test_defchararray.TestMethods) ... ok
>     test_split (test_defchararray.TestMethods) ... ok
>     test_splitlines (test_defchararray.TestMethods) ... ok
>     test_strip (test_defchararray.TestMethods) ... ok
>     test_swapcase (test_defchararray.TestMethods) ... ok
>     test_title (test_defchararray.TestMethods) ... ok
>     test_upper (test_defchararray.TestMethods) ... ok
>     test_add (test_defchararray.TestOperations) ... ok
>     Ticket #856 ... ok
>     test_mul (test_defchararray.TestOperations) ... ok
>     test_radd (test_defchararray.TestOperations) ... ok
>     test_rmod (test_defchararray.TestOperations) ... ok
>     test_rmul (test_defchararray.TestOperations) ... ok
>     test_broadcast_error (test_defchararray.TestVecString) ... ok
>     test_invalid_args_tuple (test_defchararray.TestVecString) ... ok
>     test_invalid_function_args (test_defchararray.TestVecString) ... ok
>     test_invalid_result_type (test_defchararray.TestVecString) ... ok
>     test_invalid_type_descr (test_defchararray.TestVecString) ... ok
>     test_non_existent_method (test_defchararray.TestVecString) ... ok
>     test_non_string_array (test_defchararray.TestVecString) ... ok
>     test1 (test_defchararray.TestWhitespace) ... ok
>     test_dtype (test_dtype.TestBuiltin) ... ok
>     Only test hash runs at all. ... ok
>     test_metadata_rejects_nondict (test_dtype.TestMetadata) ... ok
>     test_metadata_takes_dict (test_dtype.TestMetadata) ... ok
>     test_nested_metadata (test_dtype.TestMetadata) ... ok
>     test_no_metadata (test_dtype.TestMetadata) ... ok
>     test1 (test_dtype.TestMonsterType) ... ok
>     test_different_names (test_dtype.TestRecord) ... ok
>     test_different_titles (test_dtype.TestRecord) ... ok
>     Test whether equivalent record dtypes hash the same. ... ok
>     Test if an appropriate exception is raised when passing bad values
>     to ... ok
>     Test whether equivalent subarray dtypes hash the same. ... ok
>     Test whether different subarray dtypes hash differently. ... ok
>     Test some data types that are equal ... ok
>     Test some more complicated cases that shouldn't be equal ... ok
>     Test some simple cases that shouldn't be equal ... ok
>     test_single_subarray (test_dtype.TestSubarray) ... ok
>     test_einsum_errors (test_einsum.TestEinSum) ... ok
>     test_einsum_sums_cfloat128 (test_einsum.TestEinSum) ...
>
>     It hangs here..
>
>
>     _______________________________________________
>     NumPy-Discussion mailing list
>     NumPy-Discussion at scipy.org <mailto:NumPy-Discussion at scipy.org>
>     http://mail.scipy.org/mailman/listinfo/numpy-discussion
>
>
>
> _______________________________________________
> NumPy-Discussion mailing list
> NumPy-Discussion at scipy.org
> http://mail.scipy.org/mailman/listinfo/numpy-discussion
This may be a problem with how float128 are working on your system 
and/or the Intel compiler because the test passes with lower precision. 
Thus it really would be great for you to isolate the specific component 
or components of the test that cause this so we can at least provide a 
'fail' rather than a crash or hang.

The actual 'check_einsum_sums' test has many subtests so you need to 
find which operation is involved:
My way is just to comment out the different bits of the actual test 
'check_einsum_sums' to find which parts work. Note you should be able to 
change into the actual test directory (numpy/core/tests/) and directly 
run the test ($python test_einsum.py) or a copy of it.

Bruce
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/numpy-discussion/attachments/20111031/75b5fcd4/attachment.html>


More information about the NumPy-Discussion mailing list