[Cython] Cython 0.15 release candidate

[mark florisson]

On 25 July 2011 08:08, Arfrever Frehtes Taifersar Arahesis
<arfrever.fta at gmail.com> wrote:
> There are 4 NumPy-related test errors with Python 3.1 and 3.2.
> Output with Python 3.2:
>
> ======================================================================
> ERROR: runTest (__main__.CythonRunTestCase)
> compiling (cpp) and running numpy_bufacc_T155
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>  File "/usr/lib64/python3.2/distutils/unixccompiler.py", line 183, in _compile
>    extra_postargs)
>  File "/usr/lib64/python3.2/distutils/ccompiler.py", line 911, in spawn
>    spawn(cmd, dry_run=self.dry_run)
>  File "/usr/lib64/python3.2/distutils/spawn.py", line 34, in spawn
>    _spawn_posix(cmd, search_path, dry_run=dry_run)
>  File "/usr/lib64/python3.2/distutils/spawn.py", line 165, in _spawn_posix
>    % (cmd[0], exit_status))
> distutils.errors.DistutilsExecError: command 'x86_64-pc-linux-gnu-g++' failed with exit status 1
>
> During handling of the above exception, another exception occurred:
>
> Traceback (most recent call last):
>  File "runtests.py", line 678, in run
>    self.runCompileTest()
>  File "runtests.py", line 490, in runCompileTest
>    self.test_directory, self.expect_errors, self.annotate)
>  File "runtests.py", line 665, in compile
>    self.run_distutils(test_directory, module, workdir, incdir)
>  File "runtests.py", line 625, in run_distutils
>    build_extension.run()
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 347, in run
>    self.build_extensions()
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 456, in build_extensions
>    self.build_extension(ext)
>  File "runtests.py", line 257, in build_extension
>    _build_ext.build_extension(self, ext)
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 511, in build_extension
>    depends=ext.depends)
>  File "/usr/lib64/python3.2/distutils/ccompiler.py", line 576, in compile
>    self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
>  File "/usr/lib64/python3.2/distutils/unixccompiler.py", line 188, in _compile
>    raise CompileError(msg)
> distutils.errors.CompileError: command 'x86_64-pc-linux-gnu-g++' failed with exit status 1
>
> ======================================================================
> ERROR: runTest (__main__.CythonRunTestCase)
> compiling (cpp) and running numpy_cimport
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>  File "/usr/lib64/python3.2/distutils/unixccompiler.py", line 183, in _compile
>    extra_postargs)
>  File "/usr/lib64/python3.2/distutils/ccompiler.py", line 911, in spawn
>    spawn(cmd, dry_run=self.dry_run)
>  File "/usr/lib64/python3.2/distutils/spawn.py", line 34, in spawn
>    _spawn_posix(cmd, search_path, dry_run=dry_run)
>  File "/usr/lib64/python3.2/distutils/spawn.py", line 165, in _spawn_posix
>    % (cmd[0], exit_status))
> distutils.errors.DistutilsExecError: command 'x86_64-pc-linux-gnu-g++' failed with exit status 1
>
> During handling of the above exception, another exception occurred:
>
> Traceback (most recent call last):
>  File "runtests.py", line 678, in run
>    self.runCompileTest()
>  File "runtests.py", line 490, in runCompileTest
>    self.test_directory, self.expect_errors, self.annotate)
>  File "runtests.py", line 665, in compile
>    self.run_distutils(test_directory, module, workdir, incdir)
>  File "runtests.py", line 625, in run_distutils
>    build_extension.run()
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 347, in run
>    self.build_extensions()
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 456, in build_extensions
>    self.build_extension(ext)
>  File "runtests.py", line 257, in build_extension
>    _build_ext.build_extension(self, ext)
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 511, in build_extension
>    depends=ext.depends)
>  File "/usr/lib64/python3.2/distutils/ccompiler.py", line 576, in compile
>    self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
>  File "/usr/lib64/python3.2/distutils/unixccompiler.py", line 188, in _compile
>    raise CompileError(msg)
> distutils.errors.CompileError: command 'x86_64-pc-linux-gnu-g++' failed with exit status 1
>
> ======================================================================
> ERROR: runTest (__main__.CythonRunTestCase)
> compiling (cpp) and running numpy_parallel
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>  File "/usr/lib64/python3.2/distutils/unixccompiler.py", line 183, in _compile
>    extra_postargs)
>  File "/usr/lib64/python3.2/distutils/ccompiler.py", line 911, in spawn
>    spawn(cmd, dry_run=self.dry_run)
>  File "/usr/lib64/python3.2/distutils/spawn.py", line 34, in spawn
>    _spawn_posix(cmd, search_path, dry_run=dry_run)
>  File "/usr/lib64/python3.2/distutils/spawn.py", line 165, in _spawn_posix
>    % (cmd[0], exit_status))
> distutils.errors.DistutilsExecError: command 'x86_64-pc-linux-gnu-g++' failed with exit status 1
>
> During handling of the above exception, another exception occurred:
>
> Traceback (most recent call last):
>  File "runtests.py", line 678, in run
>    self.runCompileTest()
>  File "runtests.py", line 490, in runCompileTest
>    self.test_directory, self.expect_errors, self.annotate)
>  File "runtests.py", line 665, in compile
>    self.run_distutils(test_directory, module, workdir, incdir)
>  File "runtests.py", line 625, in run_distutils
>    build_extension.run()
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 347, in run
>    self.build_extensions()
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 456, in build_extensions
>    self.build_extension(ext)
>  File "runtests.py", line 257, in build_extension
>    _build_ext.build_extension(self, ext)
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 511, in build_extension
>    depends=ext.depends)
>  File "/usr/lib64/python3.2/distutils/ccompiler.py", line 576, in compile
>    self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
>  File "/usr/lib64/python3.2/distutils/unixccompiler.py", line 188, in _compile
>    raise CompileError(msg)
> distutils.errors.CompileError: command 'x86_64-pc-linux-gnu-g++' failed with exit status 1
>
> ======================================================================
> ERROR: runTest (__main__.CythonRunTestCase)
> compiling (cpp) and running numpy_test
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>  File "/usr/lib64/python3.2/distutils/unixccompiler.py", line 183, in _compile
>    extra_postargs)
>  File "/usr/lib64/python3.2/distutils/ccompiler.py", line 911, in spawn
>    spawn(cmd, dry_run=self.dry_run)
>  File "/usr/lib64/python3.2/distutils/spawn.py", line 34, in spawn
>    _spawn_posix(cmd, search_path, dry_run=dry_run)
>  File "/usr/lib64/python3.2/distutils/spawn.py", line 165, in _spawn_posix
>    % (cmd[0], exit_status))
> distutils.errors.DistutilsExecError: command 'x86_64-pc-linux-gnu-g++' failed with exit status 1
>
> During handling of the above exception, another exception occurred:
>
> Traceback (most recent call last):
>  File "runtests.py", line 678, in run
>    self.runCompileTest()
>  File "runtests.py", line 490, in runCompileTest
>    self.test_directory, self.expect_errors, self.annotate)
>  File "runtests.py", line 665, in compile
>    self.run_distutils(test_directory, module, workdir, incdir)
>  File "runtests.py", line 625, in run_distutils
>    build_extension.run()
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 347, in run
>    self.build_extensions()
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 456, in build_extensions
>    self.build_extension(ext)
>  File "runtests.py", line 257, in build_extension
>    _build_ext.build_extension(self, ext)
>  File "/usr/lib64/python3.2/distutils/command/build_ext.py", line 511, in build_extension
>    depends=ext.depends)
>  File "/usr/lib64/python3.2/distutils/ccompiler.py", line 576, in compile
>    self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)
>  File "/usr/lib64/python3.2/distutils/unixccompiler.py", line 188, in _compile
>    raise CompileError(msg)
> distutils.errors.CompileError: command 'x86_64-pc-linux-gnu-g++' failed with exit status 1
>
> ======================================================================
> FAIL: test_nested_break_continue (line 331) (parallel.__test__)
> Doctest: parallel.__test__.test_nested_break_continue (line 331)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>  File "/usr/lib64/python3.2/doctest.py", line 2118, in runTest
>    raise self.failureException(self.format_failure(new.getvalue()))
> AssertionError: Failed doctest test for parallel.__test__.test_nested_break_continue (line 331)
>  File "/var/tmp/portage/dev-python/cython-0.15_rc0/work/Cython-0.15rc0/tests-3.2/run/c/parallel.cpython-32.so", line unknown line number, in test_nested_break_continue (line 331)
>
> ----------------------------------------------------------------------
> File "/var/tmp/portage/dev-python/cython-0.15_rc0/work/Cython-0.15rc0/tests-3.2/run/c/parallel.cpython-32.so", line ?, in parallel.__test__.test_nested_break_continue (line 331)
> Failed example:
>    test_nested_break_continue()
> Expected:
>    6 7 6 7
>    8
> Got:
>    6 0 -1160725808 -1160725808
>    8
>
>
> ======================================================================
> FAIL: test_propagation (line 49) (parallel.__test__)
> Doctest: parallel.__test__.test_propagation (line 49)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>  File "/usr/lib64/python3.2/doctest.py", line 2118, in runTest
>    raise self.failureException(self.format_failure(new.getvalue()))
> AssertionError: Failed doctest test for parallel.__test__.test_propagation (line 49)
>  File "/var/tmp/portage/dev-python/cython-0.15_rc0/work/Cython-0.15rc0/tests-3.2/run/c/parallel.cpython-32.so", line unknown line number, in test_propagation (line 49)
>
> ----------------------------------------------------------------------
> File "/var/tmp/portage/dev-python/cython-0.15_rc0/work/Cython-0.15rc0/tests-3.2/run/c/parallel.cpython-32.so", line ?, in parallel.__test__.test_propagation (line 49)
> Failed example:
>    test_propagation()
> Expected:
>    (9, 9, 9, 9, 450, 450)
> Got:
>    (9, 0, 9, -1160725808, 0, 0)
>
>
> ======================================================================
> FAIL: test_nested_break_continue (line 331) (parallel.__test__)
> Doctest: parallel.__test__.test_nested_break_continue (line 331)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>  File "/usr/lib64/python3.2/doctest.py", line 2118, in runTest
>    raise self.failureException(self.format_failure(new.getvalue()))
> AssertionError: Failed doctest test for parallel.__test__.test_nested_break_continue (line 331)
>  File "/var/tmp/portage/dev-python/cython-0.15_rc0/work/Cython-0.15rc0/tests-3.2/run/cpp/parallel.cpython-32.so", line unknown line number, in test_nested_break_continue (line 331)
>
> ----------------------------------------------------------------------
> File "/var/tmp/portage/dev-python/cython-0.15_rc0/work/Cython-0.15rc0/tests-3.2/run/cpp/parallel.cpython-32.so", line ?, in parallel.__test__.test_nested_break_continue (line 331)
> Failed example:
>    test_nested_break_continue()
> Expected:
>    6 7 6 7
>    8
> Got:
>    6 0 -1160725808 -1160725808
>    8
>
>
> ======================================================================
> FAIL: test_propagation (line 49) (parallel.__test__)
> Doctest: parallel.__test__.test_propagation (line 49)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>  File "/usr/lib64/python3.2/doctest.py", line 2118, in runTest
>    raise self.failureException(self.format_failure(new.getvalue()))
> AssertionError: Failed doctest test for parallel.__test__.test_propagation (line 49)
>  File "/var/tmp/portage/dev-python/cython-0.15_rc0/work/Cython-0.15rc0/tests-3.2/run/cpp/parallel.cpython-32.so", line unknown line number, in test_propagation (line 49)
>
> ----------------------------------------------------------------------
> File "/var/tmp/portage/dev-python/cython-0.15_rc0/work/Cython-0.15rc0/tests-3.2/run/cpp/parallel.cpython-32.so", line ?, in parallel.__test__.test_propagation (line 49)
> Failed example:
>    test_propagation()
> Expected:
>    (9, 9, 9, 9, 450, 450)
> Got:
>    (9, 0, 9, -1160725808, 0, 0)
>
>
> ----------------------------------------------------------------------
> Ran 5528 tests in 1476.755s
>
> FAILED (failures=4, errors=4)
> ALL DONE
>
> --
> Arfrever Frehtes Taifersar Arahesis
>
> _______________________________________________
> Cython-dev mailing list
> Cython-dev at codespeak.net
> http://codespeak.net/mailman/listinfo/cython-dev
>
>

Unfortunately the output of the testrunner is rather useless here.
Could you run the tests with --no-cleanup and attach the .c and .cpp
files (found in build/run/c/numpy_cimport.c, etc)? I think something
is up with your numpy version and headers. The numpy tests should be
automatically skipped if numpy is not available.

As for the parallel tests, the values of lastprivates were racy after
breaking, returning or propagating exceptions. I pushed a fix to
https://github.com/markflorisson88/cython/commit/d9aceb672910796c3952340ab4b5d61c6634254b
. If you want and have the time Dag, you could have a look. I'll push
it to cython master later today.