[Numpy-discussion] Numpy 1.10.3 release.

Charles R Harris charlesr.harris at gmail.com
Mon Jan 4 15:38:42 EST 2016


On Sat, Jan 2, 2016 at 10:05 PM, <josef.pktd at gmail.com> wrote:

> On Sat, Jan 2, 2016 at 4:47 PM, Charles R Harris
> <charlesr.harris at gmail.com> wrote:
> > Hi All,
> >
> > A significant segfault problem has been reported against Numpy 1.10.2
> and I
> > want to make a quick 1.10.3 release to get it fixed. Two questions
> >
> > What exactly is the release process that has been decided on? AFAIK, I
> > should just do a source release on Sourceforge, ping Matthew to produce
> > wheels for Mac and wait for him to put them on pypi, and then upload the
> > sources to pypi. No windows binaries are to be produced.
> > Is there anything else that needs fixing for 1.10.3?
>
>
> I'm running the 1.10.2 tests on Windows 10 in a virtualbox on Windows 8.1
> using Gohlke binary for MKL on a fresh Python 3.5
>
> This test
> "Test workarounds for 32-bit limited fwrite, fseek, and ftell ..."
> is taking a very long time. Is this expected?
>
>
> I get the following errors on Windows 10, and also on Windows 8.1
> Winpython 3.4 (except for the last "Unable to find vcvarsall.bat"
> because it's set up for compiling with mingw)
>
> Earlier I also got a ref count error message but I don't see it
> anymore, so maybe I messed up when trying Ctrl+C to kill the tests.
>
>
> ======================================================================
> ERROR: Failure: ImportError (cannot import name 'fib2')
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
> line 39, in runTest
>     raise self.exc_val.with_traceback(self.tb)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
> line 418, in loadTestsFromName
>     addr.filename, addr.module)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 47, in importFromPath
>     return self.importFromDir(dir_path, fqname)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 94, in importFromDir
>     mod = load_module(part_fqname, fh, filename, desc)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 234, in load_module
>     return load_source(name, filename, file)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 172, in load_source
>     module = _load(spec)
>   File "<frozen importlib._bootstrap>", line 693, in _load
>   File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
>   File "<frozen importlib._bootstrap_external>", line 662, in exec_module
>   File "<frozen importlib._bootstrap>", line 222, in
> _call_with_frames_removed
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_ext\tests\test_fib2.py",
> line 4, in <module>
>     from f2py_ext import fib2
> ImportError: cannot import name 'fib2'
>
> ======================================================================
> ERROR: Failure: ImportError (cannot import name 'foo')
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
> line 39, in runTest
>     raise self.exc_val.with_traceback(self.tb)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
> line 418, in loadTestsFromName
>     addr.filename, addr.module)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 47, in importFromPath
>     return self.importFromDir(dir_path, fqname)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 94, in importFromDir
>     mod = load_module(part_fqname, fh, filename, desc)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 234, in load_module
>     return load_source(name, filename, file)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 172, in load_source
>     module = _load(spec)
>   File "<frozen importlib._bootstrap>", line 693, in _load
>   File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
>   File "<frozen importlib._bootstrap_external>", line 662, in exec_module
>   File "<frozen importlib._bootstrap>", line 222, in
> _call_with_frames_removed
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_f90_ext\tests\test_foo.py",
> line 4, in <module>
>     from f2py_f90_ext import foo
> ImportError: cannot import name 'foo'
>
> ======================================================================
> ERROR: Failure: ImportError (cannot import name 'fib3')
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
> line 39, in runTest
>     raise self.exc_val.with_traceback(self.tb)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
> line 418, in loadTestsFromName
>     addr.filename, addr.module)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 47, in importFromPath
>     return self.importFromDir(dir_path, fqname)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 94, in importFromDir
>     mod = load_module(part_fqname, fh, filename, desc)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 234, in load_module
>     return load_source(name, filename, file)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 172, in load_source
>     module = _load(spec)
>   File "<frozen importlib._bootstrap>", line 693, in _load
>   File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
>   File "<frozen importlib._bootstrap_external>", line 662, in exec_module
>   File "<frozen importlib._bootstrap>", line 222, in
> _call_with_frames_removed
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\gen_ext\tests\test_fib3.py",
> line 3, in <module>
>     from gen_ext import fib3
> ImportError: cannot import name 'fib3'
>
> ======================================================================
> ERROR: Failure: ImportError (No module named 'pyrex_ext.primes')
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
> line 39, in runTest
>     raise self.exc_val.with_traceback(self.tb)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
> line 418, in loadTestsFromName
>     addr.filename, addr.module)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 47, in importFromPath
>     return self.importFromDir(dir_path, fqname)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 94, in importFromDir
>     mod = load_module(part_fqname, fh, filename, desc)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 234, in load_module
>     return load_source(name, filename, file)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 172, in load_source
>     module = _load(spec)
>   File "<frozen importlib._bootstrap>", line 693, in _load
>   File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
>   File "<frozen importlib._bootstrap_external>", line 662, in exec_module
>   File "<frozen importlib._bootstrap>", line 222, in
> _call_with_frames_removed
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\pyrex_ext\tests\test_primes.py",
> line 4, in <module>
>     from pyrex_ext.primes import primes
> ImportError: No module named 'pyrex_ext.primes'
>
> ======================================================================
> ERROR: Failure: ImportError (cannot import name 'example')
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
> line 39, in runTest
>     raise self.exc_val.with_traceback(self.tb)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
> line 418, in loadTestsFromName
>     addr.filename, addr.module)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 47, in importFromPath
>     return self.importFromDir(dir_path, fqname)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 94, in importFromDir
>     mod = load_module(part_fqname, fh, filename, desc)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 234, in load_module
>     return load_source(name, filename, file)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 172, in load_source
>     module = _load(spec)
>   File "<frozen importlib._bootstrap>", line 693, in _load
>   File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
>   File "<frozen importlib._bootstrap_external>", line 662, in exec_module
>   File "<frozen importlib._bootstrap>", line 222, in
> _call_with_frames_removed
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example.py",
> line 4, in <module>
>     from swig_ext import example
> ImportError: cannot import name 'example'
>
> ======================================================================
> ERROR: Failure: ImportError (cannot import name 'example2')
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py",
> line 39, in runTest
>     raise self.exc_val.with_traceback(self.tb)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py",
> line 418, in loadTestsFromName
>     addr.filename, addr.module)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 47, in importFromPath
>     return self.importFromDir(dir_path, fqname)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py",
> line 94, in importFromDir
>     mod = load_module(part_fqname, fh, filename, desc)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 234, in load_module
>     return load_source(name, filename, file)
>   File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py",
> line 172, in load_source
>     module = _load(spec)
>   File "<frozen importlib._bootstrap>", line 693, in _load
>   File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
>   File "<frozen importlib._bootstrap_external>", line 662, in exec_module
>   File "<frozen importlib._bootstrap>", line 222, in
> _call_with_frames_removed
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example2.py",
> line 4, in <module>
>     from swig_ext import example2
> ImportError: cannot import name 'example2'
>
> ======================================================================
> ERROR: test_compile1 (test_system_info.TestSystemInfoReading)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\test_system_info.py",
> line 182, in test_compile1
>     c.compile([os.path.basename(self._src1)], output_dir=self._dir1)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
> line 317, in compile
>     self.initialize()
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
> line 210, in initialize
>     vc_env = _get_vc_env(plat_spec)
>   File
> "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py",
> line 85, in _get_vc_env
>     raise DistutilsPlatformError("Unable to find vcvarsall.bat")
> distutils.errors.DistutilsPlatformError: Unable to find vcvarsall.bat
>
>
> Running it again
>
> for Windows 8.1 python 3.4
>
> The above is with `nosetests numpy`
> Ran 5232 tests in 134.933s
> FAILED (SKIP=40, errors=16)
>
> if I run numpy.test() in the python session, I get
> Ran 5191 tests in 22.506s
> OK (KNOWNFAIL=10, SKIP=19)
>
>
> for Windows 10 python 3.5
>
> commandline nostetests numpy
> Ran 5615 tests in 423.469s
> FAILED (SKIP=33, errors=15)
>
> numpy.test()
> Ran 5574 tests in 21.546s
> FAILED (KNOWNFAIL=8, SKIP=12, errors=1)
> error is only missing vcvarsall.bat
>
>
> Why is there the large difference in how we run the tests?
>
>
> Related: The example from #6923 doesn't crash in my settings, neither
> python 3.4 nor 3.5.
>

The failed tests require pyrex, fortran, and swig. The refcount error comes
and goes, probably the test isn't very good.  Ralf, is there any reason to
keep the various extension building tests? They are very old.

I don't know what the recommendation on using nosetests is, but probably it
is finding too many tests.

Chuck
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/numpy-discussion/attachments/20160104/78b4034c/attachment.html>


More information about the NumPy-Discussion mailing list