On Sun, Jan 3, 2016 at 12:01 AM, Charles R Harris <charlesr.harris@gmail.com> wrote:

On Sat, Jan 2, 2016 at 4:51 PM, Matthew Brett <matthew.brett@gmail.com> wrote:

...

Hi,

On Sat, Jan 2, 2016 at 9:47 PM, Charles R Harris <charlesr.harris@gmail.com> wrote:

...

Hi All,

A significant segfault problem has been reported against Numpy 1.10.2 and I want to make a quick 1.10.3 release to get it fixed. Two questions

What exactly is the release process that has been decided on? AFAIK, I should just do a source release on Sourceforge, ping Matthew to produce wheels for Mac and wait for him to put them on pypi, and then upload the sources to pypi.

You're welcome to ping me to do the Mac wheels, but I'd be even happier if you could have a go at triggering the build, to see if you can make it work:

https://github.com/MacPython/numpy-wheels

Hmm... Since it needs to build off the tag to have the correct behavior, I assume that that needs to be set explicitly.

No, the build system uses a script I wrote to find the tag closest in development history to master, by default - see : http://stackoverflow.com/a/24557377/1939576 So, if you push a tag, then trigger a build, there's a good chance that will do what you want. If not, then you can set the tag or commit explicitly at : https://github.com/MacPython/numpy-wheels/blob/master/.travis.yml#L5

Also, it didn't look as if your last pypi uploads were signed. Did you upload with twine?

I did yes - with a custom uploader script [1], but I guess it would be better to download, sign, then upload again using some other mechanism that preserves the signature. Cheers, Matthew [1] https://github.com/MacPython/terryfy/blob/master/wheel-uploader

On Sun, Jan 3, 2016 at 12:05 AM, <josef.pktd@gmail.com> wrote:

On Sat, Jan 2, 2016 at 4:47 PM, Charles R Harris <charlesr.harris@gmail.com> wrote:

...

Hi All,

A significant segfault problem has been reported against Numpy 1.10.2 and I want to make a quick 1.10.3 release to get it fixed. Two questions

What exactly is the release process that has been decided on? AFAIK, I should just do a source release on Sourceforge, ping Matthew to produce wheels for Mac and wait for him to put them on pypi, and then upload the sources to pypi. No windows binaries are to be produced. Is there anything else that needs fixing for 1.10.3?

I'm running the 1.10.2 tests on Windows 10 in a virtualbox on Windows 8.1 using Gohlke binary for MKL on a fresh Python 3.5

This test "Test workarounds for 32-bit limited fwrite, fseek, and ftell ..." is taking a very long time. Is this expected?

I get the following errors on Windows 10, and also on Windows 8.1 Winpython 3.4 (except for the last "Unable to find vcvarsall.bat" because it's set up for compiling with mingw)

Earlier I also got a ref count error message but I don't see it anymore, so maybe I messed up when trying Ctrl+C to kill the tests.

====================================================================== ERROR: Failure: ImportError (cannot import name 'fib2') ---------------------------------------------------------------------- Traceback (most recent call last): File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py", line 39, in runTest raise self.exc_val.with_traceback(self.tb) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py", line 418, in loadTestsFromName addr.filename, addr.module) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 47, in importFromPath return self.importFromDir(dir_path, fqname) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 94, in importFromDir mod = load_module(part_fqname, fh, filename, desc) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 234, in load_module return load_source(name, filename, file) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 172, in load_source module = _load(spec) File "<frozen importlib._bootstrap>", line 693, in _load File "<frozen importlib._bootstrap>", line 673, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 662, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_ext\tests\test_fib2.py", line 4, in <module> from f2py_ext import fib2 ImportError: cannot import name 'fib2'

====================================================================== ERROR: Failure: ImportError (cannot import name 'foo') ---------------------------------------------------------------------- Traceback (most recent call last): File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py", line 39, in runTest raise self.exc_val.with_traceback(self.tb) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py", line 418, in loadTestsFromName addr.filename, addr.module) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 47, in importFromPath return self.importFromDir(dir_path, fqname) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 94, in importFromDir mod = load_module(part_fqname, fh, filename, desc) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 234, in load_module return load_source(name, filename, file) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 172, in load_source module = _load(spec) File "<frozen importlib._bootstrap>", line 693, in _load File "<frozen importlib._bootstrap>", line 673, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 662, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\f2py_f90_ext\tests\test_foo.py", line 4, in <module> from f2py_f90_ext import foo ImportError: cannot import name 'foo'

====================================================================== ERROR: Failure: ImportError (cannot import name 'fib3') ---------------------------------------------------------------------- Traceback (most recent call last): File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py", line 39, in runTest raise self.exc_val.with_traceback(self.tb) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py", line 418, in loadTestsFromName addr.filename, addr.module) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 47, in importFromPath return self.importFromDir(dir_path, fqname) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 94, in importFromDir mod = load_module(part_fqname, fh, filename, desc) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 234, in load_module return load_source(name, filename, file) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 172, in load_source module = _load(spec) File "<frozen importlib._bootstrap>", line 693, in _load File "<frozen importlib._bootstrap>", line 673, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 662, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\gen_ext\tests\test_fib3.py", line 3, in <module> from gen_ext import fib3 ImportError: cannot import name 'fib3'

====================================================================== ERROR: Failure: ImportError (No module named 'pyrex_ext.primes') ---------------------------------------------------------------------- Traceback (most recent call last): File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py", line 39, in runTest raise self.exc_val.with_traceback(self.tb) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py", line 418, in loadTestsFromName addr.filename, addr.module) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 47, in importFromPath return self.importFromDir(dir_path, fqname) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 94, in importFromDir mod = load_module(part_fqname, fh, filename, desc) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 234, in load_module return load_source(name, filename, file) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 172, in load_source module = _load(spec) File "<frozen importlib._bootstrap>", line 693, in _load File "<frozen importlib._bootstrap>", line 673, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 662, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\pyrex_ext\tests\test_primes.py", line 4, in <module> from pyrex_ext.primes import primes ImportError: No module named 'pyrex_ext.primes'

====================================================================== ERROR: Failure: ImportError (cannot import name 'example') ---------------------------------------------------------------------- Traceback (most recent call last): File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py", line 39, in runTest raise self.exc_val.with_traceback(self.tb) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py", line 418, in loadTestsFromName addr.filename, addr.module) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 47, in importFromPath return self.importFromDir(dir_path, fqname) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 94, in importFromDir mod = load_module(part_fqname, fh, filename, desc) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 234, in load_module return load_source(name, filename, file) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 172, in load_source module = _load(spec) File "<frozen importlib._bootstrap>", line 693, in _load File "<frozen importlib._bootstrap>", line 673, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 662, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example.py", line 4, in <module> from swig_ext import example ImportError: cannot import name 'example'

====================================================================== ERROR: Failure: ImportError (cannot import name 'example2') ---------------------------------------------------------------------- Traceback (most recent call last): File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\failure.py", line 39, in runTest raise self.exc_val.with_traceback(self.tb) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\loader.py", line 418, in loadTestsFromName addr.filename, addr.module) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 47, in importFromPath return self.importFromDir(dir_path, fqname) File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\nose\importer.py", line 94, in importFromDir mod = load_module(part_fqname, fh, filename, desc) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 234, in load_module return load_source(name, filename, file) File "c:\users\josef\appdata\local\programs\python\python35\lib\imp.py", line 172, in load_source module = _load(spec) File "<frozen importlib._bootstrap>", line 693, in _load File "<frozen importlib._bootstrap>", line 673, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 662, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\swig_ext\tests\test_example2.py", line 4, in <module> from swig_ext import example2 ImportError: cannot import name 'example2'

====================================================================== ERROR: test_compile1 (test_system_info.TestSystemInfoReading) ---------------------------------------------------------------------- Traceback (most recent call last): File "c:\users\josef\appdata\local\programs\python\python35\lib\site-packages\numpy\distutils\tests\test_system_info.py", line 182, in test_compile1 c.compile([os.path.basename(self._src1)], output_dir=self._dir1) File "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py", line 317, in compile self.initialize() File "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py", line 210, in initialize vc_env = _get_vc_env(plat_spec) File "c:\users\josef\appdata\local\programs\python\python35\lib\distutils\_msvccompiler.py", line 85, in _get_vc_env raise DistutilsPlatformError("Unable to find vcvarsall.bat") distutils.errors.DistutilsPlatformError: Unable to find vcvarsall.bat

Running it again

for Windows 8.1 python 3.4

The above is with `nosetests numpy` Ran 5232 tests in 134.933s FAILED (SKIP=40, errors=16)

if I run numpy.test() in the python session, I get Ran 5191 tests in 22.506s OK (KNOWNFAIL=10, SKIP=19)

for Windows 10 python 3.5

commandline nostetests numpy Ran 5615 tests in 423.469s FAILED (SKIP=33, errors=15)

numpy.test() Ran 5574 tests in 21.546s FAILED (KNOWNFAIL=8, SKIP=12, errors=1) error is only missing vcvarsall.bat

Why is there the large difference in how we run the tests?

(I'm getting old or forgetting non-stats things.) default of .test() is skip slow, nosetests doesn't skip I'm getting the same results also on Winpython 3.4.3.6 on Windows 10. But python 3.5 install without distribution is not working for me. I get dll load failed, missing dll, all over the place with the default PSF install when importing Gohlke scipy. So, I'm back to winpython and python 3.4 Josef

Related: The example from #6923 doesn't crash in my settings, neither python 3.4 nor 3.5.

Josef

...

Chuck

_______________________________________________ NumPy-Discussion mailing list NumPy-Discussion@scipy.org https://mail.scipy.org/mailman/listinfo/numpy-discussion

On Mon, Jan 4, 2016 at 9:38 PM, Charles R Harris <charlesr.harris@gmail.com> wrote:

The failed tests require pyrex, fortran, and swig. The refcount error comes and goes, probably the test isn't very good. Ralf, is there any reason to keep the various extension building tests? They are very old.

There are f2py tests that are useful - if they fail then building anything else with f2py fails as well. However those are all in f2py/tests/ IRRC, not in distutils/tests.

I don't know what the recommendation on using nosetests is,

Don't use it (it definitely gives test errors due to not having the knownfailure plugin), use either runtests.py or numpy.test().

but probably it is finding too many tests.

It's doing its job here in finding these though. It looks like these tests need either fixing (the extensions aren't built) or removing. I'll have a look tonight. Ralf