Mailman 3 July 2019 - SciPy-Dev

NumPy 1.17.0rc1 released
by Charles R Harris 27 Jul '19

27 Jul '19

Hi All, On behalf of the NumPy team I am pleased to announce the release of NumPy 1.17.0rc1. The 1.17 release contains a number of new features that should substantially improve its performance and usefulness. The Python versions supported are 3.5-3.7, note that Python 2.7 has been dropped. Python 3.8b1 should work with the released source packages, but there are no guarantees about future releases. Highlights of this release are: - A new extensible random module along with four selectable random numbe5 generators and improved seeding designed for use in parallel processes has been added. The currently available bit generators are MT19937, PCG64, Philox, and SFC64. - NumPy's FFT implementation was changed from fftpack to pocketfft, resulting in faster, more accurate transforms and better handling of datasets of prime length. - New radix sort and timsort sorting methods. It is currently not possible to choose which will be used, but they are hardwired to the datatype and used when either ``stable`` or ``mergesort`` is passed as the method. - Overriding numpy functions is now possible by default Downstream developers should use Cython >= 0.29.10 for Python 3.8 support and OpenBLAS >= 3.7 (not currently out) to avoid problems on the Skylake architecture. The NumPy wheels on PyPI are built from the OpenBLAS development branch in order to avoid those problems. Wheels for this release can be downloaded from PyPI <https://pypi.org/project/numpy/1.17.0rc1/>, source archives and release notes are available from Github <https://github.com/numpy/numpy/releases/tag/v1.17.0rc1>. *Contributors* A total of 142 people contributed to this release. People with a "+" by their names contributed a patch for the first time. - Aaron Voelker + - Abdur Rehman + - Abdur-Rahmaan Janhangeer + - Abhinav Sagar + - Adam J. Stewart + - Adam Orr + - Albert Thomas + - Alex Watt + - Alexander Blinne + - Alexander Shadchin - Allan Haldane - Ander Ustarroz + - Andras Deak - Andreas Schwab - Andrew Naguib + - Andy Scholand + - Ankit Shukla + - Anthony Sottile - Antoine Pitrou - Antony Lee - Arcesio Castaneda Medina + - Assem + - Bernardt Duvenhage + - Bharat Raghunathan + - Bharat123rox + - Bran + - Bruce Merry + - Charles Harris - Chirag Nighut + - Christoph Gohlke - Christopher Whelan + - Chuanzhu Xu + - Daniel Hrisca - Daniel Lawrence + - Debsankha Manik + - Dennis Zollo + - Dieter Werthmüller + - Dominic Jack + - EelcoPeacs + - Eric Larson - Eric Wieser - Fabrice Fontaine + - Gary Gurlaskie + - Gregory Lee + - Gregory R. Lee - Hameer Abbasi - Haoyu Sun + - He Jia + - Hunter Damron + - Ian Sanders + - Ilja + - Isaac Virshup + - Isaiah Norton + - Jaime Fernandez - Jakub Wilk - Jan S. (Milania1) + - Jarrod Millman - Javier Dehesa + - Jeremy Lay + - Jim Turner + - Jingbei Li + - Joachim Hereth + - John Belmonte + - John Kirkham - John Law + - Jonas Jensen - Joseph Fox-Rabinovitz - Joseph Martinot-Lagarde - Josh Wilson - Juan Luis Cano Rodríguez - Julian Taylor - Jérémie du Boisberranger + - Kai Striega + - Katharine Hyatt + - Kevin Sheppard - Kexuan Sun - Kiko Correoso + - Kriti Singh + - Lars Grueter + - Maksim Shabunin + - Manvi07 + - Mark Harfouche - Marten van Kerkwijk - Martin Reinecke + - Matthew Brett - Matthias Bussonnier - Matti Picus - Michel Fruchart + - Mike Lui + - Mike Taves + - Min ho Kim + - Mircea Akos Bruma - Nick Minkyu Lee - Nick Papior - Nick R. Papior + - Nicola Soranzo + - Nimish Telang + - OBATA Akio + - Oleksandr Pavlyk - Ori Broda + - Paul Ivanov - Pauli Virtanen - Peter Andreas Entschev + - Peter Bell + - Pierre de Buyl - Piyush Jaipuriayar + - Prithvi MK + - Raghuveer Devulapalli + - Ralf Gommers - Richard Harris + - Rishabh Chakrabarti + - Riya Sharma + - Robert Kern - Roman Yurchak - Ryan Levy + - Sebastian Berg - Sergei Lebedev + - Shekhar Prasad Rajak + - Stefan van der Walt - Stephan Hoyer - SuryaChand P + - Søren Rasmussen + - Thibault Hallouin + - Thomas A Caswell - Tobias Uelwer + - Tony LaTorre + - Toshiki Kataoka - Tyler Moncur + - Tyler Reddy - Valentin Haenel - Vrinda Narayan + - Warren Weckesser - Weitang Li - Wojtek Ruszczewski - Yu Feng - Yu Kobayashi + - Yury Kirienko + - @aashuli + - @euronion + - @luzpaz - @parul + - @spacescientist + Cheers, Charles Harris

1 2

PR for the addition of scipy.stats.mgc
by Sambit Panda 26 Jul '19

26 Jul '19

Hello all, For the past few weeks, I have been working on integrating MGC into scipy.stats as an additional “correlation function” (https://github.com/scipy/scipy/pull/10524). Just for reference, I had sent previous messages about this here: https://mail.python.org/pipermail/scipy-dev/2019-June/023544.html and https://mail.python.org/pipermail/scipy-dev/2019-June/023566.html. For the time being, I have only added MGC and not any of the other implementations (will do this during the next few weeks). I followed the SciPy development workflow instructions and invite your review. Thank you, Sambit Panda

2 1

Removal of fortran FFTPACK
by Peter Bell 26 Jul '19

26 Jul '19

Hello all, As of gh-10493<https://github.com/scipy/scipy/pull/10493>, pypocketfft now implements the discrete sine and cosine transforms meaning it is a complete replacement for the fortran FFTPACK library. In gh-10507<https://github.com/scipy/scipy/pull/10507>, I have proposed removing the fortran code from scipy completely and having scipy.fftpack depend on scipy.fft. This means that scipy.fftpack will now see some of the additional benefits of scipy.fft<https://github.com/scipy/scipy/wiki/Release-note-entries-for-SciPy-1.4.0#sc…> such as: long double transforms, GIL release, bluestein's algorithm, improved accuracy and improved multi-dimensional transform performance. However, there may be some cases where this affects users. For example, it will break anyone importing the private scipy.fftpack._fftpack submodule and the DCT and DST type-I are now about two times slower (but orders of magnitude more accurate). Regards, Peter

3 2

SciPy 1.0 preprint is up
by Tyler Reddy 25 Jul '19

25 Jul '19

The community may like to know that the arXiv preprint of the SciPy 1.0 paper is up: https://arxiv.org/abs/1907.10121 The email with password to claim ownership on the paper should start circulating to co-authors soon. Submitting the manuscript to a peer reviewed journal is also likely to happen soon (again). Best wishes, Tyler

2 1

Re: [SciPy-Dev] Season of Docs applications
by Ralf Gommers 25 Jul '19

25 Jul '19

Hi all, Here is a short update on Season of Docs. We are very happy and impressed with the number and quality of tech writers who applied to NumPy and SciPy. We decided we would really like to accept more people than the number of slots Google is likely to give us. We have found some more funding and mentoring bandwidth to be able to do so. After Google announces which candidates have been accepted, we will reach out to the next people on our shortlist and offer them the same mentoring and funding for their proposed projects as the accepted GSoD writers. I'm really looking forward to an interesting and productive fall working with several of you. Stay tuned! Cheers, Ralf On Wed, Jul 17, 2019 at 5:12 PM Ralf Gommers <ralf.gommers(a)gmail.com> wrote: > Hi GSoD applicants, > > To start with, I want to thank all of you who applied! There's a lot of > interest in helping improve NumPy's documentation and web presence, which > is awesome to see. During the application phase, we have interacted with > some of you already, and I will reach out to others over the next few days. > I'm just writing this email to say thank you and to confirm that yes we did > receive your application. Due to the volume of applications, it will be > difficult to reach out personally to all of you (I'll do my best though!), > hence this email. > > Really looking forward to what will happen next! > > Cheers, > Ralf > >

1 0

Combinatorial optimization in scipy.optimize
by Søren Fuglede Jørgensen 23 Jul '19

23 Jul '19

Hi SciPy-Dev This question is motivated by the recent improvements to scipy.optimize.linear_sum_assignment. [0] Here, we get a much improved algorithm for solving minimum weight perfect matching in bipartite graphs (which is excellent). Now, this problem is one in a large family of combinatorial optimization problems on packing and covering, and what I'm wondering is if SciPy should be the home for a general class of efficient algorithms for solving those? Most of these can be phrased in terms of graph theory, and indeed networkx already contains implementations of many classical algorithms (and I was surprised to find that it didn't have anything matching linear_sum_assignment directly; it does have an implementation of the Blossom algorithm). So there's some overlap of scope here, but I guess that's not a problem in and by itself, but it had me wondering where the split should be? Just to phrase this in terms of (a very incomplete list of) examples (some of which have polynomial solutions, some of which don't), would there be appetite for including into scipy.optimize algorithms for solving e.g. 1. other covering/packing problems (e.g. min set/vertex/edge cover, maximum matching, ...), 2. maximum flow, 3. shortest path, 4. travelling salesman, 5. circuit minimization? Søren [0]: https://github.com/scipy/scipy/pull/10296

5 6

to our Season of Docs applicants
by Ralf Gommers 18 Jul '19

18 Jul '19

Hi everyone, To start with, I want to thank all of you who applied for GSoD! There's a lot of interest in helping improve SciPy's documentation and web presence, which is awesome to see. During the application phase, we have interacted with some of you already, and I will reach out to others over the next few days. I'm just writing this email to say thank you and to confirm that yes we did receive your application. Due to the volume of applications, it will be difficult to reach out personally to all of you (I'll do my best though!), hence this email. Really looking forward to what will happen next! Cheers, Ralf

1 0

welcome Peter and Greg to the core team
by Ralf Gommers 17 Jul '19

17 Jul '19

Hi all, On behalf of the SciPy developers I'd like to welcome Peter Bell and Gregory Lee as members of the core team. Peter is our current GSoC participant, and he's doing a really amazing job on scipy.fft. Also, he's commenting on other PRs/issues and pitching in in other places. Here is an overview of his SciPy PRs: https://github.com/scipy/scipy/pulls/peterbell10 Greg is one of the mentors on Peter's GSoC project (together with Eric Larson), has contributed to SciPy regularly in the past, and is also a maintainer of both PyWavelets and PyFFTW. Here is an overview of his SciPy PRs: https://github.com/scipy/scipy/pulls/grlee77 I'm looking forward to Peter and Greg's continued contributions! Cheers, Ralf

5 4

macOS minimum version and scipy.fft
by Peter Bell 13 Jul '19

13 Jul '19

Hello All, Does anyone know what the minimum macOS version is that SciPy currently targets? And are there any objections to raising this to 10.9? The context for this is that in gh-10383<https://github.com/scipy/scipy/pull/10383> I am using uarray<https://uarray.readthedocs.io/en/latest/index.html> to add backend support to scipy.fft. uarray was recently rewritten in C++ and uses the thread_local keyword to support context-local backends. It's this single language feature that limits the version as older AppleClang versions didn't implement it. It can be worked around if support is an issue though. - Peter

2 1

Adding Poisson Mean Test to SciPy
by Mahendri Dwicahyo 10 Jul '19

10 Jul '19

Hello scipy-dev community, I am Mahendri, an undergraduate student majoring in Computational Statistics. I notice that as of now, SciPy does not have two sample mean difference test from poisson distribution data. So I search for poisson mean test and I am interested in E-test written by Krishnamoorthy and Thomson because it has more power than its predecessor (C-test) and provide the code. The paper also quite popular with 126 citations. The code is written in Fortran but I am able to port that into python. The python implementation have dependencies for numpy and scipy.stats.poisson, the loop is removed and odd behavior found at original code is solved. Do you think it is possible to incorporate the test into SciPy? Thank you -- Mahendri Dwicahyo Computational Statistics, Polytechnic of Statistics STIS-BPS 15.8727(a)stis.ac.id | mahendri.md(a)gmail.com

1 0