Mailman 3 August 2012 - cython-devel

Re: [Cython] Bringing Cython and PyPy closer together
by Stefan Behnel March 29, 2015

March 29, 2015

[copied here from PyPy mailing list] Stefan Behnel, 15.02.2012 12:32: > The current state of the discussion seems to be that PyPy provides ways to > talk to C code, but nothing as complete as CPython's C-API in the sense > that it allows efficient two-way communication between C code and Python > objects. Thus, we need to either improve this or look for alternatives. > > In order to get us more focussed on what can be done and what the > implications are, so that we may eventually be able to decide what should > be done, I started a Wiki page for a PyPy backend CEP (Cython Enhancement > Proposal). > > http://wiki.cython.org/enhancements/pypy The discussion so far makes me rather certain that the most promising short-term solution is to make Cython generate C code that PyPy's cpyext can handle. This should get us a rather broad set of running code somewhat quickly, while requiring the least design-from-scratch type of work in a direction that does not yet allow us to see if it will really make existing code work or not. On top of the basic cpyext interface, it should then be easy to implement obvious optimisations like native C level calls to Cython wrapped functions from PyPy (and potentially also the other direction) and otherwise avoid boxing/unboxing where unnecessary, e.g. for builtins. After all, it all boils down to native code at some point and I'm sure there are various ways to exploit that. Also, going this route will help both projects to get to know each other better. I think that's a required basis if we really aim for designing a more high-level interface at some point. The first steps I see are: - get Cython's test suite to run on PyPy - analyse the failing tests and decide how to fix them - adapt the Cython generated C code accordingly, special casing for PyPy where required Here is a "getting started" guide that tells you how testing works in Cython: http://wiki.cython.org/HackerGuide Once we have the test suite runnable, we can set up a PyPy instance on our CI server to get feed-back on any advances. https://sage.math.washington.edu:8091/hudson/ So, any volunteers or otherwise interested parties to help in getting this to work? Anyone in for financial support? Stefan

2 9

array expressions
by mark florisson Oct. 28, 2012

Oct. 28, 2012

Hey, Here a pull request for element-wise array expressions for Cython: https://github.com/cython/cython/pull/144 It includes the IndexNode refactoring branch as well. This has been the work this last summer for the gsoc, with great supervision from Dag, who helped steer the project in a great direction to make it reusable (it's partially included in Numba and will likely be in Theano in the future, hopefully others as well). I also wrote a thesis for my master's, which can be found here https://github.com/markflorisson88/minivect/tree/master/thesis, which can shed some light on some parts of the design and performance aspects. Performance graphs can also be found here: https://github.com/markflorisson88/minivect/tree/master/bench/graphs So anyway, how would you prefer dealing with the minivect submodule? We could include it verbatim, with any modifications made to minivect directly, since we'd have separate git histories. We could alternatively make it an optional submodule which is only required when actually using array expressions. I like the latter, but anything is fine with me really. Mark

5 39

Hashability of Python memoryviews
by Stefan Behnel Aug. 31, 2012

Aug. 31, 2012

Hi, there's a ticket on the CPython bug tracker where correct hashability of the "memoryview" type is being discussed. I don't have an opinion on it, but some of you might. It could translate into a similar feature for Cython's array and memory view types (no idea if hashability has been considered there yet). http://bugs.python.org/issue15814 Stefan

2 1

Cython 0.17 beta 4 released - final release candidate
by Stefan Behnel Aug. 30, 2012

Aug. 30, 2012

Hello everyone, on behalf of the Cython project team, I'm proud to announce the release of our fourth beta of Cython 0.17. Unless something truly unforseen happens, this will become our final release. So please give it another test run against your code. Cython 0.17 is another major step forward in the development of the language that will make life easier for a lot of users, rounds up some rough edges of the compiler and adds (preliminary) support for CPython 3.3 and PyPy. Download: http://cython.org/release/Cython-0.17b4.tar.gz Release notes: http://wiki.cython.org/ReleaseNotes-0.17 Documentation: http://docs.cython.org/ Major features of this release include: * vastly improved integration with the C++ STL containers http://docs.cython.org/src/userguide/wrapping_CPlusPlus.html#standard-libra… http://docs.cython.org/src/tutorial/strings.html#c-strings * "yield from" delegation between generators (PEP 380) http://www.python.org/dev/peps/pep-0380/ * alpha quality support for PyPy (via cpyext) http://docs.cython.org/src/userguide/pypy.html Several other features and improvements are listed in the release notes: http://wiki.cython.org/ReleaseNotes-0.17 Have fun, Stefan

1 0

Cython 0.17 beta 3 released - release candidate
by Stefan Behnel Aug. 29, 2012

Aug. 29, 2012

Hello everyone, on behalf of the Cython project team, I'm proud to announce the release of our third beta of Cython 0.17. This is our first and hopefully last release candidate for 0.17, another major step forward in the development of the language that will make life easier for a lot of users, rounds up some rough edges of the compiler and adds (preliminary) support for CPython 3.3 and PyPy. Download: http://cython.org/release/Cython-0.17b3.tar.gz Release notes: http://wiki.cython.org/ReleaseNotes-0.17 Documentation: http://docs.cython.org/ Major features of this release include: * vastly improved integration with the C++ STL containers http://docs.cython.org/src/userguide/wrapping_CPlusPlus.html#standard-libra… http://docs.cython.org/src/tutorial/strings.html#c-strings * "yield from" delegation between generators (PEP 380) http://www.python.org/dev/peps/pep-0380/ * alpha quality support for PyPy (via cpyext) http://docs.cython.org/src/userguide/pypy.html Several other features and improvements are listed in the release notes: http://wiki.cython.org/ReleaseNotes-0.17 Have fun, Stefan

4 26

Re: [Cython] [cython-users] Re: Cython 0.17 beta 3 released - release candidate
by Stefan Behnel Aug. 28, 2012

Aug. 28, 2012

Neal Becker, 28.08.2012 18:42: > Neal Becker wrote: > >> All built/tested OK on fedora (devel). >> >> Build log is here: >> http://kojipkgs.fedoraproject.org//work/tasks/8252/4428252/build.log >> >> Should I be concerened about these excluded tests? >> >> Ran 6865 tests in 1601.636s >> OK >> Following tests excluded because of missing dependencies on your system: >> memoryview.memoryviewattrs >> memoryview.numpy_memoryview >> run.numpy_ValueError_T172 >> run.numpy_bufacc_T155 >> run.numpy_cimport >> run.numpy_parallel >> run.numpy_test > > OK, this time including numpy in the build, it appears all tests passed OK. Thanks for testing! Stefan

1 0

cython-devel-tests-pyregr regression
by Vitja Makarov Aug. 24, 2012

Aug. 24, 2012

I've found regression: https://sage.math.washington.edu:8091/hudson/job/cython-devel-tests-pyregr/ -- vitja.

2 14

Fwd: sagemath cluster
by Stefan Behnel Aug. 22, 2012

Aug. 22, 2012

FYI -------- Original Message -------- Subject: sagemath cluster Date: Wed, 22 Aug 2012 10:21:31 -0700 From: William Stein There were some (unknown-to-me) issue with the power in the server room at University of Washington, resulting from a UPS breaking yesterday. The main fileserver was power cycled and "doesn't work" now, which means that all services hosted on the sage.math cluster will be down until this is fixed (or I switch to using an rsync backup).

1 0

Jenkins problem
by Vitja Makarov Aug. 22, 2012

Aug. 22, 2012

Hi! I've a problem running jenknins job https://sage.math.washington.edu:8091/hudson/view/dev-vitek/job/cython-vite… It says "No space left on device". Have something change there? -- vitja.

2 3

two remaining test failures before the release
by Stefan Behnel Aug. 21, 2012

Aug. 21, 2012

Hi, we are now down to two test failures in the NumPy memoryview test: https://sage.math.washington.edu:8091/hudson/job/cython-devel-tests/647/tes… I'm going to make a "final" :) pre-release when they are fixed, so please have a look. Stefan

3 4