A new webpage promoting Compiler technology for CPython
Hey all, With Numba and Blaze we have been doing a lot of work on what essentially is compiler technology and realizing more and more that we are treading on ground that has been plowed before with many other projects. So, we wanted to create a website and perhaps even a mailing list or forum where people could coordinate and communicate about compiler projects, compiler tools, and ways to share efforts and ideas. The website is: http://compilers.pydata.org/ This page is specifically for Compiler projects that either integrate with or work directly with the CPython runtime which is why PyPy is not presently listed. The PyPy project is a great project but we just felt that we wanted to explicitly create a collection of links to compilation projects that are accessible from CPython which are likely less well known. But that is just where we started from. The website is intended to be a community website constructed from a github repository. So, we welcome pull requests from anyone who would like to see the website updated to reflect their related project. Jon Riehl (Mython, PyFront, ROFL, and many other interesting projects) and Stephen Diehl (Blaze) and I will be moderating the pull requests to begin with. But, we welcome others with similar interests to participate in that effort of moderation. The github repository is here: https://github.com/pydata/compilerswebpage This is intended to be a community website for information spreading, and so we welcome any and all contributions. Thank you, Travis Oliphant
Le 15/02/2013 07:11, Travis Oliphant a écrit :
This page is specifically for Compiler projects that either integrate with or work directly with the CPython runtime which is why PyPy is not presently listed. The PyPy project is a great project but we just felt that we wanted to explicitly create a collection of links to compilation projects that are accessible from CPython which are likely less well known.
I won't argue here with the exclusion of PyPy, but RPython is definitely compiler technology that runs on CPython 2.6/2.7. For now, it is only accessible from a source checkout of PyPy but that will soon change and "pip install rpython" isn't far off. Since it's a whole tool chain, it has a wealth of functionalities, though they aren't always welldocumented or easy to access from the outside: bytecode analysis, type inference, several GC implementations, a JIT generator, assemblers for several architectures, ... Cheers, Ronan
Sorry for injecting... Which page is this about? On Feb 16, 2013, at 9:59 AM, Ronan Lamy wrote:
Le 15/02/2013 07:11, Travis Oliphant a écrit :
This page is specifically for Compiler projects that either integrate with or work directly with the CPython runtime which is why PyPy is not presently listed. The PyPy project is a great project but we just felt that we wanted to explicitly create a collection of links to compilation projects that are accessible from CPython which are likely less well known.
I won't argue here with the exclusion of PyPy, but RPython is definitely compiler technology that runs on CPython 2.6/2.7. For now, it is only accessible from a source checkout of PyPy but that will soon change and "pip install rpython" isn't far off.
Since it's a whole tool chain, it has a wealth of functionalities, though they aren't always welldocumented or easy to access from the outside: bytecode analysis, type inference, several GC implementations, a JIT generator, assemblers for several architectures, ...
Cheers, Ronan
_______________________________________________ NumPyDiscussion mailing list NumPyDiscussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpydiscussion
Le 16/02/2013 16:08, Massimo DiPierro a écrit :
Sorry for injecting... Which page is this about?
http://compilers.pydata.org/ Cf. the post I answered to.
On Feb 16, 2013, at 9:59 AM, Ronan Lamy wrote:
Le 15/02/2013 07:11, Travis Oliphant a écrit :
This page is specifically for Compiler projects that either integrate with or work directly with the CPython runtime which is why PyPy is not presently listed. The PyPy project is a great project but we just felt that we wanted to explicitly create a collection of links to compilation projects that are accessible from CPython which are likely less well known.
I won't argue here with the exclusion of PyPy, but RPython is definitely compiler technology that runs on CPython 2.6/2.7. For now, it is only accessible from a source checkout of PyPy but that will soon change and "pip install rpython" isn't far off.
Since it's a whole tool chain, it has a wealth of functionalities, though they aren't always welldocumented or easy to access from the outside: bytecode analysis, type inference, several GC implementations, a JIT generator, assemblers for several architectures, ...
Cheers, Ronan
_______________________________________________ NumPyDiscussion mailing list NumPyDiscussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpydiscussion
_______________________________________________ NumPyDiscussion mailing list NumPyDiscussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpydiscussion
Thank you. Should this be listed: https://github.com/mdipierro/ocl ? It is based on meta (which is listed) and pyopencl (which is listed, only used to run with opencl) and has some overlap with Cython and Pyjamas although it is not based on any of them. It is minimalist in scope: it only coverts to C/JS/OpenCL a common subset of those languages. But it does what it advertises. It is written in pure python and implemented and implemented in a single file. Massimo On Feb 16, 2013, at 10:13 AM, Ronan Lamy wrote:
Le 16/02/2013 16:08, Massimo DiPierro a écrit :
Sorry for injecting... Which page is this about?
http://compilers.pydata.org/ Cf. the post I answered to.
On Feb 16, 2013, at 9:59 AM, Ronan Lamy wrote:
Le 15/02/2013 07:11, Travis Oliphant a écrit :
This page is specifically for Compiler projects that either integrate with or work directly with the CPython runtime which is why PyPy is not presently listed. The PyPy project is a great project but we just felt that we wanted to explicitly create a collection of links to compilation projects that are accessible from CPython which are likely less well known.
I won't argue here with the exclusion of PyPy, but RPython is definitely compiler technology that runs on CPython 2.6/2.7. For now, it is only accessible from a source checkout of PyPy but that will soon change and "pip install rpython" isn't far off.
Since it's a whole tool chain, it has a wealth of functionalities, though they aren't always welldocumented or easy to access from the outside: bytecode analysis, type inference, several GC implementations, a JIT generator, assemblers for several architectures, ...
Cheers, Ronan
_______________________________________________ NumPyDiscussion mailing list NumPyDiscussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpydiscussion
_______________________________________________ NumPyDiscussion mailing list NumPyDiscussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpydiscussion
_______________________________________________ NumPyDiscussion mailing list NumPyDiscussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpydiscussion
We should take this discussion off list. Please email me directly if you have questions. But, we are open to listing all of these tools. On Feb 16, 2013 10:46 AM, "Massimo DiPierro" <massimo.dipierro@gmail.com> wrote:
Thank you.
Should this be listed: https://github.com/mdipierro/ocl ?
It is based on meta (which is listed) and pyopencl (which is listed, only used to run with opencl) and has some overlap with Cython and Pyjamas although it is not based on any of them. It is minimalist in scope: it only coverts to C/JS/OpenCL a common subset of those languages. But it does what it advertises. It is written in pure python and implemented and implemented in a single file.
Massimo
On Feb 16, 2013, at 10:13 AM, Ronan Lamy wrote:
Le 16/02/2013 16:08, Massimo DiPierro a écrit :
Sorry for injecting... Which page is this about?
http://compilers.pydata.org/ Cf. the post I answered to.
On Feb 16, 2013, at 9:59 AM, Ronan Lamy wrote:
Le 15/02/2013 07:11, Travis Oliphant a écrit :
This page is specifically for Compiler projects that either integrate
with or work directly with the CPython runtime which is why PyPy is not
presently listed. The PyPy project is a great project but we just felt
that we wanted to explicitly create a collection of links to compilation
projects that are accessible from CPython which are likely less well known.
I won't argue here with the exclusion of PyPy, but RPython is definitely
compiler technology that runs on CPython 2.6/2.7. For now, it is only
accessible from a source checkout of PyPy but that will soon change and
"pip install rpython" isn't far off.
Since it's a whole tool chain, it has a wealth of functionalities,
though they aren't always welldocumented or easy to access from the
outside: bytecode analysis, type inference, several GC implementations,
a JIT generator, assemblers for several architectures, ...
Cheers,
Ronan
_______________________________________________
NumPyDiscussion mailing list
NumPyDiscussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpydiscussion
_______________________________________________
NumPyDiscussion mailing list
NumPyDiscussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpydiscussion
_______________________________________________ NumPyDiscussion mailing list NumPyDiscussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpydiscussion
_______________________________________________ NumPyDiscussion mailing list NumPyDiscussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpydiscussion
On Sat, Feb 16, 2013 at 3:56 PM, Travis Oliphant <travis@continuum.io> wrote:
We should take this discussion off list.
Just as a bystander interested in this: why? It seems that OCL is within the scope of what's being proposed and another entrant into the vibrant new world of compilerextended machinery for fast numerical work in cpython, so I suspect I'm not the only numpy user curious to know the answer onlist. I know sometimes there are legitimate reasons to take a discussion offlist, but in this case it seemed to be a perfectly reasonable question that also made me curious (as I only learned of OCL thanks to this discussion). Cheers, f
I only meant off the NumPy list as it seems this is offtopic for this forum. I thought I made clear in the rest of the paragraph that we would *love* this contribution. I recommend a pull request. If you want to discuss this in public. Let's have the discussion over at numfocus@googlegroups.com until a more specific list is created. On Sat, Feb 16, 2013 at 6:14 PM, Fernando Perez <fperez.net@gmail.com>wrote:
On Sat, Feb 16, 2013 at 3:56 PM, Travis Oliphant <travis@continuum.io> wrote:
We should take this discussion off list.
Just as a bystander interested in this: why? It seems that OCL is within the scope of what's being proposed and another entrant into the vibrant new world of compilerextended machinery for fast numerical work in cpython, so I suspect I'm not the only numpy user curious to know the answer onlist.
I know sometimes there are legitimate reasons to take a discussion offlist, but in this case it seemed to be a perfectly reasonable question that also made me curious (as I only learned of OCL thanks to this discussion).
Cheers,
f _______________________________________________ NumPyDiscussion mailing list NumPyDiscussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpydiscussion
On Sat, Feb 16, 2013 at 4:24 PM, Travis Oliphant <travis@continuum.io> wrote:
If you want to discuss this in public. Let's have the discussion over at numfocus@googlegroups.com until a more specific list is created.
Sounds good. I actually think numfocus is a great list for these kind of 'inbetween' discussions that don't quite fit a specific project too well, but for things that also don't warrant their own mailing list yet. I'd love it if the numfocus list was always seen as a good space for that kind of 'connective tissue' work in our own community. Obviously there's a point where such topics may evolve into their own projects, but in the past we haven't had a good space for that kind of thing, and in my mind the numfocus list can really help play that role. Cheers, f
participants (5)

Fernando Perez

Massimo DiPierro

Ronan Lamy

Travis Oliphant

Travis Oliphant