[Python-ideas] solving multi-core Python

[Nick Coghlan]

On 21 June 2015 at 07:42, Eric Snow <ericsnowcurrently at gmail.com> wrote:
> tl;dr Let's exploit multiple cores by fixing up subinterpreters,
> exposing them in Python, and adding a mechanism to safely share
> objects between them.
>
> This proposal is meant to be a shot over the bow, so to speak.  I plan
> on putting together a more complete PEP some time in the future, with
> content that is more refined along with references to the appropriate
> online resources.
>
> Feedback appreciated!  Offers to help even more so! :)

It occurred to me in the context of another conversation that you (or
someone else!) may be able to prototype some of the public API ideas
for this using Jython and Vert.x: http://vertx.io/

That idea and some of the initial feedback in this thread also made me
realise that it is going to be essential to keep in mind that there
are key goals at two different layers here:

* design a compelling implementation independent public API for CSP
style programming in Python
* use subinterpreters to implement that API efficiently in CPython

There's a feedback loop between those two goals where limitations on
what's feasible in CPython may constrain the design of the public API,
and the design of the API may drive enhancements to the existing
subinterpreter capability, but we shouldn't lose sight of the fact
that they're *separate* goals.

Cheers,
Nick.

-- 
Nick Coghlan   |   ncoghlan at gmail.com   |   Brisbane, Australia