[Python-Dev] Thoughts fresh after EuroPython

Jörg Blank ebo at 4geeks.de
Mon Jul 26 17:04:23 CEST 2010


> According to CSP advicates, this approach will break down when you
> need more than 8-16 cores since cache coherence breaks down at 16
> cores. Then you would have to figure out a message-passing approach
> (but the messages would have to be very fast).

It does break down, and probably always will be. Imho this gets worse
with NUMA architectures becoming more prevalent. But even with 50 cores
you may be happy to have something run away with 4-8 threads shared
memory from time to time.

Developing good message based schemes is important for the long run, but
I think multithreaded parallelization will become more common, before we
see a general switch to messages.

Regards,
Joerg Blank



More information about the Python-Dev mailing list