[Python-ideas] channel (synchronous queue)
anacrolix at gmail.com
Mon Feb 20 01:57:41 CET 2012
I've created http://bugs.python.org/issue14059 for the
multiprocessing.Barrier. I suggest a new thread be started to continue
discussion on that.
On Mon, Feb 20, 2012 at 8:44 AM, Massimo Di Pierro
<massimo.dipierro at gmail.com> wrote:
> On Feb 19, 2012, at 6:40 PM, Sturla Molden wrote:
>> Den 20.02.2012 00:38, skrev Massimo Di Pierro:
>>> It would be very useful to have something like these channels built-in. Notice that using OS pipes have the problem of a OS dependent size. send is non-blocking for small data-size but becomes blocking for large data sizes. Using OS mkfifo or multiprocessing Queue is better but the OS limits the number of files open by one program.
>> Most MPI implementations use shared memory on localhost. In theory one could implement a queue (deque and lock) using a shared memory region (a file on /tmp or Windows equivalent). It would be extremely fast and could contain any number of "pipes" of arbitrary size.
>> Python-ideas mailing list
>> Python-ideas at python.org
> Python-ideas mailing list
> Python-ideas at python.org
More information about the Python-ideas