Parallel/distributed generator

[Diez B. Roggisch]

George Sakkis wrote:

> I'm looking for any existing packages or ideas on how to implement the
> equivalent of a generator (in the Python sense, i.e.
> http://www.python.org/dev/peps/pep-0255/) in a parallel/distributed
> way. As a use case, imagine a function that generates a range of
> primes. I'd like to be able to do something along the following lines:
> 
> def iterprimes(start=1, end=None):
>    # ...
>    yield prime
> 
> 
> # rpc-related initialization
> ...
> rpc_proxy = some_rpc_lib(iterprimes, start=1e6, end=1e12)
> for prime in proxy:
>     print prime
> 
> Is there any module out there that does anything close to this ?

Have you tried using pyro to just return a generator? After all, it's just
an object with a next()-method, that raises a certain exception. I can't
see why pyro shouldn't be able to handle that.

diez