[Baypiggies] clustering

[Andy Wiggin]

On 8/30/06, Jarrod Millman <millman at berkeley.edu> wrote:
> The ipython developers have a nice write up about how their new design
> will handle
> interactive parallel computing:
> http://projects.scipy.org/ipython/ipython/wiki/NewDesign/ParallelOverview
>

I don't have first hand experience with this stuff, but I was
researching this style of computing a while back. I would look at what
the scipy project is doing, and in general look at the techniques used
by the gene crunching folks (e.g., http://biopython.org/), as they
tend to use scripting, parallelization, and large data sets.

I liked these presentations, apparently produced by Enthought. They
may be a bit dated at this point, however.

  http://www.iwce.nanohub.org/talks/python/python_talk1.pdf
  http://www.iwce.nanohub.org/talks/python/python_talk2.pdf

Page 47 of talk 2 starts an overview of parallel programming with
python. COW might meet your needs as it's a pretty low rent method for
parallel job execution, and probably easier than cooking up your own
RPC solution.

Good luck. Sounds like fun!
-Andy