<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=ISO-8859-15">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Hey all,<br>
<br>
I am using IPython.parallel on a large cluster, where controller and
engines are launched via LSF. My current workflow is as follows:<br>
<br>
<blockquote>#!/bin/bash<br>
python pre_processing.py<br>
ipcluster start --profile=cluster --n=128 > ipcluster.log
2>&1<br>
sleep 120<br>
python main_computation.py<br>
python post_processing.py<br>
</blockquote>
<br>
I am not entirely happy with this, since the 2 minutes are not
always enough depending on the load of the cluster. I believe that
there is a much more elegant way to launch the cluster and check if
all the eninges are running, before proceeding with the main
computation. I would highly appreciate any help.<br>
<br>
Best regards<br>
Florian<br>
<br>
</body>
</html>