[IPython-dev] SciPy Sprint summary

[Matthieu Brucher]

>
> I've added a os.chmod right after the file was created, but I still
> have this error:
>
> line 8: /tmp/tmpDEQR0U: Text file busy
>
> Matthieu

OK, I've managed to get LSF working. I had to modify this in
ipcluster.py at line 335 as well as import stat:

        self._temp_file.file.flush()
+        os.chmod(self._temp_file.name, stat.S_IRUSR | stat.S_IWUSR |
stat.S_IXUSR)
+        self._temp_file.file.close()
        d = getProcessOutput(self.submit_command,
                             [self.template_file],
                             env=os.environ)

Unfortunately, I only get one engine instead of four:
2010-07-21 15:27:20+0200 [-] Log opened.
2010-07-21 15:27:20+0200 [-] Process ['ipcontroller',
'--logfile=/users/brucher/.ipython/log/ipcontroller', '-x', '-y'] has
started with pid=204117
2010-07-21 15:27:20+0200 [-] Waiting for controller to finish starting...
2010-07-21 15:27:22+0200 [-] Controller started
2010-07-21 15:27:22+0200 [-] starting 4 engines
2010-07-21 15:27:22+0200 [-] using default ipengine LSF script:
        #BSUB -J ipengine[1-4]
        eid=$(($LSB_JOBINDEX - 1))
        ipengine --logfile=ipengine${eid}.log

2010-07-21 15:27:22+0200 [-] Job started with job id: '17448'


And then in IPython:

In [1]: from IPython.kernel import client

In [9]: mec = client.MultiEngineClient()

In [10]: mec.get_ids()
Out[10]: [0]

In [13]: mec.activate()

In [14]: %px print "test"
Parallel execution on engines: all
Out[14]:
<Results List>
[0] In [1]: print "test"
[0] Out[1]: test

In [15]: mec.kill()
Out[15]: [None]

Two issues:
- only one engine visible instead of four
- when I kill the mec, the job is finished, but ipcluster still runs.

Matthieu
-- 
Information System Engineer, Ph.D.
Blog: http://matt.eifelle.com
LinkedIn: http://www.linkedin.com/in/matthieubrucher