[IPython-dev] SciPy Sprint summary

[Brian Granger]

Statra,

On Sat, Jul 17, 2010 at 6:23 AM, Satrajit Ghosh <satra at mit.edu> wrote:
> hi ,
>
> i've pushed my changes to:
>
> http://github.com/satra/ipython/tree/0.10.1-sge

This looks like a great start.  I looked through it quickly just now
and will follow up by looking at Justin's revisions.

> notes:
>
> 1. it starts cleanly. i can connect and execute things. when i kill using
> ctrl-c, the messages appear to indicate that everything shut down well.
> however, the sge ipengine jobs are still running.

I think this is a bug with Twisted on Python 2.6.  I see this in other
contexts as well.

> 2. the pbs option appears to require mpi to be present. i don't think one
> can launch multiple engines using pbs without mpi or without the workaround
> i've applied to the sge engine. basically it submits an sge job for each
> engine that i want to run. i would love to know if a single job can launch
> multiple engines on a sge/pbs cluster without mpi.
>
> cheers,
>
> satra
>
> On Thu, Jul 15, 2010 at 8:55 PM, Satrajit Ghosh <satra at mit.edu> wrote:
>>
>> hi justin,
>>
>> i hope to test it out tonight. from what fernando and i discussed, this
>> should be relatively straightforward. once i'm done i'll push it to my fork
>> of ipython and announce it here for others to test.
>>
>> cheers,
>>
>> satra
>>
>>
>> On Thu, Jul 15, 2010 at 4:33 PM, Justin Riley <justin.t.riley at gmail.com>
>> wrote:
>>>
>>> This is great news. Right now StarCluster just takes advantage of
>>> password-less ssh already being installed and runs:
>>>
>>> $ ipcluster ssh --clusterfile /path/to/cluster_file.py
>>>
>>> This works fine for now, however, having SGE support would allow
>>> ipcluster's load to be accounted for by the queue.
>>>
>>> Is Satra on the list? I have experience with SGE and could help with the
>>> code if needed. I can also help test this functionality.
>>>
>>> ~Justin
>>>
>>> On 07/15/2010 03:34 PM, Fernando Perez wrote:
>>> > On Thu, Jul 15, 2010 at 10:34 AM, Brian Granger <ellisonbg at gmail.com>
>>> > wrote:
>>> >> Thanks for the post.  You should also know that it looks like someone
>>> >> is going to add native SGE support to ipcluster for 0.10.1.
>>> >
>>> > Yes, Satra and I went over this last night in detail (thanks to Brian
>>> > for the pointers), and he said he might actually already have some
>>> > code for it.  I suspect we'll get this in soon.
>>> >
>>> > Cheers,
>>> >
>>> > f
>>>
>>> _______________________________________________
>>> IPython-dev mailing list
>>> IPython-dev at scipy.org
>>> http://mail.scipy.org/mailman/listinfo/ipython-dev
>>
>
>
> _______________________________________________
> IPython-dev mailing list
> IPython-dev at scipy.org
> http://mail.scipy.org/mailman/listinfo/ipython-dev
>
>



-- 
Brian E. Granger, Ph.D.
Assistant Professor of Physics
Cal Poly State University, San Luis Obispo
bgranger at calpoly.edu
ellisonbg at gmail.com