[IPython-dev] Qt console making great strides, please use it and let us know what works, what doesn't

[Dave Hirschfeld]

I did some testing of the parallel code, but ran into the same problem as:

http://article.gmane.org/gmane.comp.python.ipython.user/5616

C:\dev\code>python C:\dev\bin\Python26\Scripts\ipcluster start -n 4
[IPClusterApp] Using existing cluster dir:
C:\Users\dhirschfeld\.ipython\cluster_default
[IPClusterApp] Cluster directory set to:
C:\Users\dhirschfeld\.ipython\cluster_default
[IPClusterApp] Starting ipcluster with [daemon=False]
[IPClusterApp] Creating pid file:
C:\Users\dhirschfeld\.ipython\cluster_default\pid\ipcluster.pid
[IPClusterApp] Starting LocalControllerLauncher: ['C:\\dev\\bin\\Python26
\\python.exe', '-u', u'C:\\dev\\bin\\Python26\\lib\\site-packages\\IPython
\\parallel\\apps\\ipcontrollerapp.py', '--log-to-file', '--log-level', '20', 
'--cluster-dir', u'C:\\Users\\dhirschfeld\\.ipython\\cluster_default']
[IPClusterApp] Process 'C:\\dev\\bin\\Python26\\python.exe' started: 7096
[IPClusterApp] IPython cluster: started
Assertion failed: Socket operation on non-socket (..\..\..\src\zmq.cpp:632)

I sent an email to the Users list but it appears to have gotten lost. So I've 
reproduced it below:


Starting the controller and engines seperately appeared to work:

c:\dev\code>python C:\dev\bin\Python26\Scripts\ipcontroller
[IPControllerApp] Using existing cluster dir:
C:\Users\dhirschfeld\.ipython\cluster_default
[IPControllerApp] Cluster directory set to:
C:\Users\dhirschfeld\.ipython\cluster_default
[IPControllerApp] Hub listening on tcp://127.0.0.1:57543 for registration.
[IPControllerApp] Hub using DB backend:
'IPython.parallel.controller.dictdb.DictDB'
[IPControllerApp] hub::created hub
[IPControllerApp] task::using Python leastload Task scheduler
[IPControllerApp] Heartmonitor started
[IPControllerApp] Creating pid file:
C:\Users\dhirschfeld\.ipython\cluster_default\pid\ipcontroller.pid
tcp://127.0.0.1:57564
tcp://127.0.0.1:57565
tcp://127.0.0.1:57544
tcp://127.0.0.1:57557
Scheduler started...
<IPython.parallel.controller.scheduler.TaskScheduler object at 0x029C4E10>


c:\dev\code>python C:\dev\bin\Python26\Scripts\ipengine
[IPEngineApp] Using existing cluster dir:
C:\Users\dhirschfeld\.ipython\cluster_default
[IPEngineApp] Cluster directory set to:
C:\Users\dhirschfeld\.ipython\cluster_default
[IPEngineApp] registering
[IPEngineApp] Completed registration with id 0

...

In IPython I can connect to the engines but any attempt to do any calculation 
results in each engine dying with the error 
"Assertion failed: Invalid argument (..\..\..\src\zmq.cpp:632)" in the console.


from IPython.parallel import Client

rc = Client()

rc.ids
Out[3]: [0, 1]

dview = rc[:]

parallel_result = dview.map_sync(lambda x: x**10, range(32))
---------------------------------------------------------------------------
CompositeError                            Traceback (most recent call last)
C:\dev\bin\Python26\Scripts\<ipython-input-5-678d85c014d0> in <module>()
----> 1 parallel_result = dview.map_sync(lambda x: x**10, range(32))

C:\dev\bin\Python26\lib\site-packages\IPython\parallel\client\view.pyc 
in map_sync(self, f, *sequences, **kwargs)
    336             raise TypeError("map_sync doesn't take a `block` keyword 
                                     argument.")
    337         kwargs['block'] = True
--> 338         return self.map(f,*sequences,**kwargs)
    339 
    340     def imap(self, f, *sequences, **kwargs):

C:\dev\bin\Python26\Scripts\<string> in map(self, f, *sequences, **kwargs)

C:\dev\bin\Python26\lib\site-packages\IPython\parallel\client\view.pyc
in spin_after(f, self, *args, **kwargs)
     62 def spin_after(f, self, *args, **kwargs):
     63     """call spin after the method."""
---> 64     ret = f(self, *args, **kwargs)
     65     self.spin()
     66     return ret

C:\dev\bin\Python26\lib\site-packages\IPython\parallel\client\view.pyc
in map(self, f, *sequences, **kwargs)
    571         assert len(sequences) > 0, 
                        "must have some sequences to map onto!"
    572         pf = ParallelFunction(self, f, block=block, **kwargs)
--> 573         return pf.map(*sequences)
    574 
    575     def execute(self, code, targets=None, block=None):

C:\dev\bin\Python26\lib\site-packages\IPython\parallel\client\remotefunction.pyc
in map(self, *sequences)
    193         self._map = True
    194         try:
--> 195             ret = self.__call__(*sequences)
    196         finally:
    197             del self._map

C:\dev\bin\Python26\lib\site-packages\IPython\parallel\client\remotefunction.pyc
in __call__(self, *sequences)
    179         if self.block:
    180             try:
--> 181                 return r.get()
    182             except KeyboardInterrupt:
    183                 return r

C:\dev\bin\Python26\lib\site-packages\IPython\parallel\client\asyncresult.pyc
in get(self, timeout)
     96                 return self._result
     97             else:
---> 98                 raise self._exception
     99         else:
    100             raise error.TimeoutError("Result not ready.")

CompositeError: one or more exceptions from call to method: <lambda>
[Engine Exception]EngineError: Engine 0 died while running task 
'c89ab757-1db6-4976-a7aa-86b859fe8f4f'
[Engine Exception]EngineError: Engine 1 died while running task 
'436ffdf6-c082-45e0-a7f1-b09c10c74fe4'


NB: pyzmq tests seem to pass except for the one below which seems like it's
getting tripped up ove a deprecation warning.

C:\dev\bin\Python26\Lib\site-packages\zmq\tests>nosetests --pdb-failures
................................S...............................>
c:\dev\bin\python26\lib\site-packages\zmq\tests\__init__.py(104)
assertRaisesErrno() -> got '%s'" % (zmq.ZMQError(errno), zmq.ZMQError(e.errno)))
(Pdb) print e.message
C:\dev\bin\Python26\Lib\site-packages\zmq\tests\__init__.py:1:
DeprecationWarning: BaseException.message has been deprecated as of Python 2.6
(Pdb) exit
F........
======================================================================
FAIL: test_create (zmq.tests.test_socket.TestSocket)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\dev\bin\Python26\Lib\site-packages\zmq\tests\test_socket.py", line
47, in test_create
    self.assertRaisesErrno(zmq.EPROTONOSUPPORT, s.bind, 'ftl://a')
  File "C:\dev\bin\Python26\Lib\site-packages\zmq\tests\__init__.py", line 104,
in assertRaisesErrno
    got '%s'" % (zmq.ZMQError(errno), zmq.ZMQError(e.errno)))
AssertionError: wrong error raised, expected 'Unknown error' got 'Protocol not
supported'

----------------------------------------------------------------------
Ran 73 tests in 29.960s

FAILED (SKIP=1, failures=1)

HTH,
Dave