[IPython-dev] PyMAD/IPython which list updated
mantegazza at ill.fr
Fri Mar 18 07:21:31 EST 2005
Here is an updated version of our which list for IPython. I attached both
text (reStructured) and html versions.
-------------- next part --------------
An HTML attachment was scrubbed...
-------------- next part --------------
This document describes the interactions needed by PyMAD with IPython.
:Version: $Rev: 1291 $
The philosophy of **PyMAD** is to give to the user a high-level set of tools to
drive a spectrometer. The idea is to directly make some internal python
objects available to the user, and let him combine them.
So, The final user just calls some methods of a few high-level objects to drive
the spectrometer. This as the advantage to make all the python scripting stuff
available, to build some new high level tools.
As we also need a system which can be used from several places, we use a
client/server framework, with **Pyro**. **Pyro** is a distributed objects
server. It just make some remote python objects available to a client as if they
2) User interaction
To avoid the need for the final user to write python scripts and run them to do
something, we need a simple working environment which gives the possibility to
interactively use the server objects. That's where **IPython** solves lots of
**IPython** is an enhanced python shell. It let the user runs python code, but
has many powerfull features :
- history, even between sessions
- colorized and customizable traceback
- code completion
- magic commands
- much more...
**IPython** is on the client-side of **PyMAD**. In fact, there is a special
client which connects to the remote objects of **PyMAD**, launch an embbeded
**IPython** instance, and make the remote objects available to the user, in the
global namespace of **IPython**. This way, the user can drive the spectrometer
through the methods of these objects, or can build complex scripts to do complex
**PyMAD** also use the magic commands to make a simple command interpreter.
The magic functions use TPG (Toy Parser Generator), a easy-to-use parser based
on regexp. These MAD-like commands are for users which don't know about python,
but also to make shortcuts, to avoid the need to write several lines of normal
python code to do some complex but repetitive tasks.
One important point is that **PyMAD** can understand both syntax, which can be
combined. Most of the time, simple commands will be used, but python code can
be more powerfull to do expert measures (with automatic feedback interaction
according to the results), or to prototype a new complex command.
3) **IPython** needs
In order to give users all these powerfull features, **PyMAD** needs to
interacts very closely with **IPython**. In the actual state of IPython we patch
some internal classes, by rebinding methods to custom ones. This is not very
clean, and can lead to problems if internal structures of new ipyton releases
So, here is the main **PyMAD** interactions needed:
1. Catch custom *PyMADError* exceptions (now done with rebinding
IPython.iplib.InteractiveShell.runcode() method), **with the possibility to
get the inital text code involved in the exception**. For the moment, in the
runcode() method, we only get the code object, from which it is impossible to
retreive the text. Here is the code used::
def runcode(self, code_obj):
"""Execute a code object.
When an exception occurs, self.showtraceback() is called to display a
log = Logger()
message = MessageLogger()
# Set our own excepthook in case the user code tries to call it
# directly, so that the IPython crash handler doesn't get triggered
old_excepthook,sys.excepthook = sys.excepthook, self.excepthook
exec code_obj in self.locals
# Reset our crash handler in place
sys.excepthook = old_excepthook
except SystemExit, message:
# We just add this few lines
#except AttributeError, message:
# TODO: Use the same syntax (color) as IPython
except PyMADError, exc:
#log.exception("Console execution error")
message.critical("Pyro connexion closed")
log.exception("Console execution error")
# TODO: get the object and call rebindURI()
if code.softspace(sys.stdout, 0):
2. Add some new matchers for completion. As **PyMAD** uses remote objects,
completion only shows the client Pyro proxy. So we added a new matcher by
adding a IPython.iplib.MagicCompleter.proxy_matches() method, and insert this
matcher in ipshell.IP.Completer.matchers list. The new matcher get the object
(from the text param), call a special method on this object which returns all
available attributes (in fact, only these we want to show to the user). Give
the possibility to return all matchers, or only the no None first. Here is
the code used::
def proxy_matches(self, text, state):
""" Get the attribute of a remove Pyro object.
log = Logger('client')
# Another option, seems to work great. Catches things like ''.<tab>
m = re.match(r"(\S+(\.\w+)*)\.(\w*)$", text)
if not m:
expr, attr = m.group(1, 3)
matches = 
object = eval(expr, self.namespace)
if isinstance(object, Pyro.core.DynamicProxyWithAttrs):
words = object.getAvailableAttributes()
#words = words + get_class_members(object.__class__)
matches = 
n = len(attr)
for word in words:
if word[:n] == attr and word != "__builtins__":
matches.append("%s.%s" % (expr, word))
object.adapter.rebindURI() # Should be moved to runcode()
matches = [""]
ipshell.IP.Completer.proxy_matches = new.instancemethod(proxy_matches,
3. In the same way as matchers, get the docstring from the remote object instead
of the client one when using 'object?' syntaxe. This could be done on the
same idea: calling a special method on the object, method returning the doc
of our remote object).
4. New exception handler. Here, the idea is to be able to present different kind
of exceptions in different ways. Some will only print a simple message, some
others will print the entire traceback (maybe a modified traceback).
5. Prevent objects from beeing deleted by *del* keyword _.
6. Prompt modification at run-time _.
7. Access to the command-line interpreter, to have **IPython** interprets code
has if it was entered through keyboard (ie make difference between magic
commands and normal python code).
..  Can be done with pre-filters. Have to be tested, but should work.
..  Can be done with prompt_specials_color dict. Have to be tested,
but should work.
More information about the IPython-dev