[IPython-dev] Using Ipython cache as file proxy

[Gökhan Sever]

On Thu, Oct 21, 2010 at 5:21 PM, Gael Varoquaux
<gael.varoquaux at normalesup.org> wrote:
> On Thu, Oct 21, 2010 at 05:16:26PM -0500, Gökhan Sever wrote:
>> > I might have a solution for you.  This is based on %run's "-i" parameter, which retains the environment, similar to execfile().
>
> In similar setting, I try to structure the corresponding part of my code
> as functions with no side effects, and use joblib:
> http://packages.python.org/joblib/
>
> One big pro, is that is persists accross sessions (I get crashes, as I
> tend to do nasty things with C extensions and the memory).
>
> Gaël
>

Hi Gaël and all,

I was thinking of this pattern remembering approach yesterday late at
night. I wonder if it be possible to transparently handle this in
library side instead of directly modifying the code on user side. Say
for instance the matplotlib side computations. I do slight
modifications on code for annotations and re-run whole script. All of
the plotting code is re-executed whether changed or not.

I will look into joblib and IncPy approaches when my code evolves into
a more complex state and especially when I bring into some
CPU-intensive computations --so far still
reading/masking/masking/masking/annotating/plotting/saving.
Modelling/comparing/plotting cycles are yet to come.

Thanks for all nice feedback.

-- 
Gökhan