From lkb.teichmann at gmail.com Wed Oct 1 03:39:17 2014 From: lkb.teichmann at gmail.com (Martin Teichmann) Date: Wed, 1 Oct 2014 09:39:17 +0200 Subject: [IPython-dev] IPython inputhook, higher rate? In-Reply-To: <CAOvn4qjZUtmz9zhot9iGtY44y-_bnCgUREPnK2RrDg-1EfkjCQ@mail.gmail.com> References: <CAD+Uu3PL9_xGQWMkJjBk8krLF1hrv14Hf_8PdO2nibr2Tt9MvA@mail.gmail.com> <CAOTD34aTSXDQG-WcYh-f7JEgE9ueYVddVKgpgbkw+KwJdNwJbQ@mail.gmail.com> <CAOTD34aT_m7v=_=jRh-a=v0_Y_1kjCNijS9QEtDZhRq6XRy2MQ@mail.gmail.com> <CAHAreOpKF2q_rM-OQtfGiUaqT18JbMKRn=Rw4F=-e+zWxcJa0A@mail.gmail.com> <CAD+Uu3NPRuc4J4RyZVyn3=p68GOJJeR9tq0yBB=_VrpWA2k6FQ@mail.gmail.com> <CAOTD34ZNOSBzu6jum_+-r8nXwyG7MAR1UFPvzcb1ks9VWV18qA@mail.gmail.com> <CAOvn4qi2rLwWP-siCMoMthUTnWXj2qNz=vnG=dLx4wgjKA=Euw@mail.gmail.com> <CAK9R32S-eMB8P1xSd1Ndwr_Lf0_AHpL7oerpZmUfZZLErQJ66g@mail.gmail.com> <CAOvn4qjZUtmz9zhot9iGtY44y-_bnCgUREPnK2RrDg-1EfkjCQ@mail.gmail.com> Message-ID: <CAK9R32RficiVLXSPvcbQk+-9TufJqUZpcd91_tWYJo4fLYP5fQ@mail.gmail.com> Hi Thomas, > Thanks for looking into this. We would be interested in having a better way > to integrate event loops with getting input in the terminal. It's probably > not practical to push that straight into core Python, and even if it was, it > would be some time before we could scrap our inputhook functionality in > favour of a new feature in Python 3.5. To me it's a bit weird to say that we shouldn't push that straight into core Python - IPython is working around this broken functionality since more than a decade, so how long do we have to wait until something is not considered "straight" anymore? Apparently IPython is not the only one having this problem, as you mentioned others have also already written a library to circumvent this problem in the standard library. As for compatibility: I actually think that the way IPython is handling the problem - mostly hiding all the ugly details behind a nice API - would make it possible to have the new and old version nicely in parallel, especially as the new version has already mostly been written, for the case if IPython is not running in the terminal. Greetings Martin From bussonniermatthias at gmail.com Wed Oct 1 04:57:52 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Wed, 1 Oct 2014 10:57:52 +0200 Subject: [IPython-dev] IPython inputhook, higher rate? In-Reply-To: <CAK9R32RficiVLXSPvcbQk+-9TufJqUZpcd91_tWYJo4fLYP5fQ@mail.gmail.com> References: <CAD+Uu3PL9_xGQWMkJjBk8krLF1hrv14Hf_8PdO2nibr2Tt9MvA@mail.gmail.com> <CAOTD34aTSXDQG-WcYh-f7JEgE9ueYVddVKgpgbkw+KwJdNwJbQ@mail.gmail.com> <CAOTD34aT_m7v=_=jRh-a=v0_Y_1kjCNijS9QEtDZhRq6XRy2MQ@mail.gmail.com> <CAHAreOpKF2q_rM-OQtfGiUaqT18JbMKRn=Rw4F=-e+zWxcJa0A@mail.gmail.com> <CAD+Uu3NPRuc4J4RyZVyn3=p68GOJJeR9tq0yBB=_VrpWA2k6FQ@mail.gmail.com> <CAOTD34ZNOSBzu6jum_+-r8nXwyG7MAR1UFPvzcb1ks9VWV18qA@mail.gmail.com> <CAOvn4qi2rLwWP-siCMoMthUTnWXj2qNz=vnG=dLx4wgjKA=Euw@mail.gmail.com> <CAK9R32S-eMB8P1xSd1Ndwr_Lf0_AHpL7oerpZmUfZZLErQJ66g@mail.gmail.com> <CAOvn4qjZUtmz9zhot9iGtY44y-_bnCgUREPnK2RrDg-1EfkjCQ@mail.gmail.com> <CAK9R32RficiVLXSPvcbQk+-9TufJqUZpcd91_tWYJo4fLYP5fQ@mail.gmail.com> Message-ID: <1DD61257-3A66-42F6-A523-35F7DEDED5FC@gmail.com> Le 1 oct. 2014 ? 09:39, Martin Teichmann a ?crit : > Hi Thomas, > >> Thanks for looking into this. We would be interested in having a better way >> to integrate event loops with getting input in the terminal. It's probably >> not practical to push that straight into core Python, and even if it was, it >> would be some time before we could scrap our inputhook functionality in >> favour of a new feature in Python 3.5. > > To me it's a bit weird to say that we shouldn't push that straight into core > Python - IPython is working around this broken functionality since more > than a decade, so how long do we have to wait until something is not > considered "straight" anymore? Apparently IPython is not the only one > having this problem, as you mentioned others have also already written > a library to circumvent this problem in the standard library. I think that the point of Thomas is that our code need to be cleaned up. We are currently preparing to split IPython into different repo so trying to at that into IPython **now** is probably not a good time. What I can suggest (other can chime in and say water they think is a good idea) is to write an IPep[1] or an issue on github that target IPython 4.0 or later. It will allow us to organize and decide if/when we want that. > As for compatibility: I actually think that the way IPython is handling > the problem - mostly hiding all the ugly details behind a nice API - > would make it possible to have the new and old version nicely in > parallel, especially as the new version has already mostly been written, > for the case if IPython is not running in the terminal. The other issue is that we still support Python 2.7, thus anything that targets 3.x only is dangerous and subject to controversy. Though the discussion to drop 2.7 support for some functionality do arise more and more often. This might be a case where maybe dropping 2.7 might help, or where such a feature can push toward a drop of 2. support. It's not my area of expertise so I don't know. From the discussion on Python bug tracker with Guido, and reading in between lines, I also would say that having such a feature in IPython might help to push this into Python itself later. And having async console looks cool. > > Greetings > > Martin > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev [1] https://github.com/ipython/ipython/wiki/IPEPs:-IPython-Enhancement-Proposals, don't worry much more informal than Python one. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141001/dbd89ae9/attachment.html> From oren.a4 at gmail.com Wed Oct 1 07:35:29 2014 From: oren.a4 at gmail.com (Oren) Date: Wed, 1 Oct 2014 14:35:29 +0300 Subject: [IPython-dev] How to paste large code text using %cpaste in ipython? Message-ID: <CAA=RY-LT+D1qDi9PmUe97mTaX6HLVL8Yo6XP+PjHsHev1mU8aw@mail.gmail.com> I am having the same problem as the one described in the following link http://stackoverflow.com/questions/23765349/how-to-paste-large-code-text-using-cpaste-in-ipython "I'm trying to paste code into ipython using %cpaste, but whenever the pasted code is too large (almost 100-150 lines of code), it stops actually reading the input buffer and therefore gives me an error similar to: File "<ipython-input-2-f23a5343110f>", line 133 return(SyntaxError: unexpected EOF while parsing If it matters, I'm using a bash inside an emacs and running ipython3 -i from there. *EDIT:* interestingly if I paste half of the code, hit enter, paste the second half, press enter, then --, then enter, it processes it properly. " Is there a way to fix it? Thank You, Oren. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141001/74e80271/attachment.html> From lkb.teichmann at gmail.com Wed Oct 1 10:47:04 2014 From: lkb.teichmann at gmail.com (Martin Teichmann) Date: Wed, 1 Oct 2014 16:47:04 +0200 Subject: [IPython-dev] Asyncio extensions for IPython In-Reply-To: <CAOvn4qhA7ff5rWLBjQT69FEg3KAnQAmYBqzT7kXtQjKZAhbmqA@mail.gmail.com> References: <CAK9R32TyvTx5fbp=R1DZBJk+Keqz=EGU+BbeZNXuKz8X+2CsVA@mail.gmail.com> <CAOvn4qhA7ff5rWLBjQT69FEg3KAnQAmYBqzT7kXtQjKZAhbmqA@mail.gmail.com> Message-ID: <CAK9R32TSsN5Ln+H4K5XjDqvMu3ZO+oAQphUeev_7Ug_w6trFTA@mail.gmail.com> Hi, > I noticed you've put it under a GPL license. Much of this ecosystem is BSD ... I didn't think much about this, so I relicensed. Hopefully one day this extension will go into IPython. Greetings Martin From takowl at gmail.com Wed Oct 1 12:44:47 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 1 Oct 2014 09:44:47 -0700 Subject: [IPython-dev] IPython inputhook, higher rate? In-Reply-To: <CAK9R32RficiVLXSPvcbQk+-9TufJqUZpcd91_tWYJo4fLYP5fQ@mail.gmail.com> References: <CAD+Uu3PL9_xGQWMkJjBk8krLF1hrv14Hf_8PdO2nibr2Tt9MvA@mail.gmail.com> <CAOTD34aTSXDQG-WcYh-f7JEgE9ueYVddVKgpgbkw+KwJdNwJbQ@mail.gmail.com> <CAOTD34aT_m7v=_=jRh-a=v0_Y_1kjCNijS9QEtDZhRq6XRy2MQ@mail.gmail.com> <CAHAreOpKF2q_rM-OQtfGiUaqT18JbMKRn=Rw4F=-e+zWxcJa0A@mail.gmail.com> <CAD+Uu3NPRuc4J4RyZVyn3=p68GOJJeR9tq0yBB=_VrpWA2k6FQ@mail.gmail.com> <CAOTD34ZNOSBzu6jum_+-r8nXwyG7MAR1UFPvzcb1ks9VWV18qA@mail.gmail.com> <CAOvn4qi2rLwWP-siCMoMthUTnWXj2qNz=vnG=dLx4wgjKA=Euw@mail.gmail.com> <CAK9R32S-eMB8P1xSd1Ndwr_Lf0_AHpL7oerpZmUfZZLErQJ66g@mail.gmail.com> <CAOvn4qjZUtmz9zhot9iGtY44y-_bnCgUREPnK2RrDg-1EfkjCQ@mail.gmail.com> <CAK9R32RficiVLXSPvcbQk+-9TufJqUZpcd91_tWYJo4fLYP5fQ@mail.gmail.com> Message-ID: <CAOvn4qiK=0VRCChttJ28ax4S1qQJPAr8S2qzq8hSDRFbHHKtTQ@mail.gmail.com> Hi Martin, On 1 October 2014 00:39, Martin Teichmann <lkb.teichmann at gmail.com> wrote: > To me it's a bit weird to say that we shouldn't push that straight into > core > Python - IPython is working around this broken functionality since more > than a decade, so how long do we have to wait until something is not > considered "straight" anymore? Apparently IPython is not the only one > having this problem, as you mentioned others have also already written > a library to circumvent this problem in the standard library. > InputHook has been around for a long time, but only recently has there been a standardised event loop interface in the stdlib that it could use instead. And integrating input() with that is presumably not trivial, so it makes sense to work out the kinks in a separate package, not in a Python builtin function. > As for compatibility: I actually think that the way IPython is handling > the problem - mostly hiding all the ugly details behind a nice API - > would make it possible to have the new and old version nicely in > parallel, especially as the new version has already mostly been written, > for the case if IPython is not running in the terminal. It probably could, but we'll probably still have to maintain the old API for quite some time; this is true whether it's a separate package depending on asyncio or a new Python feature. The real value for us would be being able to drop the inputhook stuff altogether, which seems unlikely for the foreseeable future. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141001/1c62b8f9/attachment.html> From takowl at gmail.com Wed Oct 1 13:03:20 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 1 Oct 2014 10:03:20 -0700 Subject: [IPython-dev] How to paste large code text using %cpaste in ipython? In-Reply-To: <CAA=RY-LT+D1qDi9PmUe97mTaX6HLVL8Yo6XP+PjHsHev1mU8aw@mail.gmail.com> References: <CAA=RY-LT+D1qDi9PmUe97mTaX6HLVL8Yo6XP+PjHsHev1mU8aw@mail.gmail.com> Message-ID: <CAOvn4qjLKeMVe4DtHeknUV565Xm8qz2nv+6C82dpKhH94MaNxg@mail.gmail.com> Hi Oren, We have very limited control over what happens when you paste in the terminal, because it looks just like that text is being typed in very quickly. I can't see how that would cause the symptoms you describe, though. Thomas On 1 October 2014 04:35, Oren <oren.a4 at gmail.com> wrote: > I am having the same problem as the one described in the following link > > > > http://stackoverflow.com/questions/23765349/how-to-paste-large-code-text-using-cpaste-in-ipython > > "I'm trying to paste code into ipython using %cpaste, but whenever the > pasted code is too large (almost 100-150 lines of code), it stops actually > reading the input buffer and therefore gives me an error similar to: > > File "<ipython-input-2-f23a5343110f>", line 133 > return(SyntaxError: unexpected EOF while parsing > > If it matters, I'm using a bash inside an emacs and running ipython3 -i from > there. > > *EDIT:* interestingly if I paste half of the code, hit enter, paste the > second half, press enter, then --, then enter, it processes it properly. > > " > > Is there a way to fix it? > > Thank You, > Oren. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141001/d3bbc226/attachment.html> From takowl at gmail.com Wed Oct 1 13:03:54 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 1 Oct 2014 10:03:54 -0700 Subject: [IPython-dev] Asyncio extensions for IPython In-Reply-To: <CAK9R32TSsN5Ln+H4K5XjDqvMu3ZO+oAQphUeev_7Ug_w6trFTA@mail.gmail.com> References: <CAK9R32TyvTx5fbp=R1DZBJk+Keqz=EGU+BbeZNXuKz8X+2CsVA@mail.gmail.com> <CAOvn4qhA7ff5rWLBjQT69FEg3KAnQAmYBqzT7kXtQjKZAhbmqA@mail.gmail.com> <CAK9R32TSsN5Ln+H4K5XjDqvMu3ZO+oAQphUeev_7Ug_w6trFTA@mail.gmail.com> Message-ID: <CAOvn4qj34_knMCQ5u0GddLq1pKwKac-yauEhf30hAnRHs8JAxw@mail.gmail.com> Thanks Martin! Thomas On 1 October 2014 07:47, Martin Teichmann <lkb.teichmann at gmail.com> wrote: > Hi, > > > I noticed you've put it under a GPL license. Much of this ecosystem is > BSD ... > > I didn't think much about this, so I relicensed. Hopefully one day this > extension will go into IPython. > > Greetings > > Martin > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141001/717e7d1c/attachment.html> From erik.m.bray at gmail.com Wed Oct 1 13:25:57 2014 From: erik.m.bray at gmail.com (Erik Bray) Date: Wed, 1 Oct 2014 13:25:57 -0400 Subject: [IPython-dev] IPython inputhook, higher rate? In-Reply-To: <CAK9R32S-eMB8P1xSd1Ndwr_Lf0_AHpL7oerpZmUfZZLErQJ66g@mail.gmail.com> References: <CAD+Uu3PL9_xGQWMkJjBk8krLF1hrv14Hf_8PdO2nibr2Tt9MvA@mail.gmail.com> <CAOTD34aTSXDQG-WcYh-f7JEgE9ueYVddVKgpgbkw+KwJdNwJbQ@mail.gmail.com> <CAOTD34aT_m7v=_=jRh-a=v0_Y_1kjCNijS9QEtDZhRq6XRy2MQ@mail.gmail.com> <CAHAreOpKF2q_rM-OQtfGiUaqT18JbMKRn=Rw4F=-e+zWxcJa0A@mail.gmail.com> <CAD+Uu3NPRuc4J4RyZVyn3=p68GOJJeR9tq0yBB=_VrpWA2k6FQ@mail.gmail.com> <CAOTD34ZNOSBzu6jum_+-r8nXwyG7MAR1UFPvzcb1ks9VWV18qA@mail.gmail.com> <CAOvn4qi2rLwWP-siCMoMthUTnWXj2qNz=vnG=dLx4wgjKA=Euw@mail.gmail.com> <CAK9R32S-eMB8P1xSd1Ndwr_Lf0_AHpL7oerpZmUfZZLErQJ66g@mail.gmail.com> Message-ID: <CAOTD34aNEQ1cj5Us+vLKt5eM2-2gB1-RMCr5QnQnMWc4Xj9LTg@mail.gmail.com> Hi Martin, On Tue, Sep 30, 2014 at 11:05 AM, Martin Teichmann <lkb.teichmann at gmail.com> wrote: > Hi, > > I just saw this thread about why and how the python > inputhook works, and how to integrate other event loops > with IPython, using said input hooks. > > The actual problem is that the python input routine blocks > while it reads from the console. This is completely > unnecessary, as the underlying GNU readline library does > not require a block at all. Down in the python interpreter, > something like the following happens (it's in C in original). > > while True: > PyOS_InputHook() > select(stdin, timeout=100) > if something_in_stdin: > call_GNU_readline_to_read_one_char() > > so, python defines its own event loop! As one can see > very clearly, from the IPython standpoint this is completely > stupid: we want our own event loop to run (eg, the Qt > event loop), and once something arrives at stdin, call > GNU readline to process whatever arrived. > > I already wrote the necessary changes and already put > up some patch on the python issue tracker: > http://bugs.python.org/issue22412 I'm sorry your patch got rejected--it looks like something you put a lot of thought into! That said, reading over the thread, I agree with the rationale and it seemed to come with a "for now" attached to it, as in, it's not like it's a bad idea. And indeed Python's REPL event loop has been controversial for a long time now (though to say it's not needed is also incorrect at least on some major platforms...) Relatedly, if you like horror stories, you should see the time I had to reimplement raw_input and replace it in the builtins module since it would fall over and *always* block if sys.stdin was replaced: https://gist.github.com/embray/3dc1dcb0d264bce912fb (Fortunately this issue is fixed on Python 3 at least.) I agree that having something like your asyncio console in a third-party library sounds interesting, and might also look nice as part of IPython (though I defer to the IPython/Jupyter devs on that of course ;) Erik From fperez.net at gmail.com Wed Oct 1 14:26:10 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Wed, 1 Oct 2014 11:26:10 -0700 Subject: [IPython-dev] Asyncio extensions for IPython In-Reply-To: <CAK9R32TSsN5Ln+H4K5XjDqvMu3ZO+oAQphUeev_7Ug_w6trFTA@mail.gmail.com> References: <CAK9R32TyvTx5fbp=R1DZBJk+Keqz=EGU+BbeZNXuKz8X+2CsVA@mail.gmail.com> <CAOvn4qhA7ff5rWLBjQT69FEg3KAnQAmYBqzT7kXtQjKZAhbmqA@mail.gmail.com> <CAK9R32TSsN5Ln+H4K5XjDqvMu3ZO+oAQphUeev_7Ug_w6trFTA@mail.gmail.com> Message-ID: <CAHAreOq_5kToPQZ-NqR1KDZySG0SoQWV2d95VjpPEX3dBs8ErQ@mail.gmail.com> On Wed, Oct 1, 2014 at 7:47 AM, Martin Teichmann <lkb.teichmann at gmail.com> wrote: > > I noticed you've put it under a GPL license. Much of this ecosystem is > BSD ... > > I didn't think much about this, so I relicensed. Hopefully one day this > extension will go into IPython. > Much appreciated Martin! -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141001/634957af/attachment.html> From fperez.net at gmail.com Wed Oct 1 14:28:18 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Wed, 1 Oct 2014 11:28:18 -0700 Subject: [IPython-dev] py.test plugin for running Notebook cells as unit tests In-Reply-To: <CADWjrkgdDsH85XNCseeyocLqeNJzOjjWEmgyzZA7pEZ+7B2UWg@mail.gmail.com> References: <CADWjrkgdDsH85XNCseeyocLqeNJzOjjWEmgyzZA7pEZ+7B2UWg@mail.gmail.com> Message-ID: <CAHAreOpr2JgXQY=Loc-NK31tNZMjMHMnnraA5jt-8d_tdq5eMw@mail.gmail.com> Great! Could you list it in the extensions index? https://github.com/ipython/ipython/wiki/Extensions-Index Cheers f On Tue, Sep 30, 2014 at 3:23 PM, Andrea Zonca <zonca at sdsc.edu> wrote: > Hi, > I wrote a py.test plugin that discovers and runs unit tests written > as cells of IPython notebooks, it also supports fixtures, see: > > https://github.com/zonca/pytest-ipynb > http://zonca.github.io/2014/09/unit-tests-ipython-notebook.html > > Cheers, > Andrea > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141001/52964d75/attachment.html> From takowl at gmail.com Wed Oct 1 20:22:46 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 1 Oct 2014 17:22:46 -0700 Subject: [IPython-dev] IPython 2.3 released Message-ID: <CAOvn4qifKZiQ55G0x2Jw+=fP_k3PUjckOni7gOHEomnyMs_exA@mail.gmail.com> IPython 2.3, a bugfix release for the 2.x series, has been released. The most important fix is for a bug that broke the rendering of maths when notebooks were converted to HTML using nbconvert. As usual, a number of other bugfixes have been backported from master for this release. You can see the full list here: http://ipython.org/ipython-doc/2/whatsnew/github-stats-2.0.html#issues-closed-in-2-3-0 Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141001/af94c4ac/attachment.html> From fperez.net at gmail.com Thu Oct 2 01:57:06 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Wed, 1 Oct 2014 22:57:06 -0700 Subject: [IPython-dev] Heads up: shutting down hipchat Message-ID: <CAHAreOoAm2L0aGzrNqrfeG-jXAZZ=TYxSTV367UueXRktP=9ow@mail.gmail.com> Hi all, given we seem to be pretty happy using Gitter, I'm shutting down the hipchat accounts for everyone so we start paying for that. Just a heads-up in case you wonder why you get an email from hipchat about your user being deleted... cheers f -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141001/5d0fd037/attachment.html> From hughesadam87 at gmail.com Thu Oct 2 15:05:34 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Thu, 2 Oct 2014 15:05:34 -0400 Subject: [IPython-dev] Resetting widget application view/state Message-ID: <CAMHV+dAxsHWiOxDNeN=HQd4mnqB92JnuoboWg_z7nRjcEtubYg@mail.gmail.com> Hi, Following the helpful discussion on widgets last month, we've made good progress with our spectroscopy widgets and are very happy! One issue we're having is that we want the user to be able to change which datateset he/she is piping is working with. Different datasets have different default values, for example spectral units, start and end ranges etc... Right now, our application's view and model are completely separate; however, when the user chooses to work with a new dataset, we'd like the view to reset itself based on the new ranges for some of these attributes. We were hoping there was a smart way to do this! Even if it's a total hack, that's fine. Here is the notebook: http://nbviewer.ipython.org/urls/raw.github.com/hugadams/pyuvvis/master/pyuvvis/interact/ipynbs/prototypes/widgets_slicing.ipynb I've attached a ss of the ouput The _filename_changed trait is where this new functionality should go. Thanks -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141002/f4abdf98/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: widget_ss.png Type: image/png Size: 70255 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141002/f4abdf98/attachment.png> From hughesadam87 at gmail.com Thu Oct 2 15:07:02 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Thu, 2 Oct 2014 15:07:02 -0400 Subject: [IPython-dev] Resetting widget application view/state In-Reply-To: <CAMHV+dAxsHWiOxDNeN=HQd4mnqB92JnuoboWg_z7nRjcEtubYg@mail.gmail.com> References: <CAMHV+dAxsHWiOxDNeN=HQd4mnqB92JnuoboWg_z7nRjcEtubYg@mail.gmail.com> Message-ID: <CAMHV+dAxRypa-pA0_4tApLxhFOCnyY=6Zz05am-B=Ry_-t-qoQ@mail.gmail.com> Just to clarigy, the "Units" and "Sampling" widgets are the ones that ought to reset their defaults based on the new dataset, which contains attributes for its units and sampling is determined by the range of the index values. On Thu, Oct 2, 2014 at 3:05 PM, Adam Hughes <hughesadam87 at gmail.com> wrote: > Hi, > > Following the helpful discussion on widgets last month, we've made good > progress with our spectroscopy widgets and are very happy! > > One issue we're having is that we want the user to be able to change which > datateset he/she is piping is working with. Different datasets have > different default values, for example spectral units, start and end ranges > etc... > > Right now, our application's view and model are completely separate; > however, when the user chooses to work with a new dataset, we'd like the > view to reset itself based on the new ranges for some of these attributes. > We were hoping there was a smart way to do this! Even if it's a total > hack, that's fine. > > Here is the notebook: > > > http://nbviewer.ipython.org/urls/raw.github.com/hugadams/pyuvvis/master/pyuvvis/interact/ipynbs/prototypes/widgets_slicing.ipynb > > I've attached a ss of the ouput > > The _filename_changed trait is where this new functionality should go. > > Thanks > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141002/95ea196a/attachment.html> From Andy at SantaCruzIntegration.com Thu Oct 2 19:17:34 2014 From: Andy at SantaCruzIntegration.com (Andy Davidson) Date: Thu, 02 Oct 2014 16:17:34 -0700 Subject: [IPython-dev] ERROR can not use fork(), exec(), dup2() to communicate with child process Message-ID: <D0532B1E.1AF7B%Andy@SantaCruzIntegration.com> Hi I want to write a notebook that receives data from another process. Bellow is my python code. It forks a child process and reads the data from the child using a pipe. This code works if I run it in python. When I try to execute from iPython notebook I get the following error. Any idea what the problems is ? If pipes do not work, can I use a socket? The other process would send me data by writing, my notebook needs behave like a server. Any comments or suggestions would be greatly appreciated. Thanks Andy P.s. I am running headless on a remote machine and use an ssh tunnel to run the notebook from my local browser. My other notebooks works fine [ec2-user at ip-172-31-14-107 ~]$ IPYTHON_OPTS="notebook --pylab inline --no-browser --port=7000" /root/spark/bin/pyspark /root/spark/conf/spark-env.sh: line 21: ulimit: open files: cannot modify limit: Operation not permitted [NotebookApp] Using existing profile dir: u'/home/ec2-user/.ipython/profile_default' [NotebookApp] Serving notebooks from /home/ec2-user [NotebookApp] The IPython Notebook is running at: http://127.0.0.1:7000/ [NotebookApp] Use Control-C to stop this server and shut down all kernels. [NotebookApp] Using MathJax from CDN: http://cdn.mathjax.org/mathjax/latest/MathJax.js [NotebookApp] Kernel started: 71f07d5c-2db1-465f-9d86-da29f8711a0b [NotebookApp] Connecting to: tcp://127.0.0.1:54119 [NotebookApp] Connecting to: tcp://127.0.0.1:50649 [NotebookApp] Connecting to: tcp://127.0.0.1:35516 [IPKernelApp] To connect another client to this kernel, use: [IPKernelApp] --existing kernel-71f07d5c-2db1-465f-9d86-da29f8711a0b.json Assertion failed: ok (bundled/zeromq/src/mailbox.cpp:79) [NotebookApp] Kernel 71f07d5c-2db1-465f-9d86-da29f8711a0b failed to respond to heartbeat import sys import os def child(pipeout): os.dup2(pipeout, sys.stdout.fileno()) os.close(pipeout) os.execlp("./test.sh", "abc") def parent(): pipein, pipeout = os.pipe() if os.fork() == 0: os.close(pipein) child(pipeout) else: os.close(pipeout) counter = 1 pipein = os.fdopen(pipein) while True: json = pipein.readline()[:-1] print 'parent: %s' % (json) parent() $ cat test.sh #!/bin/bash script_name=$0 args=$@ current=`pwd` echo $script_name $args echo "XYZ: "$XYZ echo "PATH: "$PATH echo "current directory: $current" -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141002/aefaa3fc/attachment.html> From benjaminrk at gmail.com Thu Oct 2 20:19:18 2014 From: benjaminrk at gmail.com (MinRK) Date: Thu, 2 Oct 2014 17:19:18 -0700 Subject: [IPython-dev] ERROR can not use fork(), exec(), dup2() to communicate with child process In-Reply-To: <D0532B1E.1AF7B%Andy@SantaCruzIntegration.com> References: <D0532B1E.1AF7B%Andy@SantaCruzIntegration.com> Message-ID: <CAHNn8BXxCej6VL4XkjguOSXtgnxpsNCJXHhKGNLSBoYbiu48-g@mail.gmail.com> why use execlp instead of subprocess.Popen, which allows capturing stdout, stderr, etc.? ? On Thu, Oct 2, 2014 at 4:17 PM, Andy Davidson <Andy at santacruzintegration.com > wrote: > Hi > > > I want to write a notebook that receives data from another process. Bellow > is my python code. It forks a child process and reads the data from the > child using a pipe. This code works if I run it in python. When I try to > execute from iPython notebook I get the following error. Any idea what the > problems is ? > > > If pipes do not work, can I use a socket? The other process would send me > data by writing, my notebook needs behave like a server. > > > Any comments or suggestions would be greatly appreciated. > > > Thanks > > > Andy > > > P.s. I am running headless on a remote machine and use an ssh tunnel to > run the notebook from my local browser. My other notebooks works fine > > > > [ec2-user at ip-172-31-14-107 ~]$ IPYTHON_OPTS="notebook --pylab inline > --no-browser --port=7000" /root/spark/bin/pyspark > > /root/spark/conf/spark-env.sh: line 21: ulimit: open files: cannot modify > limit: Operation not permitted > > [NotebookApp] Using existing profile dir: > u'/home/ec2-user/.ipython/profile_default' > > [NotebookApp] Serving notebooks from /home/ec2-user > > [NotebookApp] The IPython Notebook is running at: http://127.0.0.1:7000/ > > [NotebookApp] Use Control-C to stop this server and shut down all kernels. > > [NotebookApp] Using MathJax from CDN: > http://cdn.mathjax.org/mathjax/latest/MathJax.js > > [NotebookApp] Kernel started: 71f07d5c-2db1-465f-9d86-da29f8711a0b > > [NotebookApp] Connecting to: tcp://127.0.0.1:54119 > > [NotebookApp] Connecting to: tcp://127.0.0.1:50649 > > [NotebookApp] Connecting to: tcp://127.0.0.1:35516 > > [IPKernelApp] To connect another client to this kernel, use: > > [IPKernelApp] --existing kernel-71f07d5c-2db1-465f-9d86-da29f8711a0b.json > > Assertion failed: ok (bundled/zeromq/src/mailbox.cpp:79) > > [NotebookApp] Kernel 71f07d5c-2db1-465f-9d86-da29f8711a0b failed to > respond to heartbeat > > > > import sys > import os > > def child(pipeout): > os.dup2(pipeout, sys.stdout.fileno()) > os.close(pipeout) > os.execlp("./test.sh", "abc") > > > def parent(): > pipein, pipeout = os.pipe() > if os.fork() == 0: > os.close(pipein) > child(pipeout) > else: > os.close(pipeout) > counter = 1 > pipein = os.fdopen(pipein) > while True: > json = pipein.readline()[:-1] > print 'parent: %s' % (json) > > parent() > > $ cat test.sh > > #!/bin/bash > > > script_name=$0 > > args=$@ > > current=`pwd` > > echo $script_name $args > > echo "XYZ: "$XYZ > > echo "PATH: "$PATH > > echo "current directory: $current" > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141002/19612103/attachment.html> From claresloggett at gmail.com Fri Oct 3 00:42:54 2014 From: claresloggett at gmail.com (Clare Sloggett) Date: Fri, 3 Oct 2014 14:42:54 +1000 Subject: [IPython-dev] Multi-user IPython Notebook Message-ID: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> Hi all, I am wondering if anyone knows the time for the multi-user IPython Notebook - i.e. the concept where, as I understand it, it will run as a daemon and use linux accounts for login. I'm really looking forward to this. I can see it mentioned in a couple of places: https://github.com/ipython/ipython/wiki/IPEP-3:-Multiuser-support-in-the-notebook https://github.com/ipython/ipython/wiki/Roadmap:-IPython#overview-of-2013-2014 But the timeline is just "2014". Is there any more updated info? I'm doing some work at the moment that would be unnecessary if this were out so if it's coming out soon, I will wait! Thanks, Clare -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/2ddca388/attachment.html> From ssanderson at quantopian.com Fri Oct 3 00:51:39 2014 From: ssanderson at quantopian.com (ssanderson) Date: Thu, 2 Oct 2014 21:51:39 -0700 (PDT) Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> Message-ID: <1412311899323-5073521.post@n6.nabble.com> The multi-user notebook project now goes by the name jupyterhub. It lives at https://github.com/jupyter/jupyterhub/tree/master/jupyterhub. I'm not sure what it's status is w/r/t stability and concrete/public APIs, but it's definitely usable already. -- View this message in context: http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073521.html Sent from the IPython - Development mailing list archive at Nabble.com. From benjaminrk at gmail.com Fri Oct 3 01:15:29 2014 From: benjaminrk at gmail.com (MinRK) Date: Thu, 2 Oct 2014 22:15:29 -0700 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <1412311899323-5073521.post@n6.nabble.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> Message-ID: <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> JupyterHub <https://github.com/jupyter/jupyterhub/> is basically functional, right now. We are still working on some configuration, with respect to running the server as a limited user. But if you run the server as root and you want to provide access to existing system users, it works. We also have working examples using GitHub OAuth <https://github.com/jupyter/oauthenticator> for user login instead of system passwords, as well as running user code in docker containers <https://github.com/jupyter/dockerspawner>. It?s pretty rough right now, and there?s a fair amount of UI and error handling to deal with (and documenting how to use it, importantly), but it would be great to get some feedback! -MinRK ? On Thu, Oct 2, 2014 at 9:51 PM, ssanderson <ssanderson at quantopian.com> wrote: > The multi-user notebook project now goes by the name jupyterhub. It lives > at > https://github.com/jupyter/jupyterhub/tree/master/jupyterhub. I'm not > sure > what it's status is w/r/t stability and concrete/public APIs, but it's > definitely usable already. > > > > -- > View this message in context: > http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073521.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141002/00925dfe/attachment.html> From bobd at stanford.edu Fri Oct 3 01:44:07 2014 From: bobd at stanford.edu (Bob Dougherty) Date: Thu, 2 Oct 2014 22:44:07 -0700 (PDT) Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> Message-ID: <634869803.9727722.1412315047475.JavaMail.zimbra@stanford.edu> It's definitely usable-- we're running our class tutorials through JupyterHub using the default pam authentication module. We pre-configured linux accounts on the server for each student. Over 20 students have been accessing the notebook tutorials through a JubyterHub process that's been running for a few weeks straight and it seems to be working fine for them. It's all running on a dedicated VM as root and are using ssl for security. cheers, bob -- Robert F. Dougherty, PhD Research Director Stanford Center for Cognitive and Neurobiological Imaging 70 Jordan Hall * Stanford CA 94305 * 650-725-0051 http://www.stanford.edu/~bobd ----- Original Message ----- From: "MinRK" <benjaminrk at gmail.com> To: "IPython developers list" <ipython-dev at scipy.org> Sent: Thursday, October 2, 2014 10:15:29 PM Subject: Re: [IPython-dev] Multi-user IPython Notebook JupyterHub is basically functional, right now. We are still working on some configuration, with respect to running the server as a limited user. But if you run the server as root and you want to provide access to existing system users, it works. We also have working examples using GitHub OAuth for user login instead of system passwords, as well as running user code in docker containers . It?s pretty rough right now, and there?s a fair amount of UI and error handling to deal with (and documenting how to use it, importantly), but it would be great to get some feedback! -MinRK ? On Thu, Oct 2, 2014 at 9:51 PM, ssanderson < ssanderson at quantopian.com > wrote: The multi-user notebook project now goes by the name jupyterhub. It lives at https://github.com/jupyter/jupyterhub/tree/master/jupyterhub . I'm not sure what it's status is w/r/t stability and concrete/public APIs, but it's definitely usable already. -- View this message in context: http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073521.html Sent from the IPython - Development mailing list archive at Nabble.com. _______________________________________________ IPython-dev mailing list IPython-dev at scipy.org http://mail.scipy.org/mailman/listinfo/ipython-dev _______________________________________________ IPython-dev mailing list IPython-dev at scipy.org http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141002/a9837391/attachment.html> From ssanderson at quantopian.com Fri Oct 3 02:26:45 2014 From: ssanderson at quantopian.com (ssanderson) Date: Thu, 2 Oct 2014 23:26:45 -0700 (PDT) Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> Message-ID: <1412317605582-5073526.post@n6.nabble.com> I wasn't aware of the existence of jupyter/oauthenticator and jupyter/dockerspawner. Is the plan for future extensions of this sort to be broken out into their own separate repositories? I would have naively expected all the "official" jupyterhub spawners to be part of the main repo. -- View this message in context: http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073526.html Sent from the IPython - Development mailing list archive at Nabble.com. From bussonniermatthias at gmail.com Fri Oct 3 02:44:58 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Fri, 3 Oct 2014 08:44:58 +0200 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <1412317605582-5073526.post@n6.nabble.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> Message-ID: <E4E08AFF-FDB3-4067-859C-8030EDC97938@gmail.com> Le 3 oct. 2014 ? 08:26, ssanderson a ?crit : > I wasn't aware of the existence of jupyter/oauthenticator and > jupyter/dockerspawner. Is the plan for future extensions of this sort to be > broken out into their own separate repositories? I would have naively > expected all the "official" jupyterhub spawners to be part of the main repo. It's not because it's in a different repo that it is not official. And yes we will try to work in separate repo if possible. It is easier. At install time, it is easy to just ask other repo to be requirements. We will also split IPython into smaller part/many repo. -- M > > > > -- > View this message in context: http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073526.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From ssanderson at quantopian.com Fri Oct 3 04:24:14 2014 From: ssanderson at quantopian.com (ssanderson) Date: Fri, 3 Oct 2014 01:24:14 -0700 (PDT) Subject: [IPython-dev] Interactive, Graphical, Diffable Pstats Viewer for IPython Notebook Message-ID: <1412324654616-5073531.post@n6.nabble.com> Hi all, I got frustrated this week trying to work with python's built-in pstats module for displaying cProfile results. The result of that frustration is now https://github.com/ssanderson/pstats-view, a small module for displaying and diffing cProfile runs in IPython Notebook. I was pleasantly surprised at how easy the `interactive` interface in the notebook made it to replicate most of the command-line functionality in a GUI. Anyway, I figured I'd share in case anyone else shares my dislike of the default pstats module. -Scott -- View this message in context: http://python.6.x6.nabble.com/Interactive-Graphical-Diffable-Pstats-Viewer-for-IPython-Notebook-tp5073531.html Sent from the IPython - Development mailing list archive at Nabble.com. From doug.blank at gmail.com Fri Oct 3 06:34:08 2014 From: doug.blank at gmail.com (Doug Blank) Date: Fri, 3 Oct 2014 06:34:08 -0400 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <634869803.9727722.1412315047475.JavaMail.zimbra@stanford.edu> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <634869803.9727722.1412315047475.JavaMail.zimbra@stanford.edu> Message-ID: <CAAusYCjK4NY8KrvAfp285RXzbgnE+FVy5KN1-Hp57xYw70F6ag@mail.gmail.com> I concur with Bob that it is in a state that is very usable. I've been teaching my Programming Languages course (mostly in Scheme) from jupyterhub and ipython master git (yes, a bit risky, not the recommended mode of operation. But great rewards!). All of the assignments, notes, and materials have been straight from notebooks. See my public notebooks here [1]. We hope to package up that public page code to share---jupyterhub doesn't currently come with a means to serve rendered pages, but has been suggested [2]. I'm now helping our Physics department get their own server setup. As part of that project, we are making extensive notes to help those non-sys admin types be able to get up and running. Will share notes those when available. If anyone would like to take a test drive, please contact me and we'll see about making you an account. -Doug [1] - http://jupyter.cs.brynmawr.edu/hub/dblank/public [2] - https://github.com/jupyter/jupyterhub/issues/17 On Fri, Oct 3, 2014 at 1:44 AM, Bob Dougherty <bobd at stanford.edu> wrote: > It's definitely usable-- we're running our class tutorials through > JupyterHub using the default pam authentication module. We pre-configured > linux accounts on the server for each student. Over 20 students have been > accessing the notebook tutorials through a JubyterHub process that's been > running for a few weeks straight and it seems to be working fine for them. > It's all running on a dedicated VM as root and are using ssl for security. > > cheers, > bob > > -- > Robert F. Dougherty, PhD > Research Director > Stanford Center for Cognitive and Neurobiological Imaging > 70 Jordan Hall * Stanford CA 94305 * 650-725-0051 > http://www.stanford.edu/~bobd > > ------------------------------ > *From: *"MinRK" <benjaminrk at gmail.com> > *To: *"IPython developers list" <ipython-dev at scipy.org> > *Sent: *Thursday, October 2, 2014 10:15:29 PM > *Subject: *Re: [IPython-dev] Multi-user IPython Notebook > > > JupyterHub <https://github.com/jupyter/jupyterhub/> is basically > functional, right now. We are still working on some configuration, with > respect to running the server as a limited user. But if you run the server > as root and you want to provide access to existing system users, it works. > We also have working examples using GitHub OAuth > <https://github.com/jupyter/oauthenticator> for user login instead of > system passwords, as well as running user code in docker containers > <https://github.com/jupyter/dockerspawner>. > > It?s pretty rough right now, and there?s a fair amount of UI and error > handling to deal with (and documenting how to use it, importantly), but it > would be great to get some feedback! > > -MinRK > ? > > On Thu, Oct 2, 2014 at 9:51 PM, ssanderson <ssanderson at quantopian.com> > wrote: > >> The multi-user notebook project now goes by the name jupyterhub. It >> lives at >> https://github.com/jupyter/jupyterhub/tree/master/jupyterhub. I'm not >> sure >> what it's status is w/r/t stability and concrete/public APIs, but it's >> definitely usable already. >> >> >> >> -- >> View this message in context: >> http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073521.html >> Sent from the IPython - Development mailing list archive at Nabble.com. >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/693f0ea8/attachment.html> From claresloggett at gmail.com Fri Oct 3 08:09:55 2014 From: claresloggett at gmail.com (Clare Sloggett) Date: Fri, 3 Oct 2014 22:09:55 +1000 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAAusYCjK4NY8KrvAfp285RXzbgnE+FVy5KN1-Hp57xYw70F6ag@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <634869803.9727722.1412315047475.JavaMail.zimbra@stanford.edu> <CAAusYCjK4NY8KrvAfp285RXzbgnE+FVy5KN1-Hp57xYw70F6ag@mail.gmail.com> Message-ID: <CAETqNqENSYV1Eb-zn3oq0ZaB60cwGWSd1e70oSqUBh7YqhexbQ@mail.gmail.com> Thanks MinRK and everyone, I didn't realise this - great news. I'll try it out! On 3 October 2014 20:34, Doug Blank <doug.blank at gmail.com> wrote: > I concur with Bob that it is in a state that is very usable. I've been > teaching my Programming Languages course (mostly in Scheme) from jupyterhub > and ipython master git (yes, a bit risky, not the recommended mode of > operation. But great rewards!). All of the assignments, notes, and > materials have been straight from notebooks. See my public notebooks here > [1]. We hope to package up that public page code to share---jupyterhub > doesn't currently come with a means to serve rendered pages, but has been > suggested [2]. > > I'm now helping our Physics department get their own server setup. As part > of that project, we are making extensive notes to help those non-sys admin > types be able to get up and running. Will share notes those when available. > > If anyone would like to take a test drive, please contact me and we'll see > about making you an account. > > -Doug > > [1] - http://jupyter.cs.brynmawr.edu/hub/dblank/public > [2] - https://github.com/jupyter/jupyterhub/issues/17 > > On Fri, Oct 3, 2014 at 1:44 AM, Bob Dougherty <bobd at stanford.edu> wrote: > >> It's definitely usable-- we're running our class tutorials through >> JupyterHub using the default pam authentication module. We pre-configured >> linux accounts on the server for each student. Over 20 students have been >> accessing the notebook tutorials through a JubyterHub process that's been >> running for a few weeks straight and it seems to be working fine for them. >> It's all running on a dedicated VM as root and are using ssl for security. >> >> cheers, >> bob >> >> -- >> Robert F. Dougherty, PhD >> Research Director >> Stanford Center for Cognitive and Neurobiological Imaging >> 70 Jordan Hall * Stanford CA 94305 * 650-725-0051 >> http://www.stanford.edu/~bobd >> >> ------------------------------ >> *From: *"MinRK" <benjaminrk at gmail.com> >> *To: *"IPython developers list" <ipython-dev at scipy.org> >> *Sent: *Thursday, October 2, 2014 10:15:29 PM >> *Subject: *Re: [IPython-dev] Multi-user IPython Notebook >> >> >> JupyterHub <https://github.com/jupyter/jupyterhub/> is basically >> functional, right now. We are still working on some configuration, with >> respect to running the server as a limited user. But if you run the server >> as root and you want to provide access to existing system users, it works. >> We also have working examples using GitHub OAuth >> <https://github.com/jupyter/oauthenticator> for user login instead of >> system passwords, as well as running user code in docker containers >> <https://github.com/jupyter/dockerspawner>. >> >> It?s pretty rough right now, and there?s a fair amount of UI and error >> handling to deal with (and documenting how to use it, importantly), but it >> would be great to get some feedback! >> >> -MinRK >> ? >> >> On Thu, Oct 2, 2014 at 9:51 PM, ssanderson <ssanderson at quantopian.com> >> wrote: >> >>> The multi-user notebook project now goes by the name jupyterhub. It >>> lives at >>> https://github.com/jupyter/jupyterhub/tree/master/jupyterhub. I'm not >>> sure >>> what it's status is w/r/t stability and concrete/public APIs, but it's >>> definitely usable already. >>> >>> >>> >>> -- >>> View this message in context: >>> http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073521.html >>> Sent from the IPython - Development mailing list archive at Nabble.com. >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/69e13c6b/attachment.html> From rgbkrk at gmail.com Fri Oct 3 10:54:43 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Fri, 3 Oct 2014 09:54:43 -0500 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <1412317605582-5073526.post@n6.nabble.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> Message-ID: <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> > I wasn't aware of the existence of jupyter/oauthenticator and > jupyter/dockerspawner. That's probably because these were only developed in the last couple of weeks and are still in formation. :) We're still ironing out the best way to handle containerized notebook servers. It seems it is probably time to announce the sandbox project that has been in quiet development. ;) > Is the plan for future extensions of this sort to be > broken out into their own separate repositories? I would have naively > expected all the "official" jupyterhub spawners to be part of the main repo. There may come a day, but the OAuthenticator and the Dockerspawner are both regarded as example of custom auth and spawning at this point. We'll see what happens! -- Kyle On Fri, Oct 3, 2014 at 1:26 AM, ssanderson <ssanderson at quantopian.com> wrote: > I wasn't aware of the existence of jupyter/oauthenticator and > jupyter/dockerspawner. Is the plan for future extensions of this sort to > be > broken out into their own separate repositories? I would have naively > expected all the "official" jupyterhub spawners to be part of the main > repo. > > > > -- > View this message in context: > http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073526.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/43528ee1/attachment.html> From raymond.yee at gmail.com Fri Oct 3 11:27:00 2014 From: raymond.yee at gmail.com (Raymond Yee) Date: Fri, 3 Oct 2014 08:27:00 -0700 Subject: [IPython-dev] [IPythokon-dev] Multi-user IPython Noteboo Message-ID: <CAPt735TXk0B-gZF=Ptwu+a-xAezYD1OnVsYGn-8fFWZHQOXFow@mail.gmail.com> Lo On Oct 3, 2014 7:54 AM, "Kyle Kelley" <rgbkrk at gmail.com> wrote: > > I wasn't aware of the existence of jupyter/oauthenticator and > > jupyter/dockerspawner. > > That's probably because these were only developed in the last couple of > weeks and are still in formation. :) We're still ironing out the best way > to handle containerized notebook servers. It seems it is probably time to > announce the sandbox project that has been in quiet development. ;) > > > Is the plan for future extensions of this sort to be > > broken out into their own separate repositories? I would have naively > > expected all the "official" jupyterhub spawners to be part of the main > repo. > > There may come a day, but the OAuthenticator and the Dockerspawner are > both regarded as example of custom auth and spawning at this point. We'll > see what happens! > > -- Kyle > > > On Fri, Oct 3, 2014 at 1:26 AM, ssanderson <ssanderson at quantopian.com> > wrote: > >> I wasn't aware of the existence of jupyter/oauthenticator and >> jupyter/dockerspawner. Is the plan for future extensions of this sort to >> be >> broken out into their own separate repositories? I would have naively >> expected all the "official" jupyterhub spawners to be part of the main >> repo. >> >> >> >> -- >> View this message in context: >> http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073526.html >> Sent from the IPython - Development mailing list archive at Nabble.com. >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > > -- > Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/ba81053b/attachment.html> From ssanderson at quantopian.com Fri Oct 3 11:44:30 2014 From: ssanderson at quantopian.com (ssanderson) Date: Fri, 3 Oct 2014 08:44:30 -0700 (PDT) Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> Message-ID: <1412351070200-5073572.post@n6.nabble.com> Kyle Kelley wrote > It seems it is probably time to announce the sandbox project that has been > in quiet development. ;) Interesting. Your sandbox project sounds very similar to a project we have going over at Quantopian; we're building a notebook-based financial research environment for our users. We're also using Docker containers for notebook sandboxing and performance isolation. Currently we're managing deployments of single-user servers with a homegrown prototype, but in the next few weeks we're going to investigate switching to Jupyterhub. The DockerSpawner looks very much like what I had sketched out in a to-do list of custom extensions we would have had to write ourselves :). I'd love to compare notes at some point on what you guys have planned vs our roadmap; we might be able to avoid some duplicated work that way. -Scott -- View this message in context: http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073572.html Sent from the IPython - Development mailing list archive at Nabble.com. From rgbkrk at gmail.com Fri Oct 3 12:25:15 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Fri, 3 Oct 2014 11:25:15 -0500 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <1412351070200-5073572.post@n6.nabble.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> <1412351070200-5073572.post@n6.nabble.com> Message-ID: <CA+tbMaXPeqrf5rJPQqfVwGt790XSGHY7Os=p+vfUeiwELmhN2g@mail.gmail.com> Scott, How are you currently locking down the Docker containers for your users? How many do you run per host? On Fri, Oct 3, 2014 at 10:44 AM, ssanderson <ssanderson at quantopian.com> wrote: > Kyle Kelley wrote > > It seems it is probably time to announce the sandbox project that has > been > > in quiet development. ;) > > Interesting. Your sandbox project sounds very similar to a project we have > going over at Quantopian; we're building a notebook-based financial > research > environment for our users. We're also using Docker containers for notebook > sandboxing and performance isolation. Currently we're managing deployments > of single-user servers with a homegrown prototype, but in the next few > weeks > we're going to investigate switching to Jupyterhub. The DockerSpawner > looks > very much like what I had sketched out in a to-do list of custom extensions > we would have had to write ourselves :). I'd love to compare notes at some > point on what you guys have planned vs our roadmap; we might be able to > avoid some duplicated work that way. > > -Scott > > > > -- > View this message in context: > http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073572.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/935f3af4/attachment.html> From fperez.net at gmail.com Fri Oct 3 13:37:57 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Fri, 3 Oct 2014 10:37:57 -0700 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAAusYCjK4NY8KrvAfp285RXzbgnE+FVy5KN1-Hp57xYw70F6ag@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <634869803.9727722.1412315047475.JavaMail.zimbra@stanford.edu> <CAAusYCjK4NY8KrvAfp285RXzbgnE+FVy5KN1-Hp57xYw70F6ag@mail.gmail.com> Message-ID: <CAHAreOoeS3boPqY23prjmA_fgRC3s4NsTmdENEgEeTq1hB3pvw@mail.gmail.com> On Fri, Oct 3, 2014 at 3:34 AM, Doug Blank <doug.blank at gmail.com> wrote: > I'm now helping our Physics department get their own server setup. As part > of that project, we are making extensive notes to help those non-sys admin > types be able to get up and running. Will share notes those when available. This is great! Please do share those when it makes sense, I'm sure many would find them useful. Best f -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/ecece907/attachment.html> From ssanderson at quantopian.com Fri Oct 3 14:18:50 2014 From: ssanderson at quantopian.com (ssanderson) Date: Fri, 3 Oct 2014 11:18:50 -0700 (PDT) Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CA+tbMaXPeqrf5rJPQqfVwGt790XSGHY7Os=p+vfUeiwELmhN2g@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> <1412351070200-5073572.post@n6.nabble.com> <CA+tbMaXPeqrf5rJPQqfVwGt790XSGHY7Os=p+vfUeiwELmhN2g@mail.gmail.com> Message-ID: <1412360330179-5073582.post@n6.nabble.com> Kyle, Currently we're spinning up new containers manually over SSH using Fabric. The container we're running is conceptually pretty similar to the scipyserver container in docker-notebook <https://github.com/ipython/docker-notebook> . At the moment we're not doing any sort of proxying, so each single user server just gets its own unique URL and password, which is supplied to its user. As far as how many containers we run per host, we're still playing around with different instance types and resource limits, so we haven't settled on a specific number. One of the challenges for us is that different research activities have radically different performance profiles. For example, querying historical financial data is mostly IO-bound, analyses of large datasets are often constrained by RAM, and backtesting with in-memory data is primarily CPU-bound (in my dream world, we can farm out the CPU-bound tasks to pool of worker containers using IPython Parallel, but that's a ways off). That said, I think our current ballpark is to run on the order of 10 containers per host. -- View this message in context: http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073582.html Sent from the IPython - Development mailing list archive at Nabble.com. From Andy at SantaCruzIntegration.com Fri Oct 3 14:22:40 2014 From: Andy at SantaCruzIntegration.com (Andy Davidson) Date: Fri, 03 Oct 2014 11:22:40 -0700 Subject: [IPython-dev] ERROR can not use fork(), exec(), dup2() to communicate with child process Message-ID: <D0543608.1B012%Andy@SantaCruzIntegration.com> Hi MinRK I am new to Python system programming. In my first experiments I use subprocess. Reading the document it appears subprocess it great for a setting up traditional unix style pipe like for example calling ?ls? In the notebook I aussem ! Uname ?a Works using subprocess. The subprocess documentation suggests that you need to call communicate() and that this function will not return until the child sends EOF or terminates. My child will never exit or send EOF. it will keep sending me real time data. I want to process the data one line at a time. Here is my psudo code While (True): Data = readALineFromChild() # this should block until data becomes available Graph(data) Thanks Andy > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mail.scipy.org/pipermail/ipython-dev/attachments/20141002/aefaa3fc/atta > chment-0001.html > > ------------------------------ > > Message: 3 > Date: Thu, 2 Oct 2014 17:19:18 -0700 > From: MinRK <benjaminrk at gmail.com> > Subject: Re: [IPython-dev] ERROR can not use fork(), exec(), dup2() to > communicate with child process > To: IPython developers list <ipython-dev at scipy.org> > Message-ID: > <CAHNn8BXxCej6VL4XkjguOSXtgnxpsNCJXHhKGNLSBoYbiu48-g at mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > why use execlp instead of subprocess.Popen, which allows capturing stdout, > stderr, etc.? > ? > > On Thu, Oct 2, 2014 at 4:17 PM, Andy Davidson <Andy at santacruzintegration.com >> wrote: > >> Hi >> >> >> I want to write a notebook that receives data from another process. Bellow >> is my python code. It forks a child process and reads the data from the >> child using a pipe. This code works if I run it in python. When I try to >> execute from iPython notebook I get the following error. Any idea what the >> problems is ? >> >> >> If pipes do not work, can I use a socket? The other process would send me >> data by writing, my notebook needs behave like a server. >> >> >> Any comments or suggestions would be greatly appreciated. >> >> >> Thanks >> >> >> Andy >> >> >> P.s. I am running headless on a remote machine and use an ssh tunnel to >> run the notebook from my local browser. My other notebooks works fine >> >> >> >> [ec2-user at ip-172-31-14-107 ~]$ IPYTHON_OPTS="notebook --pylab inline >> --no-browser --port=7000" /root/spark/bin/pyspark >> >> /root/spark/conf/spark-env.sh: line 21: ulimit: open files: cannot modify >> limit: Operation not permitted >> >> [NotebookApp] Using existing profile dir: >> u'/home/ec2-user/.ipython/profile_default' >> >> [NotebookApp] Serving notebooks from /home/ec2-user >> >> [NotebookApp] The IPython Notebook is running at: http://127.0.0.1:7000/ >> >> [NotebookApp] Use Control-C to stop this server and shut down all kernels. >> >> [NotebookApp] Using MathJax from CDN: >> http://cdn.mathjax.org/mathjax/latest/MathJax.js >> >> [NotebookApp] Kernel started: 71f07d5c-2db1-465f-9d86-da29f8711a0b >> >> [NotebookApp] Connecting to: tcp://127.0.0.1:54119 >> >> [NotebookApp] Connecting to: tcp://127.0.0.1:50649 >> >> [NotebookApp] Connecting to: tcp://127.0.0.1:35516 >> >> [IPKernelApp] To connect another client to this kernel, use: >> >> [IPKernelApp] --existing kernel-71f07d5c-2db1-465f-9d86-da29f8711a0b.json >> >> Assertion failed: ok (bundled/zeromq/src/mailbox.cpp:79) >> >> [NotebookApp] Kernel 71f07d5c-2db1-465f-9d86-da29f8711a0b failed to >> respond to heartbeat >> >> >> >> import sys >> import os >> >> def child(pipeout): >> os.dup2(pipeout, sys.stdout.fileno()) >> os.close(pipeout) >> os.execlp("./test.sh", "abc") >> >> >> def parent(): >> pipein, pipeout = os.pipe() >> if os.fork() == 0: >> os.close(pipein) >> child(pipeout) >> else: >> os.close(pipeout) >> counter = 1 >> pipein = os.fdopen(pipein) >> while True: >> json = pipein.readline()[:-1] >> print 'parent: %s' % (json) >> >> parent() >> >> $ cat test.sh >> >> #!/bin/bash >> >> >> script_name=$0 >> >> args=$@ >> >> current=`pwd` >> >> echo $script_name $args >> >> echo "XYZ: "$XYZ >> >> echo "PATH: "$PATH >> >> echo "current directory: $current" >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/883aab7c/attachment.html> From benjaminrk at gmail.com Fri Oct 3 14:26:52 2014 From: benjaminrk at gmail.com (MinRK) Date: Fri, 3 Oct 2014 11:26:52 -0700 Subject: [IPython-dev] ERROR can not use fork(), exec(), dup2() to communicate with child process In-Reply-To: <D0543608.1B012%Andy@SantaCruzIntegration.com> References: <D0543608.1B012%Andy@SantaCruzIntegration.com> Message-ID: <CAHNn8BUt8fPQcYYgZb=tE3ErtnOrbYYecxNHVBLEd+PkaSxMyQ@mail.gmail.com> You don?t need to read the whole output at once. You can get one line at a time. Or, you can use pexpect <http://pexpect.readthedocs.org/en/latest/> to create the subprocess, which offers nice timeout, pattern-expecting waiting for output. Depending on context, IPython will use one or the other of these for !. -MinRK ? On Fri, Oct 3, 2014 at 11:22 AM, Andy Davidson < Andy at santacruzintegration.com> wrote: > Hi MinRK > > I am new to Python system programming. In my first experiments I use > subprocess. Reading the document it appears subprocess it great for a > setting up traditional unix style pipe like for example calling ?ls? > > In the notebook I aussem > ! Uname ?a > > Works using subprocess. > > The subprocess documentation suggests that you need to call communicate() > and that this function will not return until the child sends EOF or > terminates. My child will never exit or send EOF. it will keep sending me > real time data. I want to process the data one line at a time. Here is my > psudo code > > While (True): > Data = readALineFromChild() # this should block until data becomes > available > Graph(data) > > > > Thanks > > Andy > > > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://mail.scipy.org/pipermail/ipython-dev/attachments/20141002/aefaa3fc/attachment-0001.html > > ------------------------------ > > Message: 3 > Date: Thu, 2 Oct 2014 17:19:18 -0700 > From: MinRK <benjaminrk at gmail.com> > Subject: Re: [IPython-dev] ERROR can not use fork(), exec(), dup2() to > communicate with child process > To: IPython developers list <ipython-dev at scipy.org> > Message-ID: > <CAHNn8BXxCej6VL4XkjguOSXtgnxpsNCJXHhKGNLSBoYbiu48-g at mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > why use execlp instead of subprocess.Popen, which allows capturing stdout, > stderr, etc.? > ? > > On Thu, Oct 2, 2014 at 4:17 PM, Andy Davidson < > Andy at santacruzintegration.com > > wrote: > > > Hi > > > I want to write a notebook that receives data from another process. Bellow > is my python code. It forks a child process and reads the data from the > child using a pipe. This code works if I run it in python. When I try to > execute from iPython notebook I get the following error. Any idea what the > problems is ? > > > If pipes do not work, can I use a socket? The other process would send me > data by writing, my notebook needs behave like a server. > > > Any comments or suggestions would be greatly appreciated. > > > Thanks > > > Andy > > > P.s. I am running headless on a remote machine and use an ssh tunnel to > run the notebook from my local browser. My other notebooks works fine > > > > [ec2-user at ip-172-31-14-107 ~]$ IPYTHON_OPTS="notebook --pylab inline > --no-browser --port=7000" /root/spark/bin/pyspark > > /root/spark/conf/spark-env.sh: line 21: ulimit: open files: cannot modify > limit: Operation not permitted > > [NotebookApp] Using existing profile dir: > u'/home/ec2-user/.ipython/profile_default' > > [NotebookApp] Serving notebooks from /home/ec2-user > > [NotebookApp] The IPython Notebook is running at: http://127.0.0.1:7000/ > > [NotebookApp] Use Control-C to stop this server and shut down all kernels. > > [NotebookApp] Using MathJax from CDN: > http://cdn.mathjax.org/mathjax/latest/MathJax.js > > [NotebookApp] Kernel started: 71f07d5c-2db1-465f-9d86-da29f8711a0b > > [NotebookApp] Connecting to: tcp://127.0.0.1:54119 > > [NotebookApp] Connecting to: tcp://127.0.0.1:50649 > > [NotebookApp] Connecting to: tcp://127.0.0.1:35516 > > [IPKernelApp] To connect another client to this kernel, use: > > [IPKernelApp] --existing kernel-71f07d5c-2db1-465f-9d86-da29f8711a0b.json > > Assertion failed: ok (bundled/zeromq/src/mailbox.cpp:79) > > [NotebookApp] Kernel 71f07d5c-2db1-465f-9d86-da29f8711a0b failed to > respond to heartbeat > > > > import sys > import os > > def child(pipeout): > os.dup2(pipeout, sys.stdout.fileno()) > os.close(pipeout) > os.execlp("./test.sh", "abc") > > > def parent(): > pipein, pipeout = os.pipe() > if os.fork() == 0: > os.close(pipein) > child(pipeout) > else: > os.close(pipeout) > counter = 1 > pipein = os.fdopen(pipein) > while True: > json = pipein.readline()[:-1] > print 'parent: %s' % (json) > > parent() > > $ cat test.sh > > #!/bin/bash > > > script_name=$0 > > args=$@ > > current=`pwd` > > echo $script_name $args > > echo "XYZ: "$XYZ > > echo "PATH: "$PATH > > echo "current directory: $current" > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/e56ec670/attachment.html> From takowl at gmail.com Fri Oct 3 14:32:34 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 3 Oct 2014 11:32:34 -0700 Subject: [IPython-dev] ERROR can not use fork(), exec(), dup2() to communicate with child process In-Reply-To: <D0543608.1B012%Andy@SantaCruzIntegration.com> References: <D0543608.1B012%Andy@SantaCruzIntegration.com> Message-ID: <CAOvn4qiz-1coKkid5JgPHDqAgoVtwz=HRFtca3wtRboA4L+tug@mail.gmail.com> On 3 October 2014 11:22, Andy Davidson <Andy at santacruzintegration.com> wrote: > The subprocess documentation suggests that you need to call communicate() > and that this function will not return until the child sends EOF or > terminates. You don't actually *need* to use communicate(), it's just advised for most cases to avoid deadlocks. If you need to e.g. read streaming data one line at a time, you can use Popen.stdout.read(). Where you need to be careful is if the process writes to both stdout and stderr, and you only read stdout, it will fill up the stderr buffer and then block trying to write more stderr, while you're waiting for output on stdout that never appears. Similarly, if you're sending it data on stdin, it can get stuck waiting for input while you're waiting for output. communicate() handles this for you, but if necessary you can handle it yourself. Depending on your process, you might want to pipe stderr to /dev/null to discard it, or merge it with stdout so you read both at once. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/2d1519ae/attachment.html> From ellisonbg at gmail.com Fri Oct 3 14:57:08 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 3 Oct 2014 11:57:08 -0700 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <1412360330179-5073582.post@n6.nabble.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> <1412351070200-5073572.post@n6.nabble.com> <CA+tbMaXPeqrf5rJPQqfVwGt790XSGHY7Os=p+vfUeiwELmhN2g@mail.gmail.com> <1412360330179-5073582.post@n6.nabble.com> Message-ID: <CAH4pYpRYyS9WZ4QGDhKiam-vWqAT9vTTFDU+=abionSgG+EQrA@mail.gmail.com> (Kyle, working at Rackspace, might not volunteer this information in this context) I highly recommend looking at Rackspace's OnMetal Servers for performance critical things that you want to cost contain. Cheers, Brian On Fri, Oct 3, 2014 at 11:18 AM, ssanderson <ssanderson at quantopian.com> wrote: > Kyle, > > Currently we're spinning up new containers manually over SSH using Fabric. > The container we're running is conceptually pretty similar to the > scipyserver container in docker-notebook > <https://github.com/ipython/docker-notebook> . At the moment we're not > doing any sort of proxying, so each single user server just gets its own > unique URL and password, which is supplied to its user. > > As far as how many containers we run per host, we're still playing around > with different instance types and resource limits, so we haven't settled on > a specific number. One of the challenges for us is that different research > activities have radically different performance profiles. For example, > querying historical financial data is mostly IO-bound, analyses of large > datasets are often constrained by RAM, and backtesting with in-memory data > is primarily CPU-bound (in my dream world, we can farm out the CPU-bound > tasks to pool of worker containers using IPython Parallel, but that's a ways > off). That said, I think our current ballpark is to run on the order of 10 > containers per host. > > > > -- > View this message in context: http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073582.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From one at kentran.net Fri Oct 3 16:09:42 2014 From: one at kentran.net (Kenneth Tran) Date: Fri, 3 Oct 2014 13:09:42 -0700 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAH4pYpRYyS9WZ4QGDhKiam-vWqAT9vTTFDU+=abionSgG+EQrA@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> <1412351070200-5073572.post@n6.nabble.com> <CA+tbMaXPeqrf5rJPQqfVwGt790XSGHY7Os=p+vfUeiwELmhN2g@mail.gmail.com> <1412360330179-5073582.post@n6.nabble.com> <CAH4pYpRYyS9WZ4QGDhKiam-vWqAT9vTTFDU+=abionSgG+EQrA@mail.gmail.com> Message-ID: <CAHmx4LDfnRPjMw9mRgdwXtB_1EgsOc49Njm0kKDYt8_UKvYqfA@mail.gmail.com> Are there any instructions on how to get JupyterHub work on Windows using Active Directory or using Online Microsoft accounts? Fernando mentioned that we can plug-in a custom authenticator (or something like this). I want to know more details. Thanks. -Ken On Fri, Oct 3, 2014 at 11:57 AM, Brian Granger <ellisonbg at gmail.com> wrote: > (Kyle, working at Rackspace, might not volunteer this information in > this context) > > I highly recommend looking at Rackspace's OnMetal Servers for > performance critical things that you want to cost contain. > > Cheers, > > Brian > > On Fri, Oct 3, 2014 at 11:18 AM, ssanderson <ssanderson at quantopian.com> > wrote: > > Kyle, > > > > Currently we're spinning up new containers manually over SSH using > Fabric. > > The container we're running is conceptually pretty similar to the > > scipyserver container in docker-notebook > > <https://github.com/ipython/docker-notebook> . At the moment we're not > > doing any sort of proxying, so each single user server just gets its own > > unique URL and password, which is supplied to its user. > > > > As far as how many containers we run per host, we're still playing around > > with different instance types and resource limits, so we haven't settled > on > > a specific number. One of the challenges for us is that different > research > > activities have radically different performance profiles. For example, > > querying historical financial data is mostly IO-bound, analyses of large > > datasets are often constrained by RAM, and backtesting with in-memory > data > > is primarily CPU-bound (in my dream world, we can farm out the CPU-bound > > tasks to pool of worker containers using IPython Parallel, but that's a > ways > > off). That said, I think our current ballpark is to run on the order > of 10 > > containers per host. > > > > > > > > -- > > View this message in context: > http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073582.html > > Sent from the IPython - Development mailing list archive at Nabble.com. > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > @ellisonbg on Twitter and GitHub > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/72b4a32b/attachment.html> From ellisonbg at gmail.com Fri Oct 3 16:11:46 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 3 Oct 2014 13:11:46 -0700 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAHmx4LDfnRPjMw9mRgdwXtB_1EgsOc49Njm0kKDYt8_UKvYqfA@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> <1412351070200-5073572.post@n6.nabble.com> <CA+tbMaXPeqrf5rJPQqfVwGt790XSGHY7Os=p+vfUeiwELmhN2g@mail.gmail.com> <1412360330179-5073582.post@n6.nabble.com> <CAH4pYpRYyS9WZ4QGDhKiam-vWqAT9vTTFDU+=abionSgG+EQrA@mail.gmail.com> <CAHmx4LDfnRPjMw9mRgdwXtB_1EgsOc49Njm0kKDYt8_UKvYqfA@mail.gmail.com> Message-ID: <CAH4pYpQt44hG-nXkYFM1+QfjdTgee2VG1e=P-pMsjqnpdkAMtQ@mail.gmail.com> No but we are accepting PRs! On Fri, Oct 3, 2014 at 1:09 PM, Kenneth Tran <one at kentran.net> wrote: > Are there any instructions on how to get JupyterHub work on Windows using > Active Directory or using Online Microsoft accounts? > > Fernando mentioned that we can plug-in a custom authenticator (or something > like this). I want to know more details. > > Thanks. > -Ken > > > On Fri, Oct 3, 2014 at 11:57 AM, Brian Granger <ellisonbg at gmail.com> wrote: >> >> (Kyle, working at Rackspace, might not volunteer this information in >> this context) >> >> I highly recommend looking at Rackspace's OnMetal Servers for >> performance critical things that you want to cost contain. >> >> Cheers, >> >> Brian >> >> On Fri, Oct 3, 2014 at 11:18 AM, ssanderson <ssanderson at quantopian.com> >> wrote: >> > Kyle, >> > >> > Currently we're spinning up new containers manually over SSH using >> > Fabric. >> > The container we're running is conceptually pretty similar to the >> > scipyserver container in docker-notebook >> > <https://github.com/ipython/docker-notebook> . At the moment we're not >> > doing any sort of proxying, so each single user server just gets its own >> > unique URL and password, which is supplied to its user. >> > >> > As far as how many containers we run per host, we're still playing >> > around >> > with different instance types and resource limits, so we haven't settled >> > on >> > a specific number. One of the challenges for us is that different >> > research >> > activities have radically different performance profiles. For example, >> > querying historical financial data is mostly IO-bound, analyses of large >> > datasets are often constrained by RAM, and backtesting with in-memory >> > data >> > is primarily CPU-bound (in my dream world, we can farm out the CPU-bound >> > tasks to pool of worker containers using IPython Parallel, but that's a >> > ways >> > off). That said, I think our current ballpark is to run on the order >> > of 10 >> > containers per host. >> > >> > >> > >> > -- >> > View this message in context: >> > http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073582.html >> > Sent from the IPython - Development mailing list archive at Nabble.com. >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> @ellisonbg on Twitter and GitHub >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From benjaminrk at gmail.com Fri Oct 3 16:17:04 2014 From: benjaminrk at gmail.com (MinRK) Date: Fri, 3 Oct 2014 13:17:04 -0700 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAH4pYpQt44hG-nXkYFM1+QfjdTgee2VG1e=P-pMsjqnpdkAMtQ@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> <1412351070200-5073572.post@n6.nabble.com> <CA+tbMaXPeqrf5rJPQqfVwGt790XSGHY7Os=p+vfUeiwELmhN2g@mail.gmail.com> <1412360330179-5073582.post@n6.nabble.com> <CAH4pYpRYyS9WZ4QGDhKiam-vWqAT9vTTFDU+=abionSgG+EQrA@mail.gmail.com> <CAHmx4LDfnRPjMw9mRgdwXtB_1EgsOc49Njm0kKDYt8_UKvYqfA@mail.gmail.com> <CAH4pYpQt44hG-nXkYFM1+QfjdTgee2VG1e=P-pMsjqnpdkAMtQ@mail.gmail.com> Message-ID: <CAHNn8BWuRwBX_wFMhJJV-MeGx5E2=pz125pv++qHRp+WPkLVmg@mail.gmail.com> The authentication is customizable. I wrote the OAuth example as a test case for this customizability. Anything that takes a username and password should be quite simple. We are still working on what the API should be, but it works right now. It is not planned, however, for JupyterHub to support Windows at all. -MinRK On Fri, Oct 3, 2014 at 1:11 PM, Brian Granger <ellisonbg at gmail.com> wrote: > No but we are accepting PRs! > > On Fri, Oct 3, 2014 at 1:09 PM, Kenneth Tran <one at kentran.net> wrote: > > Are there any instructions on how to get JupyterHub work on Windows using > > Active Directory or using Online Microsoft accounts? > > > > Fernando mentioned that we can plug-in a custom authenticator (or > something > > like this). I want to know more details. > > > > Thanks. > > -Ken > > > > > > On Fri, Oct 3, 2014 at 11:57 AM, Brian Granger <ellisonbg at gmail.com> > wrote: > >> > >> (Kyle, working at Rackspace, might not volunteer this information in > >> this context) > >> > >> I highly recommend looking at Rackspace's OnMetal Servers for > >> performance critical things that you want to cost contain. > >> > >> Cheers, > >> > >> Brian > >> > >> On Fri, Oct 3, 2014 at 11:18 AM, ssanderson <ssanderson at quantopian.com> > >> wrote: > >> > Kyle, > >> > > >> > Currently we're spinning up new containers manually over SSH using > >> > Fabric. > >> > The container we're running is conceptually pretty similar to the > >> > scipyserver container in docker-notebook > >> > <https://github.com/ipython/docker-notebook> . At the moment we're > not > >> > doing any sort of proxying, so each single user server just gets its > own > >> > unique URL and password, which is supplied to its user. > >> > > >> > As far as how many containers we run per host, we're still playing > >> > around > >> > with different instance types and resource limits, so we haven't > settled > >> > on > >> > a specific number. One of the challenges for us is that different > >> > research > >> > activities have radically different performance profiles. For > example, > >> > querying historical financial data is mostly IO-bound, analyses of > large > >> > datasets are often constrained by RAM, and backtesting with in-memory > >> > data > >> > is primarily CPU-bound (in my dream world, we can farm out the > CPU-bound > >> > tasks to pool of worker containers using IPython Parallel, but that's > a > >> > ways > >> > off). That said, I think our current ballpark is to run on the order > >> > of 10 > >> > containers per host. > >> > > >> > > >> > > >> > -- > >> > View this message in context: > >> > > http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073582.html > >> > Sent from the IPython - Development mailing list archive at > Nabble.com. > >> > _______________________________________________ > >> > IPython-dev mailing list > >> > IPython-dev at scipy.org > >> > http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > >> > >> > >> -- > >> Brian E. Granger > >> Cal Poly State University, San Luis Obispo > >> @ellisonbg on Twitter and GitHub > >> bgranger at calpoly.edu and ellisonbg at gmail.com > >> _______________________________________________ > >> IPython-dev mailing list > >> IPython-dev at scipy.org > >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > @ellisonbg on Twitter and GitHub > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/13946b0a/attachment.html> From rgbkrk at gmail.com Fri Oct 3 16:33:02 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Fri, 3 Oct 2014 15:33:02 -0500 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAHNn8BWuRwBX_wFMhJJV-MeGx5E2=pz125pv++qHRp+WPkLVmg@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> <1412351070200-5073572.post@n6.nabble.com> <CA+tbMaXPeqrf5rJPQqfVwGt790XSGHY7Os=p+vfUeiwELmhN2g@mail.gmail.com> <1412360330179-5073582.post@n6.nabble.com> <CAH4pYpRYyS9WZ4QGDhKiam-vWqAT9vTTFDU+=abionSgG+EQrA@mail.gmail.com> <CAHmx4LDfnRPjMw9mRgdwXtB_1EgsOc49Njm0kKDYt8_UKvYqfA@mail.gmail.com> <CAH4pYpQt44hG-nXkYFM1+QfjdTgee2VG1e=P-pMsjqnpdkAMtQ@mail.gmail.com> <CAHNn8BWuRwBX_wFMhJJV-MeGx5E2=pz125pv++qHRp+WPkLVmg@mail.gmail.com> Message-ID: <CA+tbMaWftHb5mCxoQH1WUnEFZ8Ytq9mEaW2cRGT12MGyNEZ=+g@mail.gmail.com> > It is not planned, however, for JupyterHub to support Windows at all. To clarify, JupyterHub will *only* run (server side) on *nix systems. Clients can reach it from a Windows environment. Getting custom auth with LDAP or Active Directory would work **great** with a large number of corporate environments. It's not currently in the project's plans to build this out, but I think it would be absolutely wonderful to exist with the IPython/Jupyter ecosystem/community. -- Kyle On Fri, Oct 3, 2014 at 3:17 PM, MinRK <benjaminrk at gmail.com> wrote: > The authentication is customizable. I wrote the OAuth example as a test > case for this customizability. Anything that takes a username and password > should be quite simple. We are still working on what the API should be, but > it works right now. It is not planned, however, for JupyterHub to support > Windows at all. > > -MinRK > > > On Fri, Oct 3, 2014 at 1:11 PM, Brian Granger <ellisonbg at gmail.com> wrote: > >> No but we are accepting PRs! >> >> On Fri, Oct 3, 2014 at 1:09 PM, Kenneth Tran <one at kentran.net> wrote: >> > Are there any instructions on how to get JupyterHub work on Windows >> using >> > Active Directory or using Online Microsoft accounts? >> > >> > Fernando mentioned that we can plug-in a custom authenticator (or >> something >> > like this). I want to know more details. >> > >> > Thanks. >> > -Ken >> > >> > >> > On Fri, Oct 3, 2014 at 11:57 AM, Brian Granger <ellisonbg at gmail.com> >> wrote: >> >> >> >> (Kyle, working at Rackspace, might not volunteer this information in >> >> this context) >> >> >> >> I highly recommend looking at Rackspace's OnMetal Servers for >> >> performance critical things that you want to cost contain. >> >> >> >> Cheers, >> >> >> >> Brian >> >> >> >> On Fri, Oct 3, 2014 at 11:18 AM, ssanderson <ssanderson at quantopian.com >> > >> >> wrote: >> >> > Kyle, >> >> > >> >> > Currently we're spinning up new containers manually over SSH using >> >> > Fabric. >> >> > The container we're running is conceptually pretty similar to the >> >> > scipyserver container in docker-notebook >> >> > <https://github.com/ipython/docker-notebook> . At the moment >> we're not >> >> > doing any sort of proxying, so each single user server just gets its >> own >> >> > unique URL and password, which is supplied to its user. >> >> > >> >> > As far as how many containers we run per host, we're still playing >> >> > around >> >> > with different instance types and resource limits, so we haven't >> settled >> >> > on >> >> > a specific number. One of the challenges for us is that different >> >> > research >> >> > activities have radically different performance profiles. For >> example, >> >> > querying historical financial data is mostly IO-bound, analyses of >> large >> >> > datasets are often constrained by RAM, and backtesting with in-memory >> >> > data >> >> > is primarily CPU-bound (in my dream world, we can farm out the >> CPU-bound >> >> > tasks to pool of worker containers using IPython Parallel, but >> that's a >> >> > ways >> >> > off). That said, I think our current ballpark is to run on the >> order >> >> > of 10 >> >> > containers per host. >> >> > >> >> > >> >> > >> >> > -- >> >> > View this message in context: >> >> > >> http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073582.html >> >> > Sent from the IPython - Development mailing list archive at >> Nabble.com. >> >> > _______________________________________________ >> >> > IPython-dev mailing list >> >> > IPython-dev at scipy.org >> >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> >> >> >> >> -- >> >> Brian E. Granger >> >> Cal Poly State University, San Luis Obispo >> >> @ellisonbg on Twitter and GitHub >> >> bgranger at calpoly.edu and ellisonbg at gmail.com >> >> _______________________________________________ >> >> IPython-dev mailing list >> >> IPython-dev at scipy.org >> >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> > >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> @ellisonbg on Twitter and GitHub >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/b3e0921f/attachment.html> From rgbkrk at gmail.com Fri Oct 3 17:15:17 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Fri, 3 Oct 2014 16:15:17 -0500 Subject: [IPython-dev] Multi-user IPython Notebook In-Reply-To: <CAH4pYpRYyS9WZ4QGDhKiam-vWqAT9vTTFDU+=abionSgG+EQrA@mail.gmail.com> References: <CAETqNqGzetNbgd8pV0DK02UBqy8TNoTJLy3-FD15S03D1hFj3Q@mail.gmail.com> <1412311899323-5073521.post@n6.nabble.com> <CAHNn8BWpJB1GVta_sDet0d2i0B2hy7a-oK5qRHQCRdex0iKhtQ@mail.gmail.com> <1412317605582-5073526.post@n6.nabble.com> <CA+tbMaVtd-oB2L_QRPaegZQ4q17dNY_mk3AhUoYGa636Hc6oag@mail.gmail.com> <1412351070200-5073572.post@n6.nabble.com> <CA+tbMaXPeqrf5rJPQqfVwGt790XSGHY7Os=p+vfUeiwELmhN2g@mail.gmail.com> <1412360330179-5073582.post@n6.nabble.com> <CAH4pYpRYyS9WZ4QGDhKiam-vWqAT9vTTFDU+=abionSgG+EQrA@mail.gmail.com> Message-ID: <CA+tbMaUQD03hmiH7a80Bzxh=yixgCYnG0ygcwE2bTv2Pk+XTHQ@mail.gmail.com> Thanks Brian. ;) I'm currently running a setup where I'm subdividing a machine with .5 TB of RAM, where each user gets 512 MB of RAM (~1000 users). Not quite ready to show off beyond a handful of people. Email me directly if you want to check it out. If anyone wants specs or to talk about the environment, feel free to ask. ;) All tools are built agnostic of providers, but I am working cloud configs that optimize for the hardware its being run on, primarily for how /var/lib/docker is mounted. -- Kyle On Fri, Oct 3, 2014 at 1:57 PM, Brian Granger <ellisonbg at gmail.com> wrote: > (Kyle, working at Rackspace, might not volunteer this information in > this context) > > I highly recommend looking at Rackspace's OnMetal Servers for > performance critical things that you want to cost contain. > > Cheers, > > Brian > > On Fri, Oct 3, 2014 at 11:18 AM, ssanderson <ssanderson at quantopian.com> > wrote: > > Kyle, > > > > Currently we're spinning up new containers manually over SSH using > Fabric. > > The container we're running is conceptually pretty similar to the > > scipyserver container in docker-notebook > > <https://github.com/ipython/docker-notebook> . At the moment we're not > > doing any sort of proxying, so each single user server just gets its own > > unique URL and password, which is supplied to its user. > > > > As far as how many containers we run per host, we're still playing around > > with different instance types and resource limits, so we haven't settled > on > > a specific number. One of the challenges for us is that different > research > > activities have radically different performance profiles. For example, > > querying historical financial data is mostly IO-bound, analyses of large > > datasets are often constrained by RAM, and backtesting with in-memory > data > > is primarily CPU-bound (in my dream world, we can farm out the CPU-bound > > tasks to pool of worker containers using IPython Parallel, but that's a > ways > > off). That said, I think our current ballpark is to run on the order > of 10 > > containers per host. > > > > > > > > -- > > View this message in context: > http://python.6.x6.nabble.com/Multi-user-IPython-Notebook-tp5073520p5073582.html > > Sent from the IPython - Development mailing list archive at Nabble.com. > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > @ellisonbg on Twitter and GitHub > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141003/6122956c/attachment.html> From rvraghav93 at gmail.com Mon Oct 6 04:18:39 2014 From: rvraghav93 at gmail.com (Raghav Rv) Date: Mon, 6 Oct 2014 13:48:39 +0530 Subject: [IPython-dev] PEP8 Check For IPython Notebook - A small work around Message-ID: <CAPb89bLsdTEUeavhjKd-BdOz1ihVVjW4B8LFKAcAgjw9B8tqTw@mail.gmail.com> Hi all, I recently modified the pep8 project a little to allow pep8 checks to be run on ipython notebook, inspired by this stack overflow post <http://stackoverflow.com/questions/26205629>. [ Though we do have an extension that can check for pep8 on a per-cell basis, this modification can help us run pep8 for a whole ".ipynb" file. ] Using the --format="ipynb" flag we can get the line number offset ( calculated for each individual cell ) and the cell number in the error report, to easily locate errors. This is the pull request : https://github.com/jcrocholl/pep8/pull/337 ( Looks like this won't be merged as the devs of pep8 feel this is out of scope for the project. ) I am just posting it here ( as advised by Matt ), just incase someone finds it useful ... Sample Notebook <http://nbviewer.ipython.org/github/rvraghav93/Data-Structures-By-Horowitz-in-Python/blob/master/Chapter%208/Chapter%208%20-%20Hashing.ipynb> . Result of running : `python pep8.py --format="ipynb" notebook.ipynb` on the above notebook. ( Output seems to be consistent with that of the pep8 check on the converted ".py" file ) Output <https://gist.github.com/rvraghav93/61f98948a4e0464d2cd3> Thanks Raghav Rv ( rvraghav93 ) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141006/a1429f1e/attachment.html> From wstein at gmail.com Mon Oct 6 10:39:18 2014 From: wstein at gmail.com (William Stein) Date: Mon, 6 Oct 2014 07:39:18 -0700 Subject: [IPython-dev] Fwd: [sage-devel] Re: Please review ipython notebook In-Reply-To: <826e9f22-f585-48c4-8f1d-f701bd795327@googlegroups.com> References: <c4f73a0d-e60c-4d7b-ac1e-f13d6a08b7c3@googlegroups.com> <826e9f22-f585-48c4-8f1d-f701bd795327@googlegroups.com> Message-ID: <CACLE5GB5C9C=coE7Dp9dLufWMcC=gJA-vhnQ9pAfvZH_j3XxUQ@mail.gmail.com> Any chance any IPython devs would have any interest in at least looking at what Volker's doing here? See below. A little effort by somebody could could increase the number of IPython notebook users by thousands... Forwarded conversation Subject: [sage-devel] Please review ipython notebook ------------------------ From: *Volker Braun* <vbraun.name at gmail.com> Date: Mon, Sep 29, 2014 at 4:48 AM To: sage-devel at googlegroups.com Now would be a good time to review the IPython notebook: http://trac.sagemath.org/ticket/16996 There is clearly more to be done to make the integration perfect, and we could also always wait for the next IPython version. But a bird in the hand is worth two in the bush... -- You received this message because you are subscribed to the Google Groups "sage-devel" group. To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+unsubscribe at googlegroups.com. To post to this group, send email to sage-devel at googlegroups.com. Visit this group at http://groups.google.com/group/sage-devel. For more options, visit https://groups.google.com/d/optout. ---------- From: *Volker Braun* <vbraun.name at gmail.com> Date: Mon, Oct 6, 2014 at 7:36 AM To: sage-devel at googlegroups.com anybody? -- William Stein Professor of Mathematics University of Washington http://wstein.org -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141006/1119ea28/attachment.html> From hughesadam87 at gmail.com Mon Oct 6 14:34:49 2014 From: hughesadam87 at gmail.com (hugadams) Date: Mon, 6 Oct 2014 11:34:49 -0700 (PDT) Subject: [IPython-dev] Interactive, Graphical, Diffable Pstats Viewer for IPython Notebook In-Reply-To: <1412324654616-5073531.post@n6.nabble.com> References: <1412324654616-5073531.post@n6.nabble.com> Message-ID: <1412620489897-5073832.post@n6.nabble.com> Awesome, thanks for posting. The more examples I can find of widget applications, the more I learn! -- View this message in context: http://python.6.x6.nabble.com/Interactive-Graphical-Diffable-Pstats-Viewer-for-IPython-Notebook-tp5073531p5073832.html Sent from the IPython - Development mailing list archive at Nabble.com. From hughesadam87 at gmail.com Mon Oct 6 14:52:30 2014 From: hughesadam87 at gmail.com (hugadams) Date: Mon, 6 Oct 2014 11:52:30 -0700 (PDT) Subject: [IPython-dev] Quick Question about Widgets Message-ID: <CAMHV+dAy=kYENwzt_nDZbaroM2Dn-Xb7vf=6K0AnJTzrQifrxA@mail.gmail.com> Hi Nicholas, Sorry to bother you off of the mailing list. We have been working on the example you composed for us in regard to spectroscopy widgets, and it's really working nicely. Thank you for this! We've encounted one hiccup that we thought you might immediately know how to resolve. I posted it on the list recently, but think it's pretty specialized and most users wouldn't have encountered it yet. Our prototype is working, and nicely separates model and view following your original design. http://nbviewer.ipython.org/github/hugadams/pyuvvis/blob/master/pyuvvis/interact/ipynbs/prototypes/widgets_slicing.ipynb So here's the issue. Imagine the user creates a widget with one dataset. We have a couple of widgets that are set based on the extents of the dataset itself. For example, imagine our data is a set of values from 0 to 1000 and we'd like to have a slider widget that runs from 0 to 1000. This works great; however, what if the user wants to switch datasets? Inside the gui, there's a dropdown menu that has DataA, DataB, DataC. If the user switches to DataC, we'd like the view to effectively reset. Imagine that DataC has values that range from 0 to 500: in this case, the float slider which originall ran from 0 to 1000 should redraw and run from 0 to 500. Unfortunately, that means the slider in the view needs to redraw when the model changes. We can't figure out how to execute such a redraw/reset. What's happening is that the slider tries to slice the new DataC values at 0 to 1000 and results in an IndexError. We're looking for a workaround for such a case. Does anything come to mind? Alternatively, if such a use case is impossible (or very difficult) to make work, we can redesign things with the idea of one gui per dataset. This will change our design patterns for all of the gui's to come, so it's really critical for us to obviate this problem as soon as possible. If you have any ideas, they would help us tremendously. And thank you for all of your help with this already. -- View this message in context: http://python.6.x6.nabble.com/Quick-Question-about-Widgets-tp5073833.html Sent from the IPython - Development mailing list archive at Nabble.com. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141006/126e3f25/attachment.html> From darcamo at gmail.com Mon Oct 6 16:07:23 2014 From: darcamo at gmail.com (Darlan Cavalcante Moreira) Date: Mon, 06 Oct 2014 17:07:23 -0300 Subject: [IPython-dev] Interactive, Graphical, Diffable Pstats Viewer for IPython Notebook In-Reply-To: <1412620489897-5073832.post@n6.nabble.com> References: <1412324654616-5073531.post@n6.nabble.com> <1412620489897-5073832.post@n6.nabble.com> Message-ID: <87lhot6jyc.fsf@gmail.com> Very nice, indeed. To view the profile files created by cProfile the `runsnakerun`[1] program (available in Ubuntu repos) is also very nice. [1] - http://www.vrplumber.com/programming/runsnakerun/ hughesadam87 at gmail.com writes: > Awesome, thanks for posting. The more examples I can find of widget > applications, the more I learn! > > > > -- > View this message in context: http://python.6.x6.nabble.com/Interactive-Graphical-Diffable-Pstats-Viewer-for-IPython-Notebook-tp5073531p5073832.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Darlan Cavalcante Moreira darcamo at gmail.com From nick.bollweg at gmail.com Mon Oct 6 16:29:32 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Mon, 6 Oct 2014 16:29:32 -0400 Subject: [IPython-dev] Quick Question about Widgets In-Reply-To: <CAMHV+dAy=kYENwzt_nDZbaroM2Dn-Xb7vf=6K0AnJTzrQifrxA@mail.gmail.com> References: <CAMHV+dAy=kYENwzt_nDZbaroM2Dn-Xb7vf=6K0AnJTzrQifrxA@mail.gmail.com> Message-ID: <CACejjWwa5ZgZDLGZM3BpTJ087AT5VZVzeqYNmb4aE5kV4etBYQ@mail.gmail.com> Sorry; haven't had much time to tinker on widget stuff much outside of directly work-related stuff. The file stuff sounds like it's getting pretty complicated! Maybe you could add another layer outside of the GUI, like a Workspace, and have all of the file-relevant stuff handled there. Then, when you change datasets, you just re-roll the whole GUI related to that specific dataset. However, based on what you have done... first, you could instrument the dataset as a traitlets.Instance: (*caveat: the below things are not tested!* ) class Spectrogram(HTML): > ... > ts = Instance(klass=WhateverTsIs) Then you can use the nice events to react to that being switched to a new instance on a per-linked-widget basis: class Spectroscopy(Box): > ... > def _sampling(self): > ... > start = FloatSlider( > description="Slicing Start Value", > value=self.graph.ts.index[0], > min=self.graph.ts.index.min(), > max=self.graph.ts.index.max() > ) > ... > > def _ts_changed(name, old, new): > start.value = self.graph.ts.index[0] > start.min = self.graph.ts.index.min() > start.max = self.graph.ts.index.max() > > self.graph.on_trait_changed(_ts_changed, "ts") > Now, you'll probably still have the problem of whether you are actually ready to redraw as all those controls re-initialize... the easiest thing would probably be to just add some more error handling to Spectrogram.draw to catch these errors, and let it fail if you are pretty confident that it will work once the inputs are all valid. Or, you could set a time window during which you don't try to redraw. Not sure what would work out best. Maybe this helps? -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141006/98015e8f/attachment.html> From pi at berkeley.edu Mon Oct 6 17:41:27 2014 From: pi at berkeley.edu (Paul Ivanov) Date: Mon, 6 Oct 2014 14:41:27 -0700 Subject: [IPython-dev] Interactive, Graphical, Diffable Pstats Viewer for IPython Notebook In-Reply-To: <87lhot6jyc.fsf@gmail.com> References: <1412324654616-5073531.post@n6.nabble.com> <1412620489897-5073832.post@n6.nabble.com> <87lhot6jyc.fsf@gmail.com> Message-ID: <CAHK2zoC4a3DnmdZMNoMaBzerGLBCyLchFpVZZfmz3Tpf4sRTtQ@mail.gmail.com> On Mon, Oct 6, 2014 at 1:07 PM, Darlan Cavalcante Moreira <darcamo at gmail.com > wrote: > > To view the profile files created by cProfile the `runsnakerun` > program (available in Ubuntu repos) is also very nice. For in-browser visualization of cProfiles, see Matt Davis' SnakeViz [1] 1. http://jiffyclub.github.io/snakeviz/ -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141006/20a72268/attachment.html> From jiffyclub at gmail.com Mon Oct 6 17:46:38 2014 From: jiffyclub at gmail.com (Matt Davis) Date: Mon, 6 Oct 2014 14:46:38 -0700 Subject: [IPython-dev] Interactive, Graphical, Diffable Pstats Viewer for IPython Notebook In-Reply-To: <CAHK2zoC4a3DnmdZMNoMaBzerGLBCyLchFpVZZfmz3Tpf4sRTtQ@mail.gmail.com> References: <1412324654616-5073531.post@n6.nabble.com> <1412620489897-5073832.post@n6.nabble.com> <87lhot6jyc.fsf@gmail.com> <CAHK2zoC4a3DnmdZMNoMaBzerGLBCyLchFpVZZfmz3Tpf4sRTtQ@mail.gmail.com> Message-ID: <CAMqnrZr4XT95rTrzqHTM6Ebd9RDBG=sAiZUVSV6gJ1UiHjVQMQ@mail.gmail.com> There's also a low-tech IPython magic extension for snakeviz that you can use in-place of %prun: https://github.com/jiffyclub/snakeviz/pull/20#issuecomment-32312354. On Mon, Oct 6, 2014 at 2:41 PM, Paul Ivanov <pi at berkeley.edu> wrote: > > > On Mon, Oct 6, 2014 at 1:07 PM, Darlan Cavalcante Moreira < > darcamo at gmail.com> wrote: >> >> To view the profile files created by cProfile the `runsnakerun` >> program (available in Ubuntu repos) is also very nice. > > > For in-browser visualization of cProfiles, see Matt Davis' SnakeViz [1] > > 1. http://jiffyclub.github.io/snakeviz/ > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141006/4a76f364/attachment.html> From hughesadam87 at gmail.com Mon Oct 6 18:09:11 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Mon, 6 Oct 2014 18:09:11 -0400 Subject: [IPython-dev] Quick Question about Widgets In-Reply-To: <CACejjWwa5ZgZDLGZM3BpTJ087AT5VZVzeqYNmb4aE5kV4etBYQ@mail.gmail.com> References: <CAMHV+dAy=kYENwzt_nDZbaroM2Dn-Xb7vf=6K0AnJTzrQifrxA@mail.gmail.com> <CACejjWwa5ZgZDLGZM3BpTJ087AT5VZVzeqYNmb4aE5kV4etBYQ@mail.gmail.com> Message-ID: <CAMHV+dBWZ7nzsQ_jQW_VnhHLkSdhEAAuVyADtnM8Lzeo7D_zWw@mail.gmail.com> That is a great idea, thanks! I think handling the errors is the best approach. We'll give it a shot. On Mon, Oct 6, 2014 at 4:29 PM, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > Sorry; haven't had much time to tinker on widget stuff much outside of > directly work-related stuff. > > The file stuff sounds like it's getting pretty complicated! Maybe you > could add another layer outside of the GUI, like a Workspace, and have all > of the file-relevant stuff handled there. Then, when you change datasets, > you just re-roll the whole GUI related to that specific dataset. > > However, based on what you have done... first, you could instrument the > dataset as a traitlets.Instance: (*caveat: the below things are not > tested!*) > > class Spectrogram(HTML): >> ... >> ts = Instance(klass=WhateverTsIs) > > > Then you can use the nice events to react to that being switched to a new > instance on a per-linked-widget basis: > > class Spectroscopy(Box): >> ... >> def _sampling(self): >> ... >> start = FloatSlider( >> description="Slicing Start Value", >> value=self.graph.ts.index[0], >> min=self.graph.ts.index.min(), >> max=self.graph.ts.index.max() >> ) >> ... >> >> def _ts_changed(name, old, new): >> start.value = self.graph.ts.index[0] >> start.min = self.graph.ts.index.min() >> start.max = self.graph.ts.index.max() >> >> self.graph.on_trait_changed(_ts_changed, "ts") >> > > Now, you'll probably still have the problem of whether you are actually > ready to redraw as all those controls re-initialize... the easiest thing > would probably be to just add some more error handling to Spectrogram.draw > to catch these errors, and let it fail if you are pretty confident that it > will work once the inputs are all valid. Or, you could set a time window > during which you don't try to redraw. Not sure what would work out best. > > Maybe this helps? > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141006/20a2e5a1/attachment.html> From wes.turner at gmail.com Mon Oct 6 18:17:11 2014 From: wes.turner at gmail.com (Wes Turner) Date: Mon, 6 Oct 2014 17:17:11 -0500 Subject: [IPython-dev] Fwd: [sage-devel] Re: Please review ipython notebook In-Reply-To: <CACLE5GB5C9C=coE7Dp9dLufWMcC=gJA-vhnQ9pAfvZH_j3XxUQ@mail.gmail.com> References: <c4f73a0d-e60c-4d7b-ac1e-f13d6a08b7c3@googlegroups.com> <826e9f22-f585-48c4-8f1d-f701bd795327@googlegroups.com> <CACLE5GB5C9C=coE7Dp9dLufWMcC=gJA-vhnQ9pAfvZH_j3XxUQ@mail.gmail.com> Message-ID: <CACfEFw9qoWETFCYyL74iAgbur2sPcs0Vf20q1hY+YLXrpf5FpA@mail.gmail.com> Is there any chance the SAGE project would consider utilizing a consistent cross-platform packaging strategy? (e.g. http://conda.pydata.org/docs/build.html) > The conda skeleton command can help to make skeleton recipes for common repositories, such as PyPI. [and CPAN] On Mon, Oct 6, 2014 at 9:39 AM, William Stein <wstein at gmail.com> wrote: > Any chance any IPython devs would have any interest in at least looking at > what Volker's doing here? See below. A little effort by somebody could > could increase the number of IPython notebook users by thousands... > > Forwarded conversation > Subject: [sage-devel] Please review ipython notebook > ------------------------ > > From: Volker Braun <vbraun.name at gmail.com> > Date: Mon, Sep 29, 2014 at 4:48 AM > To: sage-devel at googlegroups.com > > > Now would be a good time to review the IPython notebook: > > http://trac.sagemath.org/ticket/16996 > > There is clearly more to be done to make the integration perfect, and we > could also always wait for the next IPython version. But a bird in the hand > is worth two in the bush... > > -- > You received this message because you are subscribed to the Google Groups > "sage-devel" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to sage-devel+unsubscribe at googlegroups.com. > To post to this group, send email to sage-devel at googlegroups.com. > Visit this group at http://groups.google.com/group/sage-devel. > For more options, visit https://groups.google.com/d/optout. > > ---------- > From: Volker Braun <vbraun.name at gmail.com> > Date: Mon, Oct 6, 2014 at 7:36 AM > To: sage-devel at googlegroups.com > > > anybody? > > > > > -- > William Stein > Professor of Mathematics > University of Washington > http://wstein.org > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Wes Turner https://westurner.github.io/ From takowl at gmail.com Mon Oct 6 18:35:33 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 6 Oct 2014 15:35:33 -0700 Subject: [IPython-dev] PEP8 Check For IPython Notebook - A small work around In-Reply-To: <CAPb89bLsdTEUeavhjKd-BdOz1ihVVjW4B8LFKAcAgjw9B8tqTw@mail.gmail.com> References: <CAPb89bLsdTEUeavhjKd-BdOz1ihVVjW4B8LFKAcAgjw9B8tqTw@mail.gmail.com> Message-ID: <CAOvn4qiYLzJV6Yb493pjKbcrMq5KmxZxqn=i57SR5hqST3vVFQ@mail.gmail.com> Thanks Raghav! From the conversation on your issue, it looks like it might make sense for your code to live as a flake8 extension. Thomas On 6 October 2014 01:18, Raghav Rv <rvraghav93 at gmail.com> wrote: > Hi all, > > I recently modified the pep8 project a little to allow pep8 checks to be > run on ipython notebook, inspired by this stack overflow post > <http://stackoverflow.com/questions/26205629>. > > [ Though we do have an extension that can check for pep8 on a per-cell > basis, this modification can help us run pep8 for a whole ".ipynb" file. ] > > Using the --format="ipynb" flag we can get the line number offset ( > calculated for each individual cell ) and the cell number in the error > report, to easily locate errors. > > This is the pull request : https://github.com/jcrocholl/pep8/pull/337 > > ( Looks like this won't be merged as the devs of pep8 feel this is out of > scope for the project. ) > > I am just posting it here ( as advised by Matt ), just incase someone > finds it useful ... > > Sample Notebook > <http://nbviewer.ipython.org/github/rvraghav93/Data-Structures-By-Horowitz-in-Python/blob/master/Chapter%208/Chapter%208%20-%20Hashing.ipynb> > . > > Result of running : `python pep8.py --format="ipynb" notebook.ipynb` on > the above notebook. ( Output seems to be consistent with that of the pep8 > check on the converted ".py" file ) > > Output <https://gist.github.com/rvraghav93/61f98948a4e0464d2cd3> > > Thanks > Raghav Rv ( rvraghav93 ) > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141006/aeba5be0/attachment.html> From odewahn at oreilly.com Tue Oct 7 11:25:12 2014 From: odewahn at oreilly.com (Andrew Odewahn) Date: Tue, 7 Oct 2014 11:25:12 -0400 Subject: [IPython-dev] Set default value of Kernel dropdown in 3.0.0-dev Message-ID: <CAO5K8Esm-nUh5aRsx_5eXnUq=jhkjoehtX8UGxo3idTjyj5MWw@mail.gmail.com> Hi. I'm trying to set the default kernel that is used in Notebooks 3.0.0-dev. (i.e., set the value of the kernel_selector_widget dropdown box at the top right corner). Rather than opening in Python 3, I'd like to set it to Python 2. Is there a command line option I can pass for this? Something like: ipython notebook --ip=0.0.0.0 --no-browser --SomeConfig.SomeOption=kernel-python2 Any help appreciated! Andrew -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141007/a9231ef0/attachment.html> From tshawver at quantopian.com Tue Oct 7 12:06:01 2014 From: tshawver at quantopian.com (tshawver) Date: Tue, 7 Oct 2014 09:06:01 -0700 (PDT) Subject: [IPython-dev] Interactive Grid for Sorting and Filtering DataFrames in IPython Notebook Message-ID: <1412697961680-5073936.post@n6.nabble.com> As part of the work on our research environment at Quantopian <https://www.quantopian.com/research > , I've been building an extension which renders pandas DataFrames as interactive grids in the IPython notebook. The extension uses a Javascript library called SlickGrid to render the grids, and the current state of the project can be found here on GitHub: https://github.com/quantopian/qgrid The extension is also viewable in nbviewer: http://nbviewer.ipython.org/github/quantopian/qgrid/blob/master/qgrid_demo.ipynb The GitHub repository contains some explanation of why I chose to implement the grid as a Python package rather than a standard IPython notebook extension, which might be interesting for other people who are looking to add functionality to the notebook in a similar way. -Tim -- View this message in context: http://python.6.x6.nabble.com/Interactive-Grid-for-Sorting-and-Filtering-DataFrames-in-IPython-Notebook-tp5073936.html Sent from the IPython - Development mailing list archive at Nabble.com. From damianavila at gmail.com Tue Oct 7 12:19:07 2014 From: damianavila at gmail.com (=?UTF-8?Q?Dami=C3=A1n_Avila?=) Date: Tue, 7 Oct 2014 13:19:07 -0300 Subject: [IPython-dev] Set default value of Kernel dropdown in 3.0.0-dev In-Reply-To: <CAO5K8Esm-nUh5aRsx_5eXnUq=jhkjoehtX8UGxo3idTjyj5MWw@mail.gmail.com> References: <CAO5K8Esm-nUh5aRsx_5eXnUq=jhkjoehtX8UGxo3idTjyj5MWw@mail.gmail.com> Message-ID: <CAH+mRR0W67ywSmimoTCn1dPe4HzuA64ZiDq-ePMpL-edaqccUg@mail.gmail.com> Something like this has to work: ipython notebook --MappingKernelManager.default_kernel_name='python3' which your kernel, of course... 'python2' instead of 'python3'. 2014-10-07 12:25 GMT-03:00 Andrew Odewahn <odewahn at oreilly.com>: > > Hi. I'm trying to set the default kernel that is used in Notebooks > 3.0.0-dev. (i.e., set the value of the kernel_selector_widget dropdown > box at the top right corner). > > Rather than opening in Python 3, I'd like to set it to Python 2. Is there > a command line option I can pass for this? > > Something like: > > ipython notebook --ip=0.0.0.0 --no-browser > --SomeConfig.SomeOption=kernel-python2 > > Any help appreciated! > > Andrew > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- *Dami?n* -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141007/3b45261e/attachment.html> From ocefpaf at gmail.com Tue Oct 7 12:21:09 2014 From: ocefpaf at gmail.com (Filipe) Date: Tue, 07 Oct 2014 13:21:09 -0300 Subject: [IPython-dev] Set default value of Kernel dropdown in 3.0.0-dev In-Reply-To: <CAO5K8Esm-nUh5aRsx_5eXnUq=jhkjoehtX8UGxo3idTjyj5MWw@mail.gmail.com> References: <CAO5K8Esm-nUh5aRsx_5eXnUq=jhkjoehtX8UGxo3idTjyj5MWw@mail.gmail.com> Message-ID: <543412F5.8090901@gmail.com> Hi Andrew, Here is how I did it: https://ocefpaf.github.io/python4oceanographers/blog/2014/09/01/ipython_kernel/ This is probably not the best way to do it, but it works. -Filipe On 10/07/2014 12:25 PM, Andrew Odewahn wrote: > Hi. I'm trying to set the default kernel that is used in Notebooks > 3.0.0-dev. (i.e., set the value of the kernel_selector_widget dropdown box > at the top right corner). > > Rather than opening in Python 3, I'd like to set it to Python 2. Is there a > command line option I can pass for this? > > Something like: > > ipython notebook --ip=0.0.0.0 --no-browser > --SomeConfig.SomeOption=kernel-python2 > > Any help appreciated! > > Andrew From doug.blank at gmail.com Tue Oct 7 13:03:02 2014 From: doug.blank at gmail.com (Doug Blank) Date: Tue, 7 Oct 2014 13:03:02 -0400 Subject: [IPython-dev] Interactive Grid for Sorting and Filtering DataFrames in IPython Notebook In-Reply-To: <1412697961680-5073936.post@n6.nabble.com> References: <1412697961680-5073936.post@n6.nabble.com> Message-ID: <CAAusYCg5=_XkOFTSQ-umWTbmw91DuNzmpmNBwnnuxGqLDVOBLQ@mail.gmail.com> On Tue, Oct 7, 2014 at 12:06 PM, tshawver <tshawver at quantopian.com> wrote: > As part of the work on our research environment at Quantopian > <https://www.quantopian.com/research > , I've been building an extension > which renders pandas DataFrames as interactive grids in the IPython > notebook. The extension uses a Javascript library called SlickGrid to > render the grids, and the current state of the project can be found here on > GitHub: https://github.com/quantopian/qgrid > > The extension is also viewable in nbviewer: > > http://nbviewer.ipython.org/github/quantopian/qgrid/blob/master/qgrid_demo.ipynb > > The GitHub repository contains some explanation of why I chose to implement > the grid as a Python package rather than a standard IPython notebook > extension, which might be interesting for other people who are looking to > add functionality to the notebook in a similar way. > > Excellent! Thanks for developing and sharing... this will be very useful, and is the way that data should be viewed. -Doug > -Tim > > > > -- > View this message in context: > http://python.6.x6.nabble.com/Interactive-Grid-for-Sorting-and-Filtering-DataFrames-in-IPython-Notebook-tp5073936.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141007/b409b7a1/attachment.html> From wes.turner at gmail.com Tue Oct 7 14:12:19 2014 From: wes.turner at gmail.com (Wes Turner) Date: Tue, 7 Oct 2014 13:12:19 -0500 Subject: [IPython-dev] Interactive Grid for Sorting and Filtering DataFrames in IPython Notebook In-Reply-To: <1412697961680-5073936.post@n6.nabble.com> References: <1412697961680-5073936.post@n6.nabble.com> Message-ID: <CACfEFw9H1z+bdgODZDahouV7nZGUJ_31oL5bNS+pb9hC42X5aA@mail.gmail.com> Thanks! On Oct 7, 2014 11:06 AM, "tshawver" <tshawver at quantopian.com> wrote: > As part of the work on our research environment at Quantopian > <https://www.quantopian.com/research > , I've been building an extension > which renders pandas DataFrames as interactive grids in the IPython > notebook. The extension uses a Javascript library called SlickGrid to > render the grids, and the current state of the project can be found here on > GitHub: https://github.com/quantopian/qgrid > > The extension is also viewable in nbviewer: > > http://nbviewer.ipython.org/github/quantopian/qgrid/blob/master/qgrid_demo.ipynb > > The GitHub repository contains some explanation of why I chose to implement > the grid as a Python package rather than a standard IPython notebook > extension, which might be interesting for other people who are looking to > add functionality to the notebook in a similar way. > > -Tim > > > > -- > View this message in context: > http://python.6.x6.nabble.com/Interactive-Grid-for-Sorting-and-Filtering-DataFrames-in-IPython-Notebook-tp5073936.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141007/d1de322d/attachment.html> From ssanderson at quantopian.com Tue Oct 7 15:08:27 2014 From: ssanderson at quantopian.com (ssanderson) Date: Tue, 7 Oct 2014 12:08:27 -0700 (PDT) Subject: [IPython-dev] Interactive, Graphical, Diffable Pstats Viewer for IPython Notebook In-Reply-To: <1412324654616-5073531.post@n6.nabble.com> References: <1412324654616-5073531.post@n6.nabble.com> Message-ID: <1412708907832-5073968.post@n6.nabble.com> Thanks for the heads up about snakeviz. Looks like an awesome project. With the files that I was testing here, snakeviz barfed because it took too long to build its visualization, but that may just be because the computer I'm using for testing is made of potato... -- View this message in context: http://python.6.x6.nabble.com/Interactive-Graphical-Diffable-Pstats-Viewer-for-IPython-Notebook-tp5073531p5073968.html Sent from the IPython - Development mailing list archive at Nabble.com. From jiffyclub at gmail.com Tue Oct 7 15:18:12 2014 From: jiffyclub at gmail.com (Matt Davis) Date: Tue, 7 Oct 2014 12:18:12 -0700 Subject: [IPython-dev] Interactive, Graphical, Diffable Pstats Viewer for IPython Notebook In-Reply-To: <1412708907832-5073968.post@n6.nabble.com> References: <1412324654616-5073531.post@n6.nabble.com> <1412708907832-5073968.post@n6.nabble.com> Message-ID: <CAMqnrZpBJoZas6MjFMvwMaX_tPg-WXDHAkwXmK6djfbmqxVw+A@mail.gmail.com> No, SnakeViz doesn't work well with large profiles (profiles with a lot of different function calls). I still find the sortable table useful, but I sometimes try to narrow down the code I'm profiling to get it to visualize. One of these days I'm gonna rewrite SnakeViz... On Tue, Oct 7, 2014 at 12:08 PM, ssanderson <ssanderson at quantopian.com> wrote: > Thanks for the heads up about snakeviz. Looks like an awesome project. > With > the files that I was testing here, snakeviz barfed because it took too long > to build its visualization, but that may just be because the computer I'm > using for testing is made of potato... > > > > -- > View this message in context: > http://python.6.x6.nabble.com/Interactive-Graphical-Diffable-Pstats-Viewer-for-IPython-Notebook-tp5073531p5073968.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141007/2e11f13f/attachment.html> From rgbkrk at gmail.com Tue Oct 7 15:39:26 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Tue, 7 Oct 2014 14:39:26 -0500 Subject: [IPython-dev] Set default value of Kernel dropdown in 3.0.0-dev In-Reply-To: <CAO5K8Esm-nUh5aRsx_5eXnUq=jhkjoehtX8UGxo3idTjyj5MWw@mail.gmail.com> References: <CAO5K8Esm-nUh5aRsx_5eXnUq=jhkjoehtX8UGxo3idTjyj5MWw@mail.gmail.com> Message-ID: <CA+tbMaUuwHyy2+cnjQXfTjYHFUDZL=M-E7okFOz1L-ziiATjcg@mail.gmail.com> If you're running from the base ipython/ipython or ipython/scipystack Docker images, it defaults to the last installed version of ipython (culprit is https://github.com/ipython/ipython/blob/master/Dockerfile#L43). There should be a way to set the kernel type as the default though. On Tue, Oct 7, 2014 at 10:25 AM, Andrew Odewahn <odewahn at oreilly.com> wrote: > > Hi. I'm trying to set the default kernel that is used in Notebooks > 3.0.0-dev. (i.e., set the value of the kernel_selector_widget dropdown > box at the top right corner). > > Rather than opening in Python 3, I'd like to set it to Python 2. Is there > a command line option I can pass for this? > > Something like: > > ipython notebook --ip=0.0.0.0 --no-browser > --SomeConfig.SomeOption=kernel-python2 > > Any help appreciated! > > Andrew > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141007/c75a9041/attachment.html> From schueller at phimeca.com Wed Oct 8 03:36:39 2014 From: schueller at phimeca.com (Julien Schueller) Date: Wed, 8 Oct 2014 09:36:39 +0200 (CEST) Subject: [IPython-dev] lookfor magic extension module In-Reply-To: <1325997183.19349339.1412753719729.JavaMail.zimbra@phimeca.com> Message-ID: <1715875050.19350411.1412753799602.JavaMail.zimbra@phimeca.com> Hi list, I just uploaded to pypi the lookfor extension module to search through docstrings: https://github.com/jschueller/lookfor -- J From fperez.net at gmail.com Wed Oct 8 04:14:32 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Wed, 8 Oct 2014 01:14:32 -0700 Subject: [IPython-dev] Interactive Grid for Sorting and Filtering DataFrames in IPython Notebook In-Reply-To: <1412697961680-5073936.post@n6.nabble.com> References: <1412697961680-5073936.post@n6.nabble.com> Message-ID: <CAHAreOqWULwu+oWU8wO90C3jeWJ-igHYWVqDqFvWEhpZmbVRug@mail.gmail.com> On Tue, Oct 7, 2014 at 9:06 AM, tshawver <tshawver at quantopian.com> wrote: > As part of the work on our research environment at Quantopian > <https://www.quantopian.com/research > , I've been building an extension > which renders pandas DataFrames as interactive grids in the IPython > notebook. The extension uses a Javascript library called SlickGrid to > render the grids, and the current state of the project can be found here on > GitHub: https://github.com/quantopian/qgrid > Awesome! Just a few days ago I was musing on actually spending a bit of time doing this, but I figured someone with far better JS chops than my non-existent ones would likely do a much better job. Thanks a lot!! f -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/7498d8b1/attachment.html> From wes.turner at gmail.com Wed Oct 8 06:41:30 2014 From: wes.turner at gmail.com (Wes Turner) Date: Wed, 8 Oct 2014 05:41:30 -0500 Subject: [IPython-dev] Interactive Grid for Sorting and Filtering DataFrames in IPython Notebook In-Reply-To: <1412697961680-5073936.post@n6.nabble.com> References: <1412697961680-5073936.post@n6.nabble.com> Message-ID: <CACfEFw-pfHCn+mY9z5bL0BW67GAo9+h-5RhwqFpE-V+WHVDhZg@mail.gmail.com> This would be an excellent addition to the "Pandas Ecosystem" docs page: * http://pandas.pydata.org/pandas-docs/stable/ecosystem.html * https://github.com/pydata/pandas/blob/master/doc/source/ecosystem.rst Thanks again! On Tue, Oct 7, 2014 at 11:06 AM, tshawver <tshawver at quantopian.com> wrote: > As part of the work on our research environment at Quantopian > <https://www.quantopian.com/research > , I've been building an extension > which renders pandas DataFrames as interactive grids in the IPython > notebook. The extension uses a Javascript library called SlickGrid to > render the grids, and the current state of the project can be found here on > GitHub: https://github.com/quantopian/qgrid > > The extension is also viewable in nbviewer: > http://nbviewer.ipython.org/github/quantopian/qgrid/blob/master/qgrid_demo.ipynb > > The GitHub repository contains some explanation of why I chose to implement > the grid as a Python package rather than a standard IPython notebook > extension, which might be interesting for other people who are looking to > add functionality to the notebook in a similar way. > > -Tim > > > > -- > View this message in context: http://python.6.x6.nabble.com/Interactive-Grid-for-Sorting-and-Filtering-DataFrames-in-IPython-Notebook-tp5073936.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Wes Turner https://westurner.github.io/ From bussonniermatthias at gmail.com Wed Oct 8 06:55:04 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Wed, 8 Oct 2014 12:55:04 +0200 Subject: [IPython-dev] lookfor magic extension module In-Reply-To: <1715875050.19350411.1412753799602.JavaMail.zimbra@phimeca.com> References: <1715875050.19350411.1412753799602.JavaMail.zimbra@phimeca.com> Message-ID: <3BF99ADB-19F9-4AE6-9D67-59FCFCA770BB@gmail.com> Le 8 oct. 2014 ? 09:36, Julien Schueller a ?crit : > Hi list, > > I just uploaded to pypi the lookfor extension module to search through docstrings: > https://github.com/jschueller/lookfor Great ! Thanks ! Cf this Pull request for context : https://github.com/ipython/ipython/pull/6641 And it's already available on PyPi ! Awesome ! -- M > > > -- > J > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From wes.turner at gmail.com Wed Oct 8 07:00:12 2014 From: wes.turner at gmail.com (Wes Turner) Date: Wed, 8 Oct 2014 06:00:12 -0500 Subject: [IPython-dev] Interactive Grid for Sorting and Filtering DataFrames in IPython Notebook In-Reply-To: <CACfEFw-pfHCn+mY9z5bL0BW67GAo9+h-5RhwqFpE-V+WHVDhZg@mail.gmail.com> References: <1412697961680-5073936.post@n6.nabble.com> <CACfEFw-pfHCn+mY9z5bL0BW67GAo9+h-5RhwqFpE-V+WHVDhZg@mail.gmail.com> Message-ID: <CACfEFw8eHfa5L2Wb6P0wXRr6uOv19XSVea=csDX7CxG3woes4Q@mail.gmail.com> This PR adds a 'Graphical User Interfaces' heading: https://github.com/pydata/pandas/pull/8507 On Wed, Oct 8, 2014 at 5:41 AM, Wes Turner <wes.turner at gmail.com> wrote: > This would be an excellent addition to the "Pandas Ecosystem" docs page: > > * http://pandas.pydata.org/pandas-docs/stable/ecosystem.html > * https://github.com/pydata/pandas/blob/master/doc/source/ecosystem.rst > > Thanks again! > > On Tue, Oct 7, 2014 at 11:06 AM, tshawver <tshawver at quantopian.com> wrote: >> As part of the work on our research environment at Quantopian >> <https://www.quantopian.com/research > , I've been building an extension >> which renders pandas DataFrames as interactive grids in the IPython >> notebook. The extension uses a Javascript library called SlickGrid to >> render the grids, and the current state of the project can be found here on >> GitHub: https://github.com/quantopian/qgrid >> >> The extension is also viewable in nbviewer: >> http://nbviewer.ipython.org/github/quantopian/qgrid/blob/master/qgrid_demo.ipynb >> >> The GitHub repository contains some explanation of why I chose to implement >> the grid as a Python package rather than a standard IPython notebook >> extension, which might be interesting for other people who are looking to >> add functionality to the notebook in a similar way. >> >> -Tim >> >> >> >> -- >> View this message in context: http://python.6.x6.nabble.com/Interactive-Grid-for-Sorting-and-Filtering-DataFrames-in-IPython-Notebook-tp5073936.html >> Sent from the IPython - Development mailing list archive at Nabble.com. >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > -- > Wes Turner > https://westurner.github.io/ -- Wes Turner https://westurner.github.io/ From ivan.ogassawara at gmail.com Wed Oct 8 07:29:35 2014 From: ivan.ogassawara at gmail.com (Ivan Ogassawara) Date: Wed, 8 Oct 2014 08:29:35 -0300 Subject: [IPython-dev] Interactive Grid for Sorting and Filtering DataFrames in IPython Notebook In-Reply-To: <CACfEFw8eHfa5L2Wb6P0wXRr6uOv19XSVea=csDX7CxG3woes4Q@mail.gmail.com> References: <1412697961680-5073936.post@n6.nabble.com> <CACfEFw-pfHCn+mY9z5bL0BW67GAo9+h-5RhwqFpE-V+WHVDhZg@mail.gmail.com> <CACfEFw8eHfa5L2Wb6P0wXRr6uOv19XSVea=csDX7CxG3woes4Q@mail.gmail.com> Message-ID: <CABgfW_cGLFk06md0X92vzfbM4a+5n_SBWXaQx+ZGJs_xEJweGA@mail.gmail.com> Excellent job!! 2014-10-08 8:00 GMT-03:00 Wes Turner <wes.turner at gmail.com>: > This PR adds a 'Graphical User Interfaces' heading: > https://github.com/pydata/pandas/pull/8507 > > On Wed, Oct 8, 2014 at 5:41 AM, Wes Turner <wes.turner at gmail.com> wrote: > > This would be an excellent addition to the "Pandas Ecosystem" docs page: > > > > * http://pandas.pydata.org/pandas-docs/stable/ecosystem.html > > * https://github.com/pydata/pandas/blob/master/doc/source/ecosystem.rst > > > > Thanks again! > > > > On Tue, Oct 7, 2014 at 11:06 AM, tshawver <tshawver at quantopian.com> > wrote: > >> As part of the work on our research environment at Quantopian > >> <https://www.quantopian.com/research > , I've been building an > extension > >> which renders pandas DataFrames as interactive grids in the IPython > >> notebook. The extension uses a Javascript library called SlickGrid to > >> render the grids, and the current state of the project can be found > here on > >> GitHub: https://github.com/quantopian/qgrid > >> > >> The extension is also viewable in nbviewer: > >> > http://nbviewer.ipython.org/github/quantopian/qgrid/blob/master/qgrid_demo.ipynb > >> > >> The GitHub repository contains some explanation of why I chose to > implement > >> the grid as a Python package rather than a standard IPython notebook > >> extension, which might be interesting for other people who are looking > to > >> add functionality to the notebook in a similar way. > >> > >> -Tim > >> > >> > >> > >> -- > >> View this message in context: > http://python.6.x6.nabble.com/Interactive-Grid-for-Sorting-and-Filtering-DataFrames-in-IPython-Notebook-tp5073936.html > >> Sent from the IPython - Development mailing list archive at Nabble.com. > >> _______________________________________________ > >> IPython-dev mailing list > >> IPython-dev at scipy.org > >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > -- > > Wes Turner > > https://westurner.github.io/ > > > > -- > Wes Turner > https://westurner.github.io/ > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/a8de8a2a/attachment.html> From tra at popgen.net Wed Oct 8 08:19:03 2014 From: tra at popgen.net (Tiago Antao) Date: Wed, 8 Oct 2014 13:19:03 +0100 Subject: [IPython-dev] Temporarily suspending matplotlib inline backend Message-ID: <20141008131903.481d1b88@grandao> Hi, I have developing some notebooks to teach population genetics, and in order to spice-up some content for students I would like to generate a few animations in run-time (from PCA changes over time - this is faster than it seems). For that I need to generate a few matplotlib figures 'off-line' and then generate an animation with some extra images (i.e., I do not want the figures showing on the notebook: I will collect them as PNGs and generate an MP4 - I do not want want to use matplotlib.animation, BTW). I was wondering if there is a safe way to switch backends on server code (e.g. to Agg and them back to whatever is the default)? I have a look at the ipython source, and I am a bit afraid of potential side effects of a backend change. Thanks, Tiago From glenn.caltech at gmail.com Wed Oct 8 09:15:42 2014 From: glenn.caltech at gmail.com (G Jones) Date: Wed, 8 Oct 2014 09:15:42 -0400 Subject: [IPython-dev] Temporarily suspending matplotlib inline backend In-Reply-To: <20141008131903.481d1b88@grandao> References: <20141008131903.481d1b88@grandao> Message-ID: <CAGK_ABfi040OsNd_VDzTwxi5TKLdcznT4f5osUz7OQnivQTemg@mail.gmail.com> No need to switch backends, just use this idiom: from matplotlib.figure import Figure from matplotlib.backends.backend_agg import FigureCanvasAgg fig = Figure() ... # use the figure as you like canvas = FigureCanvasAgg(fig) fig.set_canvas(canvas) #not sure this line is strictly necessary fig.savefig('filename') On Wed, Oct 8, 2014 at 8:19 AM, Tiago Antao <tra at popgen.net> wrote: > Hi, > > I have developing some notebooks to teach population genetics, and in > order to spice-up some content for students I would like to generate a > few animations in run-time (from PCA changes over time - this is faster > than it seems). For that I need to generate a few matplotlib figures > 'off-line' and then generate an animation with some extra images (i.e., > I do not want the figures showing on the notebook: I will collect them > as PNGs and generate an MP4 - I do not want want to use > matplotlib.animation, BTW). > > I was wondering if there is a safe way to switch backends on server > code (e.g. to Agg and them back to whatever is the default)? I have a > look at the ipython source, and I am a bit afraid of potential side > effects of a backend change. > > Thanks, > Tiago > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/1831bd78/attachment.html> From tshawver at quantopian.com Wed Oct 8 10:12:01 2014 From: tshawver at quantopian.com (tshawver) Date: Wed, 8 Oct 2014 07:12:01 -0700 (PDT) Subject: [IPython-dev] Interactive Grid for Sorting and Filtering DataFrames in IPython Notebook In-Reply-To: <CACfEFw8eHfa5L2Wb6P0wXRr6uOv19XSVea=csDX7CxG3woes4Q@mail.gmail.com> References: <1412697961680-5073936.post@n6.nabble.com> <CACfEFw-pfHCn+mY9z5bL0BW67GAo9+h-5RhwqFpE-V+WHVDhZg@mail.gmail.com> <CACfEFw8eHfa5L2Wb6P0wXRr6uOv19XSVea=csDX7CxG3woes4Q@mail.gmail.com> Message-ID: <1412777521056-5074058.post@n6.nabble.com> Awesome, thanks for doing that Wes! -- View this message in context: http://python.6.x6.nabble.com/Interactive-Grid-for-Sorting-and-Filtering-DataFrames-in-IPython-Notebook-tp5073936p5074058.html Sent from the IPython - Development mailing list archive at Nabble.com. From takowl at gmail.com Wed Oct 8 15:10:44 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 8 Oct 2014 12:10:44 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input Message-ID: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> Introducing another of my side projects: Nbparameterise https://github.com/takluyver/nbparameterise The idea is that you prepare a notebook with some 'input' variable definitions in the first cell. These are standard assignments, like `a=200`, of (for now), strings, numbers and booleans. When you run nbparameterise, it will display a simple form where the user can supply new values for these variables. When the user clicks 'run notebook', their values are substituted in, the notebook is run and rendered to HTML. To see a demo of this, clone the repository, run: python3 -m nbparameterise Stock\ display.ipynb and visit http://localhost:8888/ in your browser. Notes: - It builds an HTML form, but I've tried to abstract that from the core, so you could write a local GUI or a terminal interface for it quite easily. - It's written in Python 3, but it will run notebooks in Python 2 if that's what the metadata indicates. - We can integrate backends for other languages - It's fairly rough - come and polish it. We've heard from a couple of companies doing similar things privately; I hope this can form a common base. Thomas P.S. Suggestions for a better name welcome. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/c5e5e0d9/attachment.html> From ellisonbg at gmail.com Wed Oct 8 15:15:20 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Wed, 8 Oct 2014 12:15:20 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> Message-ID: <CAH4pYpST4g_GN4xrqCSB331YBROyMDuLEW0zASNJcB8VVyTeAA@mail.gmail.com> Thanks Thomas! On Wed, Oct 8, 2014 at 12:10 PM, Thomas Kluyver <takowl at gmail.com> wrote: > Introducing another of my side projects: Nbparameterise > > https://github.com/takluyver/nbparameterise > > The idea is that you prepare a notebook with some 'input' variable > definitions in the first cell. These are standard assignments, like `a=200`, > of (for now), strings, numbers and booleans. When you run nbparameterise, it > will display a simple form where the user can supply new values for these > variables. When the user clicks 'run notebook', their values are substituted > in, the notebook is run and rendered to HTML. > > To see a demo of this, clone the repository, run: > > python3 -m nbparameterise Stock\ display.ipynb > > and visit http://localhost:8888/ in your browser. > > Notes: > - It builds an HTML form, but I've tried to abstract that from the core, so > you could write a local GUI or a terminal interface for it quite easily. > - It's written in Python 3, but it will run notebooks in Python 2 if that's > what the metadata indicates. > - We can integrate backends for other languages > - It's fairly rough - come and polish it. > > We've heard from a couple of companies doing similar things privately; I > hope this can form a common base. > > Thomas > > P.S. Suggestions for a better name welcome. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From hughesadam87 at gmail.com Wed Oct 8 15:17:49 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Wed, 8 Oct 2014 15:17:49 -0400 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> Message-ID: <CAMHV+dAuj00iZZyhFbGfBWriXc9MjvP+=30T9aPVP26TqzWu+A@mail.gmail.com> Awesome, we have a great example that fits this architecture. If you want to use it, we can add it to repo On Oct 8, 2014 3:11 PM, "Thomas Kluyver" <takowl at gmail.com> wrote: > Introducing another of my side projects: Nbparameterise > > https://github.com/takluyver/nbparameterise > > The idea is that you prepare a notebook with some 'input' variable > definitions in the first cell. These are standard assignments, like > `a=200`, of (for now), strings, numbers and booleans. When you run > nbparameterise, it will display a simple form where the user can supply new > values for these variables. When the user clicks 'run notebook', their > values are substituted in, the notebook is run and rendered to HTML. > > To see a demo of this, clone the repository, run: > > python3 -m nbparameterise Stock\ display.ipynb > > and visit http://localhost:8888/ in your browser. > > Notes: > - It builds an HTML form, but I've tried to abstract that from the core, > so you could write a local GUI or a terminal interface for it quite easily. > - It's written in Python 3, but it will run notebooks in Python 2 if > that's what the metadata indicates. > - We can integrate backends for other languages > - It's fairly rough - come and polish it. > > We've heard from a couple of companies doing similar things privately; I > hope this can form a common base. > > Thomas > > P.S. Suggestions for a better name welcome. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/8e9ebc13/attachment.html> From takowl at gmail.com Wed Oct 8 15:21:11 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 8 Oct 2014 12:21:11 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAMHV+dAuj00iZZyhFbGfBWriXc9MjvP+=30T9aPVP26TqzWu+A@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> <CAMHV+dAuj00iZZyhFbGfBWriXc9MjvP+=30T9aPVP26TqzWu+A@mail.gmail.com> Message-ID: <CAOvn4qidPQKj5mWQjwjMUdt2n9nDzEUwv7NDCD7SpL6Y2pSijw@mail.gmail.com> On 8 October 2014 12:17, Adam Hughes <hughesadam87 at gmail.com> wrote: > Awesome, we have a great example that fits this architecture. If you want > to use it, we can add it to repo > Sure - do you want to make a PR? Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/373593d7/attachment.html> From hughesadam87 at gmail.com Wed Oct 8 15:23:57 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Wed, 8 Oct 2014 15:23:57 -0400 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qidPQKj5mWQjwjMUdt2n9nDzEUwv7NDCD7SpL6Y2pSijw@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> <CAMHV+dAuj00iZZyhFbGfBWriXc9MjvP+=30T9aPVP26TqzWu+A@mail.gmail.com> <CAOvn4qidPQKj5mWQjwjMUdt2n9nDzEUwv7NDCD7SpL6Y2pSijw@mail.gmail.com> Message-ID: <CAMHV+dDupdsT5sxeiqRKJbJ-9rKo3NTT3i09LHLSg+Vznwr1KQ@mail.gmail.com> Sure, gimme a few days, out of town On Oct 8, 2014 3:21 PM, "Thomas Kluyver" <takowl at gmail.com> wrote: > On 8 October 2014 12:17, Adam Hughes <hughesadam87 at gmail.com> wrote: > >> Awesome, we have a great example that fits this architecture. If you >> want to use it, we can add it to repo >> > > Sure - do you want to make a PR? > > Thanks, > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/6bba15c5/attachment.html> From bussonniermatthias at gmail.com Wed Oct 8 16:21:31 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Wed, 8 Oct 2014 22:21:31 +0200 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> Message-ID: <3D77BBE7-4FE1-4480-AB8D-55082D7719C9@gmail.com> Great ! I think runipy already have such a feature, but I might have misunderstood : > Passing Arguments > > You can pass arguments to the notebook through environment variables. The use of environment variables is OS- and shell- dependent, but in a typical UNIX-like environment they can be passed on the command line before the program name: > > $ myvar=value runipy MyNotebook.ipynb > > Then in the notebook, to access myvar: > > from os import environ > myvar = environ['myvar'] > > environ is just a dict, so you can use .get() to fall back on a default value: > > from os import environ > myvar = environ.get('myvar', 'default!') from https://github.com/paulgb/runipy Maybe you can share part of the code. -- M Le 8 oct. 2014 ? 21:10, Thomas Kluyver a ?crit : > Introducing another of my side projects: Nbparameterise > > https://github.com/takluyver/nbparameterise > > The idea is that you prepare a notebook with some 'input' variable definitions in the first cell. These are standard assignments, like `a=200`, of (for now), strings, numbers and booleans. When you run nbparameterise, it will display a simple form where the user can supply new values for these variables. When the user clicks 'run notebook', their values are substituted in, the notebook is run and rendered to HTML. > > To see a demo of this, clone the repository, run: > > python3 -m nbparameterise Stock\ display.ipynb > > and visit http://localhost:8888/ in your browser. > > Notes: > - It builds an HTML form, but I've tried to abstract that from the core, so you could write a local GUI or a terminal interface for it quite easily. > - It's written in Python 3, but it will run notebooks in Python 2 if that's what the metadata indicates. > - We can integrate backends for other languages > - It's fairly rough - come and polish it. > > We've heard from a couple of companies doing similar things privately; I hope this can form a common base. > > Thomas > > P.S. Suggestions for a better name welcome. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/472c552b/attachment.html> From takowl at gmail.com Wed Oct 8 16:41:46 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 8 Oct 2014 13:41:46 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <3D77BBE7-4FE1-4480-AB8D-55082D7719C9@gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> <3D77BBE7-4FE1-4480-AB8D-55082D7719C9@gmail.com> Message-ID: <CAOvn4qipKLgJJenk5duv2OARjS9ZGqV4=yAAhd8dWfehvnqjiQ@mail.gmail.com> On 8 October 2014 13:21, Matthias BUSSONNIER <bussonniermatthias at gmail.com> wrote: > I think runipy already have such a feature, but I might have misunderstood > : > Kind of, but an important part of this is finding what variables can be filled in, and providing a form for them. And the rendered notebooks contain the variable definitions, so you can easily see what the input was. > Maybe you can share part of the code. If I'm understanding it correctly, there shouldn't be any code in runipy to achieve that: all you're doing is setting environment variables before you run a notebook, and then reading them in your code. That will work so long as runipy doesn't clear those environment variables. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/1368a2b8/attachment.html> From tritemio at gmail.com Wed Oct 8 17:08:27 2014 From: tritemio at gmail.com (Antonino Ingargiola) Date: Wed, 8 Oct 2014 14:08:27 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qipKLgJJenk5duv2OARjS9ZGqV4=yAAhd8dWfehvnqjiQ@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> <3D77BBE7-4FE1-4480-AB8D-55082D7719C9@gmail.com> <CAOvn4qipKLgJJenk5duv2OARjS9ZGqV4=yAAhd8dWfehvnqjiQ@mail.gmail.com> Message-ID: <CANn2QUzAe=DqngWSGA81bZ1CieVCd=2vUVb5VYUQA1bL+k6qow@mail.gmail.com> This is an interesting project, thanks Thomas! I'm using runipy to run a notebook (template notebook) on several data files in batch. I have (what I call) a "master-notebook" that calls the "template notebook" several times setting an environment variable to a different value each time. Each executed notebook is saved to a different file, leaving a trail of the computation.This done for the software of a publication, but I think is quite a common pattern (in terms of needs). What I have done is completely custom (but straightforward). Would be nice if nbparameterise could standardize a way to specify a "list" of values for a variable so the notebook can be executed in batch mode, saving the output for each execution. Saving in notebook format is somewhat diff-safe. What about HTML? I suspect it may be a little more tricky to diff... Thanks, Antonio On Wed, Oct 8, 2014 at 1:41 PM, Thomas Kluyver <takowl at gmail.com> wrote: > On 8 October 2014 13:21, Matthias BUSSONNIER <bussonniermatthias at gmail.com > > wrote: > >> I think runipy already have such a feature, but I might have >> misunderstood : >> > > Kind of, but an important part of this is finding what variables can be > filled in, and providing a form for them. And the rendered notebooks > contain the variable definitions, so you can easily see what the input was. > > > Maybe you can share part of the code. > > If I'm understanding it correctly, there shouldn't be any code in runipy > to achieve that: all you're doing is setting environment variables before > you run a notebook, and then reading them in your code. That will work so > long as runipy doesn't clear those environment variables. > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/a9336ded/attachment.html> From takowl at gmail.com Wed Oct 8 17:50:37 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 8 Oct 2014 14:50:37 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CANn2QUzAe=DqngWSGA81bZ1CieVCd=2vUVb5VYUQA1bL+k6qow@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> <3D77BBE7-4FE1-4480-AB8D-55082D7719C9@gmail.com> <CAOvn4qipKLgJJenk5duv2OARjS9ZGqV4=yAAhd8dWfehvnqjiQ@mail.gmail.com> <CANn2QUzAe=DqngWSGA81bZ1CieVCd=2vUVb5VYUQA1bL+k6qow@mail.gmail.com> Message-ID: <CAOvn4qhY2Yq=eO=w-aczbNw_TxyJQMeh0H9Da+OzpKsReudoPA@mail.gmail.com> On 8 October 2014 14:08, Antonino Ingargiola <tritemio at gmail.com> wrote: > What I have done is completely custom (but straightforward). Would be nice > if nbparameterise could standardize a way to specify a "list" of values for > a variable so the notebook can be executed in batch mode, saving the output > for each execution. Saving in notebook format is somewhat diff-safe. What > about HTML? I suspect it may be a little more tricky to diff... You could certainly use the API to do that. I've added an example: https://github.com/takluyver/nbparameterise/blob/master/batch_eg.py You could wrap that up in a higher level interface if you wanted, but I wouldn't go too high level with it: I can imagine that people might want the list of values to come from lots of different places, e.g. directory listsings, or databases. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/6a892fa4/attachment.html> From tritemio at gmail.com Wed Oct 8 18:14:48 2014 From: tritemio at gmail.com (Antonino Ingargiola) Date: Wed, 8 Oct 2014 15:14:48 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qhY2Yq=eO=w-aczbNw_TxyJQMeh0H9Da+OzpKsReudoPA@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> <3D77BBE7-4FE1-4480-AB8D-55082D7719C9@gmail.com> <CAOvn4qipKLgJJenk5duv2OARjS9ZGqV4=yAAhd8dWfehvnqjiQ@mail.gmail.com> <CANn2QUzAe=DqngWSGA81bZ1CieVCd=2vUVb5VYUQA1bL+k6qow@mail.gmail.com> <CAOvn4qhY2Yq=eO=w-aczbNw_TxyJQMeh0H9Da+OzpKsReudoPA@mail.gmail.com> Message-ID: <CANn2QUwhPw5ZwbYYPOzAH61yL4SfDpydQcU-rP_ebVVJ-AzVkw@mail.gmail.com> Interesting. Your example is exactly what I have done with runipy, just cleaner through a proper API. My suggestion however was different. I was thinking of saving the list of parameter values in the "template notebook" so that it will contain all the information about the batch processing. The "runner", in the most basic mode, would just execute the notebook iterating through the specified values. Think about that. If I have 5 notebooks for 5 different analysis, I have to maintain 5 different sets of parameters in 5 different batch-runner functions (or on disk or other location) to be able to batch-execute all of them (and this is what I do right know). If we would have a conventional way of embedding the list of parameters in each notebook, it would make the process much more transparent with all the information in one place (the template notebook). Then I can use the same exact function to batch-execute each of the 5 templates, regardless of which parameters are varied. And for "custom" executions I can always use the full API to override parameters, so no loss of generality. Antonio On Wed, Oct 8, 2014 at 2:50 PM, Thomas Kluyver <takowl at gmail.com> wrote: > On 8 October 2014 14:08, Antonino Ingargiola <tritemio at gmail.com> wrote: > >> What I have done is completely custom (but straightforward). Would be >> nice if nbparameterise could standardize a way to specify a "list" of >> values for a variable so the notebook can be executed in batch mode, saving >> the output for each execution. Saving in notebook format is somewhat >> diff-safe. What about HTML? I suspect it may be a little more tricky to >> diff... > > > You could certainly use the API to do that. I've added an example: > https://github.com/takluyver/nbparameterise/blob/master/batch_eg.py > > You could wrap that up in a higher level interface if you wanted, but I > wouldn't go too high level with it: I can imagine that people might want > the list of values to come from lots of different places, e.g. directory > listsings, or databases. > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/b5370fbe/attachment.html> From takowl at gmail.com Wed Oct 8 18:24:03 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 8 Oct 2014 15:24:03 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CANn2QUwhPw5ZwbYYPOzAH61yL4SfDpydQcU-rP_ebVVJ-AzVkw@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> <3D77BBE7-4FE1-4480-AB8D-55082D7719C9@gmail.com> <CAOvn4qipKLgJJenk5duv2OARjS9ZGqV4=yAAhd8dWfehvnqjiQ@mail.gmail.com> <CANn2QUzAe=DqngWSGA81bZ1CieVCd=2vUVb5VYUQA1bL+k6qow@mail.gmail.com> <CAOvn4qhY2Yq=eO=w-aczbNw_TxyJQMeh0H9Da+OzpKsReudoPA@mail.gmail.com> <CANn2QUwhPw5ZwbYYPOzAH61yL4SfDpydQcU-rP_ebVVJ-AzVkw@mail.gmail.com> Message-ID: <CAOvn4qh6o03kK0b+Ps76-15MOg3PLdO3ypOiChn_zqMwU3ZTAQ@mail.gmail.com> On 8 October 2014 15:14, Antonino Ingargiola <tritemio at gmail.com> wrote: > My suggestion however was different. I was thinking of saving the list of > parameter values in the "template notebook" so that it will contain all the > information about the batch processing. The "runner", in the most basic > mode, would just execute the notebook iterating through the specified > values. I see what you mean. That's an interesting idea, and I'll keep it in the back of my mind, but it's not something I want to tackle at the moment. It would certainly be possible to store the value ranges in notebook metadata, and generalise the example I gave to use that instead of hardcoded lists. Designing a good UI for writing the notebook metadata might be trickier, but you could do that as an nbextension. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/2b1a651c/attachment.html> From tritemio at gmail.com Wed Oct 8 19:33:51 2014 From: tritemio at gmail.com (Antonino Ingargiola) Date: Wed, 8 Oct 2014 16:33:51 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qh6o03kK0b+Ps76-15MOg3PLdO3ypOiChn_zqMwU3ZTAQ@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> <3D77BBE7-4FE1-4480-AB8D-55082D7719C9@gmail.com> <CAOvn4qipKLgJJenk5duv2OARjS9ZGqV4=yAAhd8dWfehvnqjiQ@mail.gmail.com> <CANn2QUzAe=DqngWSGA81bZ1CieVCd=2vUVb5VYUQA1bL+k6qow@mail.gmail.com> <CAOvn4qhY2Yq=eO=w-aczbNw_TxyJQMeh0H9Da+OzpKsReudoPA@mail.gmail.com> <CANn2QUwhPw5ZwbYYPOzAH61yL4SfDpydQcU-rP_ebVVJ-AzVkw@mail.gmail.com> <CAOvn4qh6o03kK0b+Ps76-15MOg3PLdO3ypOiChn_zqMwU3ZTAQ@mail.gmail.com> Message-ID: <CANn2QUyXyzyyiCF9F1n-ZjbT7VjKo7m2MSHqLfAzSYj7qCkmrg@mail.gmail.com> But what do you think about using real python lists with a conventional names or with a "magic" comment (or even a cell magic?) from which the values are extracted. This would not require building any custom GUI. The template notebook will have a cell like this: ipyparams_datafile = [...] that is replaced in the executed notebook by a cell like this: datafile = ".." It may be a little hackish but it is extremely simple and would already be a huge improvement over the current situation. Antonio On Wed, Oct 8, 2014 at 3:24 PM, Thomas Kluyver <takowl at gmail.com> wrote: > On 8 October 2014 15:14, Antonino Ingargiola <tritemio at gmail.com> wrote: > >> My suggestion however was different. I was thinking of saving the list of >> parameter values in the "template notebook" so that it will contain all the >> information about the batch processing. The "runner", in the most basic >> mode, would just execute the notebook iterating through the specified >> values. > > > I see what you mean. That's an interesting idea, and I'll keep it in the > back of my mind, but it's not something I want to tackle at the moment. It > would certainly be possible to store the value ranges in notebook metadata, > and generalise the example I gave to use that instead of hardcoded lists. > Designing a good UI for writing the notebook metadata might be trickier, > but you could do that as an nbextension. > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/d9aa0d0d/attachment.html> From takowl at gmail.com Wed Oct 8 19:57:47 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 8 Oct 2014 16:57:47 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CANn2QUyXyzyyiCF9F1n-ZjbT7VjKo7m2MSHqLfAzSYj7qCkmrg@mail.gmail.com> References: <CAOvn4qi-e05Qu0pR4HZorj23CSjPmE0nHuyGT8ewFM1VAGwo1w@mail.gmail.com> <3D77BBE7-4FE1-4480-AB8D-55082D7719C9@gmail.com> <CAOvn4qipKLgJJenk5duv2OARjS9ZGqV4=yAAhd8dWfehvnqjiQ@mail.gmail.com> <CANn2QUzAe=DqngWSGA81bZ1CieVCd=2vUVb5VYUQA1bL+k6qow@mail.gmail.com> <CAOvn4qhY2Yq=eO=w-aczbNw_TxyJQMeh0H9Da+OzpKsReudoPA@mail.gmail.com> <CANn2QUwhPw5ZwbYYPOzAH61yL4SfDpydQcU-rP_ebVVJ-AzVkw@mail.gmail.com> <CAOvn4qh6o03kK0b+Ps76-15MOg3PLdO3ypOiChn_zqMwU3ZTAQ@mail.gmail.com> <CANn2QUyXyzyyiCF9F1n-ZjbT7VjKo7m2MSHqLfAzSYj7qCkmrg@mail.gmail.com> Message-ID: <CAOvn4qgrh4S2CyXEVJV_EOr-mGt9TmpBNXvOG6ae4WBu=VpaHA@mail.gmail.com> On 8 October 2014 16:33, Antonino Ingargiola <tritemio at gmail.com> wrote: > But what do you think about using real python lists with a conventional > names or with a "magic" comment (or even a cell magic?) from which the > values are extracted. This would not require building any custom GUI. > I don't like this abstraction. I spent a while writing different sentences here trying to explain why, but it really just feels inflexible. Part of my concern is that it breaks the model that the notebook can be run as is, without substituting the first cell. Of course, you could get round that with a cell magic, but that doesn't feel quite right either, and it doesn't generalise neatly to other languages. > It may be a little hackish Hackish solutions are great sometimes, but part of the purpose of nbparameterise is to figure out the right ways to do things, and make those easy. So I'd rather we kept thinking about what would be a good abstraction for this, rather than building a hackish one quickly. Of course, it's easy for me to say this, because I'm not the one who wants to use it immediately ;-). Of course, if you want to build this for your own use, go right ahead. Best wishes, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141008/3d5f8178/attachment.html> From kikocorreoso at gmail.com Thu Oct 9 17:57:35 2014 From: kikocorreoso at gmail.com (Kiko) Date: Thu, 9 Oct 2014 23:57:35 +0200 Subject: [IPython-dev] Simple kernel not working on a venv Message-ID: <CAB-sx61ROeAP3-06+B3fONOyWtHuA++cxbg8Ly9Lf8Bs2AG+fg@mail.gmail.com> Hi all, I am following the recipe found here: http://nbviewer.ipython.org/github/ipython-books/cookbook-code/blob/master/notebooks/chapter01_basic/06_kernel.ipynb to create a custom and simple kernel. The kernel is working if I don't use a venv but inside a venv the notebook is 'busy' and I can't run code. It seems that the qtconsole is working fine with and without the venv. My tests are made on linux mint 64bit, chrome v38 and firefox v32. Kind regards. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141009/43589d51/attachment.html> From takowl at gmail.com Thu Oct 9 18:06:22 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 9 Oct 2014 15:06:22 -0700 Subject: [IPython-dev] Simple kernel not working on a venv In-Reply-To: <CAB-sx61ROeAP3-06+B3fONOyWtHuA++cxbg8Ly9Lf8Bs2AG+fg@mail.gmail.com> References: <CAB-sx61ROeAP3-06+B3fONOyWtHuA++cxbg8Ly9Lf8Bs2AG+fg@mail.gmail.com> Message-ID: <CAOvn4qjkvDfed9b74w9UC+cOzO6fr9-sC4w4crn9YjKmqsqwpw@mail.gmail.com> On 9 October 2014 14:57, Kiko <kikocorreoso at gmail.com> wrote: > The kernel is working if I don't use a venv but inside a venv the notebook > is 'busy' and I can't run code. My guess would be that it's somehow importing a different version of your kernel, or a different version of IPython, inside the venv. I can't think that anything we do should care whether the kernel runs in a venv or not. If you remove the env and recreate it with fresh installations of IPython and your kernel, do you still see the issue? Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141009/46da4358/attachment.html> From kikocorreoso at gmail.com Thu Oct 9 18:16:23 2014 From: kikocorreoso at gmail.com (Kiko) Date: Fri, 10 Oct 2014 00:16:23 +0200 Subject: [IPython-dev] Simple kernel not working on a venv In-Reply-To: <CAOvn4qjkvDfed9b74w9UC+cOzO6fr9-sC4w4crn9YjKmqsqwpw@mail.gmail.com> References: <CAB-sx61ROeAP3-06+B3fONOyWtHuA++cxbg8Ly9Lf8Bs2AG+fg@mail.gmail.com> <CAOvn4qjkvDfed9b74w9UC+cOzO6fr9-sC4w4crn9YjKmqsqwpw@mail.gmail.com> Message-ID: <CAB-sx637mGGO+DaCcqWHGuCJzJT=VpGkubAk369KoY=6oghrCA@mail.gmail.com> 2014-10-10 0:06 GMT+02:00 Thomas Kluyver <takowl at gmail.com>: > On 9 October 2014 14:57, Kiko <kikocorreoso at gmail.com> wrote: > >> The kernel is working if I don't use a venv but inside a venv the >> notebook is 'busy' and I can't run code. > > > My guess would be that it's somehow importing a different version of your > kernel, or a different version of IPython, inside the venv. I can't think > that anything we do should care whether the kernel runs in a venv or not. > If you remove the env and recreate it with fresh installations of IPython > and your kernel, do you still see the issue? > Let me check that tomorrow. Thanks, Thomas. > > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141010/68a12ef1/attachment.html> From ijstokes at alumni.uwaterloo.ca Thu Oct 9 21:58:23 2014 From: ijstokes at alumni.uwaterloo.ca (Ian Stokes-Rees) Date: Thu, 09 Oct 2014 21:58:23 -0400 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input Message-ID: <54373D3F.8020108@alumni.uwaterloo.ca> FWIW, We (at Continuum) have done some work on something similar, loosely tied to conda: https://github.com/conda/conda-launch It supports 3 modes: 1. CLI invocation of a notebook 2. auto-generated web-form of a notebook 3. RESTful API with URL (GET) or POST-encoded arguments It doesn't require any customization of IPython, and the parameterization can either be in the notebook meta-data, or "inline" if the last cell is a "raw" cell with the appropriate JSON. The parameterization meta-data can also include a set of dependencies, in which case a custom conda-environment will be created in which the notebook will be run. The goal is to be able to generate notebook output (HTML, data file, figures, return specific serialized references) with no retained state or persisted processes, basically a notebook-based CGI python script. It runs reasonably well right now, but the input form styling is pants (my CSS skills stink!). I haven't had time to read the thread on nbparameterize, but look forward to exploring it next week. Perhaps the two efforts can be merged. Regards, Ian -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141009/aaa0c431/attachment.html> From rgbkrk at gmail.com Thu Oct 9 22:16:57 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Thu, 9 Oct 2014 21:16:57 -0500 Subject: [IPython-dev] Docker containers Message-ID: <CA+tbMaUhV4BcWa83iLFKETROasfX28qB4r1RKz=CRsnhRkfcsA@mail.gmail.com> Hey IPythonistas and Jovyans, Our original Docker thread got *lots* of input. It's time I write about where things stand right now, and invite you to take a look at the current images (*ahem* send pull requests). Docker Hub currently builds the most recent copy of github.com/ipython/ipython master on the ipython/ipython image ( https://registry.hub.docker.com/u/ipython/ipython/). When IPython 3 releases, I'd like to make tagged versions of this base image so that you get a stable image and development images ipython/ipython:3.0 - stable 3.0 release ipython/ipython:3.x - current 3.x branch (backported fixes) ipython/ipython:latest - current master Basing off this image are three other images: ipython/scipystack (https://registry.hub.docker.com/u/ipython/scipystack/) * Based off of the ipython/ipython image * All of the scipystack (+ a few more opinionated adds) * Big thank you to Olivier Grisel for a *wonderful* OpenBLAS installation + numpy + scipy config ipython/scipyserver (https://registry.hub.docker.com/u/ipython/scipyserver/) * Based off of scipystack, runs a notebook server ipython/notebook (https://registry.hub.docker.com/u/ipython/notebook/) * Based off of ipython/ipython, runs a notebook server We've seen folks basing images off of ipython/scipystack and I think that's wonderful. We also have an image in development that sets up the Julia and R kernels (to be toggled with the kernel switcher), in https://github.com/jupyter/tmpnb/blob/master/image/Dockerfile. If you have feedback, let us know! -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141009/ecd52894/attachment.html> From zvoros at gmail.com Fri Oct 10 05:28:08 2014 From: zvoros at gmail.com (=?UTF-8?B?Wm9sdMOhbiBWw7Zyw7Zz?=) Date: Fri, 10 Oct 2014 11:28:08 +0200 Subject: [IPython-dev] notebook validation failed error Message-ID: <5437A6A8.1060707@gmail.com> Hi all, After pulling the latest version from master, I get a "Notebook validation failed" error, whenever I try to open an existing notebook, or save one. This happens even, if I create a new notebook and I try to save it. Is this error somehow related to the change in the notebook schema? In any case, I just wanted to ask if someone else has bumped into the same problem, or perhaps, something is wrong at my end. Cheers, Zolt?n From takowl at gmail.com Fri Oct 10 12:38:50 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 10 Oct 2014 09:38:50 -0700 Subject: [IPython-dev] notebook validation failed error In-Reply-To: <5437A6A8.1060707@gmail.com> References: <5437A6A8.1060707@gmail.com> Message-ID: <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> Hi Zolt?n, We recently merged some changes to the validation code itself. I'm not sure why you'd get it on brand new notebooks, but if you can send us one of the existing notebooks that fails to validate, we'll look into what the problem is. Thanks, Thomas On 10 October 2014 02:28, Zolt?n V?r?s <zvoros at gmail.com> wrote: > Hi all, > > After pulling the latest version from master, I get a "Notebook > validation failed" error, whenever I try to open an existing notebook, > or save one. This happens even, if I create a new notebook and I try to > save it. Is this error somehow related to the change in the notebook > schema? > > In any case, I just wanted to ask if someone else has bumped into the > same problem, or perhaps, something is wrong at my end. > > Cheers, > Zolt?n > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141010/fd871644/attachment.html> From tritemio at gmail.com Fri Oct 10 13:24:43 2014 From: tritemio at gmail.com (Antonino Ingargiola) Date: Fri, 10 Oct 2014 10:24:43 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <54373D3F.8020108@alumni.uwaterloo.ca> References: <54373D3F.8020108@alumni.uwaterloo.ca> Message-ID: <CANn2QUw5qAb2MFedRjW16X76t_zwoA89oD43idW_C4Oxz=Hh=w@mail.gmail.com> Hi, I like the idea of putting parameters in raw cells, I believe the all the parameter specifications should stay inside notebook. Would be possible to specify a list so that the notebook is executed for each value in the list? This is what I was discussing in the previous thread. It would make a common workflow very easy and transparent. Antonio On Thu, Oct 9, 2014 at 6:58 PM, Ian Stokes-Rees < ijstokes at alumni.uwaterloo.ca> wrote: > FWIW, We (at Continuum) have done some work on something similar, loosely > tied to conda: > > https://github.com/conda/conda-launch > > It supports 3 modes: > > 1. CLI invocation of a notebook > 2. auto-generated web-form of a notebook > 3. RESTful API with URL (GET) or POST-encoded arguments > > It doesn't require any customization of IPython, and the parameterization > can either be in the notebook meta-data, or "inline" if the last cell is a > "raw" cell with the appropriate JSON. > > The parameterization meta-data can also include a set of dependencies, in > which case a custom conda-environment will be created in which the notebook > will be run. The goal is to be able to generate notebook output (HTML, > data file, figures, return specific serialized references) with no retained > state or persisted processes, basically a notebook-based CGI python script. > > It runs reasonably well right now, but the input form styling is pants (my > CSS skills stink!). > > I haven't had time to read the thread on nbparameterize, but look forward > to exploring it next week. Perhaps the two efforts can be merged. > > Regards, > > Ian > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141010/52f1457d/attachment.html> From benjaminrk at gmail.com Fri Oct 10 13:43:41 2014 From: benjaminrk at gmail.com (MinRK) Date: Fri, 10 Oct 2014 10:43:41 -0700 Subject: [IPython-dev] notebook validation failed error In-Reply-To: <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> References: <5437A6A8.1060707@gmail.com> <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> Message-ID: <CAHNn8BUpeW_vjGVmJ=CAXZkLKJ=QjKWEG7-v=Zu5pPCDMAV8xw@mail.gmail.com> The validation might fail if the cached javascript was out of date. I suspect that was the case, especially if the validation failure was on `additionalProperties` of a code cell. -MinRK On Fri, Oct 10, 2014 at 9:38 AM, Thomas Kluyver <takowl at gmail.com> wrote: > Hi Zolt?n, > > We recently merged some changes to the validation code itself. I'm not > sure why you'd get it on brand new notebooks, but if you can send us one of > the existing notebooks that fails to validate, we'll look into what the > problem is. > > Thanks, > Thomas > > On 10 October 2014 02:28, Zolt?n V?r?s <zvoros at gmail.com> wrote: > >> Hi all, >> >> After pulling the latest version from master, I get a "Notebook >> validation failed" error, whenever I try to open an existing notebook, >> or save one. This happens even, if I create a new notebook and I try to >> save it. Is this error somehow related to the change in the notebook >> schema? >> >> In any case, I just wanted to ask if someone else has bumped into the >> same problem, or perhaps, something is wrong at my end. >> >> Cheers, >> Zolt?n >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141010/c228f2be/attachment.html> From takowl at gmail.com Fri Oct 10 14:02:02 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 10 Oct 2014 11:02:02 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <54373D3F.8020108@alumni.uwaterloo.ca> References: <54373D3F.8020108@alumni.uwaterloo.ca> Message-ID: <CAOvn4qgmgLe0EdQpnMNiXnR1_QBvHze547G3DvLX1VPWS9Y5Ug@mail.gmail.com> Thanks Ian - conda-launch was one of a few projects that prompted me to work on this. In particular, great though conda is, I don't think creating forms and executing notebooks should be tied to a particular packaging system. Looking through the description of conda-launch, I think what I want to think about most is the different ways of describing the input parameters. Conda-launch uses JSON metadata that is potentially more flexible, but very distinct from the normal workflow of writing a notebook. Nbparameterise currently looks for an initial "definitions cell", which is less extensible, but very natural for the notebook author. Part of me wants to generalise nbparameterise to handle all possible ways of describing inputs, but another part of me wants to hammer out a common way of doing this, so notebook authors don't have to learn different things for different systems. I'll keep thinking about it. Best wishes, Thomas On 9 October 2014 18:58, Ian Stokes-Rees <ijstokes at alumni.uwaterloo.ca> wrote: > FWIW, We (at Continuum) have done some work on something similar, loosely > tied to conda: > > https://github.com/conda/conda-launch > > It supports 3 modes: > > 1. CLI invocation of a notebook > 2. auto-generated web-form of a notebook > 3. RESTful API with URL (GET) or POST-encoded arguments > > It doesn't require any customization of IPython, and the parameterization > can either be in the notebook meta-data, or "inline" if the last cell is a > "raw" cell with the appropriate JSON. > > The parameterization meta-data can also include a set of dependencies, in > which case a custom conda-environment will be created in which the notebook > will be run. The goal is to be able to generate notebook output (HTML, > data file, figures, return specific serialized references) with no retained > state or persisted processes, basically a notebook-based CGI python script. > > It runs reasonably well right now, but the input form styling is pants (my > CSS skills stink!). > > I haven't had time to read the thread on nbparameterize, but look forward > to exploring it next week. Perhaps the two efforts can be merged. > > Regards, > > Ian > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141010/1dc7412b/attachment.html> From zvoros at gmail.com Fri Oct 10 14:03:58 2014 From: zvoros at gmail.com (=?windows-1252?Q?Zolt=E1n_V=F6r=F6s?=) Date: Fri, 10 Oct 2014 20:03:58 +0200 Subject: [IPython-dev] notebook validation failed error In-Reply-To: <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> References: <5437A6A8.1060707@gmail.com> <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> Message-ID: <54381F8E.1020505@gmail.com> Hi Thomas/Min, > The validation might fail if the cached javascript was out of date. I > suspect that was the case, especially if the validation failure was on > `additionalProperties` of a code cell. > > -MinRK On 10/10/2014 06:38 PM, Thomas Kluyver wrote: > Hi Zolt?n, > > We recently merged some changes to the validation code itself. I'm not > sure why you'd get it on brand new notebooks, but if you can send us > one of the existing notebooks that fails to validate, we'll look into > what the problem is. > I think clearing the cache has solved the problem. Many thanks for the pointer! I am going to disable chaching altogether, since I use chrome only with ipython, anyway. Cheers, Zolt?n From fperez.net at gmail.com Fri Oct 10 18:59:22 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Fri, 10 Oct 2014 15:59:22 -0700 Subject: [IPython-dev] notebook validation failed error In-Reply-To: <54381F8E.1020505@gmail.com> References: <5437A6A8.1060707@gmail.com> <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> <54381F8E.1020505@gmail.com> Message-ID: <CAHAreOr9T97dE40yB5cMy-1Pt22pxQrDt7O5po_=DOdWt0V0ew@mail.gmail.com> On Fri, Oct 10, 2014 at 11:03 AM, Zolt?n V?r?s <zvoros at gmail.com> wrote: > I think clearing the cache has solved the problem. Many thanks for the > pointer! I am going to disable chaching altogether, since I use chrome > only with ipython, anyway. > To all chrome users, run, don't walk to install this clear cache extension: https://chrome.google.com/webstore/detail/clear-cache/cppjkneekbjaeellbfkmgnhonkkjfpdn?hl=en life saver when dealing with the nb. -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141010/d869264d/attachment.html> From damianavila at gmail.com Fri Oct 10 19:06:40 2014 From: damianavila at gmail.com (=?UTF-8?Q?Dami=C3=A1n_Avila?=) Date: Fri, 10 Oct 2014 20:06:40 -0300 Subject: [IPython-dev] notebook validation failed error In-Reply-To: <CAHAreOr9T97dE40yB5cMy-1Pt22pxQrDt7O5po_=DOdWt0V0ew@mail.gmail.com> References: <5437A6A8.1060707@gmail.com> <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> <54381F8E.1020505@gmail.com> <CAHAreOr9T97dE40yB5cMy-1Pt22pxQrDt7O5po_=DOdWt0V0ew@mail.gmail.com> Message-ID: <CAH+mRR2Q1wXU=TGUxxN7Gv+LbPBwytEO5izWrQBY5juDQMDMCg@mail.gmail.com> And it is really working?? my setup when I develop for the notebook is use: * incognito mode * dev tools opened * clear the cache and force the page reload (3rd option of reload in the reload icon when you click with the "secondary/right" button And with all this precautions, sometimes I have close the browser or/and shutdown the server to see the changes... really... I think I will have to try it ;-) 2014-10-10 19:59 GMT-03:00 Fernando Perez <fperez.net at gmail.com>: > > On Fri, Oct 10, 2014 at 11:03 AM, Zolt?n V?r?s <zvoros at gmail.com> wrote: > >> I think clearing the cache has solved the problem. Many thanks for the >> pointer! I am going to disable chaching altogether, since I use chrome >> only with ipython, anyway. >> > > To all chrome users, run, don't walk to install this clear cache extension: > > > https://chrome.google.com/webstore/detail/clear-cache/cppjkneekbjaeellbfkmgnhonkkjfpdn?hl=en > > life saver when dealing with the nb. > > > -- > Fernando Perez (@fperez_org; http://fperez.org) > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > fernando.perez-at-berkeley: contact me here for any direct mail > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- *Dami?n* -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141010/57cdc1c0/attachment.html> From fperez.net at gmail.com Fri Oct 10 19:33:49 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Fri, 10 Oct 2014 16:33:49 -0700 Subject: [IPython-dev] notebook validation failed error In-Reply-To: <CAH+mRR2Q1wXU=TGUxxN7Gv+LbPBwytEO5izWrQBY5juDQMDMCg@mail.gmail.com> References: <5437A6A8.1060707@gmail.com> <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> <54381F8E.1020505@gmail.com> <CAHAreOr9T97dE40yB5cMy-1Pt22pxQrDt7O5po_=DOdWt0V0ew@mail.gmail.com> <CAH+mRR2Q1wXU=TGUxxN7Gv+LbPBwytEO5izWrQBY5juDQMDMCg@mail.gmail.com> Message-ID: <CAHAreOpZ9Spa5Bd29-Q_73vN+cEjceAw4F5t4YhfuHqRgfrpqQ@mail.gmail.com> It seems to work for me so far, but maybe I haven't had a problem bad enough :) Cache issues seem to be the new bane of our existence... On Fri, Oct 10, 2014 at 4:06 PM, Dami?n Avila <damianavila at gmail.com> wrote: > And it is really working?? my setup when I develop for the notebook is use: > > * incognito mode > * dev tools opened > * clear the cache and force the page reload (3rd option of reload in the > reload icon when you click with the "secondary/right" button > And with all this precautions, sometimes I have close the browser or/and > shutdown the server to see the changes... really... > > I think I will have to try it ;-) > > > 2014-10-10 19:59 GMT-03:00 Fernando Perez <fperez.net at gmail.com>: > >> >> On Fri, Oct 10, 2014 at 11:03 AM, Zolt?n V?r?s <zvoros at gmail.com> wrote: >> >>> I think clearing the cache has solved the problem. Many thanks for the >>> pointer! I am going to disable chaching altogether, since I use chrome >>> only with ipython, anyway. >>> >> >> To all chrome users, run, don't walk to install this clear cache >> extension: >> >> >> https://chrome.google.com/webstore/detail/clear-cache/cppjkneekbjaeellbfkmgnhonkkjfpdn?hl=en >> >> life saver when dealing with the nb. >> >> >> -- >> Fernando Perez (@fperez_org; http://fperez.org) >> fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) >> fernando.perez-at-berkeley: contact me here for any direct mail >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > > -- > *Dami?n* > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141010/14e870ef/attachment.html> From wstein at gmail.com Fri Oct 10 22:09:38 2014 From: wstein at gmail.com (William Stein) Date: Fri, 10 Oct 2014 19:09:38 -0700 Subject: [IPython-dev] notebook validation failed error In-Reply-To: <CAHAreOpZ9Spa5Bd29-Q_73vN+cEjceAw4F5t4YhfuHqRgfrpqQ@mail.gmail.com> References: <5437A6A8.1060707@gmail.com> <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> <54381F8E.1020505@gmail.com> <CAHAreOr9T97dE40yB5cMy-1Pt22pxQrDt7O5po_=DOdWt0V0ew@mail.gmail.com> <CAH+mRR2Q1wXU=TGUxxN7Gv+LbPBwytEO5izWrQBY5juDQMDMCg@mail.gmail.com> <CAHAreOpZ9Spa5Bd29-Q_73vN+cEjceAw4F5t4YhfuHqRgfrpqQ@mail.gmail.com> Message-ID: <CACLE5GDYy2iksA9-REsYWt2jNQmymaSFziSXk14xpqar_4cvOQ@mail.gmail.com> On Oct 10, 2014 4:34 PM, "Fernando Perez" <fperez.net at gmail.com> wrote: > > It seems to work for me so far, but maybe I haven't had a problem bad enough :) > > Cache issues seem to be the new bane of our existence... > Add a version number in the client code and server code. Have the client request the latest version periodically. If the client version is too old, notify the user. I do this with SageMathCloud, and Google does it with Google Analytics. The main point is that at least it is clear whether or not one is using the current version of code. For this to work you have to combine everything into one file (eg with uglify.js); anyway whatever else you do, you definitely need a periodic client version check. > On Fri, Oct 10, 2014 at 4:06 PM, Dami?n Avila <damianavila at gmail.com> wrote: >> >> And it is really working?? my setup when I develop for the notebook is use: >> >> * incognito mode >> * dev tools opened >> * clear the cache and force the page reload (3rd option of reload in the reload icon when you click with the "secondary/right" button >> And with all this precautions, sometimes I have close the browser or/and shutdown the server to see the changes... really... >> >> I think I will have to try it ;-) >> >> >> 2014-10-10 19:59 GMT-03:00 Fernando Perez <fperez.net at gmail.com>: >>> >>> >>> On Fri, Oct 10, 2014 at 11:03 AM, Zolt?n V?r?s <zvoros at gmail.com> wrote: >>>> >>>> I think clearing the cache has solved the problem. Many thanks for the >>>> pointer! I am going to disable chaching altogether, since I use chrome >>>> only with ipython, anyway. >>> >>> >>> To all chrome users, run, don't walk to install this clear cache extension: >>> >>> https://chrome.google.com/webstore/detail/clear-cache/cppjkneekbjaeellbfkmgnhonkkjfpdn?hl=en >>> >>> life saver when dealing with the nb. >>> >>> >>> -- >>> Fernando Perez (@fperez_org; http://fperez.org) >>> fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) >>> fernando.perez-at-berkeley: contact me here for any direct mail >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >> >> >> >> -- >> Dami?n >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > > -- > Fernando Perez (@fperez_org; http://fperez.org) > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > fernando.perez-at-berkeley: contact me here for any direct mail > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141010/30ddba81/attachment.html> From bussonniermatthias at gmail.com Sat Oct 11 04:57:04 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Sat, 11 Oct 2014 10:57:04 +0200 Subject: [IPython-dev] notebook validation failed error In-Reply-To: <CACLE5GDYy2iksA9-REsYWt2jNQmymaSFziSXk14xpqar_4cvOQ@mail.gmail.com> References: <5437A6A8.1060707@gmail.com> <CAOvn4qhPdDVBdVJ9hE5Qf19ZFoKe9KYP34F=156yAaT=_BAOVg@mail.gmail.com> <54381F8E.1020505@gmail.com> <CAHAreOr9T97dE40yB5cMy-1Pt22pxQrDt7O5po_=DOdWt0V0ew@mail.gmail.com> <CAH+mRR2Q1wXU=TGUxxN7Gv+LbPBwytEO5izWrQBY5juDQMDMCg@mail.gmail.com> <CAHAreOpZ9Spa5Bd29-Q_73vN+cEjceAw4F5t4YhfuHqRgfrpqQ@mail.gmail.com> <CACLE5GDYy2iksA9-REsYWt2jNQmymaSFziSXk14xpqar_4cvOQ@mail.gmail.com> Message-ID: <692C565B-265B-4803-A9C6-0CA90D4D7E2C@gmail.com> Le 11 oct. 2014 ? 04:09, William Stein <wstein at gmail.com> a ?crit : > > On Oct 10, 2014 4:34 PM, "Fernando Perez" <fperez.net at gmail.com> wrote: > > > > It seems to work for me so far, but maybe I haven't had a problem bad enough :) > > > > Cache issues seem to be the new bane of our existence... > > > > Add a version number in the client code and server code. Have the client request the latest version periodically. If the client version is too old, notify the user. I do this with SageMathCloud, and Google does it with Google Analytics. The main point is that at least it is clear whether or not one is using the current version of code. > Which is not very practical when developing which is when theses issues arise most of the time. There are pull requests that should solve that by embedding file hash into the URL and aggressively deactivate caching in the browser on master. -- M > For this to work you have to combine everything into one file (eg with uglify.js); anyway whatever else you do, you definitely need a periodic client version check. > > > On Fri, Oct 10, 2014 at 4:06 PM, Dami?n Avila <damianavila at gmail.com> wrote: > >> > >> And it is really working?? my setup when I develop for the notebook is use: > >> > >> * incognito mode > >> * dev tools opened > >> * clear the cache and force the page reload (3rd option of reload in the reload icon when you click with the "secondary/right" button > >> And with all this precautions, sometimes I have close the browser or/and shutdown the server to see the changes... really... > >> > >> I think I will have to try it ;-) > >> > >> > >> 2014-10-10 19:59 GMT-03:00 Fernando Perez <fperez.net at gmail.com>: > >>> > >>> > >>> On Fri, Oct 10, 2014 at 11:03 AM, Zolt?n V?r?s <zvoros at gmail.com> wrote: > >>>> > >>>> I think clearing the cache has solved the problem. Many thanks for the > >>>> pointer! I am going to disable chaching altogether, since I use chrome > >>>> only with ipython, anyway. > >>> > >>> > >>> To all chrome users, run, don't walk to install this clear cache extension: > >>> > >>> https://chrome.google.com/webstore/detail/clear-cache/cppjkneekbjaeellbfkmgnhonkkjfpdn?hl=en > >>> > >>> life saver when dealing with the nb. > >>> > >>> > >>> -- > >>> Fernando Perez (@fperez_org; http://fperez.org) > >>> fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > >>> fernando.perez-at-berkeley: contact me here for any direct mail > >>> > >>> _______________________________________________ > >>> IPython-dev mailing list > >>> IPython-dev at scipy.org > >>> http://mail.scipy.org/mailman/listinfo/ipython-dev > >>> > >> > >> > >> > >> -- > >> Dami?n > >> > >> _______________________________________________ > >> IPython-dev mailing list > >> IPython-dev at scipy.org > >> http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > > > > > > > > -- > > Fernando Perez (@fperez_org; http://fperez.org) > > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > > fernando.perez-at-berkeley: contact me here for any direct mail > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141011/5ece0751/attachment.html> From kikocorreoso at gmail.com Sat Oct 11 06:14:26 2014 From: kikocorreoso at gmail.com (Kiko) Date: Sat, 11 Oct 2014 12:14:26 +0200 Subject: [IPython-dev] Simple kernel not working on a venv In-Reply-To: <CAB-sx637mGGO+DaCcqWHGuCJzJT=VpGkubAk369KoY=6oghrCA@mail.gmail.com> References: <CAB-sx61ROeAP3-06+B3fONOyWtHuA++cxbg8Ly9Lf8Bs2AG+fg@mail.gmail.com> <CAOvn4qjkvDfed9b74w9UC+cOzO6fr9-sC4w4crn9YjKmqsqwpw@mail.gmail.com> <CAB-sx637mGGO+DaCcqWHGuCJzJT=VpGkubAk369KoY=6oghrCA@mail.gmail.com> Message-ID: <CAB-sx63VoUXaUFEmKOSjzA1SW7WZbZnJ0d-Gtbh3-NrdioPreg@mail.gmail.com> 2014-10-10 0:16 GMT+02:00 Kiko <kikocorreoso at gmail.com>: > > > 2014-10-10 0:06 GMT+02:00 Thomas Kluyver <takowl at gmail.com>: > >> On 9 October 2014 14:57, Kiko <kikocorreoso at gmail.com> wrote: >> >>> The kernel is working if I don't use a venv but inside a venv the >>> notebook is 'busy' and I can't run code. >> >> >> My guess would be that it's somehow importing a different version of your >> kernel, or a different version of IPython, inside the venv. I can't think >> that anything we do should care whether the kernel runs in a venv or not. >> If you remove the env and recreate it with fresh installations of IPython >> and your kernel, do you still see the issue? >> > > Let me check that tomorrow. > > Thanks, Thomas. > Ok, I installed a new linux mint, compiled python 3.4.2 from source, ipython dev version on a venv, I also included kernel.json on IPYTHONDIR/kernels/mykernel/kernel.json. On windows I diddn't include the kernel.json on that folder and now it is working. On windows I didn't include that fiile on the kernels folder and it was working. ?? Maybe it was related with this issue on ubuntu boxes ( http://www.reddit.com/r/Python/comments/2hha8n/python_33_and_34_virtual_environments_pyvenv_are/ ). Thanks. > >> >> >> Thomas >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141011/8fef7cdd/attachment.html> From lucienboillod at gmail.com Sat Oct 11 09:23:00 2014 From: lucienboillod at gmail.com (Lucien Boillod) Date: Sat, 11 Oct 2014 15:23:00 +0200 Subject: [IPython-dev] Wrap Javascript (D3.js) file into IPython Widget Message-ID: <EF469EC7-C634-4B7B-B653-380BF5F56DDC@gmail.com> Hi all, I currently work with d3.js ans I almost finished (fidd here: http://jsfiddle.net/mv9L7hjq/15/), but now I have to include this part into the project (https://www.lrde.epita.fr/wiki/Vaucanson), so basically we use IPython notebook for the graphical user interface, and what we would like to do is simply wrap my work on D3 into a IPython widget, so that we can display it when we need it. I have made some research about IPython widget using Javascript but all I found is something like that (http://nbviewer.ipython.org/github/ipython/ipython/blob/master/examples/Interactive%20Widgets/Custom%20Widget%20-%20Hello%20World.ipynb) But clearly I don?t want to rewrite the whole javascript file, but just load it and wrap both (HTML/CSS/JS) into a widget. I wonder if there is a way to do that ? Thank you, Cheers, LB -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141011/8e60f2da/attachment.html> From nick.bollweg at gmail.com Sat Oct 11 14:23:28 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Sat, 11 Oct 2014 14:23:28 -0400 Subject: [IPython-dev] Wrap Javascript (D3.js) file into IPython Widget In-Reply-To: <EF469EC7-C634-4B7B-B653-380BF5F56DDC@gmail.com> References: <EF469EC7-C634-4B7B-B653-380BF5F56DDC@gmail.com> Message-ID: <CACejjWwY_LFNXsFiLpsRC=YKWVK0LBvQNJ647Wa_Z8xcG4Dhog@mail.gmail.com> You can stick the whole thing in an iframe, and it will work pretty much as it is right now... the crucial bit of magic will be keeping that link between those two documents. Here is a gist with an untested 20% solution: https://gist.github.com/bollwyvl/f0ba3e16a5a824d53dc8 > Now the widget and the d3 stuff will exist in two separate documents, with two different javascript contexts, but from the view you can touch the frame with view.frame... the other direction is trickier, and if you end up needing to do that, just rewrite the whole thing to be outside of a frame :) - You may want to explore some patterns, like http://bost.ocks.org/mike/chart/, to encapsulate the relationship between data/drawing inside the iframe: right now, if a widget were to update - You'll probably want to explore d3.dispatch, so that you can create custom events (like nodeAdd, nodeRemove, etc) that the widget can react to. This may be a cleaner way than trying to "share" data - be careful of force layout changing your data (nodes, links) in-place, adding x, y, px, py, etc. - when a user changes nodes/links form outside the visualization, you'll probably need to do some things to force... but you'll want to run them at the same time. - look at Backbone.Model.changed <http://backbonejs.org/#Model-changed> and Widget.hold_sync <http://ipython.org/ipython-doc/dev/api/generated/IPython.html.widgets.widget.html#IPython.html.widgets.widget.Widget.hold_sync> to make sure that this happens atomically... or get ready for a lot of svg errors. All that being said: a well-structured backbone view, which every widget must be, will be more maintainable in the long run. Just having evented get/set on the model, and maybe some custom collections, might be worth the price of admission. Good luck! -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141011/a09d8936/attachment.html> From claresloggett at gmail.com Sun Oct 12 01:35:34 2014 From: claresloggett at gmail.com (Clare Sloggett) Date: Sun, 12 Oct 2014 16:35:34 +1100 Subject: [IPython-dev] Jupyterhub behind NGINX redirect Message-ID: <CAETqNqG1cVMpxaSOW=s3H9Vty+2+qZtSyg2fnXX0-yixADZY6Q@mail.gmail.com> Hi all, Am I right in thinking this list is also the right place for questions about Jupyterhub? I'm trying to set up Jupyterhub for multiple users, on the same server where we are running several other services. Currently there are NGINX redirects in place to these other services. I'd like to set up http://<public-url>/ipython/ to redirect to a port on localhost and run Jupyterhub over that port. Is this possible? I've got this working in the past with single-user IPython Notebook. For that, I set config options c.NotebookApp.base_project_url, c.NotebookApp.base_kernel_url, and c.NotebookApp.webapp_settings to be aware of the ipython/ URL prefix. We used an NGINX redirect to forward requests and handle websockets properly, which looked like location /ipython/ { proxy_pass http://127.0.0.1:9510; proxy_set_header Host $host; proxy_set_header X-Real-IP $remote_addr; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; proxy_set_header Upgrade $http_upgrade; proxy_set_header Connection "upgrade"; } This worked for the old single-user notebook. But, I'm not clear on the model Jupyterhub is using (and I'm not much of a sysadmin). I read through the command-line options, thought from them that I don't need to strip the /ipython/ from the incoming requests, and have tried using a similar redirect to the above and setting --JupyterHubApp.base_url='ipython/' and also setting --port 9510. This does seem to see the incoming requests but results in amusing requests like 500 GET /ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/...... ... so clearly I haven't understood what's going on. Does anyone have any pointers on how this should work? I haven't read any docs other than the README and the command-line parameter information, so apologies if there's something obvious that I didn't look at. I'm also interested in running Jupyterhub as a daemon, so if that's something that's been done before and there's anything I should know, that would be great. Any help much appreciated! Clare -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141012/4983f0ef/attachment.html> From doug.blank at gmail.com Sun Oct 12 09:44:10 2014 From: doug.blank at gmail.com (Doug Blank) Date: Sun, 12 Oct 2014 09:44:10 -0400 Subject: [IPython-dev] Jupyterhub behind NGINX redirect In-Reply-To: <CAETqNqG1cVMpxaSOW=s3H9Vty+2+qZtSyg2fnXX0-yixADZY6Q@mail.gmail.com> References: <CAETqNqG1cVMpxaSOW=s3H9Vty+2+qZtSyg2fnXX0-yixADZY6Q@mail.gmail.com> Message-ID: <CAAusYCg2qVDzOvhfFhKzUenv-7tDpG3BGkcfLYB1sq_nZYdi8g@mail.gmail.com> On Sun, Oct 12, 2014 at 1:35 AM, Clare Sloggett <claresloggett at gmail.com> wrote: > > Hi all, > > Am I right in thinking this list is also the right place for questions about Jupyterhub? > > I'm trying to set up Jupyterhub for multiple users, on the same server where we are running several other services. Currently there are NGINX redirects in place to these other services. I'd like to set up http://<public-url>/ipython/ to redirect to a port on localhost and run Jupyterhub over that port. Is this possible? > > I've got this working in the past with single-user IPython Notebook. For that, I set config options c.NotebookApp.base_project_url, c.NotebookApp.base_kernel_url, and c.NotebookApp.webapp_settings to be aware of the ipython/ URL prefix. We used an NGINX redirect to forward requests and handle websockets properly, which looked like > > location /ipython/ { > proxy_pass http://127.0.0.1:9510; > proxy_set_header Host $host; > proxy_set_header X-Real-IP $remote_addr; > proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; > proxy_set_header Upgrade $http_upgrade; > proxy_set_header Connection "upgrade"; > } > > This worked for the old single-user notebook. But, I'm not clear on the model Jupyterhub is using (and I'm not much of a sysadmin). I read through the command-line options, thought from them that I don't need to strip the /ipython/ from the incoming requests, and have tried using a similar redirect to the above and setting --JupyterHubApp.base_url='ipython/' and also setting --port 9510. This does seem to see the incoming requests but results in amusing requests like > > 500 GET /ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/...... > > ... so clearly I haven't understood what's going on. Does anyone have any pointers on how this should work? I haven't read any docs other than the README and the command-line parameter information, so apologies if there's something obvious that I didn't look at. > > I'm also interested in running Jupyterhub as a daemon, so if that's something that's been done before and there's anything I should know, that would be great. There is one other document, other than the README.md and the reported issues [1]: https://github.com/jupyter/jupyterhub/wiki/Using-sudo-to-run-the-server-as-non-root Despite the warning at the top of that page, you can make jupyterhub work on some systems (eg, Linux, such as Ubuntu) using sudo, but not as root. I suspect that this would be the recommended setup when jupyterhub is complete. One recent change is the ability to save/load state from a database. The wiki page above hasn't been updated with the note from this issue: https://github.com/jupyter/jupyterhub/issues/57 It might be easier to start without NGINX, and then add it after you have a working jupyterhub system. It would be nice to have a little bash script to make this a "service" that would support "start", "top", and "status"... but I haven't had time. Currently, we're just becoming the non-root sudoer ("rhea" in the docs) and starting the server, something along the lines: jupyterhub --LocalProcessSpawner.set_user=sudo --JupyterHubApp.ip=165.106.10.83 --JupyterHubApp.port=80 --db='sqlite:///:memory:' &>> /var/log/jupyterhub/log & The next step for us is to get it running under https... looks like others have blazed that trail, so it looks possible. If you have success, it would be great to add to the wiki docs... I suspect that many of us that aren't sys admins will be wanting to get this up and running. -Doug [1] - https://github.com/jupyter/jupyterhub > Any help much appreciated! > > Clare > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141012/9a2c4936/attachment.html> From lucienboillod at gmail.com Mon Oct 13 03:53:53 2014 From: lucienboillod at gmail.com (Lucien Boillod) Date: Mon, 13 Oct 2014 09:53:53 +0200 Subject: [IPython-dev] Wrap Javascript (D3.js) file into IPython Widget In-Reply-To: <CACejjWwY_LFNXsFiLpsRC=YKWVK0LBvQNJ647Wa_Z8xcG4Dhog@mail.gmail.com> References: <EF469EC7-C634-4B7B-B653-380BF5F56DDC@gmail.com> <CACejjWwY_LFNXsFiLpsRC=YKWVK0LBvQNJ647Wa_Z8xcG4Dhog@mail.gmail.com> Message-ID: <C3CE9977-DDF0-430F-AB93-016D666750E5@gmail.com> Really thank you for that ! I?ll explore all the way you gave me, and give you a feedback of my work ! Cheers, Le 11 oct. 2014 ? 20:23, Nicholas Bollweg <nick.bollweg at gmail.com> a ?crit : > You can stick the whole thing in an iframe, and it will work pretty much as it is right now... the crucial bit of magic will be keeping that link between those two documents. Here is a gist with an untested 20% solution: > > https://gist.github.com/bollwyvl/f0ba3e16a5a824d53dc8 > > Now the widget and the d3 stuff will exist in two separate documents, with two different javascript contexts, but from the view you can touch the frame with view.frame... the other direction is trickier, and if you end up needing to do that, just rewrite the whole thing to be outside of a frame :) > You may want to explore some patterns, like http://bost.ocks.org/mike/chart/, to encapsulate the relationship between data/drawing inside the iframe: right now, if a widget were to update > You'll probably want to explore d3.dispatch, so that you can create custom events (like nodeAdd, nodeRemove, etc) that the widget can react to. This may be a cleaner way than trying to "share" data > be careful of force layout changing your data (nodes, links) in-place, adding x, y, px, py, etc. > when a user changes nodes/links form outside the visualization, you'll probably need to do some things to force... but you'll want to run them at the same time. > look at Backbone.Model.changed and Widget.hold_sync to make sure that this happens atomically... or get ready for a lot of svg errors. > All that being said: a well-structured backbone view, which every widget must be, will be more maintainable in the long run. Just having evented get/set on the model, and maybe some custom collections, might be worth the price of admission. > > Good luck! > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141013/b161a17f/attachment.html> From John.Holt at tessella.com Mon Oct 13 07:22:33 2014 From: John.Holt at tessella.com (John.Holt at tessella.com) Date: Mon, 13 Oct 2014 12:22:33 +0100 Subject: [IPython-dev] Jupyter Server Project Startup Message-ID: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> Hi All, I am just starting a project to deploy the IPython Notebook deployed for multiple user access on a virtual cloud. I am writing in the hope that the community can advise me on any issues I am going to face getting this up and running. I am particularly interested in the following: 1) It looks like Jupyter Hub is a good choice for this system. I am aware that is is still in development but have seen some people using it. How stable is it? 2) Has anyone used IPython parallel within JupyterHub? This is a key requirement of my project. I created a sandbox which runs this and although I can use a pre-setup cluster from my notebook, I can not start a new cluster within the notebook. 3) Any other thoughts, tips, tricks or pitfalls I should avoid? Thank you for your time. Cheers, John This message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately. Please note that messages sent or received by the Tessella e-mail system may be monitored and stored in an information retrieval system. From doug.blank at gmail.com Mon Oct 13 07:51:33 2014 From: doug.blank at gmail.com (Doug Blank) Date: Mon, 13 Oct 2014 07:51:33 -0400 Subject: [IPython-dev] Jupyter Server Project Startup In-Reply-To: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> References: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> Message-ID: <CAAusYCit+LgdQgfkquA0Y68axKRnnTXAzWyd5fwMT-ZvV1znVA@mail.gmail.com> On Mon, Oct 13, 2014 at 7:22 AM, <John.Holt at tessella.com> wrote: > Hi All, > > I am just starting a project to deploy the IPython Notebook deployed for > multiple user access on a virtual cloud. I am writing in the hope that the > community can advise me on any issues I am going to face getting this up > and running. I am particularly interested in the following: > > 1) It looks like Jupyter Hub is a good choice for this system. I am > aware that is is still in development but have seen some people using it. > How stable is it? > It is fairly stable. I have a class of students using it daily. I don't update the codebase (ipython and jupyterhub) but once every few weeks: * things can still break in development * there have been some needed bug fixes along the way * the ipython group has been very responsive to keeping master working * it may require you to track down issues and report them (time consuming) * if it is a public-facing server, then it requires sys-admin-level support (account management, security updates, etc) > 2) Has anyone used IPython parallel within JupyterHub? This is a key > requirement of my project. I created a sandbox which runs this and although > I can use a pre-setup cluster from my notebook, I can not start a new > cluster within the notebook. > Yes, I am not using that for the class, but we have been developing 3rd-party kernels that utilize the cluster [1]. Everything works as advertised, although we are just running the cluster as regular processes in the system---nothing fancy (no MPI, remote nodes, etc). > 3) Any other thoughts, tips, tricks or pitfalls I should avoid? > I recommend starting simply, and adding additional variations one at a time. As this is new code, there are many combinations that have not been tested, and thus you may find bugs. Hope that helps! -Doug [1] - https://github.com/blink1073/metakernel > > Thank you for your time. > > Cheers, > > John > This message is commercial in confidence and may be privileged. It is > intended for the > addressee(s) only. Access to this message by anyone else is unauthorized > and strictly prohibited. > If you have received this message in error, please inform the sender > immediately. Please note that > messages sent or received by the Tessella e-mail system may be monitored > and stored in an > information retrieval system. > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141013/a0ce02f2/attachment.html> From lucienboillod at gmail.com Mon Oct 13 11:02:53 2014 From: lucienboillod at gmail.com (Lucien Boillod) Date: Mon, 13 Oct 2014 17:02:53 +0200 Subject: [IPython-dev] Wrap Javascript (D3.js) file into IPython Widget In-Reply-To: <CACejjWwY_LFNXsFiLpsRC=YKWVK0LBvQNJ647Wa_Z8xcG4Dhog@mail.gmail.com> References: <EF469EC7-C634-4B7B-B653-380BF5F56DDC@gmail.com> <CACejjWwY_LFNXsFiLpsRC=YKWVK0LBvQNJ647Wa_Z8xcG4Dhog@mail.gmail.com> Message-ID: <115485A7-8090-4669-806A-6B5D3386DD32@gmail.com> When we load the index.html from the javascript file we use: this.$frame = $("<iframe/>", { src: "index.html" }) Is that mean the index has to be in the same directory as the opened notebook ? because the user can open a notebook from anywhere he want, so in the case it?s not working. Le 11 oct. 2014 ? 20:23, Nicholas Bollweg <nick.bollweg at gmail.com> a ?crit : > You can stick the whole thing in an iframe, and it will work pretty much as it is right now... the crucial bit of magic will be keeping that link between those two documents. Here is a gist with an untested 20% solution: > > https://gist.github.com/bollwyvl/f0ba3e16a5a824d53dc8 > > Now the widget and the d3 stuff will exist in two separate documents, with two different javascript contexts, but from the view you can touch the frame with view.frame... the other direction is trickier, and if you end up needing to do that, just rewrite the whole thing to be outside of a frame :) > You may want to explore some patterns, like http://bost.ocks.org/mike/chart/, to encapsulate the relationship between data/drawing inside the iframe: right now, if a widget were to update > You'll probably want to explore d3.dispatch, so that you can create custom events (like nodeAdd, nodeRemove, etc) that the widget can react to. This may be a cleaner way than trying to "share" data > be careful of force layout changing your data (nodes, links) in-place, adding x, y, px, py, etc. > when a user changes nodes/links form outside the visualization, you'll probably need to do some things to force... but you'll want to run them at the same time. > look at Backbone.Model.changed and Widget.hold_sync to make sure that this happens atomically... or get ready for a lot of svg errors. > All that being said: a well-structured backbone view, which every widget must be, will be more maintainable in the long run. Just having evented get/set on the model, and maybe some custom collections, might be worth the price of admission. > > Good luck! > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141013/618c5ac3/attachment.html> From thomas.j.johnson at gmail.com Mon Oct 13 11:49:30 2014 From: thomas.j.johnson at gmail.com (Thomas Johnson) Date: Mon, 13 Oct 2014 10:49:30 -0500 Subject: [IPython-dev] IPCluster over SSH Message-ID: <CACkSTK=nucnc-9P81rMe6nmG5J05rYBh9CfC9CioYPwoKM+ukA@mail.gmail.com> I'm trying to get started using IPCluster over SSH. I have ssh-agent working, and I can ssh into my remote IP without providing a password from the command line. However, starting ipcluster still prompts for my password, and then strangely claims that the engines started: ---- <SNIP> tjohnson at XXX.XXX.XXX.XXX's password: tjohnson at XXX.XXX.XXX.XXX's password: 2014-10-13 10:42:49.490 [IPClusterStart] Engines appear to have started successfully ---- Should I ignore this password prompt? How can I check if the engines have really started on the remote server? -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141013/b73bd45a/attachment.html> From bblais at gmail.com Mon Oct 13 19:58:48 2014 From: bblais at gmail.com (Brian Blais) Date: Mon, 13 Oct 2014 19:58:48 -0400 Subject: [IPython-dev] proper animation in notebook? Message-ID: <CADzuzGOV4rmqR2UbScr53tV-w1vHD1NQeqBZgywv18SNkL-RcQ@mail.gmail.com> On Sat, Oct 11, 2014 at 4:07 AM, Steve Holden <steve at holdenweb.com> wrote: > I found the following code appeared to work without any issues: > > %matplotlib inline > import numpy as np > import matplotlib.pyplot as plt > > import sys > import time > from IPython.display import display, clear_output > > x=np.linspace(0,6,100) > for t in np.linspace(0,20,100): > clear_output(wait=True) > f=plt.figure(figsize=(10,10)) > plt.plot(np.sin(x)*np.sin(t),'-o') > plt.gca().set_ylim([-1,1]) > display(f) > plt.close() > > Further queries should be sent to the ipython-dev list, as this one is being > phased out. > Running this code makes a working animation, but watching the memory usage of the python2.7 process it is clear there is a memory leak - it starts around 150 M and climbs to 300 M. Running for longer keeps this going. I think the figures are being generated, cleared in the notebook, but still existing somehow in the background. Is there a way to determine if this is happening? Is there a proper way to write the animation to avoid this? thanks, Brian Blais ----------------- bblais at gmail.com http://web.bryant.edu/~bblais From bussonniermatthias at gmail.com Tue Oct 14 03:19:17 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Tue, 14 Oct 2014 09:19:17 +0200 Subject: [IPython-dev] Jupyter Server Project Startup In-Reply-To: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> References: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> Message-ID: <D82CC565-A8A2-4122-B0B0-90223618873A@gmail.com> Hi, You already had some comments from Doug, so I'll stay brief. Le 13 oct. 2014 ? 13:22, John.Holt at tessella.com a ?crit : > Hi All, > > I am just starting a project to deploy the IPython Notebook deployed for multiple user access on a virtual cloud. I am writing in the hope that the community can advise me on any issues I am going to face getting this up and running. I am particularly interested in the following: > > 1) It looks like Jupyter Hub is a good choice for this system. I am aware that is is still in development but have seen some people using it. How stable is it ? It is working pretty well, keep in mind that the scope of jupyterhub itself is extremely limited, so most of the further improvement would be mostly cleanig up, visual design ?etc. Most of the work will be done in Auth Plugin and Spawners. > 2) Has anyone used IPython parallel within JupyterHub? This is a key requirement of my project. I created a sandbox which runs this and although I can use a pre-setup cluster from my notebook, I can not start a new cluster within the notebook. JupyterHub Should not change anything on what you can do with IPython notebook. If you can do it with current setup, then you should be able to do it with jupyterhub. > 3) Any other thoughts, tips, tricks or pitfalls I should avoid? Avoid Windows, not supported [1]. -- M [1] But maybe one day. Probably not from us. > > Thank you for your time. > > Cheers, > > John > This message is commercial in confidence and may be privileged. It is intended for the > addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. > If you have received this message in error, please inform the sender immediately. Please note that > messages sent or received by the Tessella e-mail system may be monitored and stored in an > information retrieval system. > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From wes.turner at gmail.com Tue Oct 14 03:39:03 2014 From: wes.turner at gmail.com (Wes Turner) Date: Tue, 14 Oct 2014 02:39:03 -0500 Subject: [IPython-dev] Wrap Javascript (D3.js) file into IPython Widget In-Reply-To: <EF469EC7-C634-4B7B-B653-380BF5F56DDC@gmail.com> References: <EF469EC7-C634-4B7B-B653-380BF5F56DDC@gmail.com> Message-ID: <CACfEFw8a5ZE=oY4SXriSaNdPdrksD0ENf_efTJ-VhYFq1MCn-Q@mail.gmail.com> You should be able to implement an object with a _repr_html_ method that generates the HTML you'd like to include into the page. e.g.: https://github.com/Psycojoker/ipython-beautifulsoup/blob/master/soup.py#L93 If your CSS clashes with the IPython notebook CSS, an IFrame may be the better option. (see: https://github.com/Psycojoker/ipython-beautifulsoup/issues/2 for an explanation of the security implications) IPython documentation: * http://ipython.org/ipython-doc/dev/config/integrating.html#rich-display * http://nbviewer.ipython.org/github/ipython/ipython/blob/1.x/examples/notebooks/Part%205%20-%20Rich%20Display%20System.ipynb On Sat, Oct 11, 2014 at 8:23 AM, Lucien Boillod <lucienboillod at gmail.com> wrote: > Hi all, > > I currently work with d3.js ans I almost finished (fidd here: > http://jsfiddle.net/mv9L7hjq/15/), but now I have to include this part into > the project (https://www.lrde.epita.fr/wiki/Vaucanson), so basically we use > IPython notebook for the graphical user interface, and what we would like to > do is simply wrap my work on D3 into a IPython widget, so that we can > display it when we need it. > I have made some research about IPython widget using Javascript but all I > found is something like that > (http://nbviewer.ipython.org/github/ipython/ipython/blob/master/examples/Interactive%20Widgets/Custom%20Widget%20-%20Hello%20World.ipynb) > But clearly I don?t want to rewrite the whole javascript file, but just load > it and wrap both (HTML/CSS/JS) into a widget. I wonder if there is a way to > do that ? > > Thank you, > > Cheers, > > LB > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Wes Turner https://westurner.github.io/ From wes.turner at gmail.com Tue Oct 14 03:42:11 2014 From: wes.turner at gmail.com (Wes Turner) Date: Tue, 14 Oct 2014 02:42:11 -0500 Subject: [IPython-dev] Wrap Javascript (D3.js) file into IPython Widget In-Reply-To: <CACfEFw8a5ZE=oY4SXriSaNdPdrksD0ENf_efTJ-VhYFq1MCn-Q@mail.gmail.com> References: <EF469EC7-C634-4B7B-B653-380BF5F56DDC@gmail.com> <CACfEFw8a5ZE=oY4SXriSaNdPdrksD0ENf_efTJ-VhYFq1MCn-Q@mail.gmail.com> Message-ID: <CACfEFw8C=5YdgujEOrTdgGsZFqfVqEMt+8yDw95MFOb7NSH-5A@mail.gmail.com> There are a number of implementations of d3 with varying levels of interactivity and integration with IPython. This presentation summarizes quite a few: https://mlunacek.github.io/meetup_d3_2014/#8 On Tue, Oct 14, 2014 at 2:39 AM, Wes Turner <wes.turner at gmail.com> wrote: > You should be able to implement an object with a _repr_html_ method > that generates the HTML you'd like to include into the page. > > e.g.: https://github.com/Psycojoker/ipython-beautifulsoup/blob/master/soup.py#L93 > > If your CSS clashes with the IPython notebook CSS, an IFrame may be > the better option. (see: > https://github.com/Psycojoker/ipython-beautifulsoup/issues/2 for an > explanation of the security implications) > > IPython documentation: > > * http://ipython.org/ipython-doc/dev/config/integrating.html#rich-display > * http://nbviewer.ipython.org/github/ipython/ipython/blob/1.x/examples/notebooks/Part%205%20-%20Rich%20Display%20System.ipynb > > On Sat, Oct 11, 2014 at 8:23 AM, Lucien Boillod <lucienboillod at gmail.com> wrote: >> Hi all, >> >> I currently work with d3.js ans I almost finished (fidd here: >> http://jsfiddle.net/mv9L7hjq/15/), but now I have to include this part into >> the project (https://www.lrde.epita.fr/wiki/Vaucanson), so basically we use >> IPython notebook for the graphical user interface, and what we would like to >> do is simply wrap my work on D3 into a IPython widget, so that we can >> display it when we need it. >> I have made some research about IPython widget using Javascript but all I >> found is something like that >> (http://nbviewer.ipython.org/github/ipython/ipython/blob/master/examples/Interactive%20Widgets/Custom%20Widget%20-%20Hello%20World.ipynb) >> But clearly I don?t want to rewrite the whole javascript file, but just load >> it and wrap both (HTML/CSS/JS) into a widget. I wonder if there is a way to >> do that ? >> >> Thank you, >> >> Cheers, >> >> LB >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > > -- > Wes Turner > https://westurner.github.io/ -- Wes Turner https://westurner.github.io/ From zvoros at gmail.com Tue Oct 14 03:46:15 2014 From: zvoros at gmail.com (=?UTF-8?B?Wm9sdMOhbiBWw7Zyw7Zz?=) Date: Tue, 14 Oct 2014 09:46:15 +0200 Subject: [IPython-dev] newest development version serves no notebooks Message-ID: <543CD4C7.1040501@gmail.com> Hi all, I have just pulled the latest version from github master, and it seems to me that notebooks are not served any more. When I try to open an existing notebook, I end up with a blank page. The same thing happens, if I create a new notebook on the dashboard. The notebook is created on disc, and as far as I see, it is a valid notebook, yet, in the browser, none of the components (toolbar, header, etc.) is loaded, and the first input cell is not even inserted. I started ipython from the command line with > BROWSER=google-chrome-stable ipython notebook and here is my output: v923z at tux:~$ [I 141014 09:28:42 application:307] Using existing profile dir: u'/home/v923z/.ipython/profile_default' [I 141014 09:28:42 notebookapp:562] Serving local MathJax from /home/v923z/.ipython/profile_default/static/mathjax/MathJax.js at /static/mathjax/MathJax.js [I 141014 09:28:42 notebookapp:902] Serving notebooks from local directory: /home/v923z/papers/notes [I 141014 09:28:42 notebookapp:902] 0 active kernels [I 141014 09:28:42 notebookapp:902] The IPython Notebook is running at: http://localhost:8888/ [I 141014 09:28:42 notebookapp:903] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation). ATTENTION: default value of option force_s3tc_enable overridden by environment. [4393:4393:1014/092843:ERROR:sandbox_linux.cc(305)] InitializeSandbox() called with multiple threads in process gpu-process [4355:4355:1014/092843:ERROR:desktop_window_tree_host_x11.cc(1547)] Not implemented reached in void views::DesktopWindowTreeHostX11::MapWindow(ui::WindowShowState) [I 141014 09:28:47 handlers:114] Creating new file in / [I 141014 09:29:30 handlers:114] Creating new file in / [I 141014 09:30:32 handlers:114] Creating new file in / [4355:4355:1014/093036:ERROR:navigation_entry_screenshot_manager.cc(163)] Invalid entry with unique id: 15 [4355:4355:1014/093043:ERROR:navigation_entry_screenshot_manager.cc(163)] Invalid entry with unique id: 16 "Creating new file" refers to the moments when I pressed "New notebook" in the dashboard, while the last two error messages were generated when I tried to navigate to the address of the notebook in firefox. Is there a reason why the kernel should not be started? In the dashboard, no kernels are listed as running. (command line ipython seems to be OK.) Oh, and I want to make clear that I cleared the cache of the browser:) Is there something that I might have missed, or that I could use to track down the problem? Thanks, Zolt?n From wes.turner at gmail.com Tue Oct 14 03:52:48 2014 From: wes.turner at gmail.com (Wes Turner) Date: Tue, 14 Oct 2014 02:52:48 -0500 Subject: [IPython-dev] Jupyter Server Project Startup In-Reply-To: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> References: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> Message-ID: <CACfEFw_Z4zpSEaoO6FR6N5chpChKj=GFqjaEap=ShKTYCQKn5A@mail.gmail.com> Two additional questions: * Are there any Puppet/Salt/Ansible scripts for JupyterHub? * Is there a Vagrant VM / Docker Image for JupyterServer (with some sort of documentation for how to update)? Links: * https://github.com/jupyter/jupyterhub * http://datasciencetoolbox.org/ * https://github.com/DataScienceToolbox/data-science-toolbox/tree/master/bundles * https://registry.hub.docker.com/repos/ipython/ * https://registry.hub.docker.com/u/ipython/scipyserver/ On Mon, Oct 13, 2014 at 6:22 AM, <John.Holt at tessella.com> wrote: > Hi All, > > I am just starting a project to deploy the IPython Notebook deployed for multiple user access on a virtual cloud. I am writing in the hope that the community can advise me on any issues I am going to face getting this up and running. I am particularly interested in the following: > > 1) It looks like Jupyter Hub is a good choice for this system. I am aware that is is still in development but have seen some people using it. How stable is it? > 2) Has anyone used IPython parallel within JupyterHub? This is a key requirement of my project. I created a sandbox which runs this and although I can use a pre-setup cluster from my notebook, I can not start a new cluster within the notebook. > 3) Any other thoughts, tips, tricks or pitfalls I should avoid? > > Thank you for your time. > > Cheers, > > John > This message is commercial in confidence and may be privileged. It is intended for the > addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. > If you have received this message in error, please inform the sender immediately. Please note that > messages sent or received by the Tessella e-mail system may be monitored and stored in an > information retrieval system. > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Wes Turner https://westurner.github.io/ From bussonniermatthias at gmail.com Tue Oct 14 03:54:49 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Tue, 14 Oct 2014 09:54:49 +0200 Subject: [IPython-dev] newest development version serves no notebooks In-Reply-To: <543CD4C7.1040501@gmail.com> References: <543CD4C7.1040501@gmail.com> Message-ID: <7D4FF459-A9E5-4081-B9F2-79236168A886@gmail.com> Le 14 oct. 2014 ? 09:46, Zolt?n V?r?s a ?crit : > Hi all, > > I have just pulled the latest version from github master, and it seems > to me that notebooks are not served any more. When I try to open an > existing notebook, I end up with a blank page. The same thing happens, > if I create a new notebook on the dashboard. The notebook is created on > disc, and as far as I see, it is a valid notebook, yet, in the browser, > none of the components (toolbar, header, etc.) is loaded, and the first > input cell is not even inserted. I started ipython from the command line > with Shot in the dark, we recently update the component-repo to code mirror 4 can you try updating the submodule ? $ python setup.py submodule should do the trick. Let me know if this works. -- M >> BROWSER=google-chrome-stable ipython notebook > > and here is my output: > > > v923z at tux:~$ [I 141014 09:28:42 application:307] Using existing profile > dir: u'/home/v923z/.ipython/profile_default' > [I 141014 09:28:42 notebookapp:562] Serving local MathJax from > /home/v923z/.ipython/profile_default/static/mathjax/MathJax.js at > /static/mathjax/MathJax.js > [I 141014 09:28:42 notebookapp:902] Serving notebooks from local > directory: /home/v923z/papers/notes > [I 141014 09:28:42 notebookapp:902] 0 active kernels > [I 141014 09:28:42 notebookapp:902] The IPython Notebook is running at: > http://localhost:8888/ > [I 141014 09:28:42 notebookapp:903] Use Control-C to stop this server > and shut down all kernels (twice to skip confirmation). > ATTENTION: default value of option force_s3tc_enable overridden by > environment. > [4393:4393:1014/092843:ERROR:sandbox_linux.cc(305)] InitializeSandbox() > called with multiple threads in process gpu-process > [4355:4355:1014/092843:ERROR:desktop_window_tree_host_x11.cc(1547)] Not > implemented reached in void > views::DesktopWindowTreeHostX11::MapWindow(ui::WindowShowState) > [I 141014 09:28:47 handlers:114] Creating new file in / > [I 141014 09:29:30 handlers:114] Creating new file in / > [I 141014 09:30:32 handlers:114] Creating new file in / > [4355:4355:1014/093036:ERROR:navigation_entry_screenshot_manager.cc(163)] Invalid > entry with unique id: 15 > [4355:4355:1014/093043:ERROR:navigation_entry_screenshot_manager.cc(163)] Invalid > entry with unique id: 16 > > "Creating new file" refers to the moments when I pressed "New notebook" > in the dashboard, while the last two error messages were generated when > I tried to navigate to the address of the notebook in firefox. Is there > a reason why the kernel should not be started? In the dashboard, no > kernels are listed as running. (command line ipython seems to be OK.) > Oh, and I want to make clear that I cleared the cache of the browser:) > > Is there something that I might have missed, or that I could use to > track down the problem? > > Thanks, > > Zolt?n > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From bussonniermatthias at gmail.com Tue Oct 14 03:57:43 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Tue, 14 Oct 2014 09:57:43 +0200 Subject: [IPython-dev] Jupyter Server Project Startup In-Reply-To: <CACfEFw_Z4zpSEaoO6FR6N5chpChKj=GFqjaEap=ShKTYCQKn5A@mail.gmail.com> References: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> <CACfEFw_Z4zpSEaoO6FR6N5chpChKj=GFqjaEap=ShKTYCQKn5A@mail.gmail.com> Message-ID: <CA79A852-2E91-4B1E-985D-41CC737530B7@gmail.com> Le 14 oct. 2014 ? 09:52, Wes Turner a ?crit : > Two additional questions: > > * Are there any Puppet/Salt/Ansible scripts for JupyterHub? Not that I know of. Maybe Kyle knows. > * Is there a Vagrant VM / Docker Image for JupyterServer (with some > sort of documentation for how to update)? https://registry.hub.docker.com/repos/jupyter/ Seem to have what you ask for. (Thanks Kyle for that.) -- M > > Links: > > * https://github.com/jupyter/jupyterhub > > * http://datasciencetoolbox.org/ > * https://github.com/DataScienceToolbox/data-science-toolbox/tree/master/bundles > > * https://registry.hub.docker.com/repos/ipython/ > * https://registry.hub.docker.com/u/ipython/scipyserver/ > > > On Mon, Oct 13, 2014 at 6:22 AM, <John.Holt at tessella.com> wrote: >> Hi All, >> >> I am just starting a project to deploy the IPython Notebook deployed for multiple user access on a virtual cloud. I am writing in the hope that the community can advise me on any issues I am going to face getting this up and running. I am particularly interested in the following: >> >> 1) It looks like Jupyter Hub is a good choice for this system. I am aware that is is still in development but have seen some people using it. How stable is it? >> 2) Has anyone used IPython parallel within JupyterHub? This is a key requirement of my project. I created a sandbox which runs this and although I can use a pre-setup cluster from my notebook, I can not start a new cluster within the notebook. >> 3) Any other thoughts, tips, tricks or pitfalls I should avoid? >> >> Thank you for your time. >> >> Cheers, >> >> John >> This message is commercial in confidence and may be privileged. It is intended for the >> addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. >> If you have received this message in error, please inform the sender immediately. Please note that >> messages sent or received by the Tessella e-mail system may be monitored and stored in an >> information retrieval system. >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > -- > Wes Turner > https://westurner.github.io/ > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141014/6eb2ae14/attachment.html> From wes.turner at gmail.com Tue Oct 14 03:59:21 2014 From: wes.turner at gmail.com (Wes Turner) Date: Tue, 14 Oct 2014 02:59:21 -0500 Subject: [IPython-dev] Jupyter Server Project Startup In-Reply-To: <CA79A852-2E91-4B1E-985D-41CC737530B7@gmail.com> References: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> <CACfEFw_Z4zpSEaoO6FR6N5chpChKj=GFqjaEap=ShKTYCQKn5A@mail.gmail.com> <CA79A852-2E91-4B1E-985D-41CC737530B7@gmail.com> Message-ID: <CACfEFw-L-XTyBPouzDB4N-Kmf_kjKrnNisGx+yW4XGU19AZstg@mail.gmail.com> > https://registry.hub.docker.com/repos/jupyter/ > > Seem to have what you ask for. (Thanks Kyle for that.) Thanks! On Tue, Oct 14, 2014 at 2:57 AM, Matthias BUSSONNIER <bussonniermatthias at gmail.com> wrote: > > Le 14 oct. 2014 ? 09:52, Wes Turner a ?crit : > > Two additional questions: > > * Are there any Puppet/Salt/Ansible scripts for JupyterHub? > > > Not that I know of. Maybe Kyle knows. > > * Is there a Vagrant VM / Docker Image for JupyterServer (with some > sort of documentation for how to update)? > > > https://registry.hub.docker.com/repos/jupyter/ > > Seem to have what you ask for. (Thanks Kyle for that.) > -- > M > > > Links: > > * https://github.com/jupyter/jupyterhub > > * http://datasciencetoolbox.org/ > * > https://github.com/DataScienceToolbox/data-science-toolbox/tree/master/bundles > > * https://registry.hub.docker.com/repos/ipython/ > * https://registry.hub.docker.com/u/ipython/scipyserver/ > > > On Mon, Oct 13, 2014 at 6:22 AM, <John.Holt at tessella.com> wrote: > > Hi All, > > > I am just starting a project to deploy the IPython Notebook deployed for > multiple user access on a virtual cloud. I am writing in the hope that the > community can advise me on any issues I am going to face getting this up and > running. I am particularly interested in the following: > > > 1) It looks like Jupyter Hub is a good choice for this system. I am aware > that is is still in development but have seen some people using it. How > stable is it? > > 2) Has anyone used IPython parallel within JupyterHub? This is a key > requirement of my project. I created a sandbox which runs this and although > I can use a pre-setup cluster from my notebook, I can not start a new > cluster within the notebook. > > 3) Any other thoughts, tips, tricks or pitfalls I should avoid? > > > Thank you for your time. > > > Cheers, > > > John > > This message is commercial in confidence and may be privileged. It is > intended for the > > addressee(s) only. Access to this message by anyone else is unauthorized > and strictly prohibited. > > If you have received this message in error, please inform the sender > immediately. Please note that > > messages sent or received by the Tessella e-mail system may be monitored and > stored in an > > information retrieval system. > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > -- > Wes Turner > https://westurner.github.io/ > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Wes Turner https://westurner.github.io/ From zvoros at gmail.com Tue Oct 14 04:04:31 2014 From: zvoros at gmail.com (=?windows-1252?Q?Zolt=E1n_V=F6r=F6s?=) Date: Tue, 14 Oct 2014 10:04:31 +0200 Subject: [IPython-dev] newest development version serves no notebooks In-Reply-To: <7D4FF459-A9E5-4081-B9F2-79236168A886@gmail.com> References: <543CD4C7.1040501@gmail.com> <7D4FF459-A9E5-4081-B9F2-79236168A886@gmail.com> Message-ID: <543CD90F.9020609@gmail.com> Hi Matthias, On 10/14/2014 09:54 AM, Matthias BUSSONNIER wrote: > Le 14 oct. 2014 ? 09:46, Zolt?n V?r?s a ?crit : > >> Hi all, >> >> I have just pulled the latest version from github master, and it seems >> to me that notebooks are not served any more. When I try to open an >> existing notebook, I end up with a blank page. The same thing happens, >> if I create a new notebook on the dashboard. The notebook is created on >> disc, and as far as I see, it is a valid notebook, yet, in the browser, >> none of the components (toolbar, header, etc.) is loaded, and the first >> input cell is not even inserted. I started ipython from the command line >> with > > Shot in the dark, we recently update the component-repo to code mirror 4 > can you try updating the submodule ? > > $ python setup.py submodule > > should do the trick. > > Let me know if this works. Yes, indeed. That was the problem. Many thanks for the prompt help! Cheers, Zolt?n From bussonniermatthias at gmail.com Tue Oct 14 04:31:39 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Tue, 14 Oct 2014 10:31:39 +0200 Subject: [IPython-dev] newest development version serves no notebooks In-Reply-To: <543CD90F.9020609@gmail.com> References: <543CD4C7.1040501@gmail.com> <7D4FF459-A9E5-4081-B9F2-79236168A886@gmail.com> <543CD90F.9020609@gmail.com> Message-ID: <97D2D668-DB7C-4BB3-8DCE-2B27658C9EC5@gmail.com> Le 14 oct. 2014 ? 10:04, Zolt?n V?r?s a ?crit : > Hi Matthias, > > > On 10/14/2014 09:54 AM, Matthias BUSSONNIER wrote: >> Le 14 oct. 2014 ? 09:46, Zolt?n V?r?s a ?crit : >> >>> Hi all, >>> >>> I have just pulled the latest version from github master, and it seems >>> to me that notebooks are not served any more. When I try to open an >>> existing notebook, I end up with a blank page. The same thing happens, >>> if I create a new notebook on the dashboard. The notebook is created on >>> disc, and as far as I see, it is a valid notebook, yet, in the browser, >>> none of the components (toolbar, header, etc.) is loaded, and the first >>> input cell is not even inserted. I started ipython from the command line >>> with >> >> Shot in the dark, we recently update the component-repo to code mirror 4 >> can you try updating the submodule ? >> >> $ python setup.py submodule >> >> should do the trick. >> >> Let me know if this works. > > > Yes, indeed. That was the problem. Many thanks for the prompt help! Hopefully that'll soon be my job :-) Note that there are git hooks ($ sh git-hooks/install-hooks.sh ) that should avoid for the problem to appear again. -- M > > Cheers, > Zolt?n > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From rgbkrk at gmail.com Tue Oct 14 07:39:27 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Tue, 14 Oct 2014 04:39:27 -0700 Subject: [IPython-dev] Jupyter Server Project Startup In-Reply-To: <CACfEFw-L-XTyBPouzDB4N-Kmf_kjKrnNisGx+yW4XGU19AZstg@mail.gmail.com> References: <OF92B718BA.359A89F8-ON80257D70.003E7D9B-80257D70.003E7D9D@tessella.co.uk> <CACfEFw_Z4zpSEaoO6FR6N5chpChKj=GFqjaEap=ShKTYCQKn5A@mail.gmail.com> <CA79A852-2E91-4B1E-985D-41CC737530B7@gmail.com> <CACfEFw-L-XTyBPouzDB4N-Kmf_kjKrnNisGx+yW4XGU19AZstg@mail.gmail.com> Message-ID: <CA+tbMaVDRqMmKR=qw9Sr8m1zp0xLWC1KuFkRYCej6CLxWzhRww@mail.gmail.com> Well, thank Min too! As for config management scripts, none exist currently. Feel free to write them and link here! On Tuesday, October 14, 2014, Wes Turner <wes.turner at gmail.com> wrote: > > https://registry.hub.docker.com/repos/jupyter/ > > > > Seem to have what you ask for. (Thanks Kyle for that.) > > Thanks! > > On Tue, Oct 14, 2014 at 2:57 AM, Matthias BUSSONNIER > <bussonniermatthias at gmail.com <javascript:;>> wrote: > > > > Le 14 oct. 2014 ? 09:52, Wes Turner a ?crit : > > > > Two additional questions: > > > > * Are there any Puppet/Salt/Ansible scripts for JupyterHub? > > > > > > Not that I know of. Maybe Kyle knows. > > > > * Is there a Vagrant VM / Docker Image for JupyterServer (with some > > sort of documentation for how to update)? > > > > > > https://registry.hub.docker.com/repos/jupyter/ > > > > Seem to have what you ask for. (Thanks Kyle for that.) > > -- > > M > > > > > > Links: > > > > * https://github.com/jupyter/jupyterhub > > > > * http://datasciencetoolbox.org/ > > * > > > https://github.com/DataScienceToolbox/data-science-toolbox/tree/master/bundles > > > > * https://registry.hub.docker.com/repos/ipython/ > > * https://registry.hub.docker.com/u/ipython/scipyserver/ > > > > > > On Mon, Oct 13, 2014 at 6:22 AM, <John.Holt at tessella.com <javascript:;>> > wrote: > > > > Hi All, > > > > > > I am just starting a project to deploy the IPython Notebook deployed for > > multiple user access on a virtual cloud. I am writing in the hope that > the > > community can advise me on any issues I am going to face getting this up > and > > running. I am particularly interested in the following: > > > > > > 1) It looks like Jupyter Hub is a good choice for this system. I am > aware > > that is is still in development but have seen some people using it. How > > stable is it? > > > > 2) Has anyone used IPython parallel within JupyterHub? This is a key > > requirement of my project. I created a sandbox which runs this and > although > > I can use a pre-setup cluster from my notebook, I can not start a new > > cluster within the notebook. > > > > 3) Any other thoughts, tips, tricks or pitfalls I should avoid? > > > > > > Thank you for your time. > > > > > > Cheers, > > > > > > John > > > > This message is commercial in confidence and may be privileged. It is > > intended for the > > > > addressee(s) only. Access to this message by anyone else is unauthorized > > and strictly prohibited. > > > > If you have received this message in error, please inform the sender > > immediately. Please note that > > > > messages sent or received by the Tessella e-mail system may be monitored > and > > stored in an > > > > information retrieval system. > > > > > > > > _______________________________________________ > > > > IPython-dev mailing list > > > > IPython-dev at scipy.org <javascript:;> > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > -- > > Wes Turner > > https://westurner.github.io/ > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org <javascript:;> > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org <javascript:;> > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Wes Turner > https://westurner.github.io/ > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org <javascript:;> > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141014/a06c4293/attachment.html> From takowl at gmail.com Tue Oct 14 19:15:27 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Tue, 14 Oct 2014 16:15:27 -0700 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qgmgLe0EdQpnMNiXnR1_QBvHze547G3DvLX1VPWS9Y5Ug@mail.gmail.com> References: <54373D3F.8020108@alumni.uwaterloo.ca> <CAOvn4qgmgLe0EdQpnMNiXnR1_QBvHze547G3DvLX1VPWS9Y5Ug@mail.gmail.com> Message-ID: <CAOvn4qhQkGxmyCYqQyAs+Z6Yh8Zqj2ZZcnjZPaub1ppDLDjb8A@mail.gmail.com> Min & I discussed this over lunch today. We think that the way to get the best of both worlds in form definition is to base the parameters on the first cell, but supplement them with optional notebook metadata. This will: - Make the easy cases easy: You can make a basic form from a notebook without needing to fiddle with metadata. - Make the hard cases possible: The notebook metadata can be used to provide extra information for all kinds of applications: display names for fields, options for multiple-choice parameters, abbreviations for command line arguments, and so forth. - Ensure that the notebook can be run without needing the form interface. We feel this is important, because part of the attraction of notebooks is that it's easy to run your code and see if you've made a mistake, and you lose that if your code relies on parameters that have to be set by machinery outside the notebook. I have just updated nbparameterise to do this. The example application uses a display_name field from the metadata to display something nicer than the variable name as the label for the form field. The API exposes arbitrary metadata associated with the parameter, from metadata.parameterise.<variable name> Thomas On 10 October 2014 11:02, Thomas Kluyver <takowl at gmail.com> wrote: > Thanks Ian - conda-launch was one of a few projects that prompted me to > work on this. In particular, great though conda is, I don't think creating > forms and executing notebooks should be tied to a particular packaging > system. > > Looking through the description of conda-launch, I think what I want to > think about most is the different ways of describing the input parameters. > Conda-launch uses JSON metadata that is potentially more flexible, but very > distinct from the normal workflow of writing a notebook. Nbparameterise > currently looks for an initial "definitions cell", which is less > extensible, but very natural for the notebook author. Part of me wants to > generalise nbparameterise to handle all possible ways of describing inputs, > but another part of me wants to hammer out a common way of doing this, so > notebook authors don't have to learn different things for different > systems. I'll keep thinking about it. > > Best wishes, > Thomas > > On 9 October 2014 18:58, Ian Stokes-Rees <ijstokes at alumni.uwaterloo.ca> > wrote: > >> FWIW, We (at Continuum) have done some work on something similar, >> loosely tied to conda: >> >> https://github.com/conda/conda-launch >> >> It supports 3 modes: >> >> 1. CLI invocation of a notebook >> 2. auto-generated web-form of a notebook >> 3. RESTful API with URL (GET) or POST-encoded arguments >> >> It doesn't require any customization of IPython, and the parameterization >> can either be in the notebook meta-data, or "inline" if the last cell is a >> "raw" cell with the appropriate JSON. >> >> The parameterization meta-data can also include a set of dependencies, in >> which case a custom conda-environment will be created in which the notebook >> will be run. The goal is to be able to generate notebook output (HTML, >> data file, figures, return specific serialized references) with no retained >> state or persisted processes, basically a notebook-based CGI python script. >> >> It runs reasonably well right now, but the input form styling is pants >> (my CSS skills stink!). >> >> I haven't had time to read the thread on nbparameterize, but look forward >> to exploring it next week. Perhaps the two efforts can be merged. >> >> Regards, >> >> Ian >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141014/e7018115/attachment.html> From ijstokes at alumni.uwaterloo.ca Wed Oct 15 10:23:52 2014 From: ijstokes at alumni.uwaterloo.ca (Ian Stokes-Rees) Date: Wed, 15 Oct 2014 10:23:52 -0400 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qgmgLe0EdQpnMNiXnR1_QBvHze547G3DvLX1VPWS9Y5Ug@mail.gmail.com> References: <54373D3F.8020108@alumni.uwaterloo.ca> <CAOvn4qgmgLe0EdQpnMNiXnR1_QBvHze547G3DvLX1VPWS9Y5Ug@mail.gmail.com> Message-ID: <543E8378.2020305@alumni.uwaterloo.ca> Thomas, out of order response: On 10/10/14, 2:02 PM, Thomas Kluyver wrote: > Looking through the description of conda-launch, I think what I want > to think about most is the different ways of describing the input > parameters. Conda-launch uses JSON metadata that is potentially more > flexible, but very distinct from the normal workflow of writing a > notebook. Nbparameterise currently looks for an initial "definitions > cell", which is less extensible, but very natural for the notebook > author. Part of me wants to generalise nbparameterise to handle all > possible ways of describing inputs, but another part of me wants to > hammer out a common way of doing this, so notebook authors don't have > to learn different things for different systems. I'll keep thinking > about it. My idea is that the notebook should be stand-alone runable (i.e. "play" button in IPython Notebook), so the first cell contains "prototype" or "example" inputs for all the parameters. This acts as "template based documentation" for what the parameters are, and also means it is possible to "run" a notebook without providing any inputs. A feature I'd like to add is some piece of meta-data that can override this behavior to encode the "defaults" (or no defaults) into the meta-data, thus making the "first cell prototype" optional. > Thanks Ian - conda-launch was one of a few projects that prompted me > to work on this. In particular, great though conda is, I don't think > creating forms and executing notebooks should be tied to a particular > packaging system. It isn't. Go ahead and "python setup.py install" it. The only piece that will silently not work is the dependency specification part to create a conda environment to execute the notebook in. The commands are called "conda-appserver" (to start a server that will 'serve' notebooks as HTML forms and expose the RESTful API, and then return the rendered result from 'running' them), and "conda-launch" which is the pure-CLI version. Alias those to some other name if you don't like "conda" in the command name. You don't need conda installed. Ian -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141015/470c2de7/attachment.html> From ijstokes at alumni.uwaterloo.ca Wed Oct 15 10:26:01 2014 From: ijstokes at alumni.uwaterloo.ca (Ian Stokes-Rees) Date: Wed, 15 Oct 2014 10:26:01 -0400 Subject: [IPython-dev] Nbparameterise: simple forms for notebook input In-Reply-To: <CAOvn4qhQkGxmyCYqQyAs+Z6Yh8Zqj2ZZcnjZPaub1ppDLDjb8A@mail.gmail.com> References: <54373D3F.8020108@alumni.uwaterloo.ca> <CAOvn4qgmgLe0EdQpnMNiXnR1_QBvHze547G3DvLX1VPWS9Y5Ug@mail.gmail.com> <CAOvn4qhQkGxmyCYqQyAs+Z6Yh8Zqj2ZZcnjZPaub1ppDLDjb8A@mail.gmail.com> Message-ID: <543E83F9.5010406@alumni.uwaterloo.ca> On 10/14/14, 7:15 PM, Thomas Kluyver wrote: > Min & I discussed this over lunch today. We think that the way to get > the best of both worlds in form definition is to base the parameters > on the first cell, but supplement them with optional notebook > metadata. This will: > > - Make the easy cases easy: You can make a basic form from a notebook > without needing to fiddle with metadata. > - Make the hard cases possible: The notebook metadata can be used to > provide extra information for all kinds of applications: display names > for fields, options for multiple-choice parameters, abbreviations for > command line arguments, and so forth. > - Ensure that the notebook can be run without needing the form > interface. We feel this is important, because part of the attraction > of notebooks is that it's easy to run your code and see if you've made > a mistake, and you lose that if your code relies on parameters that > have to be set by machinery outside the notebook. Yes, I totally agree on all three of these points. "conda-launch" (you'll notice that is only the GH repo name: the actual Python module is called "ipyapp") aims to do exactly that, and provide full CLI-based or RESTful API for notebook invocation. > I have just updated nbparameterise to do this. The example application > uses a display_name field from the metadata to display something nicer > than the variable name as the label for the form field. The API > exposes arbitrary metadata associated with the parameter, from > metadata.parameterise.<variable name> Great. I look forward to exploring that. Regards, Ian -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141015/db10089a/attachment.html> From akim at lrde.epita.fr Thu Oct 16 10:42:53 2014 From: akim at lrde.epita.fr (Akim Demaille) Date: Thu, 16 Oct 2014 16:42:53 +0200 Subject: [IPython-dev] Absolute Path IPython In-Reply-To: <11EA3DEB-3971-4756-9ED7-824CC9F22EF9@gmail.com> References: <519350F2-4448-4DA5-85E3-B39207422A1C@gmail.com> <D535725D-F95F-4440-8D17-641F1BA22F05@gmail.com> <F77111DF-0AB0-4991-99FD-18CDF0F33130@gmail.com> <8CD68300-E810-4E96-92BA-EDD611BB9C32@gmail.com> <8963E105-A69C-45B9-BB87-19D0902A0155@lrde.epita.fr> <11EA3DEB-3971-4756-9ED7-824CC9F22EF9@gmail.com> Message-ID: <44FD56F4-48B9-459A-88E7-3BBAB3AAC625@lrde.epita.fr> Le 23 sept. 2014 ? 14:25, Matthias Bussonnier <bussonniermatthias at gmail.com> a ?crit : > Hi, Hi Matthias, Hi all, The context was: our documentation, written in IPython notebooks (see http://nbviewer.ipython.org/urls/www.lrde.epita.fr/dload/vaucanson/2.0/notebooks/index.ipynb), is installed on the user's machine as IPython notebooks. I wanted to be able to open these ipynb on request from the user so that she could read the documentation inline in her working notebook, but it was reported that this won't work, by design, for safety reasons. You suggested to open a static HTML page instead. >> This is possible, indeed. Which means that we should also install >> the html rendering. Why not, after all. > > I was referring in using the IPython display machinery to show a ilk to the user, and this link could open another tab. > Yo could even use js to trigger the opening of this tab. > > If you look at what Julia is doing, their "info methods" for "objects" do return html with direct link to github source code. > As you know the hash of the current version of the project, you can directly link to a rendered version. Which also avoid to build the doc locally, but I won't go into the debatee of having or not local build of docs. > One thing I can see you doing, is if you can export to html fragments, is having > doc('somehting') just return a IPython.display.HTML object with the content of the doc. > This would allow to see doc in the notebook. Well, I went ahead and now I also install the HTML rendering of these notebooks. However the (outer) notebook goes nut when I try to read one of the html I created myself, while it seems to be happy with the same file, but served by nbviewer. In clear, with: from IPython.display import HTML HTML("http://nbviewer.ipython.org/urls/www.lrde.epita.fr/dload/vaucanson/2.0/notebooks/index.ipynb") my notebook seems to stay alive, while: HTML("http://www.lrde.epita.fr/dload/vcsn/2.0/notebooks/index.html") completely breaks it (the JS part seems stuck: no means to run a cell etc.). Would you have any idea what is going wrong? Of course, I have the same problem when I try to rendering the page installed on the user's machine: HTML(filename = "/opt/local/share/vcsn/notebooks/index.html") Thanks! From moritz.beber at gmail.com Sat Oct 18 07:50:50 2014 From: moritz.beber at gmail.com (Moritz Emanuel Beber) Date: Sat, 18 Oct 2014 13:50:50 +0200 Subject: [IPython-dev] debugging remote engine death Message-ID: <5442541A.9040900@gmail.com> Hi all, I'd like to ask for your help in debugging a remote error. In case it matters, I'm running this on: Python 2.7.5 ipython 2.3.0 pyzmq 14.3.1 not sure about the libzmq version but it was pulled in with pyzmq and should be recent. So I'm using IPython.parallel with default profile and settings. The error I'm getting is the following: Traceback (most recent call last): File "scripts/trn_randomization_analysis.py", line 314, in <module> sys.exit(args.func(remote_client, args)) File "scripts/trn_randomization_analysis.py", line 259, in main_analysis for df in res_it: File "/home/mbeber/.virtualenvs/control/local/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.py", line 594, in __iter__ for r in it(): File "/home/mbeber/.virtualenvs/control/local/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.py", line 641, in _unordered_iter rlist = ar.get() File "/home/mbeber/.virtualenvs/control/local/lib/python2.7/site-packages/IPython/parallel/client/asyncresult.py", line 118, in get raise self._exception IPython.parallel.error.RemoteError: EngineError(Engine 'bd38ee8e-ad65-41af-944d-a9ea15162c03' died while running task u'a392e922-e01f-41a7-9e5e-def08ba61da8') So my first question/concern here is: A single engine has died. Shouldn't my main process just keep running and reschedule the task to a different engine? I suspect that it may be a memory problem, so I wanted to inspect the logs. However, the log names are of a different format. Their names are ipcontroller-<number>.log or ipengine-<number>.log. I guess the numbers correspond to the PIDs? Either way, I'm not sure how to find that number after the engine has died and the main process has terminated. The cluster is still running, so maybe that is of help? So instead I did a grep on all logs for the engine UUID: cat * | grep bd38ee8e-ad65-41af-944d-a9ea15162c03 2014-10-12 20:18:26.477 [IPControllerApp] client::client 'bd38ee8e-ad65-41af-944d-a9ea15162c03' requested u'registration_request' 2014-10-12 20:18:26.529 [IPControllerApp] WARNING | iopub::IOPub message lacks parent: {'parent_header': {}, 'msg_type': u'status', 'msg_id': u'042f9a0a-61c9-4238-aee5-3a6ea89596e0', 'content': {u'execution_state': u'starting'}, 'header': {u'date': datetime.datetime(2014, 10, 12, 20, 18, 26, 529317), u'username': u'mbeber', u'session': u'bd38ee8e-ad65-41af-944d-a9ea15162c03', u'msg_id': u'042f9a0a-61c9-4238-aee5-3a6ea89596e0', u'msg_type': u'status'}, 'buffers': [], 'metadata': {}} 2014-10-12 20:18:31.693 [IPControllerApp] registration::finished registering engine 0:bd38ee8e-ad65-41af-944d-a9ea15162c03 2014-10-12 22:28:04.693 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 1 2014-10-12 22:28:07.693 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 2 2014-10-12 22:28:10.692 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 3 2014-10-12 22:28:13.693 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 4 2014-10-12 22:28:16.692 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 5 2014-10-12 22:28:19.692 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 6 2014-10-12 22:28:22.693 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 7 2014-10-12 22:28:25.692 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 8 2014-10-12 22:28:28.693 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 9 2014-10-12 22:28:31.692 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 10 2014-10-12 22:28:34.692 [IPControllerApp] heartbeat::missed bd38ee8e-ad65-41af-944d-a9ea15162c03 : 11 So nothing found that tells me much more. Can anyone answer some of my question and/or recommend a strategy for further investigating this problem? Thank you in advance, Moritz From dcarrera at gmail.com Sun Oct 19 04:16:41 2014 From: dcarrera at gmail.com (Daniel Carrera) Date: Sun, 19 Oct 2014 10:16:41 +0200 Subject: [IPython-dev] Possible to run Octave in IPython without %%octave ? Message-ID: <CAEaabNiX+_ohGw7m7iTV_mAYH5JtNt4R1R=req1DXYGCJNCK_g@mail.gmail.com> Hello, I teach a very short course on MATLAB for astronomy students (6 hours). This year I am thinking of replacing my usual Impress slides with an IPython notebook running Octave. Yesterday I got Octave running in IPython and it seems to work. Is it possible to make an IPython profile that loads oct2py and treats every cell as if it had "%%octave -f svg" on the first line? This isn't a critical issue, but I think the notebook would look nicer this way. The students will not use the notebook themselves. This is just to to make my presentation a little more lively instead of just showing static code on a slide. Cheers, Daniel. -- When an engineer says that something can't be done, it's a code phrase that means it's not fun to do. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141019/8a4099d2/attachment.html> From bussonniermatthias at gmail.com Sun Oct 19 05:10:23 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Sun, 19 Oct 2014 11:10:23 +0200 Subject: [IPython-dev] Possible to run Octave in IPython without %%octave ? In-Reply-To: <CAEaabNiX+_ohGw7m7iTV_mAYH5JtNt4R1R=req1DXYGCJNCK_g@mail.gmail.com> References: <CAEaabNiX+_ohGw7m7iTV_mAYH5JtNt4R1R=req1DXYGCJNCK_g@mail.gmail.com> Message-ID: <0D2597E6-4881-41A1-8AE6-18879F8E76AC@gmail.com> Hi Daniel, Le 19 oct. 2014 ? 10:16, Daniel Carrera <dcarrera at gmail.com> a ?crit : > Hello, > > I teach a very short course on MATLAB for astronomy students (6 hours). This year I am thinking of replacing my usual Impress slides with an IPython notebook running Octave. Yesterday I got Octave running in IPython and it seems to work. > > Is it possible to make an IPython profile that loads oct2py and treats every cell as if it had "%%octave -f svg" on the first line? I would suggest looking at IOctave (Octave Kernel of IPython) https://github.com/blink1073/octave_kernel And generally look as https://github.com/ipython/ipython/wiki/Projects-using-IPython > This isn't a critical issue, but I think the notebook would look nicer this way. The students will not use the notebook themselves. This is just to to make my presentation a little more lively instead of just showing static code on a slide. I would suggest having a look at Damian Avila Live reveal mode also to do your presentation: https://github.com/damianavila/live_reveal Cheers, -- Matthias > > Cheers, > Daniel. > -- > When an engineer says that something can't be done, it's a code phrase that means it's not fun to do. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141019/a089e198/attachment.html> From dcarrera at gmail.com Sun Oct 19 05:56:14 2014 From: dcarrera at gmail.com (Daniel Carrera) Date: Sun, 19 Oct 2014 11:56:14 +0200 Subject: [IPython-dev] Possible to run Octave in IPython without %%octave ? In-Reply-To: <0D2597E6-4881-41A1-8AE6-18879F8E76AC@gmail.com> References: <CAEaabNiX+_ohGw7m7iTV_mAYH5JtNt4R1R=req1DXYGCJNCK_g@mail.gmail.com> <0D2597E6-4881-41A1-8AE6-18879F8E76AC@gmail.com> Message-ID: <CAEaabNg6yS=6+PoW1XyLLbfenFGkQo+w4w3dKK39YosAr=6x5g@mail.gmail.com> Wow. Thanks! On 19 October 2014 11:10, Matthias Bussonnier <bussonniermatthias at gmail.com> wrote: > Hi Daniel, > > Le 19 oct. 2014 ? 10:16, Daniel Carrera <dcarrera at gmail.com> a ?crit : > > Hello, > > I teach a very short course on MATLAB for astronomy students (6 hours). > This year I am thinking of replacing my usual Impress slides with an > IPython notebook running Octave. Yesterday I got Octave running in IPython > and it seems to work. > > Is it possible to make an IPython profile that loads oct2py and treats > every cell as if it had "%%octave -f svg" on the first line? > > > I would suggest looking at IOctave (Octave Kernel of IPython) > > https://github.com/blink1073/octave_kernel > > And generally look as > https://github.com/ipython/ipython/wiki/Projects-using-IPython > > This isn't a critical issue, but I think the notebook would look nicer > this way. The students will not use the notebook themselves. This is just > to to make my presentation a little more lively instead of just showing > static code on a slide. > > > I would suggest having a look at Damian Avila Live reveal mode also to do > your presentation: > > https://github.com/damianavila/live_reveal > > Cheers, > -- > Matthias > > > > > Cheers, > Daniel. > -- > When an engineer says that something can't be done, it's a code phrase > that means it's not fun to do. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- When an engineer says that something can't be done, it's a code phrase that means it's not fun to do. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141019/5848248f/attachment.html> From dcarrera at gmail.com Sun Oct 19 06:30:55 2014 From: dcarrera at gmail.com (Daniel Carrera) Date: Sun, 19 Oct 2014 12:30:55 +0200 Subject: [IPython-dev] Possible to run Octave in IPython without %%octave ? In-Reply-To: <0D2597E6-4881-41A1-8AE6-18879F8E76AC@gmail.com> References: <CAEaabNiX+_ohGw7m7iTV_mAYH5JtNt4R1R=req1DXYGCJNCK_g@mail.gmail.com> <0D2597E6-4881-41A1-8AE6-18879F8E76AC@gmail.com> Message-ID: <CAEaabNisKtxm2-9TLi6_YhpyG5ya8XeVfifYfBLB6GpHF3PgAQ@mail.gmail.com> Hmm... I need help with IOctave... maybe I found a bug in IPython 3. I installed IPython 3 from Git like the instructions say, and then I installed IOctave. --------------------------------------------- $ python --version Python 2.7.6 $ $ git clone --recursive https://github.com/ipython/ipython.git $ cd ipython $ pip install -e ".[notebook]" --user $ sudo python setup.py install $ $ ipython --version 3.0.0-dev $ $ cd ../octave_kernel $ sudo python setup.py instal --------------------------------------------- If I try to start the notebook, it says that --kernel is not recognized. --------------------------------------------- $ ipython notebook --kernel octave ... several lines of output ... [C 141019 12:20:20 application:77] Bad config encountered during initialization: [C 141019 12:20:20 application:78] Unrecognized flag: '--kernel' --------------------------------------------- But if I try the same with the Qt console, there is no complaint about --kernel and the console seems to load fine. Instead, I get an error when I type '2+2'. --------------------------------------------- $ ipython qtconsole --kernel octave NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work. ...skip... To connect another client to this kernel, use: --existing kernel-28223.json --------------------------------------------- (I type 2+2 in the console and press Enter) --------------------------------------------- Traceback (most recent call last): File "/home/sigrid/Daniel/Teaching/MATLAB-2014/ipython/IPython/qt/base_frontend_mixin.py", line 138, in _dispatch handler(msg) File "/home/sigrid/Daniel/Teaching/MATLAB-2014/ipython/IPython/qt/console/frontend_widget.py", line 537, in _handle_stream self.append_stream(msg['content']['text']) KeyError: 'text' If you suspect this is an IPython bug, please report it at: https://github.com/ipython/ipython/issues or send an email to the mailing list at ipython-dev at scipy.org You can print a more detailed traceback right now with "%tb", or use "%debug" to interactively debug it. Extra-detailed tracebacks for bug-reporting purposes can be enabled via: c.Application.verbose_crash=True --------------------------------------------- Help? Cheers, Daniel. On 19 October 2014 11:10, Matthias Bussonnier <bussonniermatthias at gmail.com> wrote: > Hi Daniel, > > Le 19 oct. 2014 ? 10:16, Daniel Carrera <dcarrera at gmail.com> a ?crit : > > Hello, > > I teach a very short course on MATLAB for astronomy students (6 hours). > This year I am thinking of replacing my usual Impress slides with an > IPython notebook running Octave. Yesterday I got Octave running in IPython > and it seems to work. > > Is it possible to make an IPython profile that loads oct2py and treats > every cell as if it had "%%octave -f svg" on the first line? > > > I would suggest looking at IOctave (Octave Kernel of IPython) > > https://github.com/blink1073/octave_kernel > > And generally look as > https://github.com/ipython/ipython/wiki/Projects-using-IPython > > This isn't a critical issue, but I think the notebook would look nicer > this way. The students will not use the notebook themselves. This is just > to to make my presentation a little more lively instead of just showing > static code on a slide. > > > I would suggest having a look at Damian Avila Live reveal mode also to do > your presentation: > > https://github.com/damianavila/live_reveal > > Cheers, > -- > Matthias > > > > > Cheers, > Daniel. > -- > When an engineer says that something can't be done, it's a code phrase > that means it's not fun to do. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- When an engineer says that something can't be done, it's a code phrase that means it's not fun to do. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141019/83f598ff/attachment.html> From bussonniermatthias at gmail.com Sun Oct 19 06:38:23 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Sun, 19 Oct 2014 12:38:23 +0200 Subject: [IPython-dev] Possible to run Octave in IPython without %%octave ? In-Reply-To: <CAEaabNisKtxm2-9TLi6_YhpyG5ya8XeVfifYfBLB6GpHF3PgAQ@mail.gmail.com> References: <CAEaabNiX+_ohGw7m7iTV_mAYH5JtNt4R1R=req1DXYGCJNCK_g@mail.gmail.com> <0D2597E6-4881-41A1-8AE6-18879F8E76AC@gmail.com> <CAEaabNisKtxm2-9TLi6_YhpyG5ya8XeVfifYfBLB6GpHF3PgAQ@mail.gmail.com> Message-ID: <A8FE7366-1C71-4D13-8CC2-7422EBBCD311@gmail.com> Le 19 oct. 2014 ? 12:30, Daniel Carrera <dcarrera at gmail.com> a ?crit : > Hmm... I need help with IOctave... maybe I found a bug in IPython 3. I installed IPython 3 from Git like the instructions say, and then I installed IOctave. > > --------------------------------------------- > $ python --version > Python 2.7.6 > $ > $ git clone --recursive https://github.com/ipython/ipython.git > $ cd ipython > $ pip install -e ".[notebook]" --user > $ sudo python setup.py install > $ > $ ipython --version > 3.0.0-dev > $ > $ cd ../octave_kernel > $ sudo python setup.py instal > --------------------------------------------- > > If I try to start the notebook, it says that --kernel is not recognized. Well, this is normal for the notebook, now that the notebook support multiple kernel. just forget about the --kernel flag, you should get a drop down in the notebook UI to select octave kernel. Look in the kernel menu, or at the top right of the notebook) For the QT stuff can you open an issue on github ? -- M > > --------------------------------------------- > $ ipython notebook --kernel octave > ... several lines of output ... > [C 141019 12:20:20 application:77] Bad config encountered during initialization: > [C 141019 12:20:20 application:78] Unrecognized flag: '--kernel' > --------------------------------------------- > > > But if I try the same with the Qt console, there is no complaint about --kernel and the console seems to load fine. Instead, I get an error when I type '2+2'. > > --------------------------------------------- > $ ipython qtconsole --kernel octave > NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work. > ...skip... > To connect another client to this kernel, use: > --existing kernel-28223.json > --------------------------------------------- > (I type 2+2 in the console and press Enter) > --------------------------------------------- > Traceback (most recent call last): > File "/home/sigrid/Daniel/Teaching/MATLAB-2014/ipython/IPython/qt/base_frontend_mixin.py", line 138, in _dispatch > handler(msg) > File "/home/sigrid/Daniel/Teaching/MATLAB-2014/ipython/IPython/qt/console/frontend_widget.py", line 537, in _handle_stream > self.append_stream(msg['content']['text']) > KeyError: 'text' > > If you suspect this is an IPython bug, please report it at: > https://github.com/ipython/ipython/issues > or send an email to the mailing list at ipython-dev at scipy.org > > You can print a more detailed traceback right now with "%tb", or use "%debug" > to interactively debug it. > > Extra-detailed tracebacks for bug-reporting purposes can be enabled via: > c.Application.verbose_crash=True > --------------------------------------------- > > Help? > > Cheers, > Daniel. > > > > On 19 October 2014 11:10, Matthias Bussonnier <bussonniermatthias at gmail.com> wrote: > Hi Daniel, > > Le 19 oct. 2014 ? 10:16, Daniel Carrera <dcarrera at gmail.com> a ?crit : > >> Hello, >> >> I teach a very short course on MATLAB for astronomy students (6 hours). This year I am thinking of replacing my usual Impress slides with an IPython notebook running Octave. Yesterday I got Octave running in IPython and it seems to work. >> >> Is it possible to make an IPython profile that loads oct2py and treats every cell as if it had "%%octave -f svg" on the first line? > > I would suggest looking at IOctave (Octave Kernel of IPython) > > https://github.com/blink1073/octave_kernel > > And generally look as https://github.com/ipython/ipython/wiki/Projects-using-IPython > >> This isn't a critical issue, but I think the notebook would look nicer this way. The students will not use the notebook themselves. This is just to to make my presentation a little more lively instead of just showing static code on a slide. > > I would suggest having a look at Damian Avila Live reveal mode also to do your presentation: > > https://github.com/damianavila/live_reveal > > Cheers, > -- > Matthias > > > >> >> Cheers, >> Daniel. >> -- >> When an engineer says that something can't be done, it's a code phrase that means it's not fun to do. >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > -- > When an engineer says that something can't be done, it's a code phrase that means it's not fun to do. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141019/b252af3d/attachment.html> From dcarrera at gmail.com Sun Oct 19 07:43:23 2014 From: dcarrera at gmail.com (Daniel Carrera) Date: Sun, 19 Oct 2014 13:43:23 +0200 Subject: [IPython-dev] Possible to run Octave in IPython without %%octave ? In-Reply-To: <A8FE7366-1C71-4D13-8CC2-7422EBBCD311@gmail.com> References: <CAEaabNiX+_ohGw7m7iTV_mAYH5JtNt4R1R=req1DXYGCJNCK_g@mail.gmail.com> <0D2597E6-4881-41A1-8AE6-18879F8E76AC@gmail.com> <CAEaabNisKtxm2-9TLi6_YhpyG5ya8XeVfifYfBLB6GpHF3PgAQ@mail.gmail.com> <A8FE7366-1C71-4D13-8CC2-7422EBBCD311@gmail.com> Message-ID: <CAEaabNhd_BzuVmgcnTVMG8-8Khgp6Ae0Yh8Gz=sR+c3+Uaw7uA@mail.gmail.com> > Well, this is normal for the notebook, now that the notebook support > multiple kernel. > just forget about the --kernel flag, you should get a drop down in the > notebook UI to select octave kernel. > Look in the kernel menu, or at the top right of the notebook) > > For the QT stuff can you open an issue on github ? > > Ok. Here it is: https://github.com/ipython/ipython/issues/6739 I started the notebook like you said, and I can see the Octave kernel on the menu. However, it doesn't produce any output. When I type "2+2" I get nothing. Here is what I know: 1) With the Python kernel I do get the "Out[1]: 4". So it's not the UI per se. 2) Octave is running. If I try "plot( [1 2 3], [4 5 6])" I actually get a plot. 3) Initially the window came as a pop-up, but "%inline" fixed it. So it looks like plotting works, and the UI can actually read the plots coming out of Octave. 4) But I still don't get the "Out[]:" lines, even when I run "disp(3)". There are no errors on the notebook, or on the terminal. It's just silent. So, I feel like everything is really close to working. I looked through the source code of the Octave kernel, but I didn't understand it enough to try anything else. As a side-note, I would like to set the figures to svg. With the old system I would write "%%octave -f svg". I cannot figure out how to do that with the new system. Cheers, Daniel. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141019/140d86a2/attachment.html> From bussonniermatthias at gmail.com Sun Oct 19 09:27:55 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Sun, 19 Oct 2014 15:27:55 +0200 Subject: [IPython-dev] Possible to run Octave in IPython without %%octave ? In-Reply-To: <CAEaabNhd_BzuVmgcnTVMG8-8Khgp6Ae0Yh8Gz=sR+c3+Uaw7uA@mail.gmail.com> References: <CAEaabNiX+_ohGw7m7iTV_mAYH5JtNt4R1R=req1DXYGCJNCK_g@mail.gmail.com> <0D2597E6-4881-41A1-8AE6-18879F8E76AC@gmail.com> <CAEaabNisKtxm2-9TLi6_YhpyG5ya8XeVfifYfBLB6GpHF3PgAQ@mail.gmail.com> <A8FE7366-1C71-4D13-8CC2-7422EBBCD311@gmail.com> <CAEaabNhd_BzuVmgcnTVMG8-8Khgp6Ae0Yh8Gz=sR+c3+Uaw7uA@mail.gmail.com> Message-ID: <40DBB83F-CEB8-4180-AF25-F6769CFF6F92@gmail.com> Le 19 oct. 2014 ? 13:43, Daniel Carrera <dcarrera at gmail.com> a ?crit : > > Well, this is normal for the notebook, now that the notebook support multiple kernel. > just forget about the --kernel flag, you should get a drop down in the notebook UI to select octave kernel. > Look in the kernel menu, or at the top right of the notebook) > > For the QT stuff can you open an issue on github ? > > > Ok. Here it is: > > https://github.com/ipython/ipython/issues/6739 Thanks ! > I started the notebook like you said, and I can see the Octave kernel on the menu. However, it doesn't produce any output. When I type "2+2" I get nothing. Here is what I know: > > 1) With the Python kernel I do get the "Out[1]: 4". So it's not the UI per se. > > 2) Octave is running. If I try "plot( [1 2 3], [4 5 6])" I actually get a plot. > > 3) Initially the window came as a pop-up, but "%inline" fixed it. So it looks like plotting works, and the UI can actually read the plots coming out of Octave. > > 4) But I still don't get the "Out[]:" lines, even when I run "disp(3)". There are no errors on the notebook, or on the terminal. It's just silent. There might also be an issue on octave kernel side. I would also open an issue on octave kernel itself, the author is probably more familiar with it than we are. > > > So, I feel like everything is really close to working. I looked through the source code of the Octave kernel, but I didn't understand it enough to try anything else. IPython 3.0 is still highly in motion, so having different things "almost" working is not too surprising. Though, the kernel architecture to get basic stuff working is already stable enough that not having any output is weird. > > As a side-note, I would like to set the figures to svg. With the old system I would write "%%octave -f svg". I cannot figure out how to do that with the new system. This you would have to see with the octave kernel. -f svg was probably setting an option somewhere. Good luck ! -- M -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141019/5fe4a744/attachment.html> From zvoros at gmail.com Mon Oct 20 03:16:56 2014 From: zvoros at gmail.com (=?UTF-8?B?Wm9sdMOhbiBWw7Zyw7Zz?=) Date: Mon, 20 Oct 2014 09:16:56 +0200 Subject: [IPython-dev] ipython fails to build on latest master Message-ID: <5444B6E8.3000007@gmail.com> Hi all, I have just checked out the latest code from github, and I end up with the following error when trying to build ipython v923z at tux:ipython$ sudo python setup.py build running build running build_py running jsversion running css Failed to build css sourcemaps: [Errno 2] No such file or directory checking package data Traceback (most recent call last): File "setup.py", line 355, in <module> main() File "setup.py", line 351, in main setup(**setup_args) File "/usr/lib/python2.7/distutils/core.py", line 152, in setup dist.run_commands() File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands self.run_command(cmd) File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command cmd_obj.run() File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run self.run_command(cmd_name) File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command self.distribution.run_command(command) File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command cmd_obj.run() File "/home/v923z/sandbox/ipython/git/ipython/setupbase.py", line 734, in run command.run(self) File "/home/v923z/sandbox/ipython/git/ipython/setupbase.py", line 227, in run check_package_data(self.package_data) File "/home/v923z/sandbox/ipython/git/ipython/setupbase.py", line 217, in check_package_data assert os.path.exists(path), "Missing package data: %s" % path AssertionError: Missing package data: IPython/html/static/components/backbone/backbone-min.js Indeed, the components directory is empty. I then went on to remove my ipython folder completely, and cloned the repository to the local directory, but this issue doesn't seem to go away. Can someone comment on this issue? Thanks, Zolt?n From bussonniermatthias at gmail.com Mon Oct 20 03:25:54 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Mon, 20 Oct 2014 09:25:54 +0200 Subject: [IPython-dev] ipython fails to build on latest master In-Reply-To: <5444B6E8.3000007@gmail.com> References: <5444B6E8.3000007@gmail.com> Message-ID: <EF1C7B90-A84A-4A24-B8E2-3A2C661178F8@gmail.com> Le 20 oct. 2014 ? 09:16, Zolt?n V?r?s <zvoros at gmail.com> a ?crit : > Hi all, > > > I have just checked out the latest code from github, and I end up with > the following error when trying to build ipython > > > v923z at tux:ipython$ sudo python setup.py build > running build > running build_py > running jsversion > running css > > Failed to build css sourcemaps: [Errno 2] No such file or directory > checking package data > Traceback (most recent call last): > File "setup.py", line 355, in <module> > main() > File "setup.py", line 351, in main > setup(**setup_args) > File "/usr/lib/python2.7/distutils/core.py", line 152, in setup > dist.run_commands() > File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands > self.run_command(cmd) > File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command > cmd_obj.run() > File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run > self.run_command(cmd_name) > File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command > self.distribution.run_command(command) > File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command > cmd_obj.run() > File "/home/v923z/sandbox/ipython/git/ipython/setupbase.py", line > 734, in run > command.run(self) > File "/home/v923z/sandbox/ipython/git/ipython/setupbase.py", line > 227, in run > check_package_data(self.package_data) > File "/home/v923z/sandbox/ipython/git/ipython/setupbase.py", line > 217, in check_package_data > assert os.path.exists(path), "Missing package data: %s" % path > AssertionError: Missing package data: > IPython/html/static/components/backbone/backbone-min.js Try a $ git clone --recursive, otherwise try a $ python setup.py submodule > > > Indeed, the components directory is empty. I then went on to remove my > ipython folder completely, and cloned the repository to the local > directory, but this issue doesn't seem to go away. Can someone comment > on this issue? > > Thanks, > > Zolt?n > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From zvoros at gmail.com Mon Oct 20 04:36:20 2014 From: zvoros at gmail.com (=?windows-1252?Q?Zolt=E1n_V=F6r=F6s?=) Date: Mon, 20 Oct 2014 10:36:20 +0200 Subject: [IPython-dev] ipython fails to build on latest master In-Reply-To: <EF1C7B90-A84A-4A24-B8E2-3A2C661178F8@gmail.com> References: <5444B6E8.3000007@gmail.com> <EF1C7B90-A84A-4A24-B8E2-3A2C661178F8@gmail.com> Message-ID: <5444C984.7020505@gmail.com> Hi Matthias, On 10/20/2014 09:25 AM, Matthias Bussonnier wrote: > > > Try a $ git clone --recursive, > > otherwise try a $ python setup.py submodule > The second command did the trick. Thanks a lot! Zolt?n From DavidAnthonyPowell+python at gmail.com Mon Oct 20 23:04:58 2014 From: DavidAnthonyPowell+python at gmail.com (David Powell) Date: Tue, 21 Oct 2014 14:04:58 +1100 Subject: [IPython-dev] Problems with tikzmagic and svg output Message-ID: <CAGXzvie8sHRruQLo09sekHRYJeWkwcWXYeL+-k76wBNABRocaA@mail.gmail.com> Hello all, I came across a problem when using the tikz cell magic to generate svg output. If the tikz graphs have text in them, then each character is defined as a glyph in the svg file. This works fine, for a single figure. If multiple tikz graphs are included as svg, then their glyph definitions clash, and the second graph is rendered incorrectly in the notebook. I have attached a notebook and screen grab showing this effect. The generated svg files themselves are okay, it's only when they are rendered in the notebook that the problem occurs, so I guess the problem lies with the notebook rather than the tikz magic. I am unsure whether to raise a github issue, as there are situations (such as fonts defined in svg), where it would make sense to share definitions globally in the document. But it would be good if there was some option to include svg data in the notebook while ensuring that its definitions are kept private. On a related point, is there an easy way to export the .svg output of a cell to a file directly from within the notebook? I know that I could use nbconvert, manually hack the html, or find the temporary svg created by the magic, but I was hoping to find a more convenient way. Thanks, David -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141021/b8234681/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: tikz-magic-output.png Type: image/png Size: 36146 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141021/b8234681/attachment.png> -------------- next part -------------- A non-text attachment was scrubbed... Name: tikz-svg-test.ipynb Type: application/octet-stream Size: 14025 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141021/b8234681/attachment.obj> From bussonniermatthias at gmail.com Tue Oct 21 03:09:13 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Tue, 21 Oct 2014 09:09:13 +0200 Subject: [IPython-dev] Problems with tikzmagic and svg output In-Reply-To: <CAGXzvie8sHRruQLo09sekHRYJeWkwcWXYeL+-k76wBNABRocaA@mail.gmail.com> References: <CAGXzvie8sHRruQLo09sekHRYJeWkwcWXYeL+-k76wBNABRocaA@mail.gmail.com> Message-ID: <69DE00F7-45D0-402F-9CC3-97E4509308B2@gmail.com> Le 21 oct. 2014 ? 05:04, David Powell <DavidAnthonyPowell+python at gmail.com> a ?crit : > Hello all, > > I came across a problem when using the tikz cell magic to generate svg output. If the tikz graphs have text in them, then each character is defined as a glyph in the svg file. This works fine, for a single figure. If multiple tikz graphs are included as svg, then their glyph definitions clash, and the second graph is rendered incorrectly in the notebook. > > I have attached a notebook and screen grab showing this effect. The generated svg files themselves are okay, it's only when they are rendered in the notebook that the problem occurs, so I guess the problem lies with the notebook rather than the tikz magic. > > I am unsure whether to raise a github issue, as there are situations (such as fonts defined in svg), where it would make sense to share definitions globally in the document. But it would be good if there was some option to include svg data in the notebook while ensuring that its definitions are kept private. I suppose you should display it in an iframe, if you display the SVG with the isolated=true metadata, IPython should do that for you automatically. > On a related point, is there an easy way to export the .svg output of a cell to a file directly from within the notebook? I know that I could use nbconvert, manually hack the html, or find the temporary svg created by the magic, but I was hoping to find a more convenient way. No, no easy way. For most content, drag-and drop from Chrome to my desktop seem to work here. I was able to do it with SVG at some point, but today it refuses. -- M > > Thanks, > David > > <tikz-magic-output.png><tikz-svg-test.ipynb>_______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From p.f.moore at gmail.com Tue Oct 21 10:43:57 2014 From: p.f.moore at gmail.com (Paul Moore) Date: Tue, 21 Oct 2014 15:43:57 +0100 Subject: [IPython-dev] Console ipython - multi-line history editing Message-ID: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> I don't know whether I am imagining this, but I thought that the console IPython shell allowed history editing of multi-line statements. So, for example, if In[1] is for i in range(3): print(i) I thought I could use up-arrow to recall the whole two-line statement and edit it. But when I try this (on Windows, with Python 3.4, IPython 2.3.0 and pyreadline 2.0) it seems that up-arrow recalls single lines. Is there a configuration setting I need to change, or am I imagining this and IPython doesn't do that? (I may be confusing the IPython shell with PowerShell's PSReadLine, which does). I know I can use the notebook for this, but sometimes console IPython is more convenient... Thanks, Paul From ronena at gmail.com Tue Oct 21 11:26:55 2014 From: ronena at gmail.com (Ronen Abravanel) Date: Tue, 21 Oct 2014 18:26:55 +0300 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> Message-ID: <CACTp8Rji9Taucy92c15PhmWjyjiVWo5M9uW0KvKtm3ehFYX23g@mail.gmail.com> You can type '%edit 1' to edit In [1]. (Or '%edit _2' to edit Out [2]) In QtConsole, the behavior is as you expected. On Tue, Oct 21, 2014 at 5:43 PM, Paul Moore <p.f.moore at gmail.com> wrote: > I don't know whether I am imagining this, but I thought that the > console IPython shell allowed history editing of multi-line > statements. So, for example, if In[1] is > > for i in range(3): > print(i) > > I thought I could use up-arrow to recall the whole two-line statement > and edit it. But when I try this (on Windows, with Python 3.4, IPython > 2.3.0 and pyreadline 2.0) it seems that up-arrow recalls single lines. > > Is there a configuration setting I need to change, or am I imagining > this and IPython doesn't do that? (I may be confusing the IPython > shell with PowerShell's PSReadLine, which does). I know I can use the > notebook for this, but sometimes console IPython is more convenient... > > Thanks, > Paul > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141021/52b04133/attachment.html> From p.f.moore at gmail.com Tue Oct 21 11:33:41 2014 From: p.f.moore at gmail.com (Paul Moore) Date: Tue, 21 Oct 2014 16:33:41 +0100 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACTp8Rji9Taucy92c15PhmWjyjiVWo5M9uW0KvKtm3ehFYX23g@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CACTp8Rji9Taucy92c15PhmWjyjiVWo5M9uW0KvKtm3ehFYX23g@mail.gmail.com> Message-ID: <CACac1F9XHgCUrXXpHwsqDwC9UGz68B_7Hm6PT8YoqAu_zhcHBQ@mail.gmail.com> On 21 October 2014 16:26, Ronen Abravanel <ronena at gmail.com> wrote: > You can type '%edit 1' to edit In [1]. > (Or '%edit _2' to edit Out [2]) Ah, that might have been what I was remembering. > In QtConsole, the behavior is as you expected. Yeah, but the dependency on Qt means I mostly don't have that available... Thanks, Paul From takowl at gmail.com Tue Oct 21 11:45:22 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Tue, 21 Oct 2014 08:45:22 -0700 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> Message-ID: <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> You remember right, it should work in the terminal too. However, it's possible that pyreadline doesn't support that. It certainly works with gnu readline on Linux. On 21 Oct 2014 07:44, "Paul Moore" <p.f.moore at gmail.com> wrote: > I don't know whether I am imagining this, but I thought that the > console IPython shell allowed history editing of multi-line > statements. So, for example, if In[1] is > > for i in range(3): > print(i) > > I thought I could use up-arrow to recall the whole two-line statement > and edit it. But when I try this (on Windows, with Python 3.4, IPython > 2.3.0 and pyreadline 2.0) it seems that up-arrow recalls single lines. > > Is there a configuration setting I need to change, or am I imagining > this and IPython doesn't do that? (I may be confusing the IPython > shell with PowerShell's PSReadLine, which does). I know I can use the > notebook for this, but sometimes console IPython is more convenient... > > Thanks, > Paul > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141021/74498faa/attachment.html> From franz.bergesund at gmail.com Tue Oct 21 11:49:52 2014 From: franz.bergesund at gmail.com (Francesco Montesano) Date: Tue, 21 Oct 2014 17:49:52 +0200 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACac1F9XHgCUrXXpHwsqDwC9UGz68B_7Hm6PT8YoqAu_zhcHBQ@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CACTp8Rji9Taucy92c15PhmWjyjiVWo5M9uW0KvKtm3ehFYX23g@mail.gmail.com> <CACac1F9XHgCUrXXpHwsqDwC9UGz68B_7Hm6PT8YoqAu_zhcHBQ@mail.gmail.com> Message-ID: <CAOCdBK+=Te7fweaCkP1bRHe+6t0ddX4K+5xuJLXkzmQvxhwNOA@mail.gmail.com> Hi, On ipython 2.3, under opensuse 13.1, I've noticed this too, and found it strange. Within an ipython session I can get back the full code blocks. If I exit ipython and re-enter I can get only one line at a time. On my other machine with Kubuntu 14.04 roaming the history with the arrows i get back correctly the code blocks . On opensuse I have libreadline6 v 6.2-68.8.1 and on Kubuntu v 6.3-4. If I have time I can give a try with older versions of ipython on opensuse to check if the feature broke recently or has always been like this. Fra 2014-10-21 17:33 GMT+02:00 Paul Moore <p.f.moore at gmail.com>: > On 21 October 2014 16:26, Ronen Abravanel <ronena at gmail.com> wrote: > > You can type '%edit 1' to edit In [1]. > > (Or '%edit _2' to edit Out [2]) > > Ah, that might have been what I was remembering. > > > In QtConsole, the behavior is as you expected. > > Yeah, but the dependency on Qt means I mostly don't have that available... > > Thanks, > Paul > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141021/25c0fb8e/attachment.html> From p.f.moore at gmail.com Tue Oct 21 12:00:06 2014 From: p.f.moore at gmail.com (Paul Moore) Date: Tue, 21 Oct 2014 17:00:06 +0100 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> Message-ID: <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> On 21 October 2014 16:45, Thomas Kluyver <takowl at gmail.com> wrote: > You remember right, it should work in the terminal too. However, it's > possible that pyreadline doesn't support that. It certainly works with gnu > readline on Linux. Oh, cool! I'll do some digging then and see if I can work out what's going on. Maybe you're right and it's a pyreadline issue. Thanks. Paul From jeanbigboute at gmail.com Tue Oct 21 14:17:16 2014 From: jeanbigboute at gmail.com (JBB) Date: Tue, 21 Oct 2014 18:17:16 +0000 (UTC) Subject: [IPython-dev] Kernel hangs after downloading notebook as .ipynb Message-ID: <loom.20141021T201640-628@post.gmane.org> I run Notebook on Firefox (Python v2.7). When I download a notebook (File --> Download As) as an .ipynb, the kernel hangs. When I try to run cells, the asterisk comes on and stays on. I have to restart the Notebook server. It doesn't hang when I download as a .py file, as far as I can tell. Any suggestions? --- JBB From takowl at gmail.com Tue Oct 21 14:59:07 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Tue, 21 Oct 2014 11:59:07 -0700 Subject: [IPython-dev] Kernel hangs after downloading notebook as .ipynb In-Reply-To: <loom.20141021T201640-628@post.gmane.org> References: <loom.20141021T201640-628@post.gmane.org> Message-ID: <CAOvn4qjGeNgitmkN16PvGobdwuEtWP4sxPLDz4XKXo4RyCrvMg@mail.gmail.com> Thanks JBB, I also see this, and I have filed an issue for it: https://github.com/ipython/ipython/issues/6764 Thomas On 21 October 2014 11:17, JBB <jeanbigboute at gmail.com> wrote: > I run Notebook on Firefox (Python v2.7). When I download a notebook (File > --> Download As) as an .ipynb, the kernel hangs. When I try to run cells, > the asterisk comes on and stays on. I have to restart the Notebook server. > > It doesn't hang when I download as a .py file, as far as I can tell. > > Any suggestions? > > --- JBB > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141021/0602b991/attachment.html> From jeanbigboute at gmail.com Tue Oct 21 17:34:30 2014 From: jeanbigboute at gmail.com (JBB) Date: Tue, 21 Oct 2014 21:34:30 +0000 (UTC) Subject: [IPython-dev] Kernel hangs after downloading notebook as .ipynb References: <loom.20141021T201640-628@post.gmane.org> <CAOvn4qjGeNgitmkN16PvGobdwuEtWP4sxPLDz4XKXo4RyCrvMg@mail.gmail.com> Message-ID: <loom.20141021T233333-516@post.gmane.org> Thomas Kluyver <takowl <at> gmail.com> writes: > > Thanks JBB, I also see this, and I have filed an issue for it:https://github.com/ipython/ipython/issues/6764 > Thomas Thank you, very much for doing that! --- JBB > > On 21 October 2014 11:17, JBB <jeanbigboute <at> gmail.com> wrote [deletia] From DavidAnthonyPowell+python at gmail.com Tue Oct 21 18:55:23 2014 From: DavidAnthonyPowell+python at gmail.com (David Powell) Date: Wed, 22 Oct 2014 09:55:23 +1100 Subject: [IPython-dev] Problems with tikzmagic and svg output In-Reply-To: <69DE00F7-45D0-402F-9CC3-97E4509308B2@gmail.com> References: <CAGXzvie8sHRruQLo09sekHRYJeWkwcWXYeL+-k76wBNABRocaA@mail.gmail.com> <69DE00F7-45D0-402F-9CC3-97E4509308B2@gmail.com> Message-ID: <CAGXzvifFX74WsQZWyEXKEt_oRHw8WCc2_JeYhhTMtfTBTTc3UA@mail.gmail.com> > > > I suppose you should display it in an iframe, if you display the SVG with > the isolated=true metadata, > IPython should do that for you automatically. > > Thanks, this was a fairly easy modification to the magic > > > On a related point, is there an easy way to export the .svg output of a > cell to a file directly from within the notebook? I know that I could use > nbconvert, manually hack the html, or find the temporary svg created by the > magic, but I was hoping to find a more convenient way. > > No, no easy way. For most content, drag-and drop from Chrome to my desktop > seem to work here. > I was able to do it with SVG at some point, but today it refuses. > -- > That's a pity, it would be nice to have a general solution to this problem for arbitrary data displayed in the cell output. Perhaps some kind of widget which runs nbconvert and selects the output from one cell would be a solution. For this specific tikz magic, the easiest thing was to add an extra argument to save a copy of the file. Anyway, I have created a modified version of this tikz magic with these two fixes, shared here in case it is useful to anybody else: https://gist.github.com/DavidPowell/84655e9a87fdfdaf2717 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/bf3e6b17/attachment.html> From p.f.moore at gmail.com Wed Oct 22 10:33:11 2014 From: p.f.moore at gmail.com (Paul Moore) Date: Wed, 22 Oct 2014 15:33:11 +0100 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> Message-ID: <CACac1F-5DmabyUPkpPR-7uWVrZpz5TqbL_nf5tQ08W7CXMhJXQ@mail.gmail.com> On 21 October 2014 17:00, Paul Moore <p.f.moore at gmail.com> wrote: > On 21 October 2014 16:45, Thomas Kluyver <takowl at gmail.com> wrote: >> You remember right, it should work in the terminal too. However, it's >> possible that pyreadline doesn't support that. It certainly works with gnu >> readline on Linux. > > Oh, cool! I'll do some digging then and see if I can work out what's > going on. Maybe you're right and it's a pyreadline issue. Hmm, well I didn't get very far :-( That's pretty complicated code... Is there any way to ask the pyreadline developers about this? Is pyreadline still maintained? It seems to be linked to IPython (insofar as the readme says it's in the "IPython git repository" and the homepage is on the IPython site) but there have been no changes in over a year. There's also another version, pyreadline-ais, that seems to have been created as a result of no movement on a particular PR... Paul From pablo.winant at gmail.com Wed Oct 22 10:58:12 2014 From: pablo.winant at gmail.com (Pablo Winant) Date: Wed, 22 Oct 2014 10:58:12 -0400 Subject: [IPython-dev] Editor widget and data persistence Message-ID: <CADQWuG4OzGoDtCd-JzzyOv8BP-uyi-8Xai1uNrd6EJtPLL0kVg@mail.gmail.com> Hi, The new widgets are absolutely wonderful ! I wonder if it is possible to save the state of these widgets when saving the notebook. More specifically, I'd like to use the text editor widget to edit a text file that comes with a notebook. That would kill two birds with one stone for me: avoid the need to ship a separate file with the notebook (btw, is there already a canonical way to do that ?), and be able to edit it from within the notebook. Are there plans in this direction ? Any idea about how I could implement that ? A somewhat related question: the IPython widgets are becoming one of the very few alternatives for python web-guis. Do you think it would be possible to use it for a relatively simple application and hide the notebook from user's sight so that it looks like an independent application ? Best, Pablo -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/4c8f72de/attachment.html> From takowl at gmail.com Wed Oct 22 12:28:21 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 22 Oct 2014 09:28:21 -0700 Subject: [IPython-dev] Editor widget and data persistence In-Reply-To: <CADQWuG4OzGoDtCd-JzzyOv8BP-uyi-8Xai1uNrd6EJtPLL0kVg@mail.gmail.com> References: <CADQWuG4OzGoDtCd-JzzyOv8BP-uyi-8Xai1uNrd6EJtPLL0kVg@mail.gmail.com> Message-ID: <CAOvn4qgBWrd+5RuU8cdZCy8sERWg07TgUBpPcSNP1AHnOC_WPQ@mail.gmail.com> Hi Pablo, > I wonder if it is possible to save the state of these widgets when saving the notebook Currently, no. We're working on ways to do that, but it turns out to be more complicated than it seems. > More specifically, I'd like to use the text editor widget to edit a text file that comes with a notebook It's possible to do this with widgets, but I don't think it's the best fit for the problem. It sounds like what you want is the %%writefile cell magic. Just make a code cell containing the text you want, with %%writefile filename.txt at the top. When you run it, it will save that content to the file. We are also planning to put a text editor component inside the notebook server, but that's not quite ready yet. > the IPython widgets are becoming one of the very few alternatives for python web-guis Yes, and this is a much larger scope than the widget architecture was really designed for. We're trying to work out how to handle this. Thanks, Thomas On 22 October 2014 07:58, Pablo Winant <pablo.winant at gmail.com> wrote: > Hi, > > The new widgets are absolutely wonderful ! > > I wonder if it is possible to save the state of these widgets when saving > the notebook. More specifically, I'd like to use the text editor widget to > edit a text file that comes with a notebook. That would kill two birds with > one stone for me: avoid the need to ship a separate file with the notebook > (btw, is there already a canonical way to do that ?), and be able to edit > it from within the notebook. Are there plans in this direction ? Any idea > about how I could implement that ? > > A somewhat related question: the IPython widgets are becoming one of the > very few alternatives for python web-guis. Do you think it would be > possible to use it for a relatively simple application and hide the > notebook from user's sight so that it looks like an independent application > ? > > Best, > > Pablo > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/22f181cd/attachment.html> From gomez.matthieu at gmail.com Wed Oct 22 13:55:35 2014 From: gomez.matthieu at gmail.com (Matthieu Gomez) Date: Wed, 22 Oct 2014 13:55:35 -0400 Subject: [IPython-dev] Multiple selections Message-ID: <etPan.5447ef97.436c6125.99a@dynamic-oit-fishnet-d-25.princeton.edu> Hello, I?m a recent (R) user of IPython and I find it amazing. I?m using the current Github version. I?ve discovered that I could select multiple lines of codes and edit them (by using ALT), which is awesome. In a similar spirit, is it possible to select multiple words starting from a selection of one?. In Sublime Text, if one selects some characters and press CMD + D, then both the current selection and the next set of character matching the current selection are selected. Pressing CMD+D a second time adds the third set of characters to the selection, etc (here is a video?https://www.youtube.com/watch?v=i2SVJa2EGIw). This is very helpful when one wants to modify the name of a variable everywhere in the code. However, as of now, when I press CMD + D, the selection is deleted. I was wondering whether this feature was implemented, maybe under a different shortcut.? Thanks a lot! Matthieu -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/2aaf8556/attachment.html> From wstein at gmail.com Wed Oct 22 14:08:20 2014 From: wstein at gmail.com (William Stein) Date: Wed, 22 Oct 2014 11:08:20 -0700 Subject: [IPython-dev] Multiple selections In-Reply-To: <etPan.5447ef97.436c6125.99a@dynamic-oit-fishnet-d-25.princeton.edu> References: <etPan.5447ef97.436c6125.99a@dynamic-oit-fishnet-d-25.princeton.edu> Message-ID: <CACLE5GDCE9DLj7m_veLZDG_WpjS7M9mgYi6rHsCqOspbO4EFPA@mail.gmail.com> On Wed, Oct 22, 2014 at 10:55 AM, Matthieu Gomez <gomez.matthieu at gmail.com> wrote: > Hello, > > I'm a recent (R) user of IPython and I find it amazing. > > I'm using the current Github version. I've discovered that I could select > multiple lines of codes and edit them (by using ALT), which is awesome. In a > similar spirit, is it possible to select multiple words starting from a > selection of one?. In Sublime Text, if one selects some characters and press > CMD + D, then both the current selection and the next set of character > matching the current selection are selected. Pressing CMD+D a second time > adds the third set of characters to the selection, etc (here is a video > https://www.youtube.com/watch?v=i2SVJa2EGIw). This is very helpful when one > wants to modify the name of a variable everywhere in the code. > > However, as of now, when I press CMD + D, the selection is deleted. I was > wondering whether this feature was implemented, maybe under a different > shortcut. I'm guessing that IPython just got this functionality as a side-effect of upgrading to Codemirror 4. Codemirror has a Sublime keybinding mode, which provides precisely the functionality you mention above. So if IPython could expose setting the sublime (and vim and emacs?!) keybinding modes that Codemirror supports, then you get the above functionality. In SageMathCloud (https://cloud.sagemath.com), you can set sublime keybindings in account settings, then open a file (anything except ipython notebooks, which don't inherit these settings *yet*), and edit it, and it works as you expect above. I've actually been wondering about how to do this, since I love multiple cursors, and I'm pleased that it just works. William > > Thanks a lot! > > Matthieu > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- William Stein Professor of Mathematics University of Washington http://wstein.org From roalexan at microsoft.com Wed Oct 22 14:21:49 2014 From: roalexan at microsoft.com (Robert Alexander) Date: Wed, 22 Oct 2014 18:21:49 +0000 Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions Message-ID: <1414002105549.34538@microsoft.com> Hello. I'm fairly new to Jupityr/Docker. Last week I did the following steps to get things started: -Create a Ubuntu 14.04 VM on Azure # tier:basic, size:A0) -Get Docker (following official Docker instructions at: http://docs.docker.com/installation/ubuntulinux/) sudo apt-get update # Ensure the list of available packages is up to date before installing anything new sudo apt-get -y install docker.io # Install Docker by installing the docker-io package sudo ln -sf /usr/bin/docker.io /usr/local/bin/docker # link and fix paths # sudo sed -i '$acomplete -F _docker docker' /etc/bash_completion.d/docker.io - instructions say to do this, but the line is already there sudo update-rc.d docker.io defaults # optionally, configure Docker to start when the server boots source /etc/bash_completion.d/docker.io -Get Docker container using "Quick start" (follow instructions at: https://github.com/jupyter/tmpnb) sudo docker pull jupyter/demo # download Docker container. export TOKEN=$( head -c 30 /dev/urandom | xxd -p ) sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN jupyter/configurable-http-proxy --default-target http://127.0.0.1:9999 sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN -v /var/run/docker.sock:/docker.sock jupyter/tmpnb -Add new endpoint to virtual machine protocol:TCP, public port:8000, private port:9999 # map internal to external port This wasn't without error. I got the error: APIError: 404 Client Error: Not Found ("client and server don't have same version (client : 1.13, server: 1.12)") So, I was attempting to re-run my steps, this time explicitly setting the docker version via: sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN -v /var/run/docker.sock:/docker.sock jupyter/tmpnb python orchestrate.py --cull-timeout=60 --docker-version="1.12" However, now I time out trying to get to the Jupyter demo. Did something change to break things between then and now? -Robert -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/027d979c/attachment.html> From benjaminrk at gmail.com Wed Oct 22 14:21:49 2014 From: benjaminrk at gmail.com (MinRK) Date: Wed, 22 Oct 2014 11:21:49 -0700 Subject: [IPython-dev] Multiple selections In-Reply-To: <CACLE5GDCE9DLj7m_veLZDG_WpjS7M9mgYi6rHsCqOspbO4EFPA@mail.gmail.com> References: <etPan.5447ef97.436c6125.99a@dynamic-oit-fishnet-d-25.princeton.edu> <CACLE5GDCE9DLj7m_veLZDG_WpjS7M9mgYi6rHsCqOspbO4EFPA@mail.gmail.com> Message-ID: <CAHNn8BX2Gm0mL+XBE6RVh8-C_6mgbNwE8D5AwvWhPRM=Putv8A@mail.gmail.com> Yes, I think enabling sublime keymap is possible <https://github.com/ipython/ipython/pull/6221#issuecomment-58936367>: in your profile?s custom.js: require(["codemirror/keymap/sublime", "notebook/js/cell"], function(sublime_keymap, cell) { cell.Cell.options_default.cm_config.keyMap = 'sublime'; }); c/o @jdfreder ? On Wed, Oct 22, 2014 at 11:08 AM, William Stein <wstein at gmail.com> wrote: > On Wed, Oct 22, 2014 at 10:55 AM, Matthieu Gomez > <gomez.matthieu at gmail.com> wrote: > > Hello, > > > > I'm a recent (R) user of IPython and I find it amazing. > > > > I'm using the current Github version. I've discovered that I could select > > multiple lines of codes and edit them (by using ALT), which is awesome. > In a > > similar spirit, is it possible to select multiple words starting from a > > selection of one?. In Sublime Text, if one selects some characters and > press > > CMD + D, then both the current selection and the next set of character > > matching the current selection are selected. Pressing CMD+D a second time > > adds the third set of characters to the selection, etc (here is a video > > https://www.youtube.com/watch?v=i2SVJa2EGIw). This is very helpful when > one > > wants to modify the name of a variable everywhere in the code. > > > > However, as of now, when I press CMD + D, the selection is deleted. I was > > wondering whether this feature was implemented, maybe under a different > > shortcut. > > I'm guessing that IPython just got this functionality as a side-effect > of upgrading to Codemirror 4. > Codemirror has a Sublime keybinding mode, which provides precisely the > functionality you mention > above. So if IPython could expose setting the sublime (and vim and > emacs?!) keybinding modes > that Codemirror supports, then you get the above functionality. > > In SageMathCloud (https://cloud.sagemath.com), you can set sublime > keybindings in account settings, then open a file (anything except > ipython notebooks, which don't inherit these settings *yet*), and edit > it, and it works as you expect above. I've actually been wondering > about how to do this, since I love multiple cursors, and I'm pleased > that it just works. > > William > > > > > Thanks a lot! > > > > Matthieu > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > William Stein > Professor of Mathematics > University of Washington > http://wstein.org > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/22bea83e/attachment.html> From takowl at gmail.com Wed Oct 22 14:28:04 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 22 Oct 2014 11:28:04 -0700 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACac1F-5DmabyUPkpPR-7uWVrZpz5TqbL_nf5tQ08W7CXMhJXQ@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> <CACac1F-5DmabyUPkpPR-7uWVrZpz5TqbL_nf5tQ08W7CXMhJXQ@mail.gmail.com> Message-ID: <CAOvn4qiWAzPEKK-m34QH0Z9boTQmzvbS=z=jcEEomAGK4KdMrQ@mail.gmail.com> On 22 October 2014 07:33, Paul Moore <p.f.moore at gmail.com> wrote: > Is there any way to ask the pyreadline developers about this? Is > pyreadline still maintained? It's maintained by J?rgen Stenarson, CCed, but I don't think he's had much time to work on it recently. If the maintainer of pyreadline-ais is responsive, I would try working with him. If pyreadline gets problematically out of date, we might point the dependency on Windows to that fork. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/16bd3c8f/attachment.html> From roalexan at microsoft.com Wed Oct 22 14:43:43 2014 From: roalexan at microsoft.com (Robert Alexander) Date: Wed, 22 Oct 2014 18:43:43 +0000 Subject: [IPython-dev] Unable to build Docker image Message-ID: <1414003420402.37844@microsoft.com> I'm trying to follow the instructions at https://github.com/jupyter/tmpnb to build a Docker image using the github source. When I run the line: docker build -t jupyter/demo image I get the error: 2014/10/22 18:39:28 stat image: no such file or directory Can someone please tell me how to resolve this? Thanks, Robert -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/c5a76afb/attachment.html> From p.f.moore at gmail.com Wed Oct 22 15:14:40 2014 From: p.f.moore at gmail.com (Paul Moore) Date: Wed, 22 Oct 2014 20:14:40 +0100 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> Message-ID: <CACac1F8FuAoGrqMMT2Bu8fXREnRjPLaS4PcbX-ViUaA40faBkw@mail.gmail.com> On 21 October 2014 17:00, Paul Moore <p.f.moore at gmail.com> wrote: > On 21 October 2014 16:45, Thomas Kluyver <takowl at gmail.com> wrote: >> You remember right, it should work in the terminal too. However, it's >> possible that pyreadline doesn't support that. It certainly works with gnu >> readline on Linux. > > Oh, cool! I'll do some digging then and see if I can work out what's > going on. Maybe you're right and it's a pyreadline issue. Actually, it looks like it's deliberate in IPython. See https://github.com/ipython/ipython/commit/1bcb58e939edac7812d0ad70d5072e27540b4f32 (back in 2011). I'm not entirely sure how I change that config directly, so I hacked the source. With TerminalInteractiveShell.multiline_history=True, multi-line history works, but the display is corrupted. So it looks like there is a pyreadline display issue at the root of this (i.e., it'd need multi-line display in pyreadline to work before it made sense to default this to True). Sadly, it'd probably take me a *lot* of work to work out how to fix this myself :-( Paul. PS How would I set TerminalInteractiveShell.multiline_history on the IPython command line? I'd like to at least report this as a pyreadline bug, and being able to describe how to reproduce it *without* saying "hack IPython" would be nice :-) From takowl at gmail.com Wed Oct 22 15:39:22 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 22 Oct 2014 12:39:22 -0700 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACac1F8FuAoGrqMMT2Bu8fXREnRjPLaS4PcbX-ViUaA40faBkw@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> <CACac1F8FuAoGrqMMT2Bu8fXREnRjPLaS4PcbX-ViUaA40faBkw@mail.gmail.com> Message-ID: <CAOvn4qhKDzr4YO=wdCTVg=gUTDOMrRDQsOj1ptmmpy2fpMU-1g@mail.gmail.com> On 22 October 2014 12:14, Paul Moore <p.f.moore at gmail.com> wrote: > Actually, it looks like it's deliberate in IPython. See > > https://github.com/ipython/ipython/commit/1bcb58e939edac7812d0ad70d5072e27540b4f32 > (back in 2011). > > I'm not entirely sure how I change that config directly, so I hacked > the source. With TerminalInteractiveShell.multiline_history=True, > multi-line history works, but the display is corrupted. So it looks > like there is a pyreadline display issue at the root of this (i.e., > it'd need multi-line display in pyreadline to work before it made > sense to default this to True). > That's probably why it was disabled on Windows in the first place. If you haven't already, try with the pyreadline-ais fork - the things it says it has implemented may be relevant here. > PS How would I set TerminalInteractiveShell.multiline_history on the > IPython command line? I'd like to at least report this as a pyreadline > bug, and being able to describe how to reproduce it *without* saying > "hack IPython" would be nice :-) > It should be as simple as adding --TerminalInteractiveShell.multiline_history=True at the command line. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/de7a00b7/attachment.html> From pablo.winant at gmail.com Wed Oct 22 15:42:07 2014 From: pablo.winant at gmail.com (Pablo Winant) Date: Wed, 22 Oct 2014 15:42:07 -0400 Subject: [IPython-dev] Editor widget and data persistence In-Reply-To: <CAOvn4qgBWrd+5RuU8cdZCy8sERWg07TgUBpPcSNP1AHnOC_WPQ@mail.gmail.com> References: <CADQWuG4OzGoDtCd-JzzyOv8BP-uyi-8Xai1uNrd6EJtPLL0kVg@mail.gmail.com> <CAOvn4qgBWrd+5RuU8cdZCy8sERWg07TgUBpPcSNP1AHnOC_WPQ@mail.gmail.com> Message-ID: <CADQWuG4m-LaQ=xB7CK6ZUVnkNJHDB8mPT-bN5w7ZCz6qmUkSuQ@mail.gmail.com> Thank you Thomas. On Wed, Oct 22, 2014 at 12:28 PM, Thomas Kluyver <takowl at gmail.com> wrote: > Hi Pablo, > IPython.html.nbextensions.> I wonder if it is possible to save the state > of these widgets when saving the notebook > > Currently, no. We're working on ways to do that, but it turns out to be > more complicated than it seems. > > > More specifically, I'd like to use the text editor widget to edit a text > file that comes with a notebook > > It's possible to do this with widgets, but I don't think it's the best fit > for the problem. It sounds like what you want is the %%writefile cell > magic. Just make a code cell containing the text you want, with %%writefile > filename.txt at the top. When you run it, it will save that content to the > file. > > Actually my usecase is trying to provide users with an easy interface to edit the content of simple structure that is also serializable as a JSON/YAML file. I would be happy if I could find way to store information produced by the code in the notebook and then read it back. Maybe, there is a way to edit cell of notebook metadata from the notebook itself ? > We are also planning to put a text editor component inside the notebook > server, but that's not quite ready yet. > > > the IPython widgets are becoming one of the very few alternatives for > python web-guis > > Yes, and this is a much larger scope than the widget architecture was > really designed for. We're trying to work out how to handle this. > I can smell some big architectural work here... Good luck with that ! Pablo > > Thanks, > Thomas > > On 22 October 2014 07:58, Pablo Winant <pablo.winant at gmail.com> wrote: > >> Hi, >> >> The new widgets are absolutely wonderful ! >> >> I wonder if it is possible to save the state of these widgets when saving >> the notebook. More specifically, I'd like to use the text editor widget to >> edit a text file that comes with a notebook. That would kill two birds with >> one stone for me: avoid the need to ship a separate file with the notebook >> (btw, is there already a canonical way to do that ?), and be able to edit >> it from within the notebook. Are there plans in this direction ? Any idea >> about how I could implement that ? >> >> A somewhat related question: the IPython widgets are becoming one of the >> very few alternatives for python web-guis. Do you think it would be >> possible to use it for a relatively simple application and hide the >> notebook from user's sight so that it looks like an independent application >> ? >> >> Best, >> >> Pablo >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/4963a56c/attachment.html> From p.f.moore at gmail.com Wed Oct 22 16:02:54 2014 From: p.f.moore at gmail.com (Paul Moore) Date: Wed, 22 Oct 2014 21:02:54 +0100 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CAOvn4qhKDzr4YO=wdCTVg=gUTDOMrRDQsOj1ptmmpy2fpMU-1g@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> <CACac1F8FuAoGrqMMT2Bu8fXREnRjPLaS4PcbX-ViUaA40faBkw@mail.gmail.com> <CAOvn4qhKDzr4YO=wdCTVg=gUTDOMrRDQsOj1ptmmpy2fpMU-1g@mail.gmail.com> Message-ID: <CACac1F-q7M7M8SLPdP8sj8DJWs8-Gxe+8B7d53A5cQ_w5dtbog@mail.gmail.com> On 22 October 2014 20:39, Thomas Kluyver <takowl at gmail.com> wrote: > That's probably why it was disabled on Windows in the first place. If you > haven't already, try with the pyreadline-ais fork - the things it says it > has implemented may be relevant here. Nope, unfortunately not. The changes didn't indicate anything that might be relevant, and I just tested and indeed it has the same issue. > It should be as simple as adding > --TerminalInteractiveShell.multiline_history=True at the command line. Thanks. I could have sworn I'd tried that and it didn't work. I must have mistyped it or something. Paul From p.f.moore at gmail.com Wed Oct 22 16:22:34 2014 From: p.f.moore at gmail.com (Paul Moore) Date: Wed, 22 Oct 2014 21:22:34 +0100 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACac1F-q7M7M8SLPdP8sj8DJWs8-Gxe+8B7d53A5cQ_w5dtbog@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> <CACac1F8FuAoGrqMMT2Bu8fXREnRjPLaS4PcbX-ViUaA40faBkw@mail.gmail.com> <CAOvn4qhKDzr4YO=wdCTVg=gUTDOMrRDQsOj1ptmmpy2fpMU-1g@mail.gmail.com> <CACac1F-q7M7M8SLPdP8sj8DJWs8-Gxe+8B7d53A5cQ_w5dtbog@mail.gmail.com> Message-ID: <CACac1F-c1hjBvwo0mmPmuz1rapbb_7jQgi69-zHy1HcUk3YaHg@mail.gmail.com> On 22 October 2014 21:02, Paul Moore <p.f.moore at gmail.com> wrote: > On 22 October 2014 20:39, Thomas Kluyver <takowl at gmail.com> wrote: >> That's probably why it was disabled on Windows in the first place. If you >> haven't already, try with the pyreadline-ais fork - the things it says it >> has implemented may be relevant here. > > Nope, unfortunately not. The changes didn't indicate anything that > might be relevant, and I just tested and indeed it has the same issue. https://github.com/pyreadline/pyreadline/issues/31 One oddity. It appears that within a session with --TerminalInteractiveShell.multiline_history=True, up arrow recalls history line by line, not multi-line. But exiting and restarting *does* get the multi-line history. I'm not sure why this happens or if it's an IPython issue or setting. It doesn't happen on Unix, and I can't see anything obvious in IPython, so I suspect pyreadline again, but I'm not certain. Paul From takowl at gmail.com Wed Oct 22 16:25:45 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 22 Oct 2014 13:25:45 -0700 Subject: [IPython-dev] Console ipython - multi-line history editing In-Reply-To: <CACac1F-c1hjBvwo0mmPmuz1rapbb_7jQgi69-zHy1HcUk3YaHg@mail.gmail.com> References: <CACac1F9E0vfAAPOS_GEyt5jLWQ=bQ+Q8WbUVix-_0DcVMa8soA@mail.gmail.com> <CAOvn4qhQOBvr9_W8hiaTmYueEW+zDOyZLDFtJGYMWFxorS75Eg@mail.gmail.com> <CACac1F-PmpBy36eQ8B=LjEcqwi8StCXkd2t+i2ETjzrGd7u57A@mail.gmail.com> <CACac1F8FuAoGrqMMT2Bu8fXREnRjPLaS4PcbX-ViUaA40faBkw@mail.gmail.com> <CAOvn4qhKDzr4YO=wdCTVg=gUTDOMrRDQsOj1ptmmpy2fpMU-1g@mail.gmail.com> <CACac1F-q7M7M8SLPdP8sj8DJWs8-Gxe+8B7d53A5cQ_w5dtbog@mail.gmail.com> <CACac1F-c1hjBvwo0mmPmuz1rapbb_7jQgi69-zHy1HcUk3YaHg@mail.gmail.com> Message-ID: <CAOvn4qhP50EYF-_AV8SOJE0qpuhH1yRK-okX4WNqZon7N8=x3A@mail.gmail.com> On 22 October 2014 13:22, Paul Moore <p.f.moore at gmail.com> wrote: > One oddity. It appears that within a session with > --TerminalInteractiveShell.multiline_history=True, up arrow recalls > history line by line, not multi-line. But exiting and restarting > *does* get the multi-line history. > When you restart IPython, we only need to fill the readline history from our own database. Within the session, we need to replace what readline automatically records with the multiline history we assemble. So I'm not surprised that it actually works better with history from previous sessions. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/57cac09a/attachment.html> From jtaylor.debian at googlemail.com Wed Oct 22 16:37:20 2014 From: jtaylor.debian at googlemail.com (Julian Taylor) Date: Wed, 22 Oct 2014 22:37:20 +0200 Subject: [IPython-dev] Unable to build Docker image In-Reply-To: <1414003420402.37844@microsoft.com> References: <1414003420402.37844@microsoft.com> Message-ID: <54481580.6000903@googlemail.com> On 22.10.2014 20:43, Robert Alexander wrote: > I'm trying to follow the instructions at > https://github.com/jupyter/tmpnb to build a Docker image using the > github source. When I run the line: > > > docker build -t jupyter/demo image > > > I get the error: > > > 2014/10/22 18:39:28 stat image: no such file or directory > > Can someone please tell me how to resolve this? the last argument must be a folder containing a Dockerfile which in that repository is images/minimal/ and images/demo/ so you build an e.g. a minimal image with: docker build -t jupyter/demo images/minimal/ From moritz.beber at gmail.com Wed Oct 22 18:02:39 2014 From: moritz.beber at gmail.com (Moritz Beber) Date: Thu, 23 Oct 2014 00:02:39 +0200 Subject: [IPython-dev] debugging remote engine death In-Reply-To: <5442541A.9040900@gmail.com> References: <5442541A.9040900@gmail.com> Message-ID: <CAFOFTpR5Wp4k6JGumnDtM7wKyCfZL29u252ox3mSxBdoRpLMsQ@mail.gmail.com> Can anyone at least tell how to find the right engine log to look into given the uuid of the engine, please? On Sat, Oct 18, 2014 at 1:50 PM, Moritz Emanuel Beber < moritz.beber at gmail.com> wrote: > Hi all, > > I'd like to ask for your help in debugging a remote error. In case it > matters, I'm running this on: > > Python 2.7.5 > > ipython 2.3.0 > > pyzmq 14.3.1 > > > not sure about the libzmq version but it was pulled in with pyzmq and > should be recent. > > So I'm using IPython.parallel with default profile and settings. The error > I'm getting is the following: > > Traceback (most recent call last): > > File "scripts/trn_randomization_analysis.py", line 314, in <module> > > sys.exit(args.func(remote_client, args)) > > File "scripts/trn_randomization_analysis.py", line 259, in main_analysis > > for df in res_it: > > File "/home/mbeber/.virtualenvs/control/local/lib/python2.7/ > site-packages/IPython/parallel/client/asyncresult.py", line 594, in > __iter__ > > for r in it(): > > File "/home/mbeber/.virtualenvs/control/local/lib/python2.7/ > site-packages/IPython/parallel/client/asyncresult.py", line 641, in > _unordered_iter > > rlist = ar.get() > > File "/home/mbeber/.virtualenvs/control/local/lib/python2.7/ > site-packages/IPython/parallel/client/asyncresult.py", line 118, in get > > raise self._exception > > IPython.parallel.error.RemoteError: EngineError(Engine > 'bd38ee8e-ad65-41af-944d-a9ea15162c03' died while running task > u'a392e922-e01f-41a7-9e5e-def08ba61da8') > > So my first question/concern here is: A single engine has died. Shouldn't > my main process just keep running and reschedule the task to a different > engine? > > I suspect that it may be a memory problem, so I wanted to inspect the > logs. However, the log names are of a different format. Their names are > ipcontroller-<number>.log or ipengine-<number>.log. I guess the numbers > correspond to the PIDs? Either way, I'm not sure how to find that number > after the engine has died and the main process has terminated. The cluster > is still running, so maybe that is of help? > > So instead I did a grep on all logs for the engine UUID: > > cat * | grep bd38ee8e-ad65-41af-944d-a9ea15162c03 > > 2014-10-12 20:18:26.477 [IPControllerApp] client::client > 'bd38ee8e-ad65-41af-944d-a9ea15162c03' requested u'registration_request' > > 2014-10-12 20:18:26.529 [IPControllerApp] WARNING | iopub::IOPub message > lacks parent: {'parent_header': {}, 'msg_type': u'status', 'msg_id': > u'042f9a0a-61c9-4238-aee5-3a6ea89596e0', 'content': {u'execution_state': > u'starting'}, 'header': {u'date': datetime.datetime(2014, 10, 12, 20, 18, > 26, 529317), u'username': u'mbeber', u'session': u'bd38ee8e-ad65-41af-944d-a9ea15162c03', > u'msg_id': u'042f9a0a-61c9-4238-aee5-3a6ea89596e0', u'msg_type': > u'status'}, 'buffers': [], 'metadata': {}} > > 2014-10-12 20:18:31.693 [IPControllerApp] registration::finished > registering engine 0:bd38ee8e-ad65-41af-944d-a9ea15162c03 > > 2014-10-12 22:28:04.693 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 1 > > 2014-10-12 22:28:07.693 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 2 > > 2014-10-12 22:28:10.692 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 3 > > 2014-10-12 22:28:13.693 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 4 > > 2014-10-12 22:28:16.692 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 5 > > 2014-10-12 22:28:19.692 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 6 > > 2014-10-12 22:28:22.693 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 7 > > 2014-10-12 22:28:25.692 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 8 > > 2014-10-12 22:28:28.693 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 9 > > 2014-10-12 22:28:31.692 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 10 > > 2014-10-12 22:28:34.692 [IPControllerApp] heartbeat::missed > bd38ee8e-ad65-41af-944d-a9ea15162c03 : 11 > > > So nothing found that tells me much more. Can anyone answer some of my > question and/or recommend a strategy for further investigating this problem? > > Thank you in advance, > Moritz > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/7c03fb21/attachment.html> From benjaminrk at gmail.com Wed Oct 22 18:05:30 2014 From: benjaminrk at gmail.com (MinRK) Date: Wed, 22 Oct 2014 15:05:30 -0700 Subject: [IPython-dev] debugging remote engine death In-Reply-To: <CAFOFTpR5Wp4k6JGumnDtM7wKyCfZL29u252ox3mSxBdoRpLMsQ@mail.gmail.com> References: <5442541A.9040900@gmail.com> <CAFOFTpR5Wp4k6JGumnDtM7wKyCfZL29u252ox3mSxBdoRpLMsQ@mail.gmail.com> Message-ID: <CAHNn8BV_g3NxspGf1VR3v8KT2vUYt8jtUkKWOeGiAB5CS-s6NA@mail.gmail.com> engines logs are identified by the process ID (not a great choice, I think). The engine ID should be logged, so you can see which engine had which ID: grep 'registration' ~/.ipython/profile_default/log/ipengine-*.log Not exactly awesome, but it should get you to the right file, at least. -MinRK On Wed, Oct 22, 2014 at 3:02 PM, Moritz Beber <moritz.beber at gmail.com> wrote: > Can anyone at least tell how to find the right engine log to look into > given the uuid of the engine, please? > > On Sat, Oct 18, 2014 at 1:50 PM, Moritz Emanuel Beber < > moritz.beber at gmail.com> wrote: > >> Hi all, >> >> I'd like to ask for your help in debugging a remote error. In case it >> matters, I'm running this on: >> >> Python 2.7.5 >> >> ipython 2.3.0 >> >> pyzmq 14.3.1 >> >> >> not sure about the libzmq version but it was pulled in with pyzmq and >> should be recent. >> >> So I'm using IPython.parallel with default profile and settings. The >> error I'm getting is the following: >> >> Traceback (most recent call last): >> >> File "scripts/trn_randomization_analysis.py", line 314, in <module> >> >> sys.exit(args.func(remote_client, args)) >> >> File "scripts/trn_randomization_analysis.py", line 259, in >> main_analysis >> >> for df in res_it: >> >> File "/home/mbeber/.virtualenvs/control/local/lib/python2.7/ >> site-packages/IPython/parallel/client/asyncresult.py", line 594, in >> __iter__ >> >> for r in it(): >> >> File "/home/mbeber/.virtualenvs/control/local/lib/python2.7/ >> site-packages/IPython/parallel/client/asyncresult.py", line 641, in >> _unordered_iter >> >> rlist = ar.get() >> >> File "/home/mbeber/.virtualenvs/control/local/lib/python2.7/ >> site-packages/IPython/parallel/client/asyncresult.py", line 118, in get >> >> raise self._exception >> >> IPython.parallel.error.RemoteError: EngineError(Engine >> 'bd38ee8e-ad65-41af-944d-a9ea15162c03' died while running task >> u'a392e922-e01f-41a7-9e5e-def08ba61da8') >> >> So my first question/concern here is: A single engine has died. Shouldn't >> my main process just keep running and reschedule the task to a different >> engine? >> >> I suspect that it may be a memory problem, so I wanted to inspect the >> logs. However, the log names are of a different format. Their names are >> ipcontroller-<number>.log or ipengine-<number>.log. I guess the numbers >> correspond to the PIDs? Either way, I'm not sure how to find that number >> after the engine has died and the main process has terminated. The cluster >> is still running, so maybe that is of help? >> >> So instead I did a grep on all logs for the engine UUID: >> >> cat * | grep bd38ee8e-ad65-41af-944d-a9ea15162c03 >> >> 2014-10-12 20:18:26.477 [IPControllerApp] client::client >> 'bd38ee8e-ad65-41af-944d-a9ea15162c03' requested u'registration_request' >> >> 2014-10-12 20:18:26.529 [IPControllerApp] WARNING | iopub::IOPub message >> lacks parent: {'parent_header': {}, 'msg_type': u'status', 'msg_id': >> u'042f9a0a-61c9-4238-aee5-3a6ea89596e0', 'content': {u'execution_state': >> u'starting'}, 'header': {u'date': datetime.datetime(2014, 10, 12, 20, 18, >> 26, 529317), u'username': u'mbeber', u'session': u'bd38ee8e-ad65-41af-944d-a9ea15162c03', >> u'msg_id': u'042f9a0a-61c9-4238-aee5-3a6ea89596e0', u'msg_type': >> u'status'}, 'buffers': [], 'metadata': {}} >> >> 2014-10-12 20:18:31.693 [IPControllerApp] registration::finished >> registering engine 0:bd38ee8e-ad65-41af-944d-a9ea15162c03 >> >> 2014-10-12 22:28:04.693 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 1 >> >> 2014-10-12 22:28:07.693 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 2 >> >> 2014-10-12 22:28:10.692 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 3 >> >> 2014-10-12 22:28:13.693 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 4 >> >> 2014-10-12 22:28:16.692 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 5 >> >> 2014-10-12 22:28:19.692 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 6 >> >> 2014-10-12 22:28:22.693 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 7 >> >> 2014-10-12 22:28:25.692 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 8 >> >> 2014-10-12 22:28:28.693 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 9 >> >> 2014-10-12 22:28:31.692 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 10 >> >> 2014-10-12 22:28:34.692 [IPControllerApp] heartbeat::missed >> bd38ee8e-ad65-41af-944d-a9ea15162c03 : 11 >> >> >> So nothing found that tells me much more. Can anyone answer some of my >> question and/or recommend a strategy for further investigating this problem? >> >> Thank you in advance, >> Moritz >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/b0bad03d/attachment.html> From moritz.beber at gmail.com Wed Oct 22 18:12:59 2014 From: moritz.beber at gmail.com (Moritz Beber) Date: Thu, 23 Oct 2014 00:12:59 +0200 Subject: [IPython-dev] debugging remote engine death In-Reply-To: <CAHNn8BV_g3NxspGf1VR3v8KT2vUYt8jtUkKWOeGiAB5CS-s6NA@mail.gmail.com> References: <5442541A.9040900@gmail.com> <CAFOFTpR5Wp4k6JGumnDtM7wKyCfZL29u252ox3mSxBdoRpLMsQ@mail.gmail.com> <CAHNn8BV_g3NxspGf1VR3v8KT2vUYt8jtUkKWOeGiAB5CS-s6NA@mail.gmail.com> Message-ID: <CAFOFTpQH+vGhQbqwGAAdN-n4NwANYU2obx=fpZd_rVobADM2aQ@mail.gmail.com> Hi, On Thu, Oct 23, 2014 at 12:05 AM, MinRK <benjaminrk at gmail.com> wrote: > engines logs are identified by the process ID (not a great choice, I > think). The engine ID should be logged, so you can see which engine had > which ID: > > grep 'registration' ~/.ipython/profile_default/log/ipengine-*.log > > Not exactly awesome, but it should get you to the right file, at least. > > -MinRK > > Unfortunately, not quite. This gives me the id used internally but not the uuid of the engine given in the RemoteError. "IPython.parallel.error.RemoteE rror: EngineError(Engine 'bd38ee8e-ad65-41af-944d-a9ea15162c03' died while running task u'a392e922-e01f-41a7-9e5e-def08ba61da8')" versus: ".ipython/profile_default/log/ipengine-16101.log:2014-10-21 18:37:07.225 [IPEngineApp] Completed registration with id 0" Thank you for looking into it, though. Moritz -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/856c2eb0/attachment.html> From moritz.beber at gmail.com Wed Oct 22 18:16:26 2014 From: moritz.beber at gmail.com (Moritz Beber) Date: Thu, 23 Oct 2014 00:16:26 +0200 Subject: [IPython-dev] debugging remote engine death In-Reply-To: <CAFOFTpQH+vGhQbqwGAAdN-n4NwANYU2obx=fpZd_rVobADM2aQ@mail.gmail.com> References: <5442541A.9040900@gmail.com> <CAFOFTpR5Wp4k6JGumnDtM7wKyCfZL29u252ox3mSxBdoRpLMsQ@mail.gmail.com> <CAHNn8BV_g3NxspGf1VR3v8KT2vUYt8jtUkKWOeGiAB5CS-s6NA@mail.gmail.com> <CAFOFTpQH+vGhQbqwGAAdN-n4NwANYU2obx=fpZd_rVobADM2aQ@mail.gmail.com> Message-ID: <CAFOFTpRFAGPH8hL4BL8+mByuKZwxfzyF9OUf7qetcbTkuJsE7w@mail.gmail.com> Ah, I can piece it together from the ipcontroller log: 37 2014-10-21 00:00:08.025 [IPControllerApp] registration::finished registering engine 9:c8f30ab9-58ec-460a-a427-d430e834129e A few loops but I can manage from here. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/84a6c758/attachment.html> From rgbkrk at gmail.com Wed Oct 22 18:48:48 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Wed, 22 Oct 2014 23:48:48 +0100 Subject: [IPython-dev] Unable to build Docker image In-Reply-To: <54481580.6000903@googlemail.com> References: <1414003420402.37844@microsoft.com> <54481580.6000903@googlemail.com> Message-ID: <CA+tbMaWps38ZVM9eGLPsAbZZP=DCT+VFLxXnj8oqNWSLHgLuxg@mail.gmail.com> Thanks Julian! Yeah the README didn't get fixed up after we made two base images. Currently there's a Makefile for spinning up the dev setup quickly, by invoking make dev. It will tear down any containers to bring up a new environment. Note: this is all under active development and the script folder was a quick way for me to note a way of piecing these together (it's not the only way to deploy this). On Wed, Oct 22, 2014 at 9:37 PM, Julian Taylor < jtaylor.debian at googlemail.com> wrote: > On 22.10.2014 20:43, Robert Alexander wrote: > > I'm trying to follow the instructions at > > https://github.com/jupyter/tmpnb to build a Docker image using the > > github source. When I run the line: > > > > > > docker build -t jupyter/demo image > > > > > > I get the error: > > > > > > 2014/10/22 18:39:28 stat image: no such file or directory > > > > Can someone please tell me how to resolve this? > > > the last argument must be a folder containing a Dockerfile which in that > repository is > images/minimal/ and images/demo/ > > so you build an e.g. a minimal image with: > > docker build -t jupyter/demo images/minimal/ > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/b6aecb1e/attachment.html> From rgbkrk at gmail.com Wed Oct 22 19:09:05 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Thu, 23 Oct 2014 00:09:05 +0100 Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions In-Reply-To: <1414002105549.34538@microsoft.com> References: <1414002105549.34538@microsoft.com> Message-ID: <CA+tbMaV8aQ6nqP2OLNjdgTLxJ3mshA+Qhv2qnXOOHPLt-zRoUg@mail.gmail.com> Hey Robert! Couple things to get started in diagnosing these issues with docker. Use docker ps to list running containers and docker ps -a to list all containers including those that have stopped. If any jupyter/demo servers or jupyter/tmpnb instances were up, use their container id (e.g. 8239ba87) to run docker logs [CONTAINER]. That being said, the big change that was introduced in the last week was spawn pools. It now takes longer for tmpnb to boot while it is allocating containers. That *does* mean that you won't see the service up immediately. Check the logs to see what's going on. You also need to make real choices about memory limits on each container (--mem-limit=512m) as well as pool size (--pool-size=10). pool_size*mem_limit should be < available RAM. I deployed this earlier tonight with the vanilla docker instructions, but I gave it some time to warm up. If none of this helps, I can work with you next week after I wrap up with the Mozilla Festival. Feel free to ask more questions on list (or in repo) and provide logs too. Once you get in a good state with this, we'd certainly welcome pull requests to improve the documentation. Cheers! -- Kyle On Wed, Oct 22, 2014 at 7:21 PM, Robert Alexander <roalexan at microsoft.com> wrote: > Hello. I'm fairly new to Jupityr/Docker. Last week I did the following > steps to get things started: > > > -Create a Ubuntu 14.04 VM on Azure # tier:basic, size:A0) > > -Get Docker (following official Docker instructions at: > http://docs.docker.com/installation/ubuntulinux/) > > sudo apt-get update # Ensure the list of available packages is up to date > before installing anything new > > sudo apt-get -y install docker.io # Install Docker by installing the > docker-io package > > sudo ln -sf /usr/bin/docker.io /usr/local/bin/docker # link and fix paths > > # sudo sed -i '$acomplete -F _docker docker' /etc/bash_completion.d/ > docker.io - instructions say to do this, but the line is already there > > sudo update-rc.d docker.io defaults # optionally, configure Docker to > start when the server boots > > source /etc/bash_completion.d/docker.io > > -Get Docker container using "Quick start" (follow instructions at: > https://github.com/jupyter/tmpnb) > > sudo docker pull jupyter/demo # download Docker container. > > export TOKEN=$( head -c 30 /dev/urandom | xxd -p ) > > sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN > jupyter/configurable-http-proxy --default-target http://127.0.0.1:9999 > > sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN -v > /var/run/docker.sock:/docker.sock jupyter/tmpnb > > -Add new endpoint to virtual machine > > protocol:TCP, public port:8000, private port:9999 # map internal to > external port > > This wasn't without error. I got the error: > > APIError: 404 Client Error: Not Found ("client and server don't have same > version (client : 1.13, server: 1.12)") > > So, I was attempting to re-run my steps, this time explicitly setting the > docker version via: > > sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN -v > /var/run/docker.sock:/docker.sock jupyter/tmpnb python orchestrate.py > --cull-timeout=60 --docker-version="1.12" > > However, *now I time out trying to get to the Jupyter demo*. Did > something change to break things between then and now? > > > -Robert > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/49cd2465/attachment.html> From hughesadam87 at gmail.com Wed Oct 22 19:56:08 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Wed, 22 Oct 2014 19:56:08 -0400 Subject: [IPython-dev] Editor widget and data persistence In-Reply-To: <CADQWuG4m-LaQ=xB7CK6ZUVnkNJHDB8mPT-bN5w7ZCz6qmUkSuQ@mail.gmail.com> References: <CADQWuG4OzGoDtCd-JzzyOv8BP-uyi-8Xai1uNrd6EJtPLL0kVg@mail.gmail.com> <CAOvn4qgBWrd+5RuU8cdZCy8sERWg07TgUBpPcSNP1AHnOC_WPQ@mail.gmail.com> <CADQWuG4m-LaQ=xB7CK6ZUVnkNJHDB8mPT-bN5w7ZCz6qmUkSuQ@mail.gmail.com> Message-ID: <CAMHV+dDUO8qhHD8NY7pQawM9m+qykC+bs_tKKEvs=GmHb1o5hQ@mail.gmail.com> If you have a notebook that calls the GUI, you can launch it in a second notebook just using the %run magic as well. IE, if you had: mywidget.ipynb Then you can launch it in a separate notebook with: %run mywidget.ipynb On Wed, Oct 22, 2014 at 3:42 PM, Pablo Winant <pablo.winant at gmail.com> wrote: > Thank you Thomas. > > On Wed, Oct 22, 2014 at 12:28 PM, Thomas Kluyver <takowl at gmail.com> wrote: > >> Hi Pablo, >> IPython.html.nbextensions.> I wonder if it is possible to save the state >> of these widgets when saving the notebook >> >> Currently, no. We're working on ways to do that, but it turns out to be >> more complicated than it seems. >> >> > More specifically, I'd like to use the text editor widget to edit a >> text file that comes with a notebook >> >> It's possible to do this with widgets, but I don't think it's the best >> fit for the problem. It sounds like what you want is the %%writefile cell >> magic. Just make a code cell containing the text you want, with %%writefile >> filename.txt at the top. When you run it, it will save that content to the >> file. >> >> > Actually my usecase is trying to provide users with an easy interface to > edit the content of simple structure that is also serializable as a > JSON/YAML file. I would be happy if I could find way to store information > produced by the code in the notebook and then read it back. Maybe, there is > a way to edit cell of notebook metadata from the notebook itself ? > > > >> We are also planning to put a text editor component inside the notebook >> server, but that's not quite ready yet. >> >> > the IPython widgets are becoming one of the very few alternatives for >> python web-guis >> >> Yes, and this is a much larger scope than the widget architecture was >> really designed for. We're trying to work out how to handle this. >> > > I can smell some big architectural work here... Good luck with that ! > > Pablo > > > >> >> Thanks, >> Thomas >> >> On 22 October 2014 07:58, Pablo Winant <pablo.winant at gmail.com> wrote: >> >>> Hi, >>> >>> The new widgets are absolutely wonderful ! >>> >>> I wonder if it is possible to save the state of these widgets when >>> saving the notebook. More specifically, I'd like to use the text editor >>> widget to edit a text file that comes with a notebook. That would kill two >>> birds with one stone for me: avoid the need to ship a separate file with >>> the notebook (btw, is there already a canonical way to do that ?), and be >>> able to edit it from within the notebook. Are there plans in this direction >>> ? Any idea about how I could implement that ? >>> >>> A somewhat related question: the IPython widgets are becoming one of the >>> very few alternatives for python web-guis. Do you think it would be >>> possible to use it for a relatively simple application and hide the >>> notebook from user's sight so that it looks like an independent application >>> ? >>> >>> Best, >>> >>> Pablo >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141022/968f41bd/attachment.html> From bussonniermatthias at gmail.com Thu Oct 23 03:44:02 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Thu, 23 Oct 2014 09:44:02 +0200 Subject: [IPython-dev] Multiple selections In-Reply-To: <CAHNn8BX2Gm0mL+XBE6RVh8-C_6mgbNwE8D5AwvWhPRM=Putv8A@mail.gmail.com> References: <etPan.5447ef97.436c6125.99a@dynamic-oit-fishnet-d-25.princeton.edu> <CACLE5GDCE9DLj7m_veLZDG_WpjS7M9mgYi6rHsCqOspbO4EFPA@mail.gmail.com> <CAHNn8BX2Gm0mL+XBE6RVh8-C_6mgbNwE8D5AwvWhPRM=Putv8A@mail.gmail.com> Message-ID: <B037F78F-8A5C-43E5-BA92-FA5B0DA300CD@gmail.com> Indeed, it is new to CM4, You can also use Cmd+Click to make non contiguous selection. And beyond just switching the all keycap you can ad 1 shortcut to codemirror keymap. -- M Le 22 oct. 2014 ? 20:21, MinRK <benjaminrk at gmail.com> a ?crit : > Yes, I think enabling sublime keymap is possible: > > in your profile?s custom.js: > > require(["codemirror/keymap/sublime", "notebook/js/cell"], function(sublime_keymap, cell) { > cell.Cell.options_default.cm_config.keyMap = 'sublime'; > }); > c/o @jdfreder > > ? > > On Wed, Oct 22, 2014 at 11:08 AM, William Stein <wstein at gmail.com> wrote: > On Wed, Oct 22, 2014 at 10:55 AM, Matthieu Gomez > <gomez.matthieu at gmail.com> wrote: > > Hello, > > > > I'm a recent (R) user of IPython and I find it amazing. > > > > I'm using the current Github version. I've discovered that I could select > > multiple lines of codes and edit them (by using ALT), which is awesome. In a > > similar spirit, is it possible to select multiple words starting from a > > selection of one?. In Sublime Text, if one selects some characters and press > > CMD + D, then both the current selection and the next set of character > > matching the current selection are selected. Pressing CMD+D a second time > > adds the third set of characters to the selection, etc (here is a video > > https://www.youtube.com/watch?v=i2SVJa2EGIw). This is very helpful when one > > wants to modify the name of a variable everywhere in the code. > > > > However, as of now, when I press CMD + D, the selection is deleted. I was > > wondering whether this feature was implemented, maybe under a different > > shortcut. > > I'm guessing that IPython just got this functionality as a side-effect > of upgrading to Codemirror 4. > Codemirror has a Sublime keybinding mode, which provides precisely the > functionality you mention > above. So if IPython could expose setting the sublime (and vim and > emacs?!) keybinding modes > that Codemirror supports, then you get the above functionality. > > In SageMathCloud (https://cloud.sagemath.com), you can set sublime > keybindings in account settings, then open a file (anything except > ipython notebooks, which don't inherit these settings *yet*), and edit > it, and it works as you expect above. I've actually been wondering > about how to do this, since I love multiple cursors, and I'm pleased > that it just works. > > William > > > > > Thanks a lot! > > > > Matthieu > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > William Stein > Professor of Mathematics > University of Washington > http://wstein.org > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/4b054c51/attachment.html> From r.gom1977 at gmail.com Thu Oct 23 08:27:47 2014 From: r.gom1977 at gmail.com (Robert Gomulka) Date: Thu, 23 Oct 2014 14:27:47 +0200 Subject: [IPython-dev] pyreadline status Message-ID: <CAMb=YrMGcV8ZF7=Da8z+ResW556o5ghk50b+GkuS-nbB=uusDw@mail.gmail.com> Hi all, is pyreadline alive? I've recently noticed that reverse search is broken, notemacs mode is broken and there are few pull requests hanging on github. (It seems that everyone switched to notebook now, where pyreadline is not a concern) Regards, Robert -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/afc16b06/attachment.html> From cbeaumont at cfa.harvard.edu Thu Oct 23 11:53:12 2014 From: cbeaumont at cfa.harvard.edu (Chris Beaumont) Date: Thu, 23 Oct 2014 11:53:12 -0400 Subject: [IPython-dev] Shutdown InProcessKernel? Message-ID: <CAFP9tKrX-j4-OrQ-2iysqDAzim0_YdtDJUXK9o8zhGZ8e6xA7Q@mail.gmail.com> Hi, Say I start the vanilla python REPL, and type: >>> x=5 >>> from IPython.kernel.inprocess.ipkernel import InProcessKernel >>> x = InProcessKernel() In : x # NameError: name 'x' is not defined instantiating a kernel takes over the REPL, gives a new prompt, and defines a new namespace (where neither x nor k are defined) At this point is there any way to shutdown the kernel, to get back to the old prompt and namespace? Thanks, Chris -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/e26ed328/attachment.html> From jon.freder at gmail.com Thu Oct 23 16:04:59 2014 From: jon.freder at gmail.com (Jonathan Frederic) Date: Thu, 23 Oct 2014 13:04:59 -0700 Subject: [IPython-dev] Javascript comments Message-ID: <CAAoBLw0x0aCyTwiyJEOKOymcyr0eOE-5BG+LuK=5nDsmhhVy4Q@mail.gmail.com> As a follow up of today's meeting, it looks like, if we don't mind the comment appearing before the function, JSDoc allows for our own doc string format (see simplest case): http://usejsdoc.org/about-getting-started.html . JSDoc claims to be "highly extensible" and has a markdown plugin distributed with it. Here's a good article comparing the 4 most popular JS comment -> API doc tools: http://blog.fusioncharts.com/2013/12/jsdoc-vs-yuidoc-vs-doxx-vs-docco-choosing-a-javascript-documentation-generator/ My preference is for JSDoc, but I'd like to hear what others think. Also the option to NOT use a comment -> doc parser still exists. Provided we can commit to keeping a separate API docs by hand. Cheers, Jon -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/f1770570/attachment.html> From dongta.hds at gmail.com Thu Oct 23 17:06:24 2014 From: dongta.hds at gmail.com (Dong Ta) Date: Thu, 23 Oct 2014 14:06:24 -0700 Subject: [IPython-dev] Jupyter Hub login problem Message-ID: <CAOvHdZTdHJ-D+2ObnbMznz9nLMh8evYLqA+PT=gcqaca2KVh1g@mail.gmail.com> Hi, I ran the jupyterhub command as an admin user. I can log in using the admin credential. However, I cannot log in using a different user's credential. I would get this error message. {'error': 'Invalid username or password'} That account does exist and I've made sure that the username/password is correct. What am I missing here? DT -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/580caff2/attachment.html> From nick.bollweg at gmail.com Thu Oct 23 21:31:51 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Thu, 23 Oct 2014 21:31:51 -0400 Subject: [IPython-dev] Javascript comments In-Reply-To: <CAAoBLw0x0aCyTwiyJEOKOymcyr0eOE-5BG+LuK=5nDsmhhVy4Q@mail.gmail.com> References: <CAAoBLw0x0aCyTwiyJEOKOymcyr0eOE-5BG+LuK=5nDsmhhVy4Q@mail.gmail.com> Message-ID: <CACejjWyjCn1U_E99d5DmJwPR8Zk6+j2i4Yi3tTpahiLqEB1TYQ@mail.gmail.com> Is it worth considering something that works with the existing sphinx documentation? https://jsdoc-toolkit-rst-template.readthedocs.org/en/latest/index.html This is used, for example, by safari books online: https://pypi.python.org/pypi/sbo-sphinx/2.0.2 And while "jupyter != ipython" might be valid here, the fact remains that sphinx makes very nice output documents... nice enough to be used by the official julia documentation, for example! On Thu, Oct 23, 2014 at 4:04 PM, Jonathan Frederic <jon.freder at gmail.com> wrote: > As a follow up of today's meeting, it looks like, if we don't mind the > comment appearing before the function, JSDoc allows for our own doc string > format (see simplest case): http://usejsdoc.org/about-getting-started.html > . JSDoc claims to be "highly extensible" and has a markdown plugin > distributed with it. Here's a good article comparing the 4 most popular JS > comment -> API doc tools: > http://blog.fusioncharts.com/2013/12/jsdoc-vs-yuidoc-vs-doxx-vs-docco-choosing-a-javascript-documentation-generator/ > > My preference is for JSDoc, but I'd like to hear what others think. Also > the option to NOT use a comment -> doc parser still exists. Provided we > can commit to keeping a separate API docs by hand. > > Cheers, > Jon > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/6804c25a/attachment.html> From benjaminrk at gmail.com Thu Oct 23 22:20:07 2014 From: benjaminrk at gmail.com (Min RK) Date: Thu, 23 Oct 2014 19:20:07 -0700 Subject: [IPython-dev] Jupyter Hub login problem In-Reply-To: <CAOvHdZTdHJ-D+2ObnbMznz9nLMh8evYLqA+PT=gcqaca2KVh1g@mail.gmail.com> References: <CAOvHdZTdHJ-D+2ObnbMznz9nLMh8evYLqA+PT=gcqaca2KVh1g@mail.gmail.com> Message-ID: <D7FBE028-EF6C-4F6D-9C67-A5521C712647@gmail.com> How have you configured the Hub? What user is running the server? Can you include log output? Possibly after running with `--debug`? -MinRK > On Oct 23, 2014, at 14:06, Dong Ta <dongta.hds at gmail.com> wrote: > > Hi, > > I ran the jupyterhub command as an admin user. I can log in using the admin credential. However, I cannot log in using a different user's credential. I would get this error message. > > {'error': 'Invalid username or password'} > > That account does exist and I've made sure that the username/password is correct. > > What am I missing here? > > DT > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141023/e33f7d3a/attachment.html> From claresloggett at gmail.com Fri Oct 24 01:01:47 2014 From: claresloggett at gmail.com (Clare Sloggett) Date: Fri, 24 Oct 2014 16:01:47 +1100 Subject: [IPython-dev] Jupyterhub behind NGINX redirect In-Reply-To: <CAAusYCg2qVDzOvhfFhKzUenv-7tDpG3BGkcfLYB1sq_nZYdi8g@mail.gmail.com> References: <CAETqNqG1cVMpxaSOW=s3H9Vty+2+qZtSyg2fnXX0-yixADZY6Q@mail.gmail.com> <CAAusYCg2qVDzOvhfFhKzUenv-7tDpG3BGkcfLYB1sq_nZYdi8g@mail.gmail.com> Message-ID: <CAETqNqG-y9ZfNZMnReHdhCPxaVGi1A6gs4ZCzaz-pSw3m3oRiw@mail.gmail.com> Hi Doug, Thanks for this. I had actually just been thinking about about the NGINX redirect issue, and had assumed everything behind that would be fairly straightforward. But it sounds like you are saying there may be more fundamental issues, and to be honest I haven't tested that the redirect is definitely the source of all my problems. It sounds like I need to do some more direct testing and come back! In the meantime, if anyone has insight into what could be causing a URL rewrite like "/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython...." that could be really helpful. Cheers, Clare On 13 October 2014 00:44, Doug Blank <doug.blank at gmail.com> wrote: > On Sun, Oct 12, 2014 at 1:35 AM, Clare Sloggett <claresloggett at gmail.com> > wrote: > > > > Hi all, > > > > Am I right in thinking this list is also the right place for questions > about Jupyterhub? > > > > I'm trying to set up Jupyterhub for multiple users, on the same server > where we are running several other services. Currently there are NGINX > redirects in place to these other services. I'd like to set up http://<public-url>/ipython/ > to redirect to a port on localhost and run Jupyterhub over that port. Is > this possible? > > > > I've got this working in the past with single-user IPython Notebook. For > that, I set config options c.NotebookApp.base_project_url, > c.NotebookApp.base_kernel_url, and c.NotebookApp.webapp_settings to be > aware of the ipython/ URL prefix. We used an NGINX redirect to forward > requests and handle websockets properly, which looked like > > > > location /ipython/ { > > proxy_pass http://127.0.0.1:9510; > > proxy_set_header Host $host; > > proxy_set_header X-Real-IP $remote_addr; > > proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; > > proxy_set_header Upgrade $http_upgrade; > > proxy_set_header Connection "upgrade"; > > } > > > > This worked for the old single-user notebook. But, I'm not clear on the > model Jupyterhub is using (and I'm not much of a sysadmin). I read through > the command-line options, thought from them that I don't need to strip the > /ipython/ from the incoming requests, and have tried using a similar > redirect to the above and setting --JupyterHubApp.base_url='ipython/' and > also setting --port 9510. This does seem to see the incoming requests but > results in amusing requests like > > > > 500 GET > /ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/...... > > > > ... so clearly I haven't understood what's going on. Does anyone have > any pointers on how this should work? I haven't read any docs other than > the README and the command-line parameter information, so apologies if > there's something obvious that I didn't look at. > > > > I'm also interested in running Jupyterhub as a daemon, so if that's > something that's been done before and there's anything I should know, that > would be great. > > There is one other document, other than the README.md and the reported > issues [1]: > > > https://github.com/jupyter/jupyterhub/wiki/Using-sudo-to-run-the-server-as-non-root > > Despite the warning at the top of that page, you can make jupyterhub work > on some systems (eg, Linux, such as Ubuntu) using sudo, but not as root. I > suspect that this would be the recommended setup when jupyterhub is > complete. One recent change is the ability to save/load state from a > database. The wiki page above hasn't been updated with the note from this > issue: > > https://github.com/jupyter/jupyterhub/issues/57 > > It might be easier to start without NGINX, and then add it after you have > a working jupyterhub system. It would be nice to have a little bash script > to make this a "service" that would support "start", "top", and "status"... > but I haven't had time. Currently, we're just becoming the non-root sudoer > ("rhea" in the docs) and starting the server, something along the lines: > > jupyterhub --LocalProcessSpawner.set_user=sudo > --JupyterHubApp.ip=165.106.10.83 --JupyterHubApp.port=80 > --db='sqlite:///:memory:' &>> /var/log/jupyterhub/log & > > The next step for us is to get it running under https... looks like others > have blazed that trail, so it looks possible. > > If you have success, it would be great to add to the wiki docs... I > suspect that many of us that aren't sys admins will be wanting to get this > up and running. > > -Doug > > [1] - https://github.com/jupyter/jupyterhub > > > Any help much appreciated! > > > > Clare > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/82cce42f/attachment.html> From dongta.hds at gmail.com Fri Oct 24 04:17:50 2014 From: dongta.hds at gmail.com (Dong Ta) Date: Fri, 24 Oct 2014 01:17:50 -0700 Subject: [IPython-dev] Jupyter Hub login problem Message-ID: <CAOvHdZS=VqyinHqh-jbv6DqDvWEnrZm8c5wH7Ld6qz2dVgdUEQ@mail.gmail.com> Hi Min, I followed the instructions on the homepage. I installed the hub using *pip install .* - If I start jupyterhub using the admin account. Then I can only log in using the admin account and not other accounts (although I've added other accounts to the hub as). - If I start with sudo /etc/anaconda/bin/jupyterhub, then I cannot log in using any account (500 error on the browser). Here's the error in the terminal. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/tornado/web.py", line 1273, in _when_complete if result.result() is not None: File "/usr/lib/python2.7/site-packages/tornado/concurrent.py", line 129, in result raise_exc_info(self.__exc_info) File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 227, in wrapper runner.run() File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 529, in run yielded = self.gen.throw(*exc_info) File "/usr/lib/python2.7/site-packages/jupyterhub/handlers/login.py", line 60, in post yield self.spawn_single_user(user) File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 557, in run self.yield_point.start(self) File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 399, in start self.result = self.future.result() File "/usr/lib/python2.7/site-packages/tornado/concurrent.py", line 129, in result raise_exc_info(self.__exc_info) File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 227, in wrapper runner.run() File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 529, in run yielded = self.gen.throw(*exc_info) File "/usr/lib/python2.7/site-packages/jupyterhub/handlers/base.py", line 171, in spawn_single_user config=self.config, File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 557, in run self.yield_point.start(self) File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 399, in start self.result = self.future.result() File "/usr/lib/python2.7/site-packages/tornado/concurrent.py", line 129, in result raise_exc_info(self.__exc_info) File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 227, in wrapper runner.run() File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 529, in run yielded = self.gen.throw(*exc_info) File "/usr/lib/python2.7/site-packages/jupyterhub/orm.py", line 322, in spawn yield spawner.start() File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 557, in run self.yield_point.start(self) File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 399, in start self.result = self.future.result() File "/usr/lib/python2.7/site-packages/tornado/concurrent.py", line 129, in result raise_exc_info(self.__exc_info) File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 227, in wrapper runner.run() File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 531, in run yielded = self.gen.send(next) File "/usr/lib/python2.7/site-packages/jupyterhub/spawner.py", line 368, in start preexec_fn=self.make_preexec_fn(self.user.name), File "/usr/lib/python2.7/subprocess.py", line 710, in __init__ errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory [E 07:51:18.294 JupyterHubApp] Could not open static file u'/usr/share/jupyter/static/images/favicon.ico' [E 07:51:18.296 JupyterHubApp] 500 POST /hub/login?next= (127.0.0.1) 341.50ms DT On Thu, Oct 23, 2014 at 7:20 PM, Min RK <benjaminrk at gmail.com> wrote: > How have you configured the Hub? What user is running the server? Can you > include log output? Possibly after running with `--debug`? > > -MinRK > > On Oct 23, 2014, at 14:06, Dong Ta <dongta.hds at gmail.com> wrote: > > Hi, > > I ran the jupyterhub command as an admin user. I can log in using the > admin credential. However, I cannot log in using a different user's > credential. I would get this error message. > > {'error': 'Invalid username or password'} > > That account does exist and I've made sure that the username/password is > correct. > > What am I missing here? > > DT > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/2d123475/attachment.html> From kikocorreoso at gmail.com Fri Oct 24 04:28:14 2014 From: kikocorreoso at gmail.com (Kiko) Date: Fri, 24 Oct 2014 10:28:14 +0200 Subject: [IPython-dev] Ruler on notebook codecells Message-ID: <CAB-sx63foz9iA-4UmkZ9=fHidQgY-eS=zY6pWJe=+-BtJGyYDw@mail.gmail.com> Hi all, I've been trying to include a ruler for the code cells with no success. I am using a modification of the code found here: https://www.pfenninger.org/posts/ipython-notebook-extensions-to-ease-day-to-day-work/ My code, included in the custom.js is as follows: <pre> $([IPython.events]).on("app_initialized.NotebookApp", function () { require[("static/components/codemirror/addon/display/rulers")]; var rulers = [{column: 79, color: "#333333", lineStyle: "dashed"}]; IPython.Cell.options_default.cm_config.rulers = rulers; console.log("Rulers loaded"); }); </pre> In the js console I can see that ruler is loaded and in the object ("IPython.Cell.options_default.cm_config.rulers") I can see the rulers array but in the notebook nothing changed. Am I doing something wrong? Thanks in advance. Kind regards. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/b882c6a1/attachment.html> From kikocorreoso at gmail.com Fri Oct 24 04:32:01 2014 From: kikocorreoso at gmail.com (Kiko) Date: Fri, 24 Oct 2014 10:32:01 +0200 Subject: [IPython-dev] Ruler on notebook codecells In-Reply-To: <CAB-sx63foz9iA-4UmkZ9=fHidQgY-eS=zY6pWJe=+-BtJGyYDw@mail.gmail.com> References: <CAB-sx63foz9iA-4UmkZ9=fHidQgY-eS=zY6pWJe=+-BtJGyYDw@mail.gmail.com> Message-ID: <CAB-sx63LwdAfotdFwPVPfWvUJZa49+T_icaVFWA1QobEC+QKsg@mail.gmail.com> 2014-10-24 10:28 GMT+02:00 Kiko <kikocorreoso at gmail.com>: > Hi all, > > I've been trying to include a ruler for the code cells with no success. > > I am using a modification of the code found here: > https://www.pfenninger.org/posts/ipython-notebook-extensions-to-ease-day-to-day-work/ > > My code, included in the custom.js is as follows: > > <pre> > $([IPython.events]).on("app_initialized.NotebookApp", function () { > require[("static/components/codemirror/addon/display/rulers")]; > var rulers = [{column: 79, color: "#333333", lineStyle: "dashed"}]; > IPython.Cell.options_default.cm_config.rulers = rulers; > console.log("Rulers loaded"); > }); > </pre> > > Please, ignore the <pre> tags above :-\ > In the js console I can see that ruler is loaded and in the object > ("IPython.Cell.options_default.cm_config.rulers") I can see the rulers > array but in the notebook nothing changed. > > Am I doing something wrong? > > Thanks in advance. > > Kind regards. > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/97fab9c8/attachment.html> From claresloggett at gmail.com Fri Oct 24 08:49:37 2014 From: claresloggett at gmail.com (Clare Sloggett) Date: Fri, 24 Oct 2014 23:49:37 +1100 Subject: [IPython-dev] Error running JupyterHub Message-ID: <CAETqNqGjaD7pjsWjK36u_Hc5=bdTU-PCtvAwv-QVXUfoQDjSaQ@mail.gmail.com> Hi all, I'm getting an error running JupyterHub. Right now all I'm doing is attempting to run it as root with no command-line options. A couple of weeks ago I was trying to set it up and while I was running into issues, I wasn't getting this particular problem - I was able to at least run the command. I'm not sure if something has changed in Jupyter. Entirely possible that I made a mistake in my setup this time! Any advice would be appreciated in interpreting the below errors. Thanks, Clare Below is the output of `jupyterhub --debug`: Traceback (most recent call last): File "/usr/lib/python2.7/logging/__init__.py", line 846, in emit msg = self.format(record) File "/usr/lib/python2.7/logging/__init__.py", line 723, in format return fmt.format(record) File "/usr/local/lib/python2.7/dist-packages/IPython/config/application.py", line 121, in format return super(LevelFormatter, self).format(record) File "/usr/lib/python2.7/logging/__init__.py", line 467, in format s = self._fmt % record.__dict__ KeyError: u'color' Logged from file application.py, line 247 Traceback (most recent call last): File "/usr/lib/python2.7/logging/__init__.py", line 846, in emit msg = self.format(record) File "/usr/lib/python2.7/logging/__init__.py", line 723, in format return fmt.format(record) File "/usr/local/lib/python2.7/dist-packages/IPython/config/application.py", line 121, in format return super(LevelFormatter, self).format(record) File "/usr/lib/python2.7/logging/__init__.py", line 467, in format s = self._fmt % record.__dict__ KeyError: u'color' Logged from file application.py, line 248 [D 23:39:03.030 JupyterHubApp] Connecting to db: sqlite:///jupyterhub.sqlite [I 23:39:03.062 JupyterHubApp] Not using whitelist. Any authenticated user will be allowed. [D 23:39:03.064 JupyterHubApp] Loaded users: ubuntu admin [I 23:39:03.072 JupyterHubApp] Starting proxy: [u'configurable-http-proxy', '--ip', u'', '--port', '8000', '--api-ip', u'localhost', '--api-port', '8001', '--default-target', 'http://localhost:8081'] 23:39:03.178 - info: [ConfigProxy] Proxying http://*:8000 to http://localhost:8081 23:39:03.180 - info: [ConfigProxy] Proxy API at http://localhost:8001/api/routes events.js:72 throw er; // Unhandled 'error' event ^ Error: listen EADDRINUSE at errnoException (net.js:904:11) at Server._listen2 (net.js:1042:14) at listen (net.js:1064:10) at net.js:1146:9 at dns.js:72:18 at process._tickCallback (node.js:419:13) at Function.Module.runMain (module.js:499:11) at startup (node.js:119:16) at node.js:906:3 [C 23:39:04.087 JupyterHubApp] Failed to start proxy Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", line 727, in start IOLoop().run_sync(self.start_proxy) File "/usr/local/lib/python2.7/dist-packages/tornado/ioloop.py", line 389, in run_sync return future_cell[0].result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 129, in result raise_exc_info(self.__exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line 302, in wrapped ret = fn(*args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 574, in inner self.set_result(key, result) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 500, in set_result self.run() File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 529, in run yielded = self.gen.throw(*exc_info) File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", line 556, in start_proxy _check() File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", line 552, in _check raise e RuntimeError: Proxy failed to start with exit code 8 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/13e932df/attachment.html> From doug.blank at gmail.com Fri Oct 24 08:58:56 2014 From: doug.blank at gmail.com (Doug Blank) Date: Fri, 24 Oct 2014 08:58:56 -0400 Subject: [IPython-dev] Error running JupyterHub In-Reply-To: <CAETqNqGjaD7pjsWjK36u_Hc5=bdTU-PCtvAwv-QVXUfoQDjSaQ@mail.gmail.com> References: <CAETqNqGjaD7pjsWjK36u_Hc5=bdTU-PCtvAwv-QVXUfoQDjSaQ@mail.gmail.com> Message-ID: <CAAusYCgYeHfXOTuPojqd0TZBB41-3VWCtop3WBLJN5t6wm=GUg@mail.gmail.com> On Fri, Oct 24, 2014 at 8:49 AM, Clare Sloggett <claresloggett at gmail.com> wrote: > Hi all, > > I'm getting an error running JupyterHub. Right now all I'm doing is > attempting to run it as root with no command-line options. > > A couple of weeks ago I was trying to set it up and while I was running > into issues, I wasn't getting this particular problem - I was able to at > least run the command. I'm not sure if something has changed in Jupyter. > Entirely possible that I made a mistake in my setup this time! > > Any advice would be appreciated in interpreting the below errors. > > Thanks, > Clare > > Below is the output of `jupyterhub --debug`: > > Traceback (most recent call last): > File "/usr/lib/python2.7/logging/__init__.py", line 846, in emit > msg = self.format(record) > File "/usr/lib/python2.7/logging/__init__.py", line 723, in format > return fmt.format(record) > File > "/usr/local/lib/python2.7/dist-packages/IPython/config/application.py", > line 121, in format > return super(LevelFormatter, self).format(record) > File "/usr/lib/python2.7/logging/__init__.py", line 467, in format > s = self._fmt % record.__dict__ > KeyError: u'color' > Logged from file application.py, line 247 > Traceback (most recent call last): > File "/usr/lib/python2.7/logging/__init__.py", line 846, in emit > msg = self.format(record) > File "/usr/lib/python2.7/logging/__init__.py", line 723, in format > return fmt.format(record) > File > "/usr/local/lib/python2.7/dist-packages/IPython/config/application.py", > line 121, in format > return super(LevelFormatter, self).format(record) > File "/usr/lib/python2.7/logging/__init__.py", line 467, in format > s = self._fmt % record.__dict__ > KeyError: u'color' > Logged from file application.py, line 248 > [D 23:39:03.030 JupyterHubApp] Connecting to db: > sqlite:///jupyterhub.sqlite > [I 23:39:03.062 JupyterHubApp] Not using whitelist. Any authenticated user > will be allowed. > [D 23:39:03.064 JupyterHubApp] Loaded users: > ubuntu admin > [I 23:39:03.072 JupyterHubApp] Starting proxy: > [u'configurable-http-proxy', '--ip', u'', '--port', '8000', '--api-ip', > u'localhost', '--api-port', '8001', '--default-target', ' > http://localhost:8081'] > 23:39:03.178 - info: [ConfigProxy] Proxying http://*:8000 to > http://localhost:8081 > 23:39:03.180 - info: [ConfigProxy] Proxy API at > http://localhost:8001/api/routes > > events.js:72 > throw er; // Unhandled 'error' event > I think that I have had that issue when configurable-http-proxy isn't running, or maybe it is already running and you are trying to start it again. Some things that I do when updating jupyterhub: 1. Updating ipython: make sure you run "python setup.py submodule" in ipython-master to get any new dependencies. Then "git pull" and "sudo pip install . -U" 2. Updating jupyterhub: do the steps in the jupyterhub/README.md again... some dependencies may have changed. Then "sudo pip install . -U" 3. Make sure all jupyterhub-singleuser processes and configurable-http-proxy processes are killed. This is still hard to do sometimes. 4. Are you running with a sudo environment? There is an additional line in the sudoers file that is now needed to kill processes. I think that is most of what I need to do. -Doug > ^ > Error: listen EADDRINUSE > at errnoException (net.js:904:11) > at Server._listen2 (net.js:1042:14) > at listen (net.js:1064:10) > at net.js:1146:9 > at dns.js:72:18 > at process._tickCallback (node.js:419:13) > at Function.Module.runMain (module.js:499:11) > at startup (node.js:119:16) > at node.js:906:3 > [C 23:39:04.087 JupyterHubApp] Failed to start proxy > Traceback (most recent call last): > File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", > line 727, in start > IOLoop().run_sync(self.start_proxy) > File "/usr/local/lib/python2.7/dist-packages/tornado/ioloop.py", > line 389, in run_sync > return future_cell[0].result() > File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", > line 129, in result > raise_exc_info(self.__exc_info) > File > "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line > 302, in wrapped > ret = fn(*args, **kwargs) > File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line > 574, in inner > self.set_result(key, result) > File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line > 500, in set_result > self.run() > File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line > 529, in run > yielded = self.gen.throw(*exc_info) > File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", > line 556, in start_proxy > _check() > File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", > line 552, in _check > raise e > RuntimeError: Proxy failed to start with exit code 8 > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/476ebc20/attachment.html> From doug.blank at gmail.com Fri Oct 24 09:13:38 2014 From: doug.blank at gmail.com (Doug Blank) Date: Fri, 24 Oct 2014 09:13:38 -0400 Subject: [IPython-dev] Jupyterhub-based CMS? Message-ID: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> Devs, If you were going to build a full web application (with components like comments, index, sitemap, search, etc) for, say, an on-line journal, blog, or course website, that was based on jupyterhub and notebooks what would you write it in? Many of those functions exist in full content-management systems (CMS) like Drupal or Wordpress. There is also support for building a CMS from tools like Django (which is written in Python). Jupyterhub is written in Tornado. As far as I see, there aren't drop-in CMS-like components for Torando. So, would you try to integrate jupyterhub into an existing CMS? Or build one from tools like Django + Torando? Or create a new project especially for jupyterhub? Or is there another option? -Doug -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/139827f0/attachment.html> From nick.bollweg at gmail.com Fri Oct 24 10:34:04 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Fri, 24 Oct 2014 10:34:04 -0400 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> Message-ID: <CACejjWxmtH+j+NJGA1Yt58GuRgZGrsPVtW5Ofkg1B4_PMLtP8w@mail.gmail.com> A thing I have wanted since finding out about both projects is notebooks as a fundamental building block of content in Apache Allura <https://allura.apache.org/>. You may know Allura's primary commercial install and main contributor, sourceforge <http://sf.net>. It is, unsurprisingly, Apache licensed. Allura's focus is providing open source tools for teams building open source, so it is based on users, groups, and projects, and code. Into each project, its admins can add any number of tools: tickets, wikis, blogs, forums, git/hg/svn repos, subprojects, chat. Every project immediately has search and an API. It has configurable usage analytics. It can import project data from a large number of other project management tools. Text is markdown all over, and has nice features like ticket linking, etc. Writing new tools is pretty easy: here's a template <http://sourceforge.net/projects/skelallura/> I made a while ago. Allura is written in TurboGears, which is kind of showing its age, but it uses classical MVC patterns, Jinja2, etc. so it wouldn't be that much different than tornado: presumably, jupyter would be run as a second server, anyway. It has customizable themes, but there are not many <https://opensourceprojects.eu/> real re-skins in the wild. Some branded, scientist-focused design love here would be amazing. Here are some specific integration ideas (and challenges): - I would see notebooks supplanting the wiki and blog tools (which are already markdown-based), as well as providing an entirely novel, multiuser compute environment with any number of kernels, as handled by jupyterhub. - Since a lot more assumptions would be in place, it would be much more reasonable to have an "app store" approach to automating package management for both the installed packages available to the current kernel, as well as what is installed in the notebook javascript environment. - While runtime notebooks could be persisted to MongoDB, files, or whatever long-term, pure notebooks, or better still notebooks + data + a snapshot of the container, could be stored in repos. This would be a boon for, say, setting up assingments: click on a link, you are using a live machine that is an exact copy of what a TA set up. - A light wrapper around something like runipy <https://github.com/paulgb/runipy>, conda-launch <https://github.com/conda/conda-launch>, etc. would make building reusable data workflows lovely. - Things like nbconvert --slides and live_reveal <https://github.com/damianavila/live_reveal/tree/master/livereveal> would make crafting talks more discoverable and reusable than any previous solution, and could be nicely configured to ensure that a whole project has a consistent theme for slides which can be regenerated at any time. - Thinking about directories of notebooks, one could imagine compiling a whole e-book or mobile app... just by hitting a URL. I'd love to get involved with an effort like this, and might even be able to get the day job interested if we thought we could get some funding to do it... there are 100 ways one could spin this, either as an LMS, a data integration environment, research platform, communication hub, or some other goal. On Fri, Oct 24, 2014 at 9:13 AM, Doug Blank <doug.blank at gmail.com> wrote: > Devs, > > If you were going to build a full web application (with components like > comments, index, sitemap, search, etc) for, say, an on-line journal, blog, > or course website, that was based on jupyterhub and notebooks what would > you write it in? > > Many of those functions exist in full content-management systems (CMS) > like Drupal or Wordpress. There is also support for building a CMS from > tools like Django (which is written in Python). > > Jupyterhub is written in Tornado. As far as I see, there aren't drop-in > CMS-like components for Torando. > > So, would you try to integrate jupyterhub into an existing CMS? Or build > one from tools like Django + Torando? Or create a new project especially > for jupyterhub? Or is there another option? > > -Doug > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/ae2b123f/attachment.html> From takowl at gmail.com Fri Oct 24 11:37:36 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 24 Oct 2014 08:37:36 -0700 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> Message-ID: <CAOvn4qiO5QgH-RUx=K1796hnsJXK_EetMW+kF05fajdZe9s_Pw@mail.gmail.com> Is it necessary to run these distinct parts in a single server process? At a glance, it sounds like it would be easier to run separate servers for different applications, and have a common authentication mechanism. That way, you are not limited to tornado solutions, or even to Python: you could use jupyterhub alongside WordPress. Thomas On 24 Oct 2014 06:13, "Doug Blank" <doug.blank at gmail.com> wrote: > Devs, > > If you were going to build a full web application (with components like > comments, index, sitemap, search, etc) for, say, an on-line journal, blog, > or course website, that was based on jupyterhub and notebooks what would > you write it in? > > Many of those functions exist in full content-management systems (CMS) > like Drupal or Wordpress. There is also support for building a CMS from > tools like Django (which is written in Python). > > Jupyterhub is written in Tornado. As far as I see, there aren't drop-in > CMS-like components for Torando. > > So, would you try to integrate jupyterhub into an existing CMS? Or build > one from tools like Django + Torando? Or create a new project especially > for jupyterhub? Or is there another option? > > -Doug > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/a2fe758c/attachment.html> From doug.blank at gmail.com Fri Oct 24 12:04:08 2014 From: doug.blank at gmail.com (Doug Blank) Date: Fri, 24 Oct 2014 12:04:08 -0400 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CAOvn4qiO5QgH-RUx=K1796hnsJXK_EetMW+kF05fajdZe9s_Pw@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> <CAOvn4qiO5QgH-RUx=K1796hnsJXK_EetMW+kF05fajdZe9s_Pw@mail.gmail.com> Message-ID: <CAAusYChpuigO+JSY835VNjtYVf1ahNtvUsQbODWi2k72xKzOVw@mail.gmail.com> On Fri, Oct 24, 2014 at 11:37 AM, Thomas Kluyver <takowl at gmail.com> wrote: > Is it necessary to run these distinct parts in a single server process? > No. > At a glance, it sounds like it would be easier to run separate servers for > different applications, and have a common authentication mechanism. That > way, you are not limited to tornado solutions, or even to Python: you could > use jupyterhub alongside WordPress. > Yes, that would probably be very easy. But would be hard to have much integration between the notebooks and the CMS components (imagine panels like "tag cloud", "trending libraries", "search/example uses", "share", "co-edit", etc). It would seem that if the CMS were at least written in Python, that would allow more interesting/useful components and integration. -Doug > Thomas > On 24 Oct 2014 06:13, "Doug Blank" <doug.blank at gmail.com> wrote: > >> Devs, >> >> If you were going to build a full web application (with components like >> comments, index, sitemap, search, etc) for, say, an on-line journal, blog, >> or course website, that was based on jupyterhub and notebooks what would >> you write it in? >> >> Many of those functions exist in full content-management systems (CMS) >> like Drupal or Wordpress. There is also support for building a CMS from >> tools like Django (which is written in Python). >> >> Jupyterhub is written in Tornado. As far as I see, there aren't drop-in >> CMS-like components for Torando. >> >> So, would you try to integrate jupyterhub into an existing CMS? Or build >> one from tools like Django + Torando? Or create a new project especially >> for jupyterhub? Or is there another option? >> >> -Doug >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/d2780b29/attachment.html> From doug.blank at gmail.com Fri Oct 24 12:16:48 2014 From: doug.blank at gmail.com (Doug Blank) Date: Fri, 24 Oct 2014 12:16:48 -0400 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CACejjWxmtH+j+NJGA1Yt58GuRgZGrsPVtW5Ofkg1B4_PMLtP8w@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> <CACejjWxmtH+j+NJGA1Yt58GuRgZGrsPVtW5Ofkg1B4_PMLtP8w@mail.gmail.com> Message-ID: <CAAusYCi_R_esuOxg0kb2rnh_NhF80U19nV3uCKg8DTtbYBYzxw@mail.gmail.com> On Fri, Oct 24, 2014 at 10:34 AM, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > A thing I have wanted since finding out about both projects is notebooks > as a fundamental building block of content in Apache Allura > <https://allura.apache.org/>. You may know Allura's primary commercial > install and main contributor, sourceforge <http://sf.net>. It is, > unsurprisingly, Apache licensed. > > Allura's focus is providing open source tools for teams building open > source, so it is based on users, groups, and projects, and code. Into each > project, its admins can add any number of tools: tickets, wikis, blogs, > forums, git/hg/svn repos, subprojects, chat. Every project immediately has > search and an API. It has configurable usage analytics. It can import > project data from a large number of other project management tools. Text is > markdown all over, and has nice features like ticket linking, etc. Writing > new tools is pretty easy: here's a template > <http://sourceforge.net/projects/skelallura/> I made a while ago. > > Allura is written in TurboGears, which is kind of showing its age, but it > uses classical MVC patterns, Jinja2, etc. so it wouldn't be that much > different than tornado: presumably, jupyter would be run as a second > server, anyway. It has customizable themes, but there are not many > <https://opensourceprojects.eu/> real re-skins in the wild. Some branded, > scientist-focused design love here would be amazing. > > Here are some specific integration ideas (and challenges): > > - I would see notebooks supplanting the wiki and blog tools (which are > already markdown-based), as well as providing an entirely novel, multiuser > compute environment with any number of kernels, as handled by jupyterhub. > - Since a lot more assumptions would be in place, it would be much > more reasonable to have an "app store" approach to automating package > management for both the installed packages available to the current kernel, > as well as what is installed in the notebook javascript environment. > - While runtime notebooks could be persisted to MongoDB, files, or > whatever long-term, pure notebooks, or better still notebooks + data + a > snapshot of the container, could be stored in repos. This would be a boon > for, say, setting up assingments: click on a link, you are using a live > machine that is an exact copy of what a TA set up. > - A light wrapper around something like runipy > <https://github.com/paulgb/runipy>, conda-launch > <https://github.com/conda/conda-launch>, etc. would make building > reusable data workflows lovely. > - Things like nbconvert --slides and live_reveal > <https://github.com/damianavila/live_reveal/tree/master/livereveal> > would make crafting talks more discoverable and reusable than any previous > solution, and could be nicely configured to ensure that a whole project has > a consistent theme for slides which can be regenerated at any time. > - Thinking about directories of notebooks, one could imagine compiling > a whole e-book or mobile app... just by hitting a URL. > > I'd love to get involved with an effort like this, and might even be able > to get the day job interested if we thought we could get some funding to do > it... there are 100 ways one could spin this, either as an LMS, a data > integration environment, research platform, communication hub, or some > other goal. > Great ideas here! Yes, I should have mentioned wikis, books, hubs, and just as a repository of reproducible experiments, with data. Not all of these ideas need to be embedded in such a component-based webapp framework. But such a project would seem to be the next logical step. I'd also love to discuss such a project with like-minded folks. A million questions and issues come to mind. I guess we can first see what kind of interest there is, and then have some conversations on a separate mailing list. -Doug > > On Fri, Oct 24, 2014 at 9:13 AM, Doug Blank <doug.blank at gmail.com> wrote: > >> Devs, >> >> If you were going to build a full web application (with components like >> comments, index, sitemap, search, etc) for, say, an on-line journal, blog, >> or course website, that was based on jupyterhub and notebooks what would >> you write it in? >> >> Many of those functions exist in full content-management systems (CMS) >> like Drupal or Wordpress. There is also support for building a CMS from >> tools like Django (which is written in Python). >> >> Jupyterhub is written in Tornado. As far as I see, there aren't drop-in >> CMS-like components for Torando. >> >> So, would you try to integrate jupyterhub into an existing CMS? Or build >> one from tools like Django + Torando? Or create a new project especially >> for jupyterhub? Or is there another option? >> >> -Doug >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/352c1014/attachment.html> From takowl at gmail.com Fri Oct 24 13:04:34 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 24 Oct 2014 10:04:34 -0700 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CAAusYChpuigO+JSY835VNjtYVf1ahNtvUsQbODWi2k72xKzOVw@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> <CAOvn4qiO5QgH-RUx=K1796hnsJXK_EetMW+kF05fajdZe9s_Pw@mail.gmail.com> <CAAusYChpuigO+JSY835VNjtYVf1ahNtvUsQbODWi2k72xKzOVw@mail.gmail.com> Message-ID: <CAOvn4qhFYo25eF4YbwrPGkLpMP1hh2qeWf-W6pRoCR-RCWc9qQ@mail.gmail.com> On 24 October 2014 09:04, Doug Blank <doug.blank at gmail.com> wrote: > Yes, that would probably be very easy. But would be hard to have much > integration between the notebooks and the CMS components (imagine panels > like "tag cloud", "trending libraries", "search/example uses", "share", > "co-edit", etc). It would seem that if the CMS were at least written in > Python, that would allow more interesting/useful components and integration. If the server processes have access to the same filesystem, you can process and display the notebooks in another application quite easily. IPython.nbformat is a Python package to read and write them, but it's a fairly thin wrapper around the JSON structures (apart from the bits to convert between different format versions), so you can manipulate them from any language that can work with JSON. Simultaneous editing is trickier, because that would need to be integrated into the notebook application. We do plan to do that at some point, but we're still some way from it. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/fcb9fcac/attachment.html> From ccordoba12 at gmail.com Fri Oct 24 13:35:13 2014 From: ccordoba12 at gmail.com (=?UTF-8?B?Q2FybG9zIEPDs3Jkb2Jh?=) Date: Fri, 24 Oct 2014 12:35:13 -0500 Subject: [IPython-dev] Less metadata for inspect_request messages? Message-ID: <544A8DD1.5060802@gmail.com> Hi, I just noticed that the content of inspect_request messages has lost some metadata we use in Spyder to improve how qtconsole tooltips are shown. Besides, I also would like to use this metadata in the future, to improve how documentation is shown in our Sphinx renderer. The idea is to add class and constructor docstrings to an object's docstring, but shown in different bootstrap tabs. What I mean exactly is this: In IPython 2, the content key of inspect messages give: In [7]: request['content'].keys() Out[7]: [u'base_class', u'init_definition', u'isalias', u'name', u'isclass', u'init_docstring', u'type_name', u'namespace', u'length', u'source', u'argspec', u'call_def', u'ismagic', u'file', u'string_form', u'found', u'class_docstring', u'definition', u'docstring', u'call_docstring'] Whereas In IPython 3.0dev it gives: In [5]: request['content'].keys() Out[5]: [u'status', u'found', u'data', u'metadata'] and 'data' contains contains just the docstring but without all the rich information it was exposed before. Is it possible that you guys expose this metadata again? Thanks, Carlos -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/a8e49d4d/attachment.html> From takowl at gmail.com Fri Oct 24 13:50:42 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 24 Oct 2014 10:50:42 -0700 Subject: [IPython-dev] Less metadata for inspect_request messages? In-Reply-To: <544A8DD1.5060802@gmail.com> References: <544A8DD1.5060802@gmail.com> Message-ID: <CAOvn4qh3yFAWVQHuSsrjz7qX0Nux-xkqwyKYom7-PfbanD0D-Q@mail.gmail.com> On 24 October 2014 10:35, Carlos C?rdoba <ccordoba12 at gmail.com> wrote: > and 'data' contains contains just the docstring but without all the rich > information it was exposed before. > > Is it possible that you guys expose this metadata again? Doubtful. We deliberately discarded the structured info because the fields were very Python specific (and in some cases, IPython specific, like ismagic), and trying to generalise them for different languages would have been a nightmare. So we decided to just send back a mimebundle of unstructured information. On the plus side, it would now be feasible to do something with Sphinx on the kernel side and produce an HTML representation which gets sent in the mimebundle. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/2b719ad9/attachment.html> From ellisonbg at gmail.com Fri Oct 24 14:02:00 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 24 Oct 2014 11:02:00 -0700 Subject: [IPython-dev] Javascript comments In-Reply-To: <CAAoBLw0x0aCyTwiyJEOKOymcyr0eOE-5BG+LuK=5nDsmhhVy4Q@mail.gmail.com> References: <CAAoBLw0x0aCyTwiyJEOKOymcyr0eOE-5BG+LuK=5nDsmhhVy4Q@mail.gmail.com> Message-ID: <CAH4pYpT1ypFgYoTNPL_uZgUjjtpekCoc_cv8wNpv-k7C2uYSFA@mail.gmail.com> This all just makes me realize how rotten JS is :( On Thu, Oct 23, 2014 at 1:04 PM, Jonathan Frederic <jon.freder at gmail.com> wrote: > As a follow up of today's meeting, it looks like, if we don't mind the > comment appearing before the function, JSDoc allows for our own doc string > format (see simplest case): http://usejsdoc.org/about-getting-started.html . > JSDoc claims to be "highly extensible" and has a markdown plugin distributed > with it. Here's a good article comparing the 4 most popular JS comment -> > API doc tools: > http://blog.fusioncharts.com/2013/12/jsdoc-vs-yuidoc-vs-doxx-vs-docco-choosing-a-javascript-documentation-generator/ > > My preference is for JSDoc, but I'd like to hear what others think. Also > the option to NOT use a comment -> doc parser still exists. Provided we can > commit to keeping a separate API docs by hand. > > Cheers, > Jon -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From ellisonbg at gmail.com Fri Oct 24 14:20:21 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 24 Oct 2014 11:20:21 -0700 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> Message-ID: <CAH4pYpTOaeprScRYyr1uKJ03MBCE1BJ8aP7SAH0D1BdbBBxChA@mail.gmail.com> We are starting to explore ways of making the different components of our web app more modular to allows others to build custom systems. But I expect our different components to continue to be very dynamic (WebSockets, etc.) in ways that make using an existing CMS difficult - at least for the live notebook. However, things like comments, indexing, etc. are things that we are thinking about. No specific plans yet and the usual caution about scope creep apply... Cheers, Brian On Fri, Oct 24, 2014 at 6:13 AM, Doug Blank <doug.blank at gmail.com> wrote: > Devs, > > If you were going to build a full web application (with components like > comments, index, sitemap, search, etc) for, say, an on-line journal, blog, > or course website, that was based on jupyterhub and notebooks what would you > write it in? > > Many of those functions exist in full content-management systems (CMS) like > Drupal or Wordpress. There is also support for building a CMS from tools > like Django (which is written in Python). > > Jupyterhub is written in Tornado. As far as I see, there aren't drop-in > CMS-like components for Torando. > > So, would you try to integrate jupyterhub into an existing CMS? Or build one > from tools like Django + Torando? Or create a new project especially for > jupyterhub? Or is there another option? > > -Doug > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From ellisonbg at gmail.com Fri Oct 24 14:20:55 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 24 Oct 2014 11:20:55 -0700 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CAH4pYpTOaeprScRYyr1uKJ03MBCE1BJ8aP7SAH0D1BdbBBxChA@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> <CAH4pYpTOaeprScRYyr1uKJ03MBCE1BJ8aP7SAH0D1BdbBBxChA@mail.gmail.com> Message-ID: <CAH4pYpT17T=3yFc=1-oob8DTmOKeOebRSNQpEUuB=4y431EWrQ@mail.gmail.com> The other thing is that given the way the proxy works, it would be easy to integrate jupyterhub with other services behind the same proxy... On Fri, Oct 24, 2014 at 11:20 AM, Brian Granger <ellisonbg at gmail.com> wrote: > We are starting to explore ways of making the different components of > our web app more modular to allows others to build custom systems. But > I expect our different components to continue to be very dynamic > (WebSockets, etc.) in ways that make using an existing CMS difficult - > at least for the live notebook. > > However, things like comments, indexing, etc. are things that we are > thinking about. No specific plans yet and the usual caution about > scope creep apply... > > Cheers, > > Brian > > On Fri, Oct 24, 2014 at 6:13 AM, Doug Blank <doug.blank at gmail.com> wrote: >> Devs, >> >> If you were going to build a full web application (with components like >> comments, index, sitemap, search, etc) for, say, an on-line journal, blog, >> or course website, that was based on jupyterhub and notebooks what would you >> write it in? >> >> Many of those functions exist in full content-management systems (CMS) like >> Drupal or Wordpress. There is also support for building a CMS from tools >> like Django (which is written in Python). >> >> Jupyterhub is written in Tornado. As far as I see, there aren't drop-in >> CMS-like components for Torando. >> >> So, would you try to integrate jupyterhub into an existing CMS? Or build one >> from tools like Django + Torando? Or create a new project especially for >> jupyterhub? Or is there another option? >> >> -Doug >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > @ellisonbg on Twitter and GitHub > bgranger at calpoly.edu and ellisonbg at gmail.com -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From ellisonbg at gmail.com Fri Oct 24 14:42:09 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 24 Oct 2014 11:42:09 -0700 Subject: [IPython-dev] Editor widget and data persistence In-Reply-To: <CAMHV+dDUO8qhHD8NY7pQawM9m+qykC+bs_tKKEvs=GmHb1o5hQ@mail.gmail.com> References: <CADQWuG4OzGoDtCd-JzzyOv8BP-uyi-8Xai1uNrd6EJtPLL0kVg@mail.gmail.com> <CAOvn4qgBWrd+5RuU8cdZCy8sERWg07TgUBpPcSNP1AHnOC_WPQ@mail.gmail.com> <CADQWuG4m-LaQ=xB7CK6ZUVnkNJHDB8mPT-bN5w7ZCz6qmUkSuQ@mail.gmail.com> <CAMHV+dDUO8qhHD8NY7pQawM9m+qykC+bs_tKKEvs=GmHb1o5hQ@mail.gmail.com> Message-ID: <CAH4pYpR11zJ2u9v0rb29_SR6-CP5bWYTgHi4Bhk8jOK7bjEmQQ@mail.gmail.com> I agree with @takluyver that in this particular case a widget is probably the wrong answer. I think that the `%%writefile` magic of the upcoming text editor page is a much better solution... Cheers, Brian On Wed, Oct 22, 2014 at 4:56 PM, Adam Hughes <hughesadam87 at gmail.com> wrote: > If you have a notebook that calls the GUI, you can launch it in a second > notebook just using the %run magic as well. IE, if you had: > > mywidget.ipynb > > Then you can launch it in a separate notebook with: > > %run mywidget.ipynb > > On Wed, Oct 22, 2014 at 3:42 PM, Pablo Winant <pablo.winant at gmail.com> > wrote: >> >> Thank you Thomas. >> >> On Wed, Oct 22, 2014 at 12:28 PM, Thomas Kluyver <takowl at gmail.com> wrote: >>> >>> Hi Pablo, >>> IPython.html.nbextensions.> I wonder if it is possible to save the state >>> of these widgets when saving the notebook >>> >>> Currently, no. We're working on ways to do that, but it turns out to be >>> more complicated than it seems. >>> >>> > More specifically, I'd like to use the text editor widget to edit a >>> > text file that comes with a notebook >>> >>> It's possible to do this with widgets, but I don't think it's the best >>> fit for the problem. It sounds like what you want is the %%writefile cell >>> magic. Just make a code cell containing the text you want, with %%writefile >>> filename.txt at the top. When you run it, it will save that content to the >>> file. >>> >> >> Actually my usecase is trying to provide users with an easy interface to >> edit the content of simple structure that is also serializable as a >> JSON/YAML file. I would be happy if I could find way to store information >> produced by the code in the notebook and then read it back. Maybe, there is >> a way to edit cell of notebook metadata from the notebook itself ? >> >> >>> >>> We are also planning to put a text editor component inside the notebook >>> server, but that's not quite ready yet. >>> >>> > the IPython widgets are becoming one of the very few alternatives for >>> > python web-guis >>> >>> Yes, and this is a much larger scope than the widget architecture was >>> really designed for. We're trying to work out how to handle this. >> >> >> I can smell some big architectural work here... Good luck with that ! >> >> Pablo >> >> >>> >>> >>> Thanks, >>> Thomas >>> >>> On 22 October 2014 07:58, Pablo Winant <pablo.winant at gmail.com> wrote: >>>> >>>> Hi, >>>> >>>> The new widgets are absolutely wonderful ! >>>> >>>> I wonder if it is possible to save the state of these widgets when >>>> saving the notebook. More specifically, I'd like to use the text editor >>>> widget to edit a text file that comes with a notebook. That would kill two >>>> birds with one stone for me: avoid the need to ship a separate file with the >>>> notebook (btw, is there already a canonical way to do that ?), and be able >>>> to edit it from within the notebook. Are there plans in this direction ? Any >>>> idea about how I could implement that ? >>>> >>>> A somewhat related question: the IPython widgets are becoming one of the >>>> very few alternatives for python web-guis. Do you think it would be possible >>>> to use it for a relatively simple application and hide the notebook from >>>> user's sight so that it looks like an independent application ? >>>> >>>> Best, >>>> >>>> Pablo >>>> >>>> _______________________________________________ >>>> IPython-dev mailing list >>>> IPython-dev at scipy.org >>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>> >>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From fperez.net at gmail.com Fri Oct 24 14:54:21 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Fri, 24 Oct 2014 11:54:21 -0700 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CAAusYCi_R_esuOxg0kb2rnh_NhF80U19nV3uCKg8DTtbYBYzxw@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> <CACejjWxmtH+j+NJGA1Yt58GuRgZGrsPVtW5Ofkg1B4_PMLtP8w@mail.gmail.com> <CAAusYCi_R_esuOxg0kb2rnh_NhF80U19nV3uCKg8DTtbYBYzxw@mail.gmail.com> Message-ID: <CAHAreOpWD_YY4QE71R--534BhjP2FnhBB9LjcnGizqAQ_zC0CA@mail.gmail.com> On Fri, Oct 24, 2014 at 9:16 AM, Doug Blank <doug.blank at gmail.com> wrote: > I'd also love to discuss such a project with like-minded folks. A million > questions and issues come to mind. I guess we can first see what kind of > interest there is, and then have some conversations on a separate mailing > list. I think the time is coming to create a separate mailing list for Jupyter as a project, where these discussions that really go well beyond 'IPython' can take place. Now, something like this may even go one step further, where a sub-community may emerge with its own projects around CMS-like ideas, and we'd love to see that. But it sounds like at least having a Jupyter area for these conversations to launch from is a good idea. I've gotten similar feedback from the Julia folks. I'll start a separate thread on this. Cheers, f -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/144b216f/attachment.html> From massimodisasha at gmail.com Fri Oct 24 14:54:50 2014 From: massimodisasha at gmail.com (epi) Date: Fri, 24 Oct 2014 14:54:50 -0400 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CAOvn4qhFYo25eF4YbwrPGkLpMP1hh2qeWf-W6pRoCR-RCWc9qQ@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> <CAOvn4qiO5QgH-RUx=K1796hnsJXK_EetMW+kF05fajdZe9s_Pw@mail.gmail.com> <CAAusYChpuigO+JSY835VNjtYVf1ahNtvUsQbODWi2k72xKzOVw@mail.gmail.com> <CAOvn4qhFYo25eF4YbwrPGkLpMP1hh2qeWf-W6pRoCR-RCWc9qQ@mail.gmail.com> Message-ID: <19F0C2AA-285B-4EFB-808C-81A6AF938EB8@gmail.com> I?m dreaming of such an app (CMS based on a Jupiter server) for a long time :) something on the line of Rstudio server [1] will be awesome. I don?t know if of any help but few months ago i was experimenting on how to connect a flask app with an Ipython notebook. this is a very simple example on how to pass python object between a running notebook and a lack app : the flask app is : https://gist.github.com/anonymous/1ef39d31c16e3153f3e7 <https://gist.github.com/anonymous/1ef39d31c16e3153f3e7> it runs on host:5000 and from a notebook like : http://nbviewer.ipython.org/gist/anonymous/cce682857defaf0016ee <http://nbviewer.ipython.org/gist/anonymous/cce682857defaf0016ee> CMS in python .. the first that comes in mind is based on flask and is called ?quokka? [2] demo [3] [1] https://support.rstudio.com/hc/en-us <https://support.rstudio.com/hc/en-us> [2] https://github.com/pythonhub/quokka [3] http://demo.quokkaproject.org <http://demo.quokkaproject.org/> > On Oct 24, 2014, at 1:04 PM, Thomas Kluyver <takowl at gmail.com> wrote: > > On 24 October 2014 09:04, Doug Blank <doug.blank at gmail.com <mailto:doug.blank at gmail.com>> wrote: > Yes, that would probably be very easy. But would be hard to have much integration between the notebooks and the CMS components (imagine panels like "tag cloud", "trending libraries", "search/example uses", "share", "co-edit", etc). It would seem that if the CMS were at least written in Python, that would allow more interesting/useful components and integration. > > If the server processes have access to the same filesystem, you can process and display the notebooks in another application quite easily. IPython.nbformat is a Python package to read and write them, but it's a fairly thin wrapper around the JSON structures (apart from the bits to convert between different format versions), so you can manipulate them from any language that can work with JSON. > > Simultaneous editing is trickier, because that would need to be integrated into the notebook application. We do plan to do that at some point, but we're still some way from it. > > Thomas > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/dc5e562b/attachment.html> From fperez.net at gmail.com Fri Oct 24 14:58:02 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Fri, 24 Oct 2014 11:58:02 -0700 Subject: [IPython-dev] Time for a Jupyter mailing list? Message-ID: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> Hi folks, We've been getting signals from many fronts on the need for a more generic mailing list around the language-agnostic, broader-scope Jupyter effort. I think that's probably a good idea. Before I pull the trigger and create it, I figured I'd float the idea here in case anyone has feedback. Discussions like a CMS platform (ongoing thread right now on this list) might evolve into something that needs to further grow its own community, and that would be totally OK. But having a common space for all language communities to interact on the common questions that Jupyter exposes would be useful, I think. Folk from Julia have certainly expressed that desire already. My proposal is to create, for now, a single 'Project Jupyter' list on Google Groups. I know GG is far from ideal, but I'm not in the mood to maintain a mailing list by hand these days... Thoughts? f -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/0fa6c335/attachment.html> From damianavila at gmail.com Fri Oct 24 15:06:58 2014 From: damianavila at gmail.com (=?UTF-8?Q?Dami=C3=A1n_Avila?=) Date: Fri, 24 Oct 2014 16:06:58 -0300 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> Message-ID: <CAH+mRR3zuwDD-u6ZGFdYb80aC9E5TSWa_MeagKjFjV3ymiJugg@mail.gmail.com> I agree, we need somthing else... and probably GG is the simplest move... +1 Damian 2014-10-24 15:58 GMT-03:00 Fernando Perez <fperez.net at gmail.com>: > Hi folks, > > We've been getting signals from many fronts on the need for a more generic > mailing list around the language-agnostic, broader-scope Jupyter effort. I > think that's probably a good idea. Before I pull the trigger and create it, > I figured I'd float the idea here in case anyone has feedback. > > Discussions like a CMS platform (ongoing thread right now on this list) > might evolve into something that needs to further grow its own community, > and that would be totally OK. But having a common space for all language > communities to interact on the common questions that Jupyter exposes would > be useful, I think. Folk from Julia have certainly expressed that desire > already. > > My proposal is to create, for now, a single 'Project Jupyter' list on > Google Groups. I know GG is far from ideal, but I'm not in the mood to > maintain a mailing list by hand these days... > > Thoughts? > > f > > -- > Fernando Perez (@fperez_org; http://fperez.org) > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > fernando.perez-at-berkeley: contact me here for any direct mail > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- *Dami?n* -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/48f7a4e2/attachment.html> From ellisonbg at gmail.com Fri Oct 24 15:17:01 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 24 Oct 2014 12:17:01 -0700 Subject: [IPython-dev] Jupyterhub-based CMS? In-Reply-To: <CAHAreOpWD_YY4QE71R--534BhjP2FnhBB9LjcnGizqAQ_zC0CA@mail.gmail.com> References: <CAAusYChOhhsHQCg=ZDvkjQTZ3qVN=a7v2AWUV42mD9A+FcRdBA@mail.gmail.com> <CACejjWxmtH+j+NJGA1Yt58GuRgZGrsPVtW5Ofkg1B4_PMLtP8w@mail.gmail.com> <CAAusYCi_R_esuOxg0kb2rnh_NhF80U19nV3uCKg8DTtbYBYzxw@mail.gmail.com> <CAHAreOpWD_YY4QE71R--534BhjP2FnhBB9LjcnGizqAQ_zC0CA@mail.gmail.com> Message-ID: <CAH4pYpSxS7w7imeRnDsM6-Sb58On33cTmUUrLFKfwHGVoRhS5Q@mail.gmail.com> +1 on a jupyter list On Fri, Oct 24, 2014 at 11:54 AM, Fernando Perez <fperez.net at gmail.com> wrote: > > On Fri, Oct 24, 2014 at 9:16 AM, Doug Blank <doug.blank at gmail.com> wrote: >> >> I'd also love to discuss such a project with like-minded folks. A million >> questions and issues come to mind. I guess we can first see what kind of >> interest there is, and then have some conversations on a separate mailing >> list. > > > I think the time is coming to create a separate mailing list for Jupyter as > a project, where these discussions that really go well beyond 'IPython' can > take place. Now, something like this may even go one step further, where a > sub-community may emerge with its own projects around CMS-like ideas, and > we'd love to see that. But it sounds like at least having a Jupyter area for > these conversations to launch from is a good idea. I've gotten similar > feedback from the Julia folks. > > I'll start a separate thread on this. > > Cheers, > > f > > > -- > Fernando Perez (@fperez_org; http://fperez.org) > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > fernando.perez-at-berkeley: contact me here for any direct mail > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From ellisonbg at gmail.com Fri Oct 24 15:17:17 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 24 Oct 2014 12:17:17 -0700 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> Message-ID: <CAH4pYpSUbcEH-qJgtV1gEgSZQnf36jq-K53je97CMGDTNR1DCQ@mail.gmail.com> +1 On Fri, Oct 24, 2014 at 11:58 AM, Fernando Perez <fperez.net at gmail.com> wrote: > Hi folks, > > We've been getting signals from many fronts on the need for a more generic > mailing list around the language-agnostic, broader-scope Jupyter effort. I > think that's probably a good idea. Before I pull the trigger and create it, > I figured I'd float the idea here in case anyone has feedback. > > Discussions like a CMS platform (ongoing thread right now on this list) > might evolve into something that needs to further grow its own community, > and that would be totally OK. But having a common space for all language > communities to interact on the common questions that Jupyter exposes would > be useful, I think. Folk from Julia have certainly expressed that desire > already. > > My proposal is to create, for now, a single 'Project Jupyter' list on Google > Groups. I know GG is far from ideal, but I'm not in the mood to maintain a > mailing list by hand these days... > > Thoughts? > > f > > -- > Fernando Perez (@fperez_org; http://fperez.org) > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > fernando.perez-at-berkeley: contact me here for any direct mail > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From arnaud.sahuguet at gmail.com Fri Oct 24 15:30:53 2014 From: arnaud.sahuguet at gmail.com (Arnaud Sahuguet) Date: Fri, 24 Oct 2014 15:30:53 -0400 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAH4pYpSUbcEH-qJgtV1gEgSZQnf36jq-K53je97CMGDTNR1DCQ@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAH4pYpSUbcEH-qJgtV1gEgSZQnf36jq-K53je97CMGDTNR1DCQ@mail.gmail.com> Message-ID: <CAJb-C87suwJqdvtF9s60wn_2Eb7KWX+EYUMEQ2Gv2Q=F79kyHA@mail.gmail.com> Have you guys looked at discourse.org by the guy who created stack overflow? On Oct 24, 2014 2:17 PM, "Brian Granger" <ellisonbg at gmail.com> wrote: > +1 > > On Fri, Oct 24, 2014 at 11:58 AM, Fernando Perez <fperez.net at gmail.com> > wrote: > > Hi folks, > > > > We've been getting signals from many fronts on the need for a more > generic > > mailing list around the language-agnostic, broader-scope Jupyter effort. > I > > think that's probably a good idea. Before I pull the trigger and create > it, > > I figured I'd float the idea here in case anyone has feedback. > > > > Discussions like a CMS platform (ongoing thread right now on this list) > > might evolve into something that needs to further grow its own community, > > and that would be totally OK. But having a common space for all language > > communities to interact on the common questions that Jupyter exposes > would > > be useful, I think. Folk from Julia have certainly expressed that desire > > already. > > > > My proposal is to create, for now, a single 'Project Jupyter' list on > Google > > Groups. I know GG is far from ideal, but I'm not in the mood to maintain > a > > mailing list by hand these days... > > > > Thoughts? > > > > f > > > > -- > > Fernando Perez (@fperez_org; http://fperez.org) > > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > > fernando.perez-at-berkeley: contact me here for any direct mail > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > @ellisonbg on Twitter and GitHub > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/ba125b9a/attachment.html> From rgbkrk at gmail.com Fri Oct 24 15:38:36 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Fri, 24 Oct 2014 20:38:36 +0100 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAH4pYpSUbcEH-qJgtV1gEgSZQnf36jq-K53je97CMGDTNR1DCQ@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAH4pYpSUbcEH-qJgtV1gEgSZQnf36jq-K53je97CMGDTNR1DCQ@mail.gmail.com> Message-ID: <CA+tbMaWYSo5L-ffccEJRYgpuTjn2YswW4pak1Decwx_YDa9K_A@mail.gmail.com> +1000 On Fri, Oct 24, 2014 at 8:17 PM, Brian Granger <ellisonbg at gmail.com> wrote: > +1 > > On Fri, Oct 24, 2014 at 11:58 AM, Fernando Perez <fperez.net at gmail.com> > wrote: > > Hi folks, > > > > We've been getting signals from many fronts on the need for a more > generic > > mailing list around the language-agnostic, broader-scope Jupyter effort. > I > > think that's probably a good idea. Before I pull the trigger and create > it, > > I figured I'd float the idea here in case anyone has feedback. > > > > Discussions like a CMS platform (ongoing thread right now on this list) > > might evolve into something that needs to further grow its own community, > > and that would be totally OK. But having a common space for all language > > communities to interact on the common questions that Jupyter exposes > would > > be useful, I think. Folk from Julia have certainly expressed that desire > > already. > > > > My proposal is to create, for now, a single 'Project Jupyter' list on > Google > > Groups. I know GG is far from ideal, but I'm not in the mood to maintain > a > > mailing list by hand these days... > > > > Thoughts? > > > > f > > > > -- > > Fernando Perez (@fperez_org; http://fperez.org) > > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > > fernando.perez-at-berkeley: contact me here for any direct mail > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > @ellisonbg on Twitter and GitHub > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/96ac3bbc/attachment.html> From doug.blank at gmail.com Fri Oct 24 15:55:06 2014 From: doug.blank at gmail.com (Doug Blank) Date: Fri, 24 Oct 2014 15:55:06 -0400 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> Message-ID: <CAAusYCj=7BJqWCxpFWvxz=_fFppLbzM4u+x2rH-Kw6kE4+Jf7Q@mail.gmail.com> On Fri, Oct 24, 2014 at 2:58 PM, Fernando Perez <fperez.net at gmail.com> wrote: > Hi folks, > > We've been getting signals from many fronts on the need for a more generic > mailing list around the language-agnostic, broader-scope Jupyter effort. I > think that's probably a good idea. Before I pull the trigger and create it, > I figured I'd float the idea here in case anyone has feedback. > > Discussions like a CMS platform (ongoing thread right now on this list) > might evolve into something that needs to further grow its own community, > and that would be totally OK. But having a common space for all language > communities to interact on the common questions that Jupyter exposes would > be useful, I think. Folk from Julia have certainly expressed that desire > already. > > My proposal is to create, for now, a single 'Project Jupyter' list on > Google Groups. I know GG is far from ideal, but I'm not in the mood to > maintain a mailing list by hand these days... > > Thoughts? > Sounds great! Whatever is easiest to use and maintain! -Doug > > f > > -- > Fernando Perez (@fperez_org; http://fperez.org) > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > fernando.perez-at-berkeley: contact me here for any direct mail > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/42fa89f6/attachment.html> From pablo.winant at gmail.com Fri Oct 24 15:54:47 2014 From: pablo.winant at gmail.com (Pablo Winant) Date: Fri, 24 Oct 2014 15:54:47 -0400 Subject: [IPython-dev] Editor widget and data persistence In-Reply-To: <CAH4pYpR11zJ2u9v0rb29_SR6-CP5bWYTgHi4Bhk8jOK7bjEmQQ@mail.gmail.com> References: <CADQWuG4OzGoDtCd-JzzyOv8BP-uyi-8Xai1uNrd6EJtPLL0kVg@mail.gmail.com> <CAOvn4qgBWrd+5RuU8cdZCy8sERWg07TgUBpPcSNP1AHnOC_WPQ@mail.gmail.com> <CADQWuG4m-LaQ=xB7CK6ZUVnkNJHDB8mPT-bN5w7ZCz6qmUkSuQ@mail.gmail.com> <CAMHV+dDUO8qhHD8NY7pQawM9m+qykC+bs_tKKEvs=GmHb1o5hQ@mail.gmail.com> <CAH4pYpR11zJ2u9v0rb29_SR6-CP5bWYTgHi4Bhk8jOK7bjEmQQ@mail.gmail.com> Message-ID: <CADQWuG6pRMJrC5h5G2BC2GX6TSCMWADn=2R-jwLaXS=93FJm0A@mail.gmail.com> I am not sure about that, I?m using the widget interface to edit structures, which have many fields only some of them being text (like https://www.dropbox.com/l/4TJTCjPMiVnZ2WTfIO1BUp). I also plan to have some kind of consistency checks for user entered values. In the meantime I draw some inspiration from this thread http://python.6.x6.nabble.com/API-to-Modify-Notebook-Metadata-td5071535.html and am now trying to call a javascript code to modify and read the notebook metadata. It?s not completely working yet. I guess I?m having trouble to control when the javascript code is called. Ideally, I?d like to query the state of the javascript intepreter structure and get the result within the same Python function. Here are the two functions: def set_metadata(val): # serialize data import json valstring = json.dumps(val) from IPython.display import Javascript, display js = """ IPython.notebook.metadata.modfile = '{}'; """.format(valstring) display ( Javascript(js) ) return None and def get_metadata(): from IPython.display import Javascript, display import json js = """ var command = "meta = " + JSON.stringify(IPython.notebook.metadata); var kernel = IPython.notebook.kernel; kernel.execute(command); """ display(Javascript(js)) # this seems to be evaluated after the function has returned so doesn't give the good result valstring = globals()['meta']['modfile'] return json.loads(valstring) In[10] set_metadata({'arbitrary': 'data', 0:1}) In[11] resp = get_metadata() # incorrect or no result In[12] resp = get_metadata() # correct result Best, Pablo ? On Fri, Oct 24, 2014 at 2:42 PM, Brian Granger <ellisonbg at gmail.com> wrote: > I agree with @takluyver that in this particular case a widget is > probably the wrong answer. I think that the `%%writefile` magic of the > upcoming text editor page is a much better solution... > > Cheers, > > Brian > > On Wed, Oct 22, 2014 at 4:56 PM, Adam Hughes <hughesadam87 at gmail.com> > wrote: > > If you have a notebook that calls the GUI, you can launch it in a second > > notebook just using the %run magic as well. IE, if you had: > > > > mywidget.ipynb > > > > Then you can launch it in a separate notebook with: > > > > %run mywidget.ipynb > > > > On Wed, Oct 22, 2014 at 3:42 PM, Pablo Winant <pablo.winant at gmail.com> > > wrote: > >> > >> Thank you Thomas. > >> > >> On Wed, Oct 22, 2014 at 12:28 PM, Thomas Kluyver <takowl at gmail.com> > wrote: > >>> > >>> Hi Pablo, > >>> IPython.html.nbextensions.> I wonder if it is possible to save the > state > >>> of these widgets when saving the notebook > >>> > >>> Currently, no. We're working on ways to do that, but it turns out to be > >>> more complicated than it seems. > >>> > >>> > More specifically, I'd like to use the text editor widget to edit a > >>> > text file that comes with a notebook > >>> > >>> It's possible to do this with widgets, but I don't think it's the best > >>> fit for the problem. It sounds like what you want is the %%writefile > cell > >>> magic. Just make a code cell containing the text you want, with > %%writefile > >>> filename.txt at the top. When you run it, it will save that content to > the > >>> file. > >>> > >> > >> Actually my usecase is trying to provide users with an easy interface to > >> edit the content of simple structure that is also serializable as a > >> JSON/YAML file. I would be happy if I could find way to store > information > >> produced by the code in the notebook and then read it back. Maybe, > there is > >> a way to edit cell of notebook metadata from the notebook itself ? > >> > >> > >>> > >>> We are also planning to put a text editor component inside the notebook > >>> server, but that's not quite ready yet. > >>> > >>> > the IPython widgets are becoming one of the very few alternatives for > >>> > python web-guis > >>> > >>> Yes, and this is a much larger scope than the widget architecture was > >>> really designed for. We're trying to work out how to handle this. > >> > >> > >> I can smell some big architectural work here... Good luck with that ! > >> > >> Pablo > >> > >> > >>> > >>> > >>> Thanks, > >>> Thomas > >>> > >>> On 22 October 2014 07:58, Pablo Winant <pablo.winant at gmail.com> wrote: > >>>> > >>>> Hi, > >>>> > >>>> The new widgets are absolutely wonderful ! > >>>> > >>>> I wonder if it is possible to save the state of these widgets when > >>>> saving the notebook. More specifically, I'd like to use the text > editor > >>>> widget to edit a text file that comes with a notebook. That would > kill two > >>>> birds with one stone for me: avoid the need to ship a separate file > with the > >>>> notebook (btw, is there already a canonical way to do that ?), and be > able > >>>> to edit it from within the notebook. Are there plans in this > direction ? Any > >>>> idea about how I could implement that ? > >>>> > >>>> A somewhat related question: the IPython widgets are becoming one of > the > >>>> very few alternatives for python web-guis. Do you think it would be > possible > >>>> to use it for a relatively simple application and hide the notebook > from > >>>> user's sight so that it looks like an independent application ? > >>>> > >>>> Best, > >>>> > >>>> Pablo > >>>> > >>>> _______________________________________________ > >>>> IPython-dev mailing list > >>>> IPython-dev at scipy.org > >>>> http://mail.scipy.org/mailman/listinfo/ipython-dev > >>>> > >>> > >>> > >>> _______________________________________________ > >>> IPython-dev mailing list > >>> IPython-dev at scipy.org > >>> http://mail.scipy.org/mailman/listinfo/ipython-dev > >>> > >> > >> > >> _______________________________________________ > >> IPython-dev mailing list > >> IPython-dev at scipy.org > >> http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > @ellisonbg on Twitter and GitHub > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/ea66aced/attachment.html> From bussonniermatthias at gmail.com Fri Oct 24 16:17:11 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Fri, 24 Oct 2014 21:17:11 +0100 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAJb-C87suwJqdvtF9s60wn_2Eb7KWX+EYUMEQ2Gv2Q=F79kyHA@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAH4pYpSUbcEH-qJgtV1gEgSZQnf36jq-K53je97CMGDTNR1DCQ@mail.gmail.com> <CAJb-C87suwJqdvtF9s60wn_2Eb7KWX+EYUMEQ2Gv2Q=F79kyHA@mail.gmail.com> Message-ID: <4D50E3C6-8B1C-4DCE-BC0F-45CDC62BADD8@gmail.com> I would be tempted to try discourse, Though the plan at $200 per month seem a little excessive, and maintaining that ourselves might be too much extra work. -- M Envoy? de mon iPhone > Le 24 oct. 2014 ? 20:30, Arnaud Sahuguet <arnaud.sahuguet at gmail.com> a ?crit : > > Have you guys looked at discourse.org by the guy who created stack overflow? > >> On Oct 24, 2014 2:17 PM, "Brian Granger" <ellisonbg at gmail.com> wrote: >> +1 >> >> On Fri, Oct 24, 2014 at 11:58 AM, Fernando Perez <fperez.net at gmail.com> wrote: >> > Hi folks, >> > >> > We've been getting signals from many fronts on the need for a more generic >> > mailing list around the language-agnostic, broader-scope Jupyter effort. I >> > think that's probably a good idea. Before I pull the trigger and create it, >> > I figured I'd float the idea here in case anyone has feedback. >> > >> > Discussions like a CMS platform (ongoing thread right now on this list) >> > might evolve into something that needs to further grow its own community, >> > and that would be totally OK. But having a common space for all language >> > communities to interact on the common questions that Jupyter exposes would >> > be useful, I think. Folk from Julia have certainly expressed that desire >> > already. >> > >> > My proposal is to create, for now, a single 'Project Jupyter' list on Google >> > Groups. I know GG is far from ideal, but I'm not in the mood to maintain a >> > mailing list by hand these days... >> > >> > Thoughts? >> > >> > f >> > >> > -- >> > Fernando Perez (@fperez_org; http://fperez.org) >> > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) >> > fernando.perez-at-berkeley: contact me here for any direct mail >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> @ellisonbg on Twitter and GitHub >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/9ecafb62/attachment.html> From satra at mit.edu Fri Oct 24 16:17:45 2014 From: satra at mit.edu (Satrajit Ghosh) Date: Fri, 24 Oct 2014 16:17:45 -0400 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAAusYCj=7BJqWCxpFWvxz=_fFppLbzM4u+x2rH-Kw6kE4+Jf7Q@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAAusYCj=7BJqWCxpFWvxz=_fFppLbzM4u+x2rH-Kw6kE4+Jf7Q@mail.gmail.com> Message-ID: <CA+A4wOkdNO-H5VNFMST-y+A_K1iqe5c+g9D+ZcHCWeV5UtZyhA@mail.gmail.com> hi folks, a couple of pointers and things we have found. we have been running the nipy-user mailing list on google groups for a while and recently wanted to extract the messages from it. while it's really easy to setup and run, getting the messages out from google groups is a nightmare - one has to resort to screen scraping techniques. there is no api. the reason we wanted to get messages out is because we were transitioning our Q&A to a platform called biostars and had a google summer of code student this year to help extend various usability features including deployment and ui. here are the sites that use this framework: biostars.org neurostars.org https://biostar.usegalaxy.org/ the code itself is at: https://github.com/ialbert/biostar-central we will continue to evolve this platform. cheers, satra On Fri, Oct 24, 2014 at 3:55 PM, Doug Blank <doug.blank at gmail.com> wrote: > On Fri, Oct 24, 2014 at 2:58 PM, Fernando Perez <fperez.net at gmail.com> > wrote: > >> Hi folks, >> >> We've been getting signals from many fronts on the need for a more >> generic mailing list around the language-agnostic, broader-scope Jupyter >> effort. I think that's probably a good idea. Before I pull the trigger and >> create it, I figured I'd float the idea here in case anyone has feedback. >> >> Discussions like a CMS platform (ongoing thread right now on this list) >> might evolve into something that needs to further grow its own community, >> and that would be totally OK. But having a common space for all language >> communities to interact on the common questions that Jupyter exposes would >> be useful, I think. Folk from Julia have certainly expressed that desire >> already. >> >> My proposal is to create, for now, a single 'Project Jupyter' list on >> Google Groups. I know GG is far from ideal, but I'm not in the mood to >> maintain a mailing list by hand these days... >> >> Thoughts? >> > > Sounds great! Whatever is easiest to use and maintain! > > -Doug > > >> >> f >> >> -- >> Fernando Perez (@fperez_org; http://fperez.org) >> fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) >> fernando.perez-at-berkeley: contact me here for any direct mail >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/32bb48ad/attachment.html> From ellisonbg at gmail.com Fri Oct 24 16:25:04 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 24 Oct 2014 13:25:04 -0700 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CA+A4wOkdNO-H5VNFMST-y+A_K1iqe5c+g9D+ZcHCWeV5UtZyhA@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAAusYCj=7BJqWCxpFWvxz=_fFppLbzM4u+x2rH-Kw6kE4+Jf7Q@mail.gmail.com> <CA+A4wOkdNO-H5VNFMST-y+A_K1iqe5c+g9D+ZcHCWeV5UtZyhA@mail.gmail.com> Message-ID: <CAH4pYpSDr3F15Gxfxm+KcbnuE_khg-XRVfZTQENMRi7A9HGDQw@mail.gmail.com> I am +1 on exploring other options -1000 on us deploying and maintaining anything ourselves +1 on this decision being simple On Fri, Oct 24, 2014 at 1:17 PM, Satrajit Ghosh <satra at mit.edu> wrote: > hi folks, > > a couple of pointers and things we have found. we have been running the > nipy-user mailing list on google groups for a while and recently wanted to > extract the messages from it. while it's really easy to setup and run, > getting the messages out from google groups is a nightmare - one has to > resort to screen scraping techniques. there is no api. > > the reason we wanted to get messages out is because we were transitioning > our Q&A to a platform called biostars and had a google summer of code > student this year to help extend various usability features including > deployment and ui. > > here are the sites that use this framework: > biostars.org > neurostars.org > https://biostar.usegalaxy.org/ > > the code itself is at: https://github.com/ialbert/biostar-central > > we will continue to evolve this platform. > > cheers, > > satra > > On Fri, Oct 24, 2014 at 3:55 PM, Doug Blank <doug.blank at gmail.com> wrote: >> >> On Fri, Oct 24, 2014 at 2:58 PM, Fernando Perez <fperez.net at gmail.com> >> wrote: >>> >>> Hi folks, >>> >>> We've been getting signals from many fronts on the need for a more >>> generic mailing list around the language-agnostic, broader-scope Jupyter >>> effort. I think that's probably a good idea. Before I pull the trigger and >>> create it, I figured I'd float the idea here in case anyone has feedback. >>> >>> Discussions like a CMS platform (ongoing thread right now on this list) >>> might evolve into something that needs to further grow its own community, >>> and that would be totally OK. But having a common space for all language >>> communities to interact on the common questions that Jupyter exposes would >>> be useful, I think. Folk from Julia have certainly expressed that desire >>> already. >>> >>> My proposal is to create, for now, a single 'Project Jupyter' list on >>> Google Groups. I know GG is far from ideal, but I'm not in the mood to >>> maintain a mailing list by hand these days... >>> >>> Thoughts? >> >> >> Sounds great! Whatever is easiest to use and maintain! >> >> -Doug >> >>> >>> >>> f >>> >>> -- >>> Fernando Perez (@fperez_org; http://fperez.org) >>> fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) >>> fernando.perez-at-berkeley: contact me here for any direct mail >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From ewm at redtetrahedron.org Fri Oct 24 16:55:51 2014 From: ewm at redtetrahedron.org (Eric Moore) Date: Fri, 24 Oct 2014 16:55:51 -0400 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CA+A4wOkdNO-H5VNFMST-y+A_K1iqe5c+g9D+ZcHCWeV5UtZyhA@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAAusYCj=7BJqWCxpFWvxz=_fFppLbzM4u+x2rH-Kw6kE4+Jf7Q@mail.gmail.com> <CA+A4wOkdNO-H5VNFMST-y+A_K1iqe5c+g9D+ZcHCWeV5UtZyhA@mail.gmail.com> Message-ID: <CAGeA38nUE_LB+z32Vu20eRPzz+qtQu5wsciyD5__SAbOCsuzAQ@mail.gmail.com> On Friday, October 24, 2014, Satrajit Ghosh <satra at mit.edu> wrote: > hi folks, > > a couple of pointers and things we have found. we have been running the > nipy-user mailing list on google groups for a while and recently wanted to > extract the messages from it. while it's really easy to setup and run, > getting the messages out from google groups is a nightmare - one has to > resort to screen scraping techniques. there is no api. > > the reason we wanted to get messages out is because we were transitioning > our Q&A to a platform called biostars and had a google summer of code > student this year to help extend various usability features including > deployment and ui. > > here are the sites that use this framework: > biostars.org > neurostars.org > https://biostar.usegalaxy.org/ > > the code itself is at: https://github.com/ialbert/biostar-central > > we will continue to evolve this platform. > > cheers, > > satra > > On Fri, Oct 24, 2014 at 3:55 PM, Doug Blank <doug.blank at gmail.com > <javascript:_e(%7B%7D,'cvml','doug.blank at gmail.com');>> wrote: > >> On Fri, Oct 24, 2014 at 2:58 PM, Fernando Perez <fperez.net at gmail.com >> <javascript:_e(%7B%7D,'cvml','fperez.net at gmail.com');>> wrote: >> >>> Hi folks, >>> >>> We've been getting signals from many fronts on the need for a more >>> generic mailing list around the language-agnostic, broader-scope Jupyter >>> effort. I think that's probably a good idea. Before I pull the trigger and >>> create it, I figured I'd float the idea here in case anyone has feedback. >>> >>> Discussions like a CMS platform (ongoing thread right now on this list) >>> might evolve into something that needs to further grow its own community, >>> and that would be totally OK. But having a common space for all language >>> communities to interact on the common questions that Jupyter exposes would >>> be useful, I think. Folk from Julia have certainly expressed that desire >>> already. >>> >>> My proposal is to create, for now, a single 'Project Jupyter' list on >>> Google Groups. I know GG is far from ideal, but I'm not in the mood to >>> maintain a mailing list by hand these days... >>> >>> Thoughts? >>> >> >> Sounds great! Whatever is easiest to use and maintain! >> >> -Doug >> >> >>> >>> f >>> >>> -- >>> Fernando Perez (@fperez_org; http://fperez.org) >>> fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) >>> fernando.perez-at-berkeley: contact me here for any direct mail >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> <javascript:_e(%7B%7D,'cvml','IPython-dev at scipy.org');> >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> <javascript:_e(%7B%7D,'cvml','IPython-dev at scipy.org');> >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > Does your archive have to come from google? I believe gmane has downloadable archives. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/8fbdaed2/attachment.html> From fperez.net at gmail.com Fri Oct 24 18:17:50 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Fri, 24 Oct 2014 15:17:50 -0700 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAH4pYpSDr3F15Gxfxm+KcbnuE_khg-XRVfZTQENMRi7A9HGDQw@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAAusYCj=7BJqWCxpFWvxz=_fFppLbzM4u+x2rH-Kw6kE4+Jf7Q@mail.gmail.com> <CA+A4wOkdNO-H5VNFMST-y+A_K1iqe5c+g9D+ZcHCWeV5UtZyhA@mail.gmail.com> <CAH4pYpSDr3F15Gxfxm+KcbnuE_khg-XRVfZTQENMRi7A9HGDQw@mail.gmail.com> Message-ID: <CAHAreOpFLyzGSkxccKwGiS-nLiaivb2GJ7OUkq+U8mDo4bkrhQ@mail.gmail.com> On Fri, Oct 24, 2014 at 1:25 PM, Brian Granger <ellisonbg at gmail.com> wrote: > -1000 on us deploying and maintaining anything ourselves make that - \infty... -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/d4dad531/attachment.html> From arnaud.sahuguet at gmail.com Fri Oct 24 18:23:21 2014 From: arnaud.sahuguet at gmail.com (Arnaud Sahuguet) Date: Fri, 24 Oct 2014 18:23:21 -0400 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <4D50E3C6-8B1C-4DCE-BC0F-45CDC62BADD8@gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAH4pYpSUbcEH-qJgtV1gEgSZQnf36jq-K53je97CMGDTNR1DCQ@mail.gmail.com> <CAJb-C87suwJqdvtF9s60wn_2Eb7KWX+EYUMEQ2Gv2Q=F79kyHA@mail.gmail.com> <4D50E3C6-8B1C-4DCE-BC0F-45CDC62BADD8@gmail.com> Message-ID: <CAJb-C87MM09Pep2oqWYvbRCZenQ=kqppMbHmQ3cAd8Q842hWNw@mail.gmail.com> This is opensource. You grab the code and can run it wherever you want. On Fri, Oct 24, 2014 at 4:17 PM, Matthias Bussonnier < bussonniermatthias at gmail.com> wrote: > I would be tempted to try discourse, > Though the plan at $200 per month seem a little excessive, and maintaining > that ourselves might be too much extra work. > -- > M > > Envoy? de mon iPhone > > Le 24 oct. 2014 ? 20:30, Arnaud Sahuguet <arnaud.sahuguet at gmail.com> a > ?crit : > > Have you guys looked at discourse.org by the guy who created stack > overflow? > On Oct 24, 2014 2:17 PM, "Brian Granger" <ellisonbg at gmail.com> wrote: > >> +1 >> >> On Fri, Oct 24, 2014 at 11:58 AM, Fernando Perez <fperez.net at gmail.com> >> wrote: >> > Hi folks, >> > >> > We've been getting signals from many fronts on the need for a more >> generic >> > mailing list around the language-agnostic, broader-scope Jupyter >> effort. I >> > think that's probably a good idea. Before I pull the trigger and create >> it, >> > I figured I'd float the idea here in case anyone has feedback. >> > >> > Discussions like a CMS platform (ongoing thread right now on this list) >> > might evolve into something that needs to further grow its own >> community, >> > and that would be totally OK. But having a common space for all language >> > communities to interact on the common questions that Jupyter exposes >> would >> > be useful, I think. Folk from Julia have certainly expressed that desire >> > already. >> > >> > My proposal is to create, for now, a single 'Project Jupyter' list on >> Google >> > Groups. I know GG is far from ideal, but I'm not in the mood to >> maintain a >> > mailing list by hand these days... >> > >> > Thoughts? >> > >> > f >> > >> > -- >> > Fernando Perez (@fperez_org; http://fperez.org) >> > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) >> > fernando.perez-at-berkeley: contact me here for any direct mail >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> @ellisonbg on Twitter and GitHub >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Arnaud Sahuguet Do a little. Change a lot. <http://www.google.com/onetoday> -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/46b9d11c/attachment.html> From bussonniermatthias at gmail.com Fri Oct 24 18:25:58 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Fri, 24 Oct 2014 23:25:58 +0100 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAJb-C87MM09Pep2oqWYvbRCZenQ=kqppMbHmQ3cAd8Q842hWNw@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAH4pYpSUbcEH-qJgtV1gEgSZQnf36jq-K53je97CMGDTNR1DCQ@mail.gmail.com> <CAJb-C87suwJqdvtF9s60wn_2Eb7KWX+EYUMEQ2Gv2Q=F79kyHA@mail.gmail.com> <4D50E3C6-8B1C-4DCE-BC0F-45CDC62BADD8@gmail.com> <CAJb-C87MM09Pep2oqWYvbRCZenQ=kqppMbHmQ3cAd8Q842hWNw@mail.gmail.com> Message-ID: <DBBF7672-DCCA-405C-93AA-1714B07D0DB2@gmail.com> Le 24 oct. 2014 ? 23:23, Arnaud Sahuguet <arnaud.sahuguet at gmail.com> a ?crit : > This is opensource. > You grab the code and can run it wherever you want. That was in the "and maintaining that ourselves might be too much extra work" part of my sentence. That extra dev ops, setting up server, patching OpenSSL, to avoid heart bleed, Poodle, check that shellshock does not affect us... > On Fri, Oct 24, 2014 at 4:17 PM, Matthias Bussonnier <bussonniermatthias at gmail.com> wrote: > I would be tempted to try discourse, > Though the plan at $200 per month seem a little excessive, and maintaining that ourselves might be too much extra work. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141024/5c382d44/attachment.html> From ellisonbg at gmail.com Fri Oct 24 18:39:42 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 24 Oct 2014 15:39:42 -0700 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAJb-C87MM09Pep2oqWYvbRCZenQ=kqppMbHmQ3cAd8Q842hWNw@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <CAH4pYpSUbcEH-qJgtV1gEgSZQnf36jq-K53je97CMGDTNR1DCQ@mail.gmail.com> <CAJb-C87suwJqdvtF9s60wn_2Eb7KWX+EYUMEQ2Gv2Q=F79kyHA@mail.gmail.com> <4D50E3C6-8B1C-4DCE-BC0F-45CDC62BADD8@gmail.com> <CAJb-C87MM09Pep2oqWYvbRCZenQ=kqppMbHmQ3cAd8Q842hWNw@mail.gmail.com> Message-ID: <CAH4pYpTRD8w_LyTd6Pv=jxAaLugiKroAUS2-p+7kHYJ=5PAyBQ@mail.gmail.com> the "grab the code and run it wherever you want" was my -1000 and Fernando's -\infty I would gladly pay thousands of dollars right now to anyone or anything that allows me to think about fewer things. This is not question of open source versus commercial, it is just an issue of 24 hour days and picking the most important things to work on. On Fri, Oct 24, 2014 at 3:23 PM, Arnaud Sahuguet <arnaud.sahuguet at gmail.com> wrote: > This is opensource. > You grab the code and can run it wherever you want. > > On Fri, Oct 24, 2014 at 4:17 PM, Matthias Bussonnier > <bussonniermatthias at gmail.com> wrote: >> >> I would be tempted to try discourse, >> Though the plan at $200 per month seem a little excessive, and maintaining >> that ourselves might be too much extra work. >> -- >> M >> >> Envoy? de mon iPhone >> >> Le 24 oct. 2014 ? 20:30, Arnaud Sahuguet <arnaud.sahuguet at gmail.com> a >> ?crit : >> >> Have you guys looked at discourse.org by the guy who created stack >> overflow? >> >> On Oct 24, 2014 2:17 PM, "Brian Granger" <ellisonbg at gmail.com> wrote: >>> >>> +1 >>> >>> On Fri, Oct 24, 2014 at 11:58 AM, Fernando Perez <fperez.net at gmail.com> >>> wrote: >>> > Hi folks, >>> > >>> > We've been getting signals from many fronts on the need for a more >>> > generic >>> > mailing list around the language-agnostic, broader-scope Jupyter >>> > effort. I >>> > think that's probably a good idea. Before I pull the trigger and create >>> > it, >>> > I figured I'd float the idea here in case anyone has feedback. >>> > >>> > Discussions like a CMS platform (ongoing thread right now on this list) >>> > might evolve into something that needs to further grow its own >>> > community, >>> > and that would be totally OK. But having a common space for all >>> > language >>> > communities to interact on the common questions that Jupyter exposes >>> > would >>> > be useful, I think. Folk from Julia have certainly expressed that >>> > desire >>> > already. >>> > >>> > My proposal is to create, for now, a single 'Project Jupyter' list on >>> > Google >>> > Groups. I know GG is far from ideal, but I'm not in the mood to >>> > maintain a >>> > mailing list by hand these days... >>> > >>> > Thoughts? >>> > >>> > f >>> > >>> > -- >>> > Fernando Perez (@fperez_org; http://fperez.org) >>> > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) >>> > fernando.perez-at-berkeley: contact me here for any direct mail >>> > >>> > _______________________________________________ >>> > IPython-dev mailing list >>> > IPython-dev at scipy.org >>> > http://mail.scipy.org/mailman/listinfo/ipython-dev >>> > >>> >>> >>> >>> -- >>> Brian E. Granger >>> Cal Poly State University, San Luis Obispo >>> @ellisonbg on Twitter and GitHub >>> bgranger at calpoly.edu and ellisonbg at gmail.com >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > > -- > Arnaud Sahuguet > Do a little. Change a lot. > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com From jason-sage at creativetrax.com Fri Oct 24 20:40:44 2014 From: jason-sage at creativetrax.com (Jason Grout) Date: Fri, 24 Oct 2014 20:40:44 -0400 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> Message-ID: <544AF18C.7010808@creativetrax.com> On 10/24/14, 14:58, Fernando Perez wrote: > Thoughts? +1 on GG, with gmane.org mirroring. Jason From roalexan at microsoft.com Fri Oct 24 22:08:40 2014 From: roalexan at microsoft.com (Robert Alexander) Date: Sat, 25 Oct 2014 02:08:40 +0000 Subject: [IPython-dev] error running docker pull jupyter/demo Message-ID: <1414202917930.2932@microsoft.com> Anyone else seeing this? In setting up jupyter/tmpnb, I'm seeing: sudo docker pull jupyter/demo Pulling repository jupyter/demo 150a62370f1d: Pulling dependent layers 511136ea3c5a: Download complete ... ebee8767795d: Download complete 113a452eaaa8: Downloading [========> ] 104.1 MB/598.9 MB 3m54s 2014/10/25 01:46:13 unexpected EOF Here's what I'm seeing if I run it again: sudo docker pull jupyter/demo ... 113a452eaaa8: Error downloading dependent layers 2014/10/25 01:53:12 Could not find repository on any of the indexed registries. This has happened to me two times in a row now on a fresh Ubuntu Server 14.04 LTS virtual machine. -Robert -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141025/cb3c1692/attachment.html> From roalexan at microsoft.com Fri Oct 24 23:54:38 2014 From: roalexan at microsoft.com (Robert Alexander) Date: Sat, 25 Oct 2014 03:54:38 +0000 Subject: [IPython-dev] error running docker pull jupyter/demo In-Reply-To: <1414202917930.2932@microsoft.com> References: <1414202917930.2932@microsoft.com> Message-ID: <1414209268859.39511@microsoft.com> I tried coming at this from a different angle, namely by download from git and bootstrapping using an "out-of-the-box" script that I found: sudo git clone https://github.com/jupyter/tmpnb.git sudo script/bootstrap It looks like it ultimately sort of does the same thing, namely pull the jupyter/demo repository. This time around, however, it made it passed the previously failing "dependent layer" - maybe that was a particularly large download that the network temporarily glitched on. ________________________________ From: ipython-dev-bounces at scipy.org <ipython-dev-bounces at scipy.org> on behalf of Robert Alexander <roalexan at microsoft.com> Sent: Friday, October 24, 2014 10:08 PM To: ipython-dev at scipy.org Subject: [IPython-dev] error running docker pull jupyter/demo Anyone else seeing this? In setting up jupyter/tmpnb, I'm seeing: sudo docker pull jupyter/demo Pulling repository jupyter/demo 150a62370f1d: Pulling dependent layers 511136ea3c5a: Download complete ... ebee8767795d: Download complete 113a452eaaa8: Downloading [========> ] 104.1 MB/598.9 MB 3m54s 2014/10/25 01:46:13 unexpected EOF Here's what I'm seeing if I run it again: sudo docker pull jupyter/demo ... 113a452eaaa8: Error downloading dependent layers 2014/10/25 01:53:12 Could not find repository on any of the indexed registries. This has happened to me two times in a row now on a fresh Ubuntu Server 14.04 LTS virtual machine. -Robert -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141025/acbaec39/attachment.html> From roalexan at microsoft.com Sat Oct 25 03:19:46 2014 From: roalexan at microsoft.com (roalexan) Date: Sat, 25 Oct 2014 00:19:46 -0700 (PDT) Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions In-Reply-To: <CA+tbMaV8aQ6nqP2OLNjdgTLxJ3mshA+Qhv2qnXOOHPLt-zRoUg@mail.gmail.com> References: <1414002105549.34538@microsoft.com> <CA+tbMaV8aQ6nqP2OLNjdgTLxJ3mshA+Qhv2qnXOOHPLt-zRoUg@mail.gmail.com> Message-ID: <1414221586573-5075736.post@n6.nabble.com> With a fresh VM, I installed Docker then did the following steps: sudo docker pull jupyter/demo export TOKEN=$( head -c 30 /dev/urandom | xxd -p ) sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN jupyter/configurable-http-proxy --default-target http://127.0.0.1:9999 sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN -v /var/run/docker.sock:/docker.sock jupyter/tmpnb python orchestrate.py --cull-timeout=60 --docker-version="1.12" --mem_limit=256m --pool-size=2 NOTE: I'm specifying pool-size (2) * mem_limit (256m) = 512m, and my VM has 768m. I then listed the running Docker containers via: sudo docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 090b48f7776f jupyter/tmpnb:latest python orchestrate.p 41 seconds ago Exited (1) 32 seconds ago mad_kirch fc080e9738e1 jupyter/configurable-http-proxy:latest configurable-http-pr 18 minutes ago Up 18 minutes ecstatic_goodall This indicates that the tmpnb process exited, so looked at the logs for this container and saw an error (see below) - any idea what is going on? sudo docker logs fc080e9738e1 06:28:24.502 - info: [ConfigProxy] Proxying http://*:8000 to http://127.0.0.1:9999 06:28:24.552 - info: [ConfigProxy] Proxy API at http://localhost:8001/api/routes azureuser at rbaJupyDockVm4:~$ sudo docker logs 090b48f7776f [E 141025 06:46:23 dockworker:157] Encountered a Docker error (5 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (4 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (5 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (3 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (2 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (4 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (3 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (2 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (1 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (1 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (0 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") [E 141025 06:46:23 dockworker:157] Encountered a Docker error (0 retries remain): 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") Traceback (most recent call last): File "orchestrate.py", line 199, in <module> main() File "orchestrate.py", line 182, in main ioloop.run_sync(pool.heartbeat) File "/usr/local/lib/python2.7/dist-packages/tornado/ioloop.py", line 418, in run_sync return future_cell[0].result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 631, in run yielded = self.gen.throw(*sys.exc_info()) File "/srv/tmpnb/spawnpool.py", line 170, in heartbeat yield tasks File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 628, in run value = future.result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 464, in callback result_list = [i.result() for i in children] File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 631, in run yielded = self.gen.throw(*sys.exc_info()) File "/srv/tmpnb/spawnpool.py", line 195, in _launch_container container_config=self.container_config) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 628, in run value = future.result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 631, in run yielded = self.gen.throw(*sys.exc_info()) File "/srv/tmpnb/dockworker.py", line 95, in create_notebook_server cpu_shares=container_config.cpu_shares) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 628, in run value = future.result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 631, in run yielded = self.gen.throw(*sys.exc_info()) File "/srv/tmpnb/dockworker.py", line 160, in _with_retries result = yield self._with_retries(fn, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 628, in run value = future.result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 631, in run yielded = self.gen.throw(*sys.exc_info()) File "/srv/tmpnb/dockworker.py", line 160, in _with_retries result = yield self._with_retries(fn, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 628, in run value = future.result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 631, in run yielded = self.gen.throw(*sys.exc_info()) File "/srv/tmpnb/dockworker.py", line 160, in _with_retries result = yield self._with_retries(fn, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 628, in run value = future.result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 631, in run yielded = self.gen.throw(*sys.exc_info()) File "/srv/tmpnb/dockworker.py", line 160, in _with_retries result = yield self._with_retries(fn, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 628, in run value = future.result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 631, in run yielded = self.gen.throw(*sys.exc_info()) File "/srv/tmpnb/dockworker.py", line 160, in _with_retries result = yield self._with_retries(fn, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 628, in run value = future.result() File "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 109, in result raise_exc_info(self._exc_info) File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line 631, in run yielded = self.gen.throw(*sys.exc_info()) File "/srv/tmpnb/dockworker.py", line 163, in _with_retries raise e docker.errors.APIError: 404 Client Error: Not Found ("No such image: jupyter/demo (tag: latest)") -- View this message in context: http://python.6.x6.nabble.com/Unable-to-start-Jupityr-on-Docker-using-Quick-start-instructions-tp5075454p5075736.html Sent from the IPython - Development mailing list archive at Nabble.com. From roalexan at microsoft.com Sat Oct 25 04:14:12 2014 From: roalexan at microsoft.com (roalexan) Date: Sat, 25 Oct 2014 01:14:12 -0700 (PDT) Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions In-Reply-To: <1414221586573-5075736.post@n6.nabble.com> References: <1414002105549.34538@microsoft.com> <CA+tbMaV8aQ6nqP2OLNjdgTLxJ3mshA+Qhv2qnXOOHPLt-zRoUg@mail.gmail.com> <1414221586573-5075736.post@n6.nabble.com> Message-ID: <1414224852357-5075739.post@n6.nabble.com> The underlying problem appears to be an incomplete run of: sudo docker pull jupyter/demo. There are many relevant posts, such as: https://github.com/docker/docker/issues/3721. I will continue to investigate... -- View this message in context: http://python.6.x6.nabble.com/Unable-to-start-Jupityr-on-Docker-using-Quick-start-instructions-tp5075454p5075739.html Sent from the IPython - Development mailing list archive at Nabble.com. From benjaminrk at gmail.com Sat Oct 25 15:34:34 2014 From: benjaminrk at gmail.com (MinRK) Date: Sat, 25 Oct 2014 12:34:34 -0700 Subject: [IPython-dev] Jupyterhub behind NGINX redirect In-Reply-To: <CAETqNqG-y9ZfNZMnReHdhCPxaVGi1A6gs4ZCzaz-pSw3m3oRiw@mail.gmail.com> References: <CAETqNqG1cVMpxaSOW=s3H9Vty+2+qZtSyg2fnXX0-yixADZY6Q@mail.gmail.com> <CAAusYCg2qVDzOvhfFhKzUenv-7tDpG3BGkcfLYB1sq_nZYdi8g@mail.gmail.com> <CAETqNqG-y9ZfNZMnReHdhCPxaVGi1A6gs4ZCzaz-pSw3m3oRiw@mail.gmail.com> Message-ID: <CAHNn8BWgTxLJmyX8wrmw4D3fEzXMVzrxrjOeym12rWuG5gbVMA@mail.gmail.com> Clare, Can you update to the latest master? I think the never-ending redirects could be the result of a recently fixed typo. Thanks, -MinRK On Thu, Oct 23, 2014 at 10:01 PM, Clare Sloggett <claresloggett at gmail.com> wrote: > Hi Doug, > > Thanks for this. I had actually just been thinking about about the NGINX > redirect issue, and had assumed everything behind that would be fairly > straightforward. But it sounds like you are saying there may be more > fundamental issues, and to be honest I haven't tested that the redirect is > definitely the source of all my problems. > > It sounds like I need to do some more direct testing and come back! > > In the meantime, if anyone has insight into what could be causing a URL > rewrite like "/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython...." > that could be really helpful. > > Cheers, > Clare > > On 13 October 2014 00:44, Doug Blank <doug.blank at gmail.com> wrote: > >> On Sun, Oct 12, 2014 at 1:35 AM, Clare Sloggett <claresloggett at gmail.com> >> wrote: >> > >> > Hi all, >> > >> > Am I right in thinking this list is also the right place for questions >> about Jupyterhub? >> > >> > I'm trying to set up Jupyterhub for multiple users, on the same server >> where we are running several other services. Currently there are NGINX >> redirects in place to these other services. I'd like to set up http://<public-url>/ipython/ >> to redirect to a port on localhost and run Jupyterhub over that port. Is >> this possible? >> > >> > I've got this working in the past with single-user IPython Notebook. >> For that, I set config options c.NotebookApp.base_project_url, >> c.NotebookApp.base_kernel_url, and c.NotebookApp.webapp_settings to be >> aware of the ipython/ URL prefix. We used an NGINX redirect to forward >> requests and handle websockets properly, which looked like >> > >> > location /ipython/ { >> > proxy_pass http://127.0.0.1:9510; >> > proxy_set_header Host $host; >> > proxy_set_header X-Real-IP $remote_addr; >> > proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; >> > proxy_set_header Upgrade $http_upgrade; >> > proxy_set_header Connection "upgrade"; >> > } >> > >> > This worked for the old single-user notebook. But, I'm not clear on the >> model Jupyterhub is using (and I'm not much of a sysadmin). I read through >> the command-line options, thought from them that I don't need to strip the >> /ipython/ from the incoming requests, and have tried using a similar >> redirect to the above and setting --JupyterHubApp.base_url='ipython/' and >> also setting --port 9510. This does seem to see the incoming requests but >> results in amusing requests like >> > >> > 500 GET >> /ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/...... >> > >> > ... so clearly I haven't understood what's going on. Does anyone have >> any pointers on how this should work? I haven't read any docs other than >> the README and the command-line parameter information, so apologies if >> there's something obvious that I didn't look at. >> > >> > I'm also interested in running Jupyterhub as a daemon, so if that's >> something that's been done before and there's anything I should know, that >> would be great. >> >> There is one other document, other than the README.md and the reported >> issues [1]: >> >> >> https://github.com/jupyter/jupyterhub/wiki/Using-sudo-to-run-the-server-as-non-root >> >> Despite the warning at the top of that page, you can make jupyterhub work >> on some systems (eg, Linux, such as Ubuntu) using sudo, but not as root. I >> suspect that this would be the recommended setup when jupyterhub is >> complete. One recent change is the ability to save/load state from a >> database. The wiki page above hasn't been updated with the note from this >> issue: >> >> https://github.com/jupyter/jupyterhub/issues/57 >> >> It might be easier to start without NGINX, and then add it after you have >> a working jupyterhub system. It would be nice to have a little bash script >> to make this a "service" that would support "start", "top", and "status"... >> but I haven't had time. Currently, we're just becoming the non-root sudoer >> ("rhea" in the docs) and starting the server, something along the lines: >> >> jupyterhub --LocalProcessSpawner.set_user=sudo >> --JupyterHubApp.ip=165.106.10.83 --JupyterHubApp.port=80 >> --db='sqlite:///:memory:' &>> /var/log/jupyterhub/log & >> >> The next step for us is to get it running under https... looks like >> others have blazed that trail, so it looks possible. >> >> If you have success, it would be great to add to the wiki docs... I >> suspect that many of us that aren't sys admins will be wanting to get this >> up and running. >> >> -Doug >> >> [1] - https://github.com/jupyter/jupyterhub >> >> > Any help much appreciated! >> > >> > Clare >> > >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141025/8a7ad577/attachment.html> From hughesadam87 at gmail.com Sat Oct 25 16:58:32 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Sat, 25 Oct 2014 16:58:32 -0400 Subject: [IPython-dev] Quick Question about Widgets In-Reply-To: <CACejjWwa5ZgZDLGZM3BpTJ087AT5VZVzeqYNmb4aE5kV4etBYQ@mail.gmail.com> References: <CAMHV+dAy=kYENwzt_nDZbaroM2Dn-Xb7vf=6K0AnJTzrQifrxA@mail.gmail.com> <CACejjWwa5ZgZDLGZM3BpTJ087AT5VZVzeqYNmb4aE5kV4etBYQ@mail.gmail.com> Message-ID: <CAMHV+dB8Hoy0-HOZOsLxRL=CLXZOWNPDu-bHGSZG1=-ZVK24Aw@mail.gmail.com> Hi Nicholas, I just wanted to say that this suggest worked like a charm and we are very appreciate for your help! On Mon, Oct 6, 2014 at 4:29 PM, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > Sorry; haven't had much time to tinker on widget stuff much outside of > directly work-related stuff. > > The file stuff sounds like it's getting pretty complicated! Maybe you > could add another layer outside of the GUI, like a Workspace, and have all > of the file-relevant stuff handled there. Then, when you change datasets, > you just re-roll the whole GUI related to that specific dataset. > > However, based on what you have done... first, you could instrument the > dataset as a traitlets.Instance: (*caveat: the below things are not > tested!*) > > class Spectrogram(HTML): >> ... >> ts = Instance(klass=WhateverTsIs) > > > Then you can use the nice events to react to that being switched to a new > instance on a per-linked-widget basis: > > class Spectroscopy(Box): >> ... >> def _sampling(self): >> ... >> start = FloatSlider( >> description="Slicing Start Value", >> value=self.graph.ts.index[0], >> min=self.graph.ts.index.min(), >> max=self.graph.ts.index.max() >> ) >> ... >> >> def _ts_changed(name, old, new): >> start.value = self.graph.ts.index[0] >> start.min = self.graph.ts.index.min() >> start.max = self.graph.ts.index.max() >> >> self.graph.on_trait_changed(_ts_changed, "ts") >> > > Now, you'll probably still have the problem of whether you are actually > ready to redraw as all those controls re-initialize... the easiest thing > would probably be to just add some more error handling to Spectrogram.draw > to catch these errors, and let it fail if you are pretty confident that it > will work once the inputs are all valid. Or, you could set a time window > during which you don't try to redraw. Not sure what would work out best. > > Maybe this helps? > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141025/544f3d10/attachment.html> From hughesadam87 at gmail.com Sat Oct 25 17:07:03 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Sat, 25 Oct 2014 17:07:03 -0400 Subject: [IPython-dev] More widget feasibility ideas Message-ID: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> Hi, We're very happy with the progress in our widget applications, and along the way have thought up some cool improvements, but don't have a great sense as to whether or not they're directly implementable in the widget framework as is. I was hoping for just some quick feedback like "ya that's easy to do" or "ya, you can do that but it requires A, B, C hacks" or "no, that's out of the scope of the framework" to help us best apportion our development time. Here are a few ideas we had: 1. For a given frame of widgets, it would be great if we could have a little hyperlink that says "what's this?" and if a user clicks it, it would pop up a short description of the function of some of those widgets. Many applications have this feature. 2. Most of our updates pass through a single "redraw()" method. Sometimes we don't know if the program is frozen, if the draw has been skipped, or if it's done successfully. I'd love to have a little box at the top center of the application that prints state information like "Warning" or "Ready" or "Updating" or "Failure". This would be a great feature; especially if it could display different colors (eg red vs. green for different outcomes, but that's not essential...) 3. TraitsUI has a nice tabbed-view where the layout has several tabs, which effectively lets you pack 4 layouts into one main container. This would be awesome for us, since many widgets are shared between our different utilities, but we repurpose alot. Image I had two GUI's; one that does analysis A and one that does analysis B. It would be amazing if we could keep the shared widgets like plotting/changing unit systems/save button at the top or bottom of the layout, and have an "analysis A/B" set of tabs to cycle through the different workflows. I presume this is not possible right now, but is this something that might fit in down the road with the current dev plans? Thanks -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141025/c6f6598c/attachment.html> From nick.bollweg at gmail.com Sat Oct 25 19:51:22 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Sat, 25 Oct 2014 19:51:22 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> Message-ID: <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> > 1. pop up a short description of the function > The bootstrap popover would be a good way to do this: http://getbootstrap.com/javascript/#popovers Unlike some of the bootstrap components, you can't just add it with DOM attributes, though, and actually need to do some JS. Here's a relatively simple way to get a popover: https://gist.github.com/bollwyvl/7c1d9606bc31272c825a It has a lot of limitations: a better one would do a full container in the popup body, expose all the options, etc. > 2. state information > Again, bootstrap mostly has you covered: http://getbootstrap.com/components/#alerts widgets.HTML( value="X", _dom_classes=["alert alert-danger"] ) When you want it to be something else, you would just change the value and the _dom_classes. > 3. tabbed-view > There is already a tabs widget, which subclasses Box: widgets.Tab( _titles={0: "A", 1: "B"}, children=[widgets.Box(), widgets.Box()] ) It should be pretty easy to adapt this to your layout, and it can be switched programattically with selected_index. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141025/544b13b0/attachment.html> From hughesadam87 at gmail.com Sat Oct 25 20:12:46 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Sat, 25 Oct 2014 20:12:46 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> Message-ID: <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> Awesome, thanks so much! On Sat, Oct 25, 2014 at 7:51 PM, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > > 1. pop up a short description of the function >> > The bootstrap popover would be a good way to do this: > http://getbootstrap.com/javascript/#popovers > > Unlike some of the bootstrap components, you can't just add it with DOM > attributes, though, and actually need to do some JS. Here's a relatively > simple way to get a popover: > https://gist.github.com/bollwyvl/7c1d9606bc31272c825a > > It has a lot of limitations: a better one would do a full container in the > popup body, expose all the options, etc. > > >> 2. state information >> > Again, bootstrap mostly has you covered: > http://getbootstrap.com/components/#alerts > > widgets.HTML( > value="X", > _dom_classes=["alert alert-danger"] > ) > > When you want it to be something else, you would just change the value and > the _dom_classes. > > >> 3. tabbed-view >> > > There is already a tabs widget, which subclasses Box: > > widgets.Tab( > _titles={0: "A", 1: "B"}, > children=[widgets.Box(), widgets.Box()] > ) > > It should be pretty easy to adapt this to your layout, and it can be > switched programattically with selected_index. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141025/7c6f2b97/attachment.html> From hughesadam87 at gmail.com Sat Oct 25 20:15:54 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Sat, 25 Oct 2014 20:15:54 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> Message-ID: <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> So just for my knowledge, all bootstrap/java/css is fully supported implicitly by the notebook running in the browser, right? Or is only a certain subset of those libraries available? On Sat, Oct 25, 2014 at 8:12 PM, Adam Hughes <hughesadam87 at gmail.com> wrote: > Awesome, thanks so much! > > On Sat, Oct 25, 2014 at 7:51 PM, Nicholas Bollweg <nick.bollweg at gmail.com> > wrote: > >> >> 1. pop up a short description of the function >>> >> The bootstrap popover would be a good way to do this: >> http://getbootstrap.com/javascript/#popovers >> >> Unlike some of the bootstrap components, you can't just add it with DOM >> attributes, though, and actually need to do some JS. Here's a relatively >> simple way to get a popover: >> https://gist.github.com/bollwyvl/7c1d9606bc31272c825a >> >> It has a lot of limitations: a better one would do a full container in >> the popup body, expose all the options, etc. >> >> >>> 2. state information >>> >> Again, bootstrap mostly has you covered: >> http://getbootstrap.com/components/#alerts >> >> widgets.HTML( >> value="X", >> _dom_classes=["alert alert-danger"] >> ) >> >> When you want it to be something else, you would just change the value >> and the _dom_classes. >> >> >>> 3. tabbed-view >>> >> >> There is already a tabs widget, which subclasses Box: >> >> widgets.Tab( >> _titles={0: "A", 1: "B"}, >> children=[widgets.Box(), widgets.Box()] >> ) >> >> It should be pretty easy to adapt this to your layout, and it can be >> switched programattically with selected_index. >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141025/82ac18f5/attachment.html> From nick.bollweg at gmail.com Sat Oct 25 20:49:02 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Sat, 25 Oct 2014 20:49:02 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> Message-ID: <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> Right: the notebook UI and many of the "stock" widgets use it, so I would feel pretty safe building on it... nothing on the roadmap makes me think they'd move away from it. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141025/c39c63bc/attachment.html> From akim at lrde.epita.fr Mon Oct 27 06:02:22 2014 From: akim at lrde.epita.fr (Akim Demaille) Date: Mon, 27 Oct 2014 11:02:22 +0100 Subject: [IPython-dev] Absolute Path IPython In-Reply-To: <44FD56F4-48B9-459A-88E7-3BBAB3AAC625@lrde.epita.fr> References: <519350F2-4448-4DA5-85E3-B39207422A1C@gmail.com> <D535725D-F95F-4440-8D17-641F1BA22F05@gmail.com> <F77111DF-0AB0-4991-99FD-18CDF0F33130@gmail.com> <8CD68300-E810-4E96-92BA-EDD611BB9C32@gmail.com> <8963E105-A69C-45B9-BB87-19D0902A0155@lrde.epita.fr> <11EA3DEB-3971-4756-9ED7-824CC9F22EF9@gmail.com> <44FD56F4-48B9-459A-88E7-3BBAB3AAC625@lrde.epita.fr> Message-ID: <948E6174-B697-4DD8-8030-F156696C6DCC@lrde.epita.fr> Hi all! A little ping, especially on the issues I face below when using HMTL. Thanks a lot! Le 16 oct. 2014 ? 16:42, Akim Demaille <akim at lrde.epita.fr> a ?crit : > > Le 23 sept. 2014 ? 14:25, Matthias Bussonnier <bussonniermatthias at gmail.com> a ?crit : > >> Hi, > > Hi Matthias, Hi all, > > The context was: our documentation, written in IPython notebooks > (see http://nbviewer.ipython.org/urls/www.lrde.epita.fr/dload/vaucanson/2.0/notebooks/index.ipynb), is installed on the user's machine as IPython notebooks. > I wanted to be able to open these ipynb on request from > the user so that she could read the documentation inline in her > working notebook, but it was reported that this won't work, by > design, for safety reasons. > > You suggested to open a static HTML page instead. > >>> This is possible, indeed. Which means that we should also install >>> the html rendering. Why not, after all. >> >> I was referring in using the IPython display machinery to show a ilk to the user, and this link could open another tab. >> Yo could even use js to trigger the opening of this tab. >> >> If you look at what Julia is doing, their "info methods" for "objects" do return html with direct link to github source code. >> As you know the hash of the current version of the project, you can directly link to a rendered version. Which also avoid to build the doc locally, but I won't go into the debatee of having or not local build of docs. > >> One thing I can see you doing, is if you can export to html fragments, is having >> doc('somehting') just return a IPython.display.HTML object with the content of the doc. >> This would allow to see doc in the notebook. > > Well, I went ahead and now I also install the HTML rendering > of these notebooks. However the (outer) notebook goes nut > when I try to read one of the html I created myself, while > it seems to be happy with the same file, but served by nbviewer. > > In clear, with: > > from IPython.display import HTML > HTML("http://nbviewer.ipython.org/urls/www.lrde.epita.fr/dload/vaucanson/2.0/notebooks/index.ipynb") > > my notebook seems to stay alive, while: > > HTML("http://www.lrde.epita.fr/dload/vcsn/2.0/notebooks/index.html") > > completely breaks it (the JS part seems stuck: no means to run a cell > etc.). Would you have any idea what is going wrong? > > Of course, I have the same problem when I try to rendering the > page installed on the user's machine: > > HTML(filename = "/opt/local/share/vcsn/notebooks/index.html") > > Thanks! From John.Holt at tessella.com Mon Oct 27 07:31:37 2014 From: John.Holt at tessella.com (John.Holt at tessella.com) Date: Mon, 27 Oct 2014 11:31:37 +0000 Subject: [IPython-dev] Multi-user IPython Notebook Message-ID: <OFF258323E.95712B93-ON80257D7E.003EB778-80257D7E.003F51D9@tessella.co.uk> An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141027/e2583ed0/attachment.html> From roalexan at microsoft.com Mon Oct 27 11:42:56 2014 From: roalexan at microsoft.com (Robert Alexander) Date: Mon, 27 Oct 2014 15:42:56 +0000 Subject: [IPython-dev] tools for automated testing of ipython notebook Message-ID: <1414424570661.39967@microsoft.com> Does anyone have some good pointers to tools for automated testing of ipython notebook? I've looked at Selenium, but it won't type into the cells of a notebook - maybe because there don't seem to be ids associated with these web elements? I've also looked at iMacros, but it doesn't seem to support uploading files (I've got python test files I want loaded into the notebooks) - plus, can't type into cells. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141027/e2038151/attachment.html> From nathan12343 at gmail.com Mon Oct 27 12:01:06 2014 From: nathan12343 at gmail.com (Nathan Goldbaum) Date: Mon, 27 Oct 2014 09:01:06 -0700 Subject: [IPython-dev] tools for automated testing of ipython notebook In-Reply-To: <1414424570661.39967@microsoft.com> References: <1414424570661.39967@microsoft.com> Message-ID: <CAJXewOn89Ya+a5GRZvg0QWyaquCarEVwNJO0XdB070DG_3+kgg@mail.gmail.com> Take a look at runipy: https://github.com/paulgb/runipy It lets you script notebook evaluation, nicely sidestepping browser automation. On Monday, October 27, 2014, Robert Alexander <roalexan at microsoft.com> wrote: > Does anyone have some good pointers to tools for automated testing of > ipython notebook? I've looked at Selenium, but it won't type into the cells > of a notebook - maybe because there don't seem to be ids associated with > these web elements? I've also looked at iMacros, but it doesn't seem to > support uploading files (I've got python test files I want loaded into the > notebooks) - plus, can't type into cells. > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141027/57ebca13/attachment.html> From hughesadam87 at gmail.com Mon Oct 27 20:39:21 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Mon, 27 Oct 2014 20:39:21 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> Message-ID: <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> Hey Nicholas, These solutions work really well. Thanks! Do you know offhand if the alerts should be colored (green/blue/red) by default as they are shown in the bootstrap tutorial. When I used the widget you specified, I get the correct text, but it only appears as black text on white background instead of that nice colored bubbled alert. Do you expect that behavior? On Sat, Oct 25, 2014 at 8:49 PM, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > Right: the notebook UI and many of the "stock" widgets use it, so I would > feel pretty safe building on it... nothing on the roadmap makes me think > they'd move away from it. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141027/5e7673b4/attachment.html> From fperez.net at gmail.com Mon Oct 27 20:49:05 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Mon, 27 Oct 2014 17:49:05 -0700 Subject: [IPython-dev] IPython/Jupyter governance model Message-ID: <CAHAreOoLESqjsL9Xrjtvbwxr-a_izz2CoyixRFo3z-7E4mwJqg@mail.gmail.com> Hi all, for the past couple of weeks, the core devs have been working on trying to formalize what up until now have been our informally maintained governance practices. The idea is simply that clarifying and making explicit many of these informal practices will make our community healthier as it grows, and easier for newcomers and external agents to engage with, participate in, and become productive members of. We tried to do the minimal amount of private editing just to make sure that the core devs were comfortable with the language, but the current document should be considered a draft fully open to feedback and discussion from the broader community. It currently lives at: https://github.com/ipython/ipython/wiki/IPEP-29:-Project-Governance We'd like to hear any feedback any of you might have. I'd also like to thank the members of the core team who provided thoughtful, considered and meaningful feedback as we worked on this initial draft together. All the best, Fernando, on behalf of the core dev team. -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141027/3bcebe45/attachment.html> From nick.bollweg at gmail.com Mon Oct 27 20:50:48 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Mon, 27 Oct 2014 20:50:48 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> Message-ID: <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> right, you'd switch it out to another context: from IPython.html import widgets > from IPython.display import display > for context in ["info", "danger", "warning", "success"]: > display(widgets.HTML(value=context, _dom_classes=["alert", "alert-" + > context])) > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141027/d3c6e184/attachment.html> From hughesadam87 at gmail.com Mon Oct 27 20:55:14 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Mon, 27 Oct 2014 20:55:14 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> Message-ID: <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> Yes, but when you do this in your notebook, does it appear in a different colors? Mine looks like plain text. IE I literally see: info danger warning success In my output cell, instead of pretty colors like the example on the bootstrap link. Using about a 2week-old version of 3.0 dev, if that matters. On Mon, Oct 27, 2014 at 8:50 PM, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > right, you'd switch it out to another context: > > from IPython.html import widgets >> from IPython.display import display >> for context in ["info", "danger", "warning", "success"]: >> display(widgets.HTML(value=context, _dom_classes=["alert", "alert-" + >> context])) >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141027/2e74cd41/attachment.html> From nick.bollweg at gmail.com Mon Oct 27 22:45:29 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Mon, 27 Oct 2014 22:45:29 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> Message-ID: <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> For reference, I see this: [image: Inline image 3] ah, the _dom_classes may have been more recent than that. Here's the change, landed sept 23: https://github.com/ipython/ipython/pull/6235 you may have to go back to something like: w = HTML("text") > w.on_displayed(lambda x: w.add_class("alert-warning") > When you want to change it, you'd then have to: w.remove_class("alert-warning") > w.add_class("alert-success") > In the new core widgets, a traitlet manages these directly: https://github.com/ipython/ipython/blob/master/IPython/html/widgets/widget_button.py#L36 And all the class adding/removing is done on the client side. In my bootstrap librar <https://github.com/bollwyvl/ip-bootstrap>y i have been tinkering with, I did the same, though a little differently. On Mon, Oct 27, 2014 at 8:55 PM, Adam Hughes <hughesadam87 at gmail.com> wrote: > Yes, but when you do this in your notebook, does it appear in a different > colors? Mine looks like plain text. IE I literally see: > > info > danger > warning > success > > In my output cell, instead of pretty colors like the example on the > bootstrap link. Using about a 2week-old version of 3.0 dev, if that > matters. > > On Mon, Oct 27, 2014 at 8:50 PM, Nicholas Bollweg <nick.bollweg at gmail.com> > wrote: > >> right, you'd switch it out to another context: >> >> from IPython.html import widgets >>> from IPython.display import display >>> for context in ["info", "danger", "warning", "success"]: >>> display(widgets.HTML(value=context, _dom_classes=["alert", "alert-" >>> + context])) >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141027/4f2145ad/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: 2014-10-27_2239.png Type: image/png Size: 47090 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141027/4f2145ad/attachment.png> From hughesadam87 at gmail.com Tue Oct 28 00:07:17 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Tue, 28 Oct 2014 00:07:17 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> Message-ID: <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> Ah gotcha! Thanks for clearing that up, much appreciated! I guess my dev is way older than I recall. On Mon, Oct 27, 2014 at 10:45 PM, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > For reference, I see this: > > [image: Inline image 3] > > ah, the _dom_classes may have been more recent than that. Here's the > change, landed sept 23: https://github.com/ipython/ipython/pull/6235 > > you may have to go back to something like: > > w = HTML("text") >> w.on_displayed(lambda x: w.add_class("alert-warning") >> > > When you want to change it, you'd then have to: > > w.remove_class("alert-warning") >> w.add_class("alert-success") >> > > In the new core widgets, a traitlet manages these directly: > > https://github.com/ipython/ipython/blob/master/IPython/html/widgets/widget_button.py#L36 > And all the class adding/removing is done on the client side. > > In my bootstrap librar <https://github.com/bollwyvl/ip-bootstrap>y i have > been tinkering with, I did the same, though a little differently. > > On Mon, Oct 27, 2014 at 8:55 PM, Adam Hughes <hughesadam87 at gmail.com> > wrote: > >> Yes, but when you do this in your notebook, does it appear in a different >> colors? Mine looks like plain text. IE I literally see: >> >> info >> danger >> warning >> success >> >> In my output cell, instead of pretty colors like the example on the >> bootstrap link. Using about a 2week-old version of 3.0 dev, if that >> matters. >> >> On Mon, Oct 27, 2014 at 8:50 PM, Nicholas Bollweg <nick.bollweg at gmail.com >> > wrote: >> >>> right, you'd switch it out to another context: >>> >>> from IPython.html import widgets >>>> from IPython.display import display >>>> for context in ["info", "danger", "warning", "success"]: >>>> display(widgets.HTML(value=context, _dom_classes=["alert", "alert-" >>>> + context])) >>>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141028/abb73864/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: 2014-10-27_2239.png Type: image/png Size: 47090 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141028/abb73864/attachment.png> From claresloggett at gmail.com Tue Oct 28 03:08:51 2014 From: claresloggett at gmail.com (Clare Sloggett) Date: Tue, 28 Oct 2014 18:08:51 +1100 Subject: [IPython-dev] Error running JupyterHub In-Reply-To: <CAAusYCgYeHfXOTuPojqd0TZBB41-3VWCtop3WBLJN5t6wm=GUg@mail.gmail.com> References: <CAETqNqGjaD7pjsWjK36u_Hc5=bdTU-PCtvAwv-QVXUfoQDjSaQ@mail.gmail.com> <CAAusYCgYeHfXOTuPojqd0TZBB41-3VWCtop3WBLJN5t6wm=GUg@mail.gmail.com> Message-ID: <CAETqNqGAcCGk5Z-YKAU2BOd5Tw3mioRUEVn1uxZ7ZL4km22KEA@mail.gmail.com> Hi Doug, 1. I'm not installing ipython from source, just with pip, so a bit confused by the instructions re ipython-master. Maybe I'm misunderstanding. I've run `pip install ipython --upgrade`; do I really need to do ipython from source? 2. I've just tried the jupyterhub README instructions from scratch on a new machine (a new cloud instance) from the current jupyterhub master, commit db5cf9cf99f68f133b... - same issues unfortunately. 3. I'm not sure how to check for this but it's probably addressed by having launched a new machine! 4. I'm running as root, no sudo involved. Just $ su root $ jupyterhub And I get all the same errors as previously. I'm mystified as I can see others posting here saying that they are using it, so it must be a problem in my setup, but I really can't see what. Could it possibly be a node.js issue? Thanks again for the help! Clare On 24 October 2014 23:58, Doug Blank <doug.blank at gmail.com> wrote: > On Fri, Oct 24, 2014 at 8:49 AM, Clare Sloggett <claresloggett at gmail.com> > wrote: > >> Hi all, >> >> I'm getting an error running JupyterHub. Right now all I'm doing is >> attempting to run it as root with no command-line options. >> >> A couple of weeks ago I was trying to set it up and while I was running >> into issues, I wasn't getting this particular problem - I was able to at >> least run the command. I'm not sure if something has changed in Jupyter. >> Entirely possible that I made a mistake in my setup this time! >> >> Any advice would be appreciated in interpreting the below errors. >> >> Thanks, >> Clare >> >> Below is the output of `jupyterhub --debug`: >> >> Traceback (most recent call last): >> File "/usr/lib/python2.7/logging/__init__.py", line 846, in emit >> msg = self.format(record) >> File "/usr/lib/python2.7/logging/__init__.py", line 723, in format >> return fmt.format(record) >> File >> "/usr/local/lib/python2.7/dist-packages/IPython/config/application.py", >> line 121, in format >> return super(LevelFormatter, self).format(record) >> File "/usr/lib/python2.7/logging/__init__.py", line 467, in format >> s = self._fmt % record.__dict__ >> KeyError: u'color' >> Logged from file application.py, line 247 >> Traceback (most recent call last): >> File "/usr/lib/python2.7/logging/__init__.py", line 846, in emit >> msg = self.format(record) >> File "/usr/lib/python2.7/logging/__init__.py", line 723, in format >> return fmt.format(record) >> File >> "/usr/local/lib/python2.7/dist-packages/IPython/config/application.py", >> line 121, in format >> return super(LevelFormatter, self).format(record) >> File "/usr/lib/python2.7/logging/__init__.py", line 467, in format >> s = self._fmt % record.__dict__ >> KeyError: u'color' >> Logged from file application.py, line 248 >> [D 23:39:03.030 JupyterHubApp] Connecting to db: >> sqlite:///jupyterhub.sqlite >> [I 23:39:03.062 JupyterHubApp] Not using whitelist. Any authenticated >> user will be allowed. >> [D 23:39:03.064 JupyterHubApp] Loaded users: >> ubuntu admin >> [I 23:39:03.072 JupyterHubApp] Starting proxy: >> [u'configurable-http-proxy', '--ip', u'', '--port', '8000', '--api-ip', >> u'localhost', '--api-port', '8001', '--default-target', ' >> http://localhost:8081'] >> 23:39:03.178 - info: [ConfigProxy] Proxying http://*:8000 to >> http://localhost:8081 >> 23:39:03.180 - info: [ConfigProxy] Proxy API at >> http://localhost:8001/api/routes >> >> events.js:72 >> throw er; // Unhandled 'error' event >> > > I think that I have had that issue when configurable-http-proxy isn't > running, or maybe it is already running and you are trying to start it > again. > > Some things that I do when updating jupyterhub: > > 1. Updating ipython: make sure you run "python setup.py submodule" in > ipython-master to get any new dependencies. Then "git pull" and "sudo pip > install . -U" > > 2. Updating jupyterhub: do the steps in the jupyterhub/README.md again... > some dependencies may have changed. Then "sudo pip install . -U" > > 3. Make sure all jupyterhub-singleuser processes and > configurable-http-proxy processes are killed. This is still hard to do > sometimes. > > 4. Are you running with a sudo environment? There is an additional line in > the sudoers file that is now needed to kill processes. > > I think that is most of what I need to do. > > -Doug > > >> ^ >> Error: listen EADDRINUSE >> at errnoException (net.js:904:11) >> at Server._listen2 (net.js:1042:14) >> at listen (net.js:1064:10) >> at net.js:1146:9 >> at dns.js:72:18 >> at process._tickCallback (node.js:419:13) >> at Function.Module.runMain (module.js:499:11) >> at startup (node.js:119:16) >> at node.js:906:3 >> [C 23:39:04.087 JupyterHubApp] Failed to start proxy >> Traceback (most recent call last): >> File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", >> line 727, in start >> IOLoop().run_sync(self.start_proxy) >> File "/usr/local/lib/python2.7/dist-packages/tornado/ioloop.py", >> line 389, in run_sync >> return future_cell[0].result() >> File >> "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 129, >> in result >> raise_exc_info(self.__exc_info) >> File >> "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line >> 302, in wrapped >> ret = fn(*args, **kwargs) >> File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line >> 574, in inner >> self.set_result(key, result) >> File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line >> 500, in set_result >> self.run() >> File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line >> 529, in run >> yielded = self.gen.throw(*exc_info) >> File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", >> line 556, in start_proxy >> _check() >> File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", >> line 552, in _check >> raise e >> RuntimeError: Proxy failed to start with exit code 8 >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141028/09e41c21/attachment.html> From claresloggett at gmail.com Tue Oct 28 03:15:13 2014 From: claresloggett at gmail.com (Clare Sloggett) Date: Tue, 28 Oct 2014 18:15:13 +1100 Subject: [IPython-dev] Jupyterhub behind NGINX redirect In-Reply-To: <CAHNn8BWgTxLJmyX8wrmw4D3fEzXMVzrxrjOeym12rWuG5gbVMA@mail.gmail.com> References: <CAETqNqG1cVMpxaSOW=s3H9Vty+2+qZtSyg2fnXX0-yixADZY6Q@mail.gmail.com> <CAAusYCg2qVDzOvhfFhKzUenv-7tDpG3BGkcfLYB1sq_nZYdi8g@mail.gmail.com> <CAETqNqG-y9ZfNZMnReHdhCPxaVGi1A6gs4ZCzaz-pSw3m3oRiw@mail.gmail.com> <CAHNn8BWgTxLJmyX8wrmw4D3fEzXMVzrxrjOeym12rWuG5gbVMA@mail.gmail.com> Message-ID: <CAETqNqFGJE0H=OeCuEbYKJx-CbsjHshpepcOYZK=624qSuPF-A@mail.gmail.com> Hi Min, Thanks for your help! Actually at the moment I have been pushed back to a more fundamental problem and can't even reproduce the error I was posting about in this email. I can't get jupyterhub to run at all. I posted this separate error in another thread, which I've just replied to a moment ago: "Error running JupyterHub". I suspect the issue is mine as I encountered it a few days ago and am still encountering it after updating to the latest commit. It seems unlikely a bug has survived through several commits without someone else discovering it too. But I'm having trouble working out what the cause is, and am not sure what to make of the error messages it's throwing (both python *and* javascript errors are thrown when it crashes). Full error printout is in that thread! Cheers, Clare On 26 October 2014 06:34, MinRK <benjaminrk at gmail.com> wrote: > Clare, > > Can you update to the latest master? I think the never-ending redirects > could be the result of a recently fixed typo. > > Thanks, > -MinRK > > On Thu, Oct 23, 2014 at 10:01 PM, Clare Sloggett <claresloggett at gmail.com> > wrote: > >> Hi Doug, >> >> Thanks for this. I had actually just been thinking about about the NGINX >> redirect issue, and had assumed everything behind that would be fairly >> straightforward. But it sounds like you are saying there may be more >> fundamental issues, and to be honest I haven't tested that the redirect is >> definitely the source of all my problems. >> >> It sounds like I need to do some more direct testing and come back! >> >> In the meantime, if anyone has insight into what could be causing a URL >> rewrite like "/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython...." >> that could be really helpful. >> >> Cheers, >> Clare >> >> On 13 October 2014 00:44, Doug Blank <doug.blank at gmail.com> wrote: >> >>> On Sun, Oct 12, 2014 at 1:35 AM, Clare Sloggett <claresloggett at gmail.com> >>> wrote: >>> > >>> > Hi all, >>> > >>> > Am I right in thinking this list is also the right place for questions >>> about Jupyterhub? >>> > >>> > I'm trying to set up Jupyterhub for multiple users, on the same server >>> where we are running several other services. Currently there are NGINX >>> redirects in place to these other services. I'd like to set up http://<public-url>/ipython/ >>> to redirect to a port on localhost and run Jupyterhub over that port. Is >>> this possible? >>> > >>> > I've got this working in the past with single-user IPython Notebook. >>> For that, I set config options c.NotebookApp.base_project_url, >>> c.NotebookApp.base_kernel_url, and c.NotebookApp.webapp_settings to be >>> aware of the ipython/ URL prefix. We used an NGINX redirect to forward >>> requests and handle websockets properly, which looked like >>> > >>> > location /ipython/ { >>> > proxy_pass http://127.0.0.1:9510; >>> > proxy_set_header Host $host; >>> > proxy_set_header X-Real-IP $remote_addr; >>> > proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; >>> > proxy_set_header Upgrade $http_upgrade; >>> > proxy_set_header Connection "upgrade"; >>> > } >>> > >>> > This worked for the old single-user notebook. But, I'm not clear on >>> the model Jupyterhub is using (and I'm not much of a sysadmin). I read >>> through the command-line options, thought from them that I don't need to >>> strip the /ipython/ from the incoming requests, and have tried using a >>> similar redirect to the above and setting >>> --JupyterHubApp.base_url='ipython/' and also setting --port 9510. This does >>> seem to see the incoming requests but results in amusing requests like >>> > >>> > 500 GET >>> /ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/ipython/ipython/hub/...... >>> > >>> > ... so clearly I haven't understood what's going on. Does anyone have >>> any pointers on how this should work? I haven't read any docs other than >>> the README and the command-line parameter information, so apologies if >>> there's something obvious that I didn't look at. >>> > >>> > I'm also interested in running Jupyterhub as a daemon, so if that's >>> something that's been done before and there's anything I should know, that >>> would be great. >>> >>> There is one other document, other than the README.md and the reported >>> issues [1]: >>> >>> >>> https://github.com/jupyter/jupyterhub/wiki/Using-sudo-to-run-the-server-as-non-root >>> >>> Despite the warning at the top of that page, you can make jupyterhub >>> work on some systems (eg, Linux, such as Ubuntu) using sudo, but not as >>> root. I suspect that this would be the recommended setup when jupyterhub is >>> complete. One recent change is the ability to save/load state from a >>> database. The wiki page above hasn't been updated with the note from this >>> issue: >>> >>> https://github.com/jupyter/jupyterhub/issues/57 >>> >>> It might be easier to start without NGINX, and then add it after you >>> have a working jupyterhub system. It would be nice to have a little bash >>> script to make this a "service" that would support "start", "top", and >>> "status"... but I haven't had time. Currently, we're just becoming the >>> non-root sudoer ("rhea" in the docs) and starting the server, something >>> along the lines: >>> >>> jupyterhub --LocalProcessSpawner.set_user=sudo >>> --JupyterHubApp.ip=165.106.10.83 --JupyterHubApp.port=80 >>> --db='sqlite:///:memory:' &>> /var/log/jupyterhub/log & >>> >>> The next step for us is to get it running under https... looks like >>> others have blazed that trail, so it looks possible. >>> >>> If you have success, it would be great to add to the wiki docs... I >>> suspect that many of us that aren't sys admins will be wanting to get this >>> up and running. >>> >>> -Doug >>> >>> [1] - https://github.com/jupyter/jupyterhub >>> >>> > Any help much appreciated! >>> > >>> > Clare >>> > >>> > >>> > _______________________________________________ >>> > IPython-dev mailing list >>> > IPython-dev at scipy.org >>> > http://mail.scipy.org/mailman/listinfo/ipython-dev >>> > >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141028/b9b1ed4a/attachment.html> From doug.blank at gmail.com Tue Oct 28 06:54:51 2014 From: doug.blank at gmail.com (Doug Blank) Date: Tue, 28 Oct 2014 06:54:51 -0400 Subject: [IPython-dev] Error running JupyterHub In-Reply-To: <CAETqNqGAcCGk5Z-YKAU2BOd5Tw3mioRUEVn1uxZ7ZL4km22KEA@mail.gmail.com> References: <CAETqNqGjaD7pjsWjK36u_Hc5=bdTU-PCtvAwv-QVXUfoQDjSaQ@mail.gmail.com> <CAAusYCgYeHfXOTuPojqd0TZBB41-3VWCtop3WBLJN5t6wm=GUg@mail.gmail.com> <CAETqNqGAcCGk5Z-YKAU2BOd5Tw3mioRUEVn1uxZ7ZL4km22KEA@mail.gmail.com> Message-ID: <CAAusYCjkeQ+WnC_5=HO92KBo87XF5sVcn6h2EBOAbMxfRXHNdQ@mail.gmail.com> On Tue, Oct 28, 2014 at 3:08 AM, Clare Sloggett <claresloggett at gmail.com> wrote: > Hi Doug, > > I can confirm that attempting to run the configurable-http-proxy twice gives the error you describe. There are probably other reasons to get that error too (eg, maybe something is already listening on that port, permission error, etc). I would try the items related to node, listed at the bottom here first: > 1. I'm not installing ipython from source, just with pip, so a bit > confused by the instructions re ipython-master. Maybe I'm misunderstanding. > I've run `pip install ipython --upgrade`; do I really need to do ipython > from source? > I'm not 100% sure if it is necessary. Installing from master is easy, if that is a concern: git clone https://github.com/ipython/ipython.git cd ipython python setup.py submodules pip install . -U To update after initial install, just do the last two steps. > 2. I've just tried the jupyterhub README instructions from scratch on a > new machine (a new cloud instance) from the current jupyterhub master, > commit db5cf9cf99f68f133b... - same issues unfortunately. > Hmmm.... the error log shows that the error is launching the http-configurable-proxy... > > 3. I'm not sure how to check for this but it's probably addressed by > having launched a new machine! > There are two programs that are run by "root": configurable-http-proxy and jupyterhub, and then for each user there is a "jupyterhub-singleuser" that is running. You can use something like "ps aux | grep configurable-http-proxy" or "ps aux | grep jupyterhub" to see the associated processes. You can use "kill" to kill those, if necessary. But it sounds like it hasn't made it that far. > > 4. I'm running as root, no sudo involved. Just > $ su root > $ jupyterhub > If this computer is on the internet, then eventually you'll probably want to move to the more involved "sudo" method for better security. But this should be fine for testing and getting it working. > And I get all the same errors as previously. > > I'm mystified as I can see others posting here saying that they are using > it, so it must be a problem in my setup, but I really can't see what. Could > it possibly be a node.js issue? > You should be able to run this line, from your log: configurable-http-proxy --ip '' --port 8000 --api-ip localhost --api-port 8001 --default-target http://localhost:8081 Does that work without errors? Control+c to exit, if it does work. I can confirm that if you try to run this with one already running, you get exactly the error you describe. On the page: https://github.com/jupyter/jupyterhub/wiki/Using-sudo-to-run-the-server-as-non-root there is also a note needed for serving on restricted ports: sudo setcap 'cap_net_bind_service=+ep' /usr/bin/node but read that doc for warnings. You may need that too, even when running as root. Your issue does appear to be a problem starting the http server via node. Hope that helps! -Doug > Thanks again for the help! > > Clare > > > On 24 October 2014 23:58, Doug Blank <doug.blank at gmail.com> wrote: > >> On Fri, Oct 24, 2014 at 8:49 AM, Clare Sloggett <claresloggett at gmail.com> >> wrote: >> >>> Hi all, >>> >>> I'm getting an error running JupyterHub. Right now all I'm doing is >>> attempting to run it as root with no command-line options. >>> >>> A couple of weeks ago I was trying to set it up and while I was running >>> into issues, I wasn't getting this particular problem - I was able to at >>> least run the command. I'm not sure if something has changed in Jupyter. >>> Entirely possible that I made a mistake in my setup this time! >>> >>> Any advice would be appreciated in interpreting the below errors. >>> >>> Thanks, >>> Clare >>> >>> Below is the output of `jupyterhub --debug`: >>> >>> Traceback (most recent call last): >>> File "/usr/lib/python2.7/logging/__init__.py", line 846, in emit >>> msg = self.format(record) >>> File "/usr/lib/python2.7/logging/__init__.py", line 723, in format >>> return fmt.format(record) >>> File >>> "/usr/local/lib/python2.7/dist-packages/IPython/config/application.py", >>> line 121, in format >>> return super(LevelFormatter, self).format(record) >>> File "/usr/lib/python2.7/logging/__init__.py", line 467, in format >>> s = self._fmt % record.__dict__ >>> KeyError: u'color' >>> Logged from file application.py, line 247 >>> Traceback (most recent call last): >>> File "/usr/lib/python2.7/logging/__init__.py", line 846, in emit >>> msg = self.format(record) >>> File "/usr/lib/python2.7/logging/__init__.py", line 723, in format >>> return fmt.format(record) >>> File >>> "/usr/local/lib/python2.7/dist-packages/IPython/config/application.py", >>> line 121, in format >>> return super(LevelFormatter, self).format(record) >>> File "/usr/lib/python2.7/logging/__init__.py", line 467, in format >>> s = self._fmt % record.__dict__ >>> KeyError: u'color' >>> Logged from file application.py, line 248 >>> [D 23:39:03.030 JupyterHubApp] Connecting to db: >>> sqlite:///jupyterhub.sqlite >>> [I 23:39:03.062 JupyterHubApp] Not using whitelist. Any authenticated >>> user will be allowed. >>> [D 23:39:03.064 JupyterHubApp] Loaded users: >>> ubuntu admin >>> [I 23:39:03.072 JupyterHubApp] Starting proxy: >>> [u'configurable-http-proxy', '--ip', u'', '--port', '8000', '--api-ip', >>> u'localhost', '--api-port', '8001', '--default-target', ' >>> http://localhost:8081'] >>> 23:39:03.178 - info: [ConfigProxy] Proxying http://*:8000 to >>> http://localhost:8081 >>> 23:39:03.180 - info: [ConfigProxy] Proxy API at >>> http://localhost:8001/api/routes >>> >>> events.js:72 >>> throw er; // Unhandled 'error' event >>> >> >> I think that I have had that issue when configurable-http-proxy isn't >> running, or maybe it is already running and you are trying to start it >> again. >> >> Some things that I do when updating jupyterhub: >> >> 1. Updating ipython: make sure you run "python setup.py submodule" in >> ipython-master to get any new dependencies. Then "git pull" and "sudo pip >> install . -U" >> >> 2. Updating jupyterhub: do the steps in the jupyterhub/README.md again... >> some dependencies may have changed. Then "sudo pip install . -U" >> >> 3. Make sure all jupyterhub-singleuser processes and >> configurable-http-proxy processes are killed. This is still hard to do >> sometimes. >> >> 4. Are you running with a sudo environment? There is an additional line >> in the sudoers file that is now needed to kill processes. >> >> I think that is most of what I need to do. >> >> -Doug >> >> >>> ^ >>> Error: listen EADDRINUSE >>> at errnoException (net.js:904:11) >>> at Server._listen2 (net.js:1042:14) >>> at listen (net.js:1064:10) >>> at net.js:1146:9 >>> at dns.js:72:18 >>> at process._tickCallback (node.js:419:13) >>> at Function.Module.runMain (module.js:499:11) >>> at startup (node.js:119:16) >>> at node.js:906:3 >>> [C 23:39:04.087 JupyterHubApp] Failed to start proxy >>> Traceback (most recent call last): >>> File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", >>> line 727, in start >>> IOLoop().run_sync(self.start_proxy) >>> File "/usr/local/lib/python2.7/dist-packages/tornado/ioloop.py", >>> line 389, in run_sync >>> return future_cell[0].result() >>> File >>> "/usr/local/lib/python2.7/dist-packages/tornado/concurrent.py", line 129, >>> in result >>> raise_exc_info(self.__exc_info) >>> File >>> "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line >>> 302, in wrapped >>> ret = fn(*args, **kwargs) >>> File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line >>> 574, in inner >>> self.set_result(key, result) >>> File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line >>> 500, in set_result >>> self.run() >>> File "/usr/local/lib/python2.7/dist-packages/tornado/gen.py", line >>> 529, in run >>> yielded = self.gen.throw(*exc_info) >>> File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", >>> line 556, in start_proxy >>> _check() >>> File "/usr/local/lib/python2.7/dist-packages/jupyterhub/app.py", >>> line 552, in _check >>> raise e >>> RuntimeError: Proxy failed to start with exit code 8 >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141028/6e2945f6/attachment.html> From roalexan at microsoft.com Tue Oct 28 12:10:11 2014 From: roalexan at microsoft.com (roalexan) Date: Tue, 28 Oct 2014 09:10:11 -0700 (PDT) Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions In-Reply-To: <1414224852357-5075739.post@n6.nabble.com> References: <1414002105549.34538@microsoft.com> <CA+tbMaV8aQ6nqP2OLNjdgTLxJ3mshA+Qhv2qnXOOHPLt-zRoUg@mail.gmail.com> <1414221586573-5075736.post@n6.nabble.com> <1414224852357-5075739.post@n6.nabble.com> Message-ID: <1414512611948-5075948.post@n6.nabble.com> The problem with not being able to run 'sudo docker pull jupyter/demo' appears to have been fixed in Docker 1.0.1. Here's where I am now. I run these exact steps: # Create virtual machine Virtual Machines>New>Compute>Virtual Machine>From Gallery>Ubuntu>Ubuntu Server 14.04 LTS Password:PASSWORD,Name:HOST,Tier:Standard,Size:A4, Add endpoint;name:ipython_nb,protocol:TCP,public port:8000,private port:9999 # Get Docker sudo apt-get -y update sudo apt-get -y install docker.io sudo ln -sf /usr/bin/docker.io /usr/local/bin/docker # Get/Start containers sudo docker pull jupyter/demo # takes 45 minutes export TOKEN=$( head -c 30 /dev/urandom | xxd -p ) sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN jupyter/configurable-http-proxy --default-target http://127.0.0.1:9999 sudo docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN -v /var/run/docker.sock:/docker.sock jupyter/tmpnb python orchestrate.py --cull-timeout=60 --docker-version="1.12" --mem-limit=512m --pool-size=10 When I test from a browser, I see: tmpnb The server you requested is no longer running or it doesn't exist. Starting a new notebook server, just for you... and then: Oh snap! It looks like we're full up. Every single container is in use right now! Try again later and maybe you'll have better luck. Sorry for the inconvenience! If you hang around here for a while, you'll automatically retry in 600 seconds. Looking at the running Docker containers, I see: sudo docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES d7966e5e8811 jupyter/demo:latest "/bin/sh -c 'ipython 42 seconds ago Up 40 seconds 127.0.0.1:49153->8888/tcp compassionate_perlman f50f981a39af jupyter/demo:latest "/bin/sh -c 'ipython 11 minutes ago Up 11 minutes 127.0.0.1:49154->8888/tcp stupefied_mclean 4e2630ccb2c1 jupyter/demo:latest "/bin/sh -c 'ipython 12 minutes ago Up 11 minutes 127.0.0.1:49155->8888/tcp stoic_carson bad13e2189e7 jupyter/demo:latest "/bin/sh -c 'ipython 12 minutes ago Up 12 minutes 127.0.0.1:49156->8888/tcp prickly_elion 09fa0a489f43 jupyter/demo:latest "/bin/sh -c 'ipython 12 minutes ago Up 12 minutes 127.0.0.1:49157->8888/tcp condescending_nobel 3a7cc32240e2 jupyter/demo:latest "/bin/sh -c 'ipython 13 minutes ago Up 13 minutes 127.0.0.1:49158->8888/tcp hopeful_tesla 4e3f244a023f jupyter/demo:latest "/bin/sh -c 'ipython 13 minutes ago Up 13 minutes 127.0.0.1:49159->8888/tcp angry_bardeen 0a127865e2bc jupyter/demo:latest "/bin/sh -c 'ipython 14 minutes ago Up 14 minutes 127.0.0.1:49160->8888/tcp tender_turing 8f806d6a3c37 jupyter/demo:latest "/bin/sh -c 'ipython 14 minutes ago Up 14 minutes 127.0.0.1:49162->8888/tcp berserk_meitner d4e518665164 jupyter/demo:latest "/bin/sh -c 'ipython 47 minutes ago Up 47 minutes 127.0.0.1:49161->8888/tcp sharp_mcclintock 322cdaa75933 jupyter/tmpnb:latest python orchestrate.p 47 minutes ago Up 47 minutes berserk_fermat 6d9376d46e54 jupyter/configurable-http-proxy:latest configurable-http-pr 54 minutes ago Up 54 minutes pensive_tesla I'm guessing that the browser error is reflecting the fact that there are already ten containers running, and there is no room for another one? So, I stopped and removed a couple of them using: sudo docker stop f50f981a39af sudo docker stop 4e2630ccb2c1 sudo docker rm f50f981a39af sudo docker rm 4e2630ccb2c1 and verified that there are now either containers running. However, I still get the same browser error. Any thoughts on how to get this working? -- View this message in context: http://python.6.x6.nabble.com/Unable-to-start-Jupityr-on-Docker-using-Quick-start-instructions-tp5075454p5075948.html Sent from the IPython - Development mailing list archive at Nabble.com. From fperez.net at gmail.com Tue Oct 28 14:10:25 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Tue, 28 Oct 2014 11:10:25 -0700 Subject: [IPython-dev] [ANN] Python for Scientific Computing conference in Boulder, CO; April 2015 Message-ID: <CAHAreOoCTLKZO8eOiOk7=KzLSKb0iFG3QZcT_Ls9BL_eHnO58g@mail.gmail.com> Hi folks, a colleague from NCAR in Boulder just sent me this link about a conference they are organizing in the spring: https://sea.ucar.edu/conference/2015 I figured this might be of interest to many on these lists. The actual call isn't up yet, so if you're interested, watch that site for an upcoming call when they post it (I'm not directly involved, just passing the message along). Cheers -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141028/2eb9d909/attachment.html> From roalexan at microsoft.com Tue Oct 28 15:30:24 2014 From: roalexan at microsoft.com (roalexan) Date: Tue, 28 Oct 2014 12:30:24 -0700 (PDT) Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions In-Reply-To: <1414002105549.34538@microsoft.com> References: <1414002105549.34538@microsoft.com> Message-ID: <1414524624235-5075963.post@n6.nabble.com> So, having looked at the code (in particular orchestrate.py) it is clear that tmpnb has a background process that will "pre-launch a set number of containers". I think that the number of containers is controlled by the /pool-size/ parameter (and the upper memory limit per container is set by the /mem-limit/ parameter). Having said that, I would expect going to http://MYHOST.cloudapp.net:8000 would open up a notebook using one of the pre-allocated containers. What it actually does is redirect me to: http://MYHOST.cloudapp.net:8000/spawn/, which fails with an error (...It looks like we're full up. Every single container is in use right now!). I can manually get it to work by looking in the log file of jupyter/tmpnb:latest to find a valid user name of one of the containers to construct a URL like, http://MYHOST.cloudapp.net:8000/user-dH5GL6B4B0pN/tree, but what I really need is the correct URL entry point that I should be using. Can somebody please help me with this? -- View this message in context: http://python.6.x6.nabble.com/Unable-to-start-Jupityr-on-Docker-using-Quick-start-instructions-tp5075454p5075963.html Sent from the IPython - Development mailing list archive at Nabble.com. From roalexan at microsoft.com Tue Oct 28 15:31:44 2014 From: roalexan at microsoft.com (roalexan) Date: Tue, 28 Oct 2014 12:31:44 -0700 (PDT) Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions In-Reply-To: <1414512611948-5075948.post@n6.nabble.com> References: <1414002105549.34538@microsoft.com> <CA+tbMaV8aQ6nqP2OLNjdgTLxJ3mshA+Qhv2qnXOOHPLt-zRoUg@mail.gmail.com> <1414221586573-5075736.post@n6.nabble.com> <1414224852357-5075739.post@n6.nabble.com> <1414512611948-5075948.post@n6.nabble.com> Message-ID: <1414524704590-5075964.post@n6.nabble.com> Oct 28, 2014; 3:30pm roalexanonline roalexan So, having looked at the code (in particular orchestrate.py) it is clear that tmpnb has a background process that will "pre-launch a set number of containers". I think that the number of containers is controlled by the pool-size parameter (and the upper memory limit per container is set by the mem-limit parameter). Having said that, I would expect going to http://MYHOST.cloudapp.net:8000 would open up a notebook using one of the pre-allocated containers. What it actually does is redirect me to: http://MYHOST.cloudapp.net:8000/spawn/, which fails with an error (...It looks like we're full up. Every single container is in use right now!). I can manually get it to work by looking in the log file of jupyter/tmpnb:latest to find a valid user name of one of the containers to construct a URL like, http://MYHOST.cloudapp.net:8000/user-dH5GL6B4B0pN/tree, but what I really need is the correct URL entry point that I should be using. Can somebody please help me with this? -- View this message in context: http://python.6.x6.nabble.com/Unable-to-start-Jupityr-on-Docker-using-Quick-start-instructions-tp5075454p5075964.html Sent from the IPython - Development mailing list archive at Nabble.com. From rgbkrk at gmail.com Tue Oct 28 18:04:13 2014 From: rgbkrk at gmail.com (Kyle Kelley) Date: Tue, 28 Oct 2014 22:04:13 +0000 Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions In-Reply-To: <1414524624235-5075963.post@n6.nabble.com> References: <1414002105549.34538@microsoft.com> <1414524624235-5075963.post@n6.nabble.com> Message-ID: <CA+tbMaX8_BEYO3HSF5n4aK4xbYHCYYQX=rdVU6ugrwQKFOh2Yg@mail.gmail.com> Yup, the maximum number of containers is controlled by the pool size parameter (and the upper memory limit is the mem-limit param). That is pretty strange behavior that I can replicate for the right set of parameters. My hunch is that it's related to the initial heartbeat of the culling/spawnpool service, as lightly raised in https://github.com/jupyter/tmpnb/issues/80 On Tue, Oct 28, 2014 at 7:30 PM, roalexan <roalexan at microsoft.com> wrote: > So, having looked at the code (in particular orchestrate.py) it is clear > that > tmpnb has a background process that will "pre-launch a set number of > containers". I think that the number of containers is controlled by the > /pool-size/ parameter (and the upper memory limit per container is set by > the /mem-limit/ parameter). > > Having said that, I would expect going to http://MYHOST.cloudapp.net:8000 > would open up a notebook using one of the pre-allocated containers. What it > actually does is redirect me to: http://MYHOST.cloudapp.net:8000/spawn/, > which fails with an error (...It looks like we're full up. Every single > container is in use right now!). > > I can manually get it to work by looking in the log file of > jupyter/tmpnb:latest to find a valid user name of one of the containers to > construct a URL like, > http://MYHOST.cloudapp.net:8000/user-dH5GL6B4B0pN/tree, but what I really > need is the correct URL entry point that I should be using. Can somebody > please help me with this? > > > > -- > View this message in context: > http://python.6.x6.nabble.com/Unable-to-start-Jupityr-on-Docker-using-Quick-start-instructions-tp5075454p5075963.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Kyle Kelley (@rgbkrk <https://twitter.com/rgbkrk>; http://lambdaops.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141028/b7fa4333/attachment.html> From konrad.hinsen at fastmail.net Wed Oct 29 07:39:46 2014 From: konrad.hinsen at fastmail.net (Konrad Hinsen) Date: Wed, 29 Oct 2014 12:39:46 +0100 Subject: [IPython-dev] How to cite the IPython notebook? Message-ID: <21584.53762.639725.751557@Ordinateur-de-Catherine-Konrad.local> Hi everyone, I am looking for a citable reference for the IPython notebook. All I could find on ipython.org is a 2007 paper describing IPython, but that was before the notebook. The context of my citation is tools for reproducible research, so ideally I'd like to cite a paper that actually describes the notebook and the design decisions behind it. Konrad. From bussonniermatthias at gmail.com Wed Oct 29 07:46:41 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Wed, 29 Oct 2014 12:46:41 +0100 Subject: [IPython-dev] How to cite the IPython notebook? In-Reply-To: <21584.53762.639725.751557@Ordinateur-de-Catherine-Konrad.local> References: <21584.53762.639725.751557@Ordinateur-de-Catherine-Konrad.local> Message-ID: <E3BA64A5-28EF-4A8C-AED7-11ABB2C50A2D@gmail.com> Hi, Le 29 oct. 2014 ? 12:39, Konrad Hinsen <konrad.hinsen at fastmail.net> a ?crit : > Hi everyone, > > I am looking for a citable reference for the IPython notebook. All I > could find on ipython.org is a 2007 paper describing IPython, but that > was before the notebook. The context of my citation is tools for > reproducible research, so ideally I'd like to cite a paper that > actually describes the notebook and the design decisions behind it. There are no citation post notebook from US, we are working on it. Can it wait a bit ? -- M > > Konrad. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From jason-sage at creativetrax.com Wed Oct 29 08:08:14 2014 From: jason-sage at creativetrax.com (Jason Grout) Date: Wed, 29 Oct 2014 08:08:14 -0400 Subject: [IPython-dev] How to cite the IPython notebook? In-Reply-To: <E3BA64A5-28EF-4A8C-AED7-11ABB2C50A2D@gmail.com> References: <21584.53762.639725.751557@Ordinateur-de-Catherine-Konrad.local> <E3BA64A5-28EF-4A8C-AED7-11ABB2C50A2D@gmail.com> Message-ID: <5450D8AE.6020403@creativetrax.com> On 10/29/14, 7:46, Matthias Bussonnier wrote: > Hi, > > Le 29 oct. 2014 ? 12:39, Konrad Hinsen <konrad.hinsen at fastmail.net> a ?crit : > >> Hi everyone, >> >> I am looking for a citable reference for the IPython notebook. All I >> could find on ipython.org is a 2007 paper describing IPython, but that >> was before the notebook. The context of my citation is tools for >> reproducible research, so ideally I'd like to cite a paper that >> actually describes the notebook and the design decisions behind it. > > There are no citation post notebook from US, we are working on it. > Can it wait a bit ? Doesn't github allow generating DOIs from software releases? Perhaps that would be a good way to cite IPython and a version number: https://guides.github.com/activities/citable-code/ Thanks, Jason From roalexan at microsoft.com Wed Oct 29 08:51:49 2014 From: roalexan at microsoft.com (roalexan) Date: Wed, 29 Oct 2014 05:51:49 -0700 (PDT) Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions In-Reply-To: <CA+tbMaX8_BEYO3HSF5n4aK4xbYHCYYQX=rdVU6ugrwQKFOh2Yg@mail.gmail.com> References: <1414002105549.34538@microsoft.com> <CA+tbMaX8_BEYO3HSF5n4aK4xbYHCYYQX=rdVU6ugrwQKFOh2Yg@mail.gmail.com> Message-ID: <1414587109748-5076012.post@n6.nabble.com> I looked over this github posting, and it looks like it's describing a scenario where tmpnb goes down. In my case, it appears that it is up, but the proxy service is not redirecting the browser to use one of the available containers. When I go to http://MYHOST.cloudapp.net:8000 I get the browser error and see this in the log file (for tmpnb): [I 141029 12:40:03 web:1811] 304 GET / (127.0.0.1) 6.97ms [W 141029 12:40:03 orchestrate:70] The container pool is empty! [I 141029 12:40:03 web:1811] 304 GET /spawn/ (127.0.0.1) 2.30ms even though doing sudo docker ps shows 10 containers ready to go. BTW, just to confuse the issue, sometimes it does work. I get a new notebook, and I see the below in the log file. Even in this working case, however, it seems odd that it had to spawn a new container. [I 141029 12:40:03 web:1811] 304 GET / (127.0.0.1) 6.97ms [W 141029 12:40:03 orchestrate:70] The container pool is empty! [I 141029 12:40:03 web:1811] 304 GET /spawn/ (127.0.0.1) 2.30ms [I 141029 12:42:15 spawnpool:94] Releasing container [PooledContainer(id=u'81a97cb3558ca2f9a6e8980ff7208a73d3331b9de422cec840ced77c451e168f', path=u'/user-WteHc10JAoUj')]. [W 141029 12:42:39 dockworker:99] [u'Your kernel does not support swap limit capabilities. Limitation discarded.'] [I 141029 12:42:39 dockworker:102] Created container 12bfbbedd1745a572a84ff75ae7bab5e1cc92e660d2aef0f5fbe8e0012b24119 [I 141029 12:42:39 spawnpool:234] Waiting for a container to launch at [127.0.0.1:49153]. [I 141029 12:42:39 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:41 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:41 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:41 spawnpool:272] Server [user-kCEzbZem6Lbv] at address [127.0.0.1:49153] has booted! Have at it. [I 141029 12:42:41 spawnpool:219] Proxied path [user-kCEzbZem6Lbv] to port [49153]. [I 141029 12:42:41 spawnpool:225] Adding container [PooledContainer(id=u'12bfbbedd1745a572a84ff75ae7bab5e1cc92e660d2aef0f5fbe8e0012b24119', path='user-kCEzbZem6Lbv')] to the pool. [I 141029 12:42:41 spawnpool:175] Replaced [1] stale containers. [I 141029 12:45:19 web:1811] 304 GET / (127.0.0.1) 3.48ms [I 141029 12:45:19 orchestrate:53] Allocated [user-kCEzbZem6Lbv] from the pool. [I 141029 12:45:19 web:1811] 302 GET /spawn/ (127.0.0.1) 0.82ms Let me know if this email thread is the best way to continue, or if entering issues in github is the best way to move forward. -- View this message in context: http://python.6.x6.nabble.com/Unable-to-start-Jupityr-on-Docker-using-Quick-start-instructions-tp5075454p5076012.html Sent from the IPython - Development mailing list archive at Nabble.com. From roalexan at microsoft.com Wed Oct 29 08:52:41 2014 From: roalexan at microsoft.com (roalexan) Date: Wed, 29 Oct 2014 05:52:41 -0700 (PDT) Subject: [IPython-dev] Unable to start Jupityr on Docker using "Quick start" instructions In-Reply-To: <CA+tbMaX8_BEYO3HSF5n4aK4xbYHCYYQX=rdVU6ugrwQKFOh2Yg@mail.gmail.com> References: <1414002105549.34538@microsoft.com> <CA+tbMaX8_BEYO3HSF5n4aK4xbYHCYYQX=rdVU6ugrwQKFOh2Yg@mail.gmail.com> Message-ID: <1414587161017-5076015.post@n6.nabble.com> I looked over this github posting, and it looks like it's describing a scenario where tmpnb goes down. In my case, it appears that it is up, but the proxy service is not redirecting the browser to use one of the available containers. When I go to http://MYHOST.cloudapp.net:8000 I get the browser error and see this in the log file (for tmpnb): [I 141029 12:40:03 web:1811] 304 GET / (127.0.0.1) 6.97ms [W 141029 12:40:03 orchestrate:70] The container pool is empty! [I 141029 12:40:03 web:1811] 304 GET /spawn/ (127.0.0.1) 2.30ms even though doing sudo docker ps shows 10 containers ready to go. BTW, just to confuse the issue, sometimes it does work. I get a new notebook, and I see the below in the log file. Even in this working case, however, it seems odd that it had to spawn a new container. [I 141029 12:40:03 web:1811] 304 GET / (127.0.0.1) 6.97ms [W 141029 12:40:03 orchestrate:70] The container pool is empty! [I 141029 12:40:03 web:1811] 304 GET /spawn/ (127.0.0.1) 2.30ms [I 141029 12:42:15 spawnpool:94] Releasing container [PooledContainer(id=u'81a97cb3558ca2f9a6e8980ff7208a73d3331b9de422cec840ced77c451e168f', path=u'/user-WteHc10JAoUj')]. [W 141029 12:42:39 dockworker:99] [u'Your kernel does not support swap limit capabilities. Limitation discarded.'] [I 141029 12:42:39 dockworker:102] Created container 12bfbbedd1745a572a84ff75ae7bab5e1cc92e660d2aef0f5fbe8e0012b24119 [I 141029 12:42:39 spawnpool:234] Waiting for a container to launch at [127.0.0.1:49153]. [I 141029 12:42:39 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:40 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:41 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:41 spawnpool:266] Booting server at [user-kCEzbZem6Lbv], getting HTTP status [599] [I 141029 12:42:41 spawnpool:272] Server [user-kCEzbZem6Lbv] at address [127.0.0.1:49153] has booted! Have at it. [I 141029 12:42:41 spawnpool:219] Proxied path [user-kCEzbZem6Lbv] to port [49153]. [I 141029 12:42:41 spawnpool:225] Adding container [PooledContainer(id=u'12bfbbedd1745a572a84ff75ae7bab5e1cc92e660d2aef0f5fbe8e0012b24119', path='user-kCEzbZem6Lbv')] to the pool. [I 141029 12:42:41 spawnpool:175] Replaced [1] stale containers. [I 141029 12:45:19 web:1811] 304 GET / (127.0.0.1) 3.48ms [I 141029 12:45:19 orchestrate:53] Allocated [user-kCEzbZem6Lbv] from the pool. [I 141029 12:45:19 web:1811] 302 GET /spawn/ (127.0.0.1) 0.82ms Let me know if this email thread is the best way to continue, or if entering issues in github is the best way to move forward. -- View this message in context: http://python.6.x6.nabble.com/Unable-to-start-Jupityr-on-Docker-using-Quick-start-instructions-tp5075454p5076015.html Sent from the IPython - Development mailing list archive at Nabble.com. From odewahn at oreilly.com Wed Oct 29 16:04:22 2014 From: odewahn at oreilly.com (Andrew Odewahn) Date: Wed, 29 Oct 2014 16:04:22 -0400 Subject: [IPython-dev] scipystack kernel restart Message-ID: <CAO5K8EuKf76N4+tKHdzfk43EuAJyZ2his3dHcxDkKsfaAyPTaw@mail.gmail.com> Hi. I'm using the Docker image "ipython/scipystack" like this: $ docker run -p 8888:8888 ipython/scipystack ipython notebook --ip=0.0.0.0 --no-browser The service starts fine with no errors, and I can browse to one of the examples, but as soon as try to edit or run anything, the kernel repeatedly fails: [I 16:52:21.718 NotebookApp] Using existing profile dir: '/root/.ipython/profile_default' [I 16:52:21.735 NotebookApp] Writing notebook server cookie secret to /root/.ipython/profile_default/security/notebook_cookie_secret [I 16:52:21.736 NotebookApp] Using MathJax from CDN: https://cdn.mathjax.org/mathjax/latest/MathJax.js [I 16:52:21.767 NotebookApp] Serving notebooks from local directory: /srv/ipython [I 16:52:21.768 NotebookApp] 0 active kernels [I 16:52:21.768 NotebookApp] The IPython Notebook is running at: http://0.0.0.0:8888/ [I 16:52:21.768 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation). [I 16:52:48.211 NotebookApp] Writing notebook-signing key to /root/.ipython/profile_default/security/notebook_secret [W 16:52:48.218 NotebookApp] Notebook examples/Interactive Widgets/Custom Widget - Hello World.ipynb is not trusted [I 16:52:48.465 tornado.access] 302 GET /notebooks/examples/Interactive%20Widgets/images/WidgetArch.png (192.168.59.3) 1.00ms [I 16:52:51.282 NotebookApp] Kernel started: e8b80f70-de72-490d-8a10-c478e64f9a6d [I 16:52:54.282 NotebookApp] KernelRestarter: restarting kernel (1/5) WARNING:root:kernel e8b80f70-de72-490d-8a10-c478e64f9a6d restarted [I 16:52:57.292 NotebookApp] KernelRestarter: restarting kernel (2/5) WARNING:root:kernel e8b80f70-de72-490d-8a10-c478e64f9a6d restarted [I 16:53:00.303 NotebookApp] KernelRestarter: restarting kernel (3/5) WARNING:root:kernel e8b80f70-de72-490d-8a10-c478e64f9a6d restarted [I 16:53:03.313 NotebookApp] KernelRestarter: restarting kernel (4/5) [W 16:53:06.321 NotebookApp] KernelRestarter: restart failed [W 16:53:06.322 NotebookApp] Kernel e8b80f70-de72-490d-8a10-c478e64f9a6d died, removing from map. Any thoughts on why just plain old "run" would be causing this? Any help appreciated! Andrew -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/688d6c06/attachment.html> From hughesadam87 at gmail.com Wed Oct 29 18:53:52 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Wed, 29 Oct 2014 18:53:52 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> Message-ID: <CAMHV+dDJY1+9hxKSQuJ9TGTZnVFb=pomLWNNrdpoGTYfQkgJ2w@mail.gmail.com> Hi Nicholas, After I updated to the recent dev, part of our code broke. It's from the part that you showed to us, so I figured you might be aware of what has been changed: AttributeError Traceback (most recent call last)<ipython-input-8-70485b3b7990> in displayed(self, _) 113 # ----- 114 def displayed(self, _):--> 115 self.add_class("col-xs-9") 116 # THIS IS WHERE DRAW IS CALLED AFTER DISPLAYS CHANGE 117 self.draw() AttributeError: 'Spectrogram' object has no attribute 'add_class' On Tue, Oct 28, 2014 at 12:07 AM, Adam Hughes <hughesadam87 at gmail.com> wrote: > Ah gotcha! Thanks for clearing that up, much appreciated! I guess my dev > is way older than I recall. > > On Mon, Oct 27, 2014 at 10:45 PM, Nicholas Bollweg <nick.bollweg at gmail.com > > wrote: > >> For reference, I see this: >> >> [image: Inline image 3] >> >> ah, the _dom_classes may have been more recent than that. Here's the >> change, landed sept 23: https://github.com/ipython/ipython/pull/6235 >> >> you may have to go back to something like: >> >> w = HTML("text") >>> w.on_displayed(lambda x: w.add_class("alert-warning") >>> >> >> When you want to change it, you'd then have to: >> >> w.remove_class("alert-warning") >>> w.add_class("alert-success") >>> >> >> In the new core widgets, a traitlet manages these directly: >> >> https://github.com/ipython/ipython/blob/master/IPython/html/widgets/widget_button.py#L36 >> And all the class adding/removing is done on the client side. >> >> In my bootstrap librar <https://github.com/bollwyvl/ip-bootstrap>y i >> have been tinkering with, I did the same, though a little differently. >> >> On Mon, Oct 27, 2014 at 8:55 PM, Adam Hughes <hughesadam87 at gmail.com> >> wrote: >> >>> Yes, but when you do this in your notebook, does it appear in a >>> different colors? Mine looks like plain text. IE I literally see: >>> >>> info >>> danger >>> warning >>> success >>> >>> In my output cell, instead of pretty colors like the example on the >>> bootstrap link. Using about a 2week-old version of 3.0 dev, if that >>> matters. >>> >>> On Mon, Oct 27, 2014 at 8:50 PM, Nicholas Bollweg < >>> nick.bollweg at gmail.com> wrote: >>> >>>> right, you'd switch it out to another context: >>>> >>>> from IPython.html import widgets >>>>> from IPython.display import display >>>>> for context in ["info", "danger", "warning", "success"]: >>>>> display(widgets.HTML(value=context, _dom_classes=["alert", >>>>> "alert-" + context])) >>>>> >>>> >>>> _______________________________________________ >>>> IPython-dev mailing list >>>> IPython-dev at scipy.org >>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>> >>>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/72f57a09/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: 2014-10-27_2239.png Type: image/png Size: 47090 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/72f57a09/attachment.png> From nick.bollweg at gmail.com Wed Oct 29 19:05:34 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Wed, 29 Oct 2014 19:05:34 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dDJY1+9hxKSQuJ9TGTZnVFb=pomLWNNrdpoGTYfQkgJ2w@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> <CAMHV+dDJY1+9hxKSQuJ9TGTZnVFb=pomLWNNrdpoGTYfQkgJ2w@mail.gmail.com> Message-ID: <CACejjWzXtVX6pLmBOhtSu_sb5N8nQjzViE+k-Dnoc0-TEC3E+Q@mail.gmail.com> Yes, add_class was replaced with _dom_classes. It should actually simplify a lot of your code! On Wed, Oct 29, 2014 at 6:53 PM, Adam Hughes <hughesadam87 at gmail.com> wrote: > Hi Nicholas, > > After I updated to the recent dev, part of our code broke. It's from the > part that you showed to us, so I figured you might be aware of what has > been changed: > > AttributeError Traceback (most recent call last)<ipython-input-8-70485b3b7990> in displayed(self, _) 113 # ----- 114 def displayed(self, _):--> 115 self.add_class("col-xs-9") 116 # THIS IS WHERE DRAW IS CALLED AFTER DISPLAYS CHANGE 117 self.draw() > AttributeError: 'Spectrogram' object has no attribute 'add_class' > > > > On Tue, Oct 28, 2014 at 12:07 AM, Adam Hughes <hughesadam87 at gmail.com> > wrote: > >> Ah gotcha! Thanks for clearing that up, much appreciated! I guess my >> dev is way older than I recall. >> >> On Mon, Oct 27, 2014 at 10:45 PM, Nicholas Bollweg < >> nick.bollweg at gmail.com> wrote: >> >>> For reference, I see this: >>> >>> [image: Inline image 3] >>> >>> ah, the _dom_classes may have been more recent than that. Here's the >>> change, landed sept 23: https://github.com/ipython/ipython/pull/6235 >>> >>> you may have to go back to something like: >>> >>> w = HTML("text") >>>> w.on_displayed(lambda x: w.add_class("alert-warning") >>>> >>> >>> When you want to change it, you'd then have to: >>> >>> w.remove_class("alert-warning") >>>> w.add_class("alert-success") >>>> >>> >>> In the new core widgets, a traitlet manages these directly: >>> >>> https://github.com/ipython/ipython/blob/master/IPython/html/widgets/widget_button.py#L36 >>> And all the class adding/removing is done on the client side. >>> >>> In my bootstrap librar <https://github.com/bollwyvl/ip-bootstrap>y i >>> have been tinkering with, I did the same, though a little differently. >>> >>> On Mon, Oct 27, 2014 at 8:55 PM, Adam Hughes <hughesadam87 at gmail.com> >>> wrote: >>> >>>> Yes, but when you do this in your notebook, does it appear in a >>>> different colors? Mine looks like plain text. IE I literally see: >>>> >>>> info >>>> danger >>>> warning >>>> success >>>> >>>> In my output cell, instead of pretty colors like the example on the >>>> bootstrap link. Using about a 2week-old version of 3.0 dev, if that >>>> matters. >>>> >>>> On Mon, Oct 27, 2014 at 8:50 PM, Nicholas Bollweg < >>>> nick.bollweg at gmail.com> wrote: >>>> >>>>> right, you'd switch it out to another context: >>>>> >>>>> from IPython.html import widgets >>>>>> from IPython.display import display >>>>>> for context in ["info", "danger", "warning", "success"]: >>>>>> display(widgets.HTML(value=context, _dom_classes=["alert", >>>>>> "alert-" + context])) >>>>>> >>>>> >>>>> _______________________________________________ >>>>> IPython-dev mailing list >>>>> IPython-dev at scipy.org >>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> IPython-dev mailing list >>>> IPython-dev at scipy.org >>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>> >>>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/bfd1dbe8/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: 2014-10-27_2239.png Type: image/png Size: 47090 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/bfd1dbe8/attachment.png> From hughesadam87 at gmail.com Wed Oct 29 19:40:08 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Wed, 29 Oct 2014 19:40:08 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CACejjWzXtVX6pLmBOhtSu_sb5N8nQjzViE+k-Dnoc0-TEC3E+Q@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> <CAMHV+dDJY1+9hxKSQuJ9TGTZnVFb=pomLWNNrdpoGTYfQkgJ2w@mail.gmail.com> <CACejjWzXtVX6pLmBOhtSu_sb5N8nQjzViE+k-Dnoc0-TEC3E+Q@mail.gmail.com> Message-ID: <CAMHV+dALeaJd81FXK5NwRU0=2zE=+0g649AWDeSkgtPYQ58T-g@mail.gmail.com> Ah ok. Thanks will try to get up to speed so not always asking such simple questions On Oct 29, 2014 7:06 PM, "Nicholas Bollweg" <nick.bollweg at gmail.com> wrote: > Yes, add_class was replaced with _dom_classes. It should actually simplify > a lot of your code! > > On Wed, Oct 29, 2014 at 6:53 PM, Adam Hughes <hughesadam87 at gmail.com> > wrote: > >> Hi Nicholas, >> >> After I updated to the recent dev, part of our code broke. It's from the >> part that you showed to us, so I figured you might be aware of what has >> been changed: >> >> AttributeError Traceback (most recent call last)<ipython-input-8-70485b3b7990> in displayed(self, _) 113 # ----- 114 def displayed(self, _):--> 115 self.add_class("col-xs-9") 116 # THIS IS WHERE DRAW IS CALLED AFTER DISPLAYS CHANGE 117 self.draw() >> AttributeError: 'Spectrogram' object has no attribute 'add_class' >> >> >> >> On Tue, Oct 28, 2014 at 12:07 AM, Adam Hughes <hughesadam87 at gmail.com> >> wrote: >> >>> Ah gotcha! Thanks for clearing that up, much appreciated! I guess my >>> dev is way older than I recall. >>> >>> On Mon, Oct 27, 2014 at 10:45 PM, Nicholas Bollweg < >>> nick.bollweg at gmail.com> wrote: >>> >>>> For reference, I see this: >>>> >>>> [image: Inline image 3] >>>> >>>> ah, the _dom_classes may have been more recent than that. Here's the >>>> change, landed sept 23: https://github.com/ipython/ipython/pull/6235 >>>> >>>> you may have to go back to something like: >>>> >>>> w = HTML("text") >>>>> w.on_displayed(lambda x: w.add_class("alert-warning") >>>>> >>>> >>>> When you want to change it, you'd then have to: >>>> >>>> w.remove_class("alert-warning") >>>>> w.add_class("alert-success") >>>>> >>>> >>>> In the new core widgets, a traitlet manages these directly: >>>> >>>> https://github.com/ipython/ipython/blob/master/IPython/html/widgets/widget_button.py#L36 >>>> And all the class adding/removing is done on the client side. >>>> >>>> In my bootstrap librar <https://github.com/bollwyvl/ip-bootstrap>y i >>>> have been tinkering with, I did the same, though a little differently. >>>> >>>> On Mon, Oct 27, 2014 at 8:55 PM, Adam Hughes <hughesadam87 at gmail.com> >>>> wrote: >>>> >>>>> Yes, but when you do this in your notebook, does it appear in a >>>>> different colors? Mine looks like plain text. IE I literally see: >>>>> >>>>> info >>>>> danger >>>>> warning >>>>> success >>>>> >>>>> In my output cell, instead of pretty colors like the example on the >>>>> bootstrap link. Using about a 2week-old version of 3.0 dev, if that >>>>> matters. >>>>> >>>>> On Mon, Oct 27, 2014 at 8:50 PM, Nicholas Bollweg < >>>>> nick.bollweg at gmail.com> wrote: >>>>> >>>>>> right, you'd switch it out to another context: >>>>>> >>>>>> from IPython.html import widgets >>>>>>> from IPython.display import display >>>>>>> for context in ["info", "danger", "warning", "success"]: >>>>>>> display(widgets.HTML(value=context, _dom_classes=["alert", >>>>>>> "alert-" + context])) >>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> IPython-dev mailing list >>>>>> IPython-dev at scipy.org >>>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> IPython-dev mailing list >>>>> IPython-dev at scipy.org >>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> IPython-dev mailing list >>>> IPython-dev at scipy.org >>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>> >>>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/0428e2e9/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: 2014-10-27_2239.png Type: image/png Size: 47090 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/0428e2e9/attachment.png> From fperez.net at gmail.com Wed Oct 29 21:25:25 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Wed, 29 Oct 2014 18:25:25 -0700 Subject: [IPython-dev] scipystack kernel restart In-Reply-To: <CAO5K8EuKf76N4+tKHdzfk43EuAJyZ2his3dHcxDkKsfaAyPTaw@mail.gmail.com> References: <CAO5K8EuKf76N4+tKHdzfk43EuAJyZ2his3dHcxDkKsfaAyPTaw@mail.gmail.com> Message-ID: <CAHAreOoq2WFTvRbEonH0PZYZUCAcSbP=9H_p77DBNbqm7F6tEQ@mail.gmail.com> On Wed, Oct 29, 2014 at 1:04 PM, Andrew Odewahn <odewahn at oreilly.com> wrote: > The service starts fine with no errors, and I can browse to one of the > examples, but as soon as try to edit or run anything, the kernel repeatedly > fails: > > > [I 16:52:21.718 NotebookApp] Using existing profile dir: > '/root/.ipython/profile_default' > Wild guess, likely wrong: permissions issues with writing to root's home directory? Can you try to run the server with `--debug` and see if any useful info comes out? Cheers f -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/b99b2b78/attachment.html> From fperez.net at gmail.com Wed Oct 29 22:03:29 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Wed, 29 Oct 2014 19:03:29 -0700 Subject: [IPython-dev] No dev meeting tomorrow, Oct 30 Message-ID: <CAHAreOoZ0=zJkGvwZizJmRqb_SwfLw3+7zEBU33K_SeCm64VJg@mail.gmail.com> Hi folks, we've had so many video calls this week with a bunch of people that we're kind of maxed out, so I propose we skip tomorrow's dev meeting. We can be on gitter and jump on short notice if anything is required. Cheers f -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/fae4bfb7/attachment.html> From fperez.net at gmail.com Wed Oct 29 22:23:10 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Wed, 29 Oct 2014 19:23:10 -0700 Subject: [IPython-dev] Time for a Jupyter mailing list? In-Reply-To: <544AF18C.7010808@creativetrax.com> References: <CAHAreOrBgtdmvb1dGxodUm1ZnzQdvChadu=RS8f0rUKOzFC_OQ@mail.gmail.com> <544AF18C.7010808@creativetrax.com> Message-ID: <CAHAreOqn1faCryn6xf=J_w08pY3RttsFi=3x8VHEobPSvRhHKw@mail.gmail.com> On Fri, Oct 24, 2014 at 5:40 PM, Jason Grout <jason-sage at creativetrax.com> wrote: > +1 on GG, with gmane.org mirroring. > Yup, I think that's a great plan. We'll make that and announce the address shortly so interested folks can join. Cheers, f -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/4d0c5aa0/attachment.html> From nick.bollweg at gmail.com Wed Oct 29 23:20:03 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Wed, 29 Oct 2014 23:20:03 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dALeaJd81FXK5NwRU0=2zE=+0g649AWDeSkgtPYQ58T-g@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> <CAMHV+dDJY1+9hxKSQuJ9TGTZnVFb=pomLWNNrdpoGTYfQkgJ2w@mail.gmail.com> <CACejjWzXtVX6pLmBOhtSu_sb5N8nQjzViE+k-Dnoc0-TEC3E+Q@mail.gmail.com> <CAMHV+dALeaJd81FXK5NwRU0=2zE=+0g649AWDeSkgtPYQ58T-g@mail.gmail.com> Message-ID: <CACejjWwYP1amUkRZkOLT3_PPoXq4B2_AzNtW0Atd+D=QXPF0Uw@mail.gmail.com> Hey, no problem: the API is definitely changing a lot right now, so it's a bit of a moving target... On Wed, Oct 29, 2014 at 7:40 PM, Adam Hughes <hughesadam87 at gmail.com> wrote: > Ah ok. Thanks will try to get up to speed so not always asking such > simple questions > On Oct 29, 2014 7:06 PM, "Nicholas Bollweg" <nick.bollweg at gmail.com> > wrote: > >> Yes, add_class was replaced with _dom_classes. It should actually >> simplify a lot of your code! >> >> On Wed, Oct 29, 2014 at 6:53 PM, Adam Hughes <hughesadam87 at gmail.com> >> wrote: >> >>> Hi Nicholas, >>> >>> After I updated to the recent dev, part of our code broke. It's from >>> the part that you showed to us, so I figured you might be aware of what has >>> been changed: >>> >>> AttributeError Traceback (most recent call last)<ipython-input-8-70485b3b7990> in displayed(self, _) 113 # ----- 114 def displayed(self, _):--> 115 self.add_class("col-xs-9") 116 # THIS IS WHERE DRAW IS CALLED AFTER DISPLAYS CHANGE 117 self.draw() >>> AttributeError: 'Spectrogram' object has no attribute 'add_class' >>> >>> >>> >>> On Tue, Oct 28, 2014 at 12:07 AM, Adam Hughes <hughesadam87 at gmail.com> >>> wrote: >>> >>>> Ah gotcha! Thanks for clearing that up, much appreciated! I guess my >>>> dev is way older than I recall. >>>> >>>> On Mon, Oct 27, 2014 at 10:45 PM, Nicholas Bollweg < >>>> nick.bollweg at gmail.com> wrote: >>>> >>>>> For reference, I see this: >>>>> >>>>> [image: Inline image 3] >>>>> >>>>> ah, the _dom_classes may have been more recent than that. Here's the >>>>> change, landed sept 23: https://github.com/ipython/ipython/pull/6235 >>>>> >>>>> you may have to go back to something like: >>>>> >>>>> w = HTML("text") >>>>>> w.on_displayed(lambda x: w.add_class("alert-warning") >>>>>> >>>>> >>>>> When you want to change it, you'd then have to: >>>>> >>>>> w.remove_class("alert-warning") >>>>>> w.add_class("alert-success") >>>>>> >>>>> >>>>> In the new core widgets, a traitlet manages these directly: >>>>> >>>>> https://github.com/ipython/ipython/blob/master/IPython/html/widgets/widget_button.py#L36 >>>>> And all the class adding/removing is done on the client side. >>>>> >>>>> In my bootstrap librar <https://github.com/bollwyvl/ip-bootstrap>y i >>>>> have been tinkering with, I did the same, though a little differently. >>>>> >>>>> On Mon, Oct 27, 2014 at 8:55 PM, Adam Hughes <hughesadam87 at gmail.com> >>>>> wrote: >>>>> >>>>>> Yes, but when you do this in your notebook, does it appear in a >>>>>> different colors? Mine looks like plain text. IE I literally see: >>>>>> >>>>>> info >>>>>> danger >>>>>> warning >>>>>> success >>>>>> >>>>>> In my output cell, instead of pretty colors like the example on the >>>>>> bootstrap link. Using about a 2week-old version of 3.0 dev, if that >>>>>> matters. >>>>>> >>>>>> On Mon, Oct 27, 2014 at 8:50 PM, Nicholas Bollweg < >>>>>> nick.bollweg at gmail.com> wrote: >>>>>> >>>>>>> right, you'd switch it out to another context: >>>>>>> >>>>>>> from IPython.html import widgets >>>>>>>> from IPython.display import display >>>>>>>> for context in ["info", "danger", "warning", "success"]: >>>>>>>> display(widgets.HTML(value=context, _dom_classes=["alert", >>>>>>>> "alert-" + context])) >>>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> IPython-dev mailing list >>>>>>> IPython-dev at scipy.org >>>>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>>>> >>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> IPython-dev mailing list >>>>>> IPython-dev at scipy.org >>>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> IPython-dev mailing list >>>>> IPython-dev at scipy.org >>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>> >>>>> >>>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/c524b1d6/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: 2014-10-27_2239.png Type: image/png Size: 47090 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141029/c524b1d6/attachment.png> From hughesadam87 at gmail.com Thu Oct 30 12:01:35 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Thu, 30 Oct 2014 12:01:35 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CACejjWwYP1amUkRZkOLT3_PPoXq4B2_AzNtW0Atd+D=QXPF0Uw@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> <CAMHV+dDJY1+9hxKSQuJ9TGTZnVFb=pomLWNNrdpoGTYfQkgJ2w@mail.gmail.com> <CACejjWzXtVX6pLmBOhtSu_sb5N8nQjzViE+k-Dnoc0-TEC3E+Q@mail.gmail.com> <CAMHV+dALeaJd81FXK5NwRU0=2zE=+0g649AWDeSkgtPYQ58T-g@mail.gmail.com> <CACejjWwYP1amUkRZkOLT3_PPoXq4B2_AzNtW0Atd+D=QXPF0Uw@mail.gmail.com> Message-ID: <CAMHV+dBjAd3+s2eHEpRxCg3yEvBcpfuB5ttNjy1MZ9Bu28cCyw@mail.gmail.com> So do I want to change calls to add_class() remove_class() With calls to the _dcom_class attribute? For example: def displayed(self, _): self.add_class("panel-body") Becomes: def displayed(self, _): self._dcom_class = "panel-body" On Wed, Oct 29, 2014 at 11:20 PM, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > Hey, no problem: the API is definitely changing a lot right now, so it's a > bit of a moving target... > > On Wed, Oct 29, 2014 at 7:40 PM, Adam Hughes <hughesadam87 at gmail.com> > wrote: > >> Ah ok. Thanks will try to get up to speed so not always asking such >> simple questions >> On Oct 29, 2014 7:06 PM, "Nicholas Bollweg" <nick.bollweg at gmail.com> >> wrote: >> >>> Yes, add_class was replaced with _dom_classes. It should actually >>> simplify a lot of your code! >>> >>> On Wed, Oct 29, 2014 at 6:53 PM, Adam Hughes <hughesadam87 at gmail.com> >>> wrote: >>> >>>> Hi Nicholas, >>>> >>>> After I updated to the recent dev, part of our code broke. It's from >>>> the part that you showed to us, so I figured you might be aware of what has >>>> been changed: >>>> >>>> AttributeError Traceback (most recent call last)<ipython-input-8-70485b3b7990> in displayed(self, _) 113 # ----- 114 def displayed(self, _):--> 115 self.add_class("col-xs-9") 116 # THIS IS WHERE DRAW IS CALLED AFTER DISPLAYS CHANGE 117 self.draw() >>>> AttributeError: 'Spectrogram' object has no attribute 'add_class' >>>> >>>> >>>> >>>> On Tue, Oct 28, 2014 at 12:07 AM, Adam Hughes <hughesadam87 at gmail.com> >>>> wrote: >>>> >>>>> Ah gotcha! Thanks for clearing that up, much appreciated! I guess my >>>>> dev is way older than I recall. >>>>> >>>>> On Mon, Oct 27, 2014 at 10:45 PM, Nicholas Bollweg < >>>>> nick.bollweg at gmail.com> wrote: >>>>> >>>>>> For reference, I see this: >>>>>> >>>>>> [image: Inline image 3] >>>>>> >>>>>> ah, the _dom_classes may have been more recent than that. Here's the >>>>>> change, landed sept 23: https://github.com/ipython/ipython/pull/6235 >>>>>> >>>>>> you may have to go back to something like: >>>>>> >>>>>> w = HTML("text") >>>>>>> w.on_displayed(lambda x: w.add_class("alert-warning") >>>>>>> >>>>>> >>>>>> When you want to change it, you'd then have to: >>>>>> >>>>>> w.remove_class("alert-warning") >>>>>>> w.add_class("alert-success") >>>>>>> >>>>>> >>>>>> In the new core widgets, a traitlet manages these directly: >>>>>> >>>>>> https://github.com/ipython/ipython/blob/master/IPython/html/widgets/widget_button.py#L36 >>>>>> And all the class adding/removing is done on the client side. >>>>>> >>>>>> In my bootstrap librar <https://github.com/bollwyvl/ip-bootstrap>y i >>>>>> have been tinkering with, I did the same, though a little differently. >>>>>> >>>>>> On Mon, Oct 27, 2014 at 8:55 PM, Adam Hughes <hughesadam87 at gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Yes, but when you do this in your notebook, does it appear in a >>>>>>> different colors? Mine looks like plain text. IE I literally see: >>>>>>> >>>>>>> info >>>>>>> danger >>>>>>> warning >>>>>>> success >>>>>>> >>>>>>> In my output cell, instead of pretty colors like the example on the >>>>>>> bootstrap link. Using about a 2week-old version of 3.0 dev, if that >>>>>>> matters. >>>>>>> >>>>>>> On Mon, Oct 27, 2014 at 8:50 PM, Nicholas Bollweg < >>>>>>> nick.bollweg at gmail.com> wrote: >>>>>>> >>>>>>>> right, you'd switch it out to another context: >>>>>>>> >>>>>>>> from IPython.html import widgets >>>>>>>>> from IPython.display import display >>>>>>>>> for context in ["info", "danger", "warning", "success"]: >>>>>>>>> display(widgets.HTML(value=context, _dom_classes=["alert", >>>>>>>>> "alert-" + context])) >>>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> IPython-dev mailing list >>>>>>>> IPython-dev at scipy.org >>>>>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> IPython-dev mailing list >>>>>>> IPython-dev at scipy.org >>>>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>>>> >>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> IPython-dev mailing list >>>>>> IPython-dev at scipy.org >>>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>>> >>>>>> >>>>> >>>> >>>> _______________________________________________ >>>> IPython-dev mailing list >>>> IPython-dev at scipy.org >>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>> >>>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141030/60359f3e/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: 2014-10-27_2239.png Type: image/png Size: 47090 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141030/60359f3e/attachment.png> From nick.bollweg at gmail.com Thu Oct 30 13:05:10 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Thu, 30 Oct 2014 13:05:10 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dBjAd3+s2eHEpRxCg3yEvBcpfuB5ttNjy1MZ9Bu28cCyw@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> <CAMHV+dDJY1+9hxKSQuJ9TGTZnVFb=pomLWNNrdpoGTYfQkgJ2w@mail.gmail.com> <CACejjWzXtVX6pLmBOhtSu_sb5N8nQjzViE+k-Dnoc0-TEC3E+Q@mail.gmail.com> <CAMHV+dALeaJd81FXK5NwRU0=2zE=+0g649AWDeSkgtPYQ58T-g@mail.gmail.com> <CACejjWwYP1amUkRZkOLT3_PPoXq4B2_AzNtW0Atd+D=QXPF0Uw@mail.gmail.com> <CAMHV+dBjAd3+s2eHEpRxCg3yEvBcpfuB5ttNjy1MZ9Bu28cCyw@mail.gmail.com> Message-ID: <CACejjWyaf9vMobggJmRzAdz=VDqkWa=4mhAcDpL5f27NTJ8Bng@mail.gmail.com> You specify it when you create the instance: w = SomeWidget(_dom_classes=["panel-body"]) or, in the case of class that should always get a _dom_class: class PanelBody(widgets.Box): def __init__(self, *args, **kwargs): super(PanelBody, self).__init__(*args, **kwargs) self._dom_classes += ("panel-body",) You could also monkey with the kwargs beforehand, avoiding, under the covers, two calls to update_classes, but this approach is easy to read, which i think wins out. When I asked about this on gitter, the reasoning for this change was that the add/remove class couldn't be made stateful, and that it was using extra, custom comms stuff to do something that traitlets were perfectly capable of. Thus, this traitlet. Howevever, as you can see from it having the _ prefix, this is really much more of a widget-developer functionality: it is suggested that no-fooling custom javascript be done... which is still not exactly simple. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141030/5d843c5f/attachment.html> From hughesadam87 at gmail.com Thu Oct 30 13:38:36 2014 From: hughesadam87 at gmail.com (Adam Hughes) Date: Thu, 30 Oct 2014 13:38:36 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CACejjWyaf9vMobggJmRzAdz=VDqkWa=4mhAcDpL5f27NTJ8Bng@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> <CAMHV+dDJY1+9hxKSQuJ9TGTZnVFb=pomLWNNrdpoGTYfQkgJ2w@mail.gmail.com> <CACejjWzXtVX6pLmBOhtSu_sb5N8nQjzViE+k-Dnoc0-TEC3E+Q@mail.gmail.com> <CAMHV+dALeaJd81FXK5NwRU0=2zE=+0g649AWDeSkgtPYQ58T-g@mail.gmail.com> <CACejjWwYP1amUkRZkOLT3_PPoXq4B2_AzNtW0Atd+D=QXPF0Uw@mail.gmail.com> <CAMHV+dBjAd3+s2eHEpRxCg3yEvBcpfuB5ttNjy1MZ9Bu28cCyw@mail.gmail.com> <CACejjWyaf9vMobggJmRzAdz=VDqkWa=4mhAcDpL5f27NTJ8Bng@mail.gmail.com> Message-ID: <CAMHV+dC4XN+pO2E7qOx=4SAuzm2+PKpCg6M8+RZy_V9KFENNdw@mail.gmail.com> So we can also drop the def displayed() / on_displayed portions of the GUI, right? On Thu, Oct 30, 2014 at 1:05 PM, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > You specify it when you create the instance: > > w = SomeWidget(_dom_classes=["panel-body"]) > > or, in the case of class that should always get a _dom_class: > > class PanelBody(widgets.Box): > def __init__(self, *args, **kwargs): > super(PanelBody, self).__init__(*args, **kwargs) > self._dom_classes += ("panel-body",) > > You could also monkey with the kwargs beforehand, avoiding, under the > covers, two calls to update_classes, but this approach is easy to read, > which i think wins out. > > When I asked about this on gitter, the reasoning for this change was that > the add/remove class couldn't be made stateful, and that it was using > extra, custom comms stuff to do something that traitlets were perfectly > capable of. Thus, this traitlet. Howevever, as you can see from it having > the _ prefix, this is really much more of a widget-developer functionality: > it is suggested that no-fooling custom javascript be done... which is still > not exactly simple. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141030/09d0f630/attachment.html> From benjaminrk at gmail.com Thu Oct 30 19:12:12 2014 From: benjaminrk at gmail.com (MinRK) Date: Thu, 30 Oct 2014 16:12:12 -0700 Subject: [IPython-dev] Jupyter Hub login problem In-Reply-To: <CAOvHdZS=VqyinHqh-jbv6DqDvWEnrZm8c5wH7Ld6qz2dVgdUEQ@mail.gmail.com> References: <CAOvHdZS=VqyinHqh-jbv6DqDvWEnrZm8c5wH7Ld6qz2dVgdUEQ@mail.gmail.com> Message-ID: <CAHNn8BWPmpOY1DWWwqKhG07GCx+fO-SkEwpMsV6uu87wznFrvQ@mail.gmail.com> I suspect there is a path issue when you run it with sudo, such that the single-user server isn't on the PATH. On Fri, Oct 24, 2014 at 1:17 AM, Dong Ta <dongta.hds at gmail.com> wrote: > Hi Min, > > I followed the instructions on the homepage. I installed the hub using *pip > install .* > > - If I start jupyterhub using the admin account. Then I can only log > in using the admin account and not other accounts (although I've added > other accounts to the hub as). > - If I start with sudo /etc/anaconda/bin/jupyterhub, then I cannot log > in using any account (500 error on the browser). Here's the error in the > terminal. > > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/tornado/web.py", line 1273, > in _when_complete > if result.result() is not None: > File "/usr/lib/python2.7/site-packages/tornado/concurrent.py", line > 129, in result > raise_exc_info(self.__exc_info) > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 227, in > wrapper > runner.run() > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 529, in > run > yielded = self.gen.throw(*exc_info) > File > "/usr/lib/python2.7/site-packages/jupyterhub/handlers/login.py", line 60, > in post > yield self.spawn_single_user(user) > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 557, in > run > self.yield_point.start(self) > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 399, in > start > self.result = self.future.result() > File "/usr/lib/python2.7/site-packages/tornado/concurrent.py", line > 129, in result > raise_exc_info(self.__exc_info) > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 227, in > wrapper > runner.run() > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 529, in > run > yielded = self.gen.throw(*exc_info) > File "/usr/lib/python2.7/site-packages/jupyterhub/handlers/base.py", > line 171, in spawn_single_user > config=self.config, > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 557, in > run > self.yield_point.start(self) > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 399, in > start > self.result = self.future.result() > File "/usr/lib/python2.7/site-packages/tornado/concurrent.py", line > 129, in result > raise_exc_info(self.__exc_info) > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 227, in > wrapper > runner.run() > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 529, in > run > yielded = self.gen.throw(*exc_info) > File "/usr/lib/python2.7/site-packages/jupyterhub/orm.py", line 322, > in spawn > yield spawner.start() > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 557, in > run > self.yield_point.start(self) > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 399, in > start > self.result = self.future.result() > File "/usr/lib/python2.7/site-packages/tornado/concurrent.py", line > 129, in result > raise_exc_info(self.__exc_info) > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 227, in > wrapper > runner.run() > File "/usr/lib/python2.7/site-packages/tornado/gen.py", line 531, in > run > yielded = self.gen.send(next) > File "/usr/lib/python2.7/site-packages/jupyterhub/spawner.py", line > 368, in start > preexec_fn=self.make_preexec_fn(self.user.name), > File "/usr/lib/python2.7/subprocess.py", line 710, in __init__ > errread, errwrite) > File "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child > raise child_exception > OSError: [Errno 2] No such file or directory > [E 07:51:18.294 JupyterHubApp] Could not open static file > u'/usr/share/jupyter/static/images/favicon.ico' > [E 07:51:18.296 JupyterHubApp] 500 POST /hub/login?next= (127.0.0.1) > 341.50ms > > DT > > On Thu, Oct 23, 2014 at 7:20 PM, Min RK <benjaminrk at gmail.com> wrote: > > How have you configured the Hub? What user is running the server? Can you >> include log output? Possibly after running with `--debug`? >> >> -MinRK >> >> On Oct 23, 2014, at 14:06, Dong Ta <dongta.hds at gmail.com> wrote: >> >> Hi, >> >> I ran the jupyterhub command as an admin user. I can log in using the >> admin credential. However, I cannot log in using a different user's >> credential. I would get this error message. >> >> {'error': 'Invalid username or password'} >> >> That account does exist and I've made sure that the username/password is >> correct. >> >> What am I missing here? >> >> DT >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141030/acfb58f0/attachment.html> From nick.bollweg at gmail.com Thu Oct 30 20:35:34 2014 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Thu, 30 Oct 2014 20:35:34 -0400 Subject: [IPython-dev] More widget feasibility ideas In-Reply-To: <CAMHV+dC4XN+pO2E7qOx=4SAuzm2+PKpCg6M8+RZy_V9KFENNdw@mail.gmail.com> References: <CAMHV+dAptq7vwXb9wm3PvTK9m9Ru3LMR-jBabXvHBs4PFOM9kA@mail.gmail.com> <CACejjWygugCD1t8e6hBtiFKhGmD_Ad+mfF=RHLC6vmCTN_Em0g@mail.gmail.com> <CAMHV+dABJ+TwAsYBd6VGNHAj6NUJqncacmbO3D_0mDDO9xxGOA@mail.gmail.com> <CAMHV+dB0yRPpnjfALhK3eaeoFTDPH-VN6B31u8XzLt9hfLVRgA@mail.gmail.com> <CACejjWw6VXNzyjkda_VO4nu6KAC=QNYHdcV0vGkGkhM1=P5Q1A@mail.gmail.com> <CAMHV+dBUdePMz4kuPQG06NG8OSoAV7my27Hd51JAqS3vG+Pkjg@mail.gmail.com> <CACejjWwpNQzp=j8ZtpC8HjP4CQj97zA9-scUY5uWC8SHZHosHg@mail.gmail.com> <CAMHV+dCiVRnc7U-wTwzeUqCoxKR+_fuCxW=rAtrU70-K_Nmx_Q@mail.gmail.com> <CACejjWxx1deQx9oT124KYMJ4FRZ+q=fo4U63FDEEuO=55Fb99A@mail.gmail.com> <CAMHV+dDHHFoYkmugy4NwLWRDhzmZFpsUy8TG8G4UB5=7CZaejw@mail.gmail.com> <CAMHV+dDJY1+9hxKSQuJ9TGTZnVFb=pomLWNNrdpoGTYfQkgJ2w@mail.gmail.com> <CACejjWzXtVX6pLmBOhtSu_sb5N8nQjzViE+k-Dnoc0-TEC3E+Q@mail.gmail.com> <CAMHV+dALeaJd81FXK5NwRU0=2zE=+0g649AWDeSkgtPYQ58T-g@mail.gmail.com> <CACejjWwYP1amUkRZkOLT3_PPoXq4B2_AzNtW0Atd+D=QXPF0Uw@mail.gmail.com> <CAMHV+dBjAd3+s2eHEpRxCg3yEvBcpfuB5ttNjy1MZ9Bu28cCyw@mail.gmail.com> <CACejjWyaf9vMobggJmRzAdz=VDqkWa=4mhAcDpL5f27NTJ8Bng@mail.gmail.com> <CAMHV+dC4XN+pO2E7qOx=4SAuzm2+PKpCg6M8+RZy_V9KFENNdw@mail.gmail.com> Message-ID: <CACejjWx5wOXxSVb9rgRME94iS8y2sCdGw=PRryyBZFLTvN6Uvg@mail.gmail.com> if there's nothing else going on there, that is correct! On Thu, Oct 30, 2014 at 1:38 PM, Adam Hughes <hughesadam87 at gmail.com> wrote: > So we can also drop the def displayed() / on_displayed portions of the > GUI, right? > > On Thu, Oct 30, 2014 at 1:05 PM, Nicholas Bollweg <nick.bollweg at gmail.com> > wrote: > >> You specify it when you create the instance: >> >> w = SomeWidget(_dom_classes=["panel-body"]) >> >> or, in the case of class that should always get a _dom_class: >> >> class PanelBody(widgets.Box): >> def __init__(self, *args, **kwargs): >> super(PanelBody, self).__init__(*args, **kwargs) >> self._dom_classes += ("panel-body",) >> >> You could also monkey with the kwargs beforehand, avoiding, under the >> covers, two calls to update_classes, but this approach is easy to read, >> which i think wins out. >> >> When I asked about this on gitter, the reasoning for this change was that >> the add/remove class couldn't be made stateful, and that it was using >> extra, custom comms stuff to do something that traitlets were perfectly >> capable of. Thus, this traitlet. Howevever, as you can see from it having >> the _ prefix, this is really much more of a widget-developer functionality: >> it is suggested that no-fooling custom javascript be done... which is still >> not exactly simple. >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141030/a891133d/attachment.html> From DavidAnthonyPowell+python at gmail.com Fri Oct 31 03:19:10 2014 From: DavidAnthonyPowell+python at gmail.com (David Powell) Date: Fri, 31 Oct 2014 18:19:10 +1100 Subject: [IPython-dev] Conflict between IPython notebook javascript and three.js? Message-ID: <CAGXzvie3b+uufT3wEo5wJz_65VhcAQRgPv9uRALjy4s50nSiCA@mail.gmail.com> I am trying to display 3D objects in IPython notebooks, and so far three.js looks like the most promising approach. In particular, it is important that the 3D plot is still visible after converting the notebook to html. So far I have succeeded in getting a basic example working, by adapting http://nbviewer.ipython.org/github/payne92/notebooks/blob/master/00%20Javascript%20In%20Notebooks.ipynb However, I run into problems when I include the trackball controls from three.js, and restrict the controls to input only on the cavas DOM element (so that clicking outside the canvas does not modify the perspective). The trackball controls do not work correctly, as can be seen by running the attached notebook example. When I export the notebook to html, I see that the wegbl output is present as I wanted. Furthermore, it seems that in the html, the trackball controls work perfectly. This suggests that the problem is some kind of conflict with the notebook's javascript. Any hints as to the possible cause of this problem would be greatly appreciated. In case it matters, I am using IPython 2.3 regards David -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141031/9ead1efb/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: Cube geometry.ipynb Type: application/octet-stream Size: 28930 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141031/9ead1efb/attachment.obj> From konrad.hinsen at fastmail.net Fri Oct 31 05:42:11 2014 From: konrad.hinsen at fastmail.net (Konrad Hinsen) Date: Fri, 31 Oct 2014 10:42:11 +0100 Subject: [IPython-dev] How to cite the IPython notebook? In-Reply-To: <E3BA64A5-28EF-4A8C-AED7-11ABB2C50A2D@gmail.com> References: <21584.53762.639725.751557@Ordinateur-de-Catherine-Konrad.local> <E3BA64A5-28EF-4A8C-AED7-11ABB2C50A2D@gmail.com> Message-ID: <51C405574C84F1FDAB3FCBA0@Ordinateur-de-Catherine-Konrad.local> --On 29 octobre 2014 12:46:41 +0100 Matthias Bussonnier <bussonniermatthias at gmail.com> wrote: >> was before the notebook. The context of my citation is tools for >> reproducible research, so ideally I'd like to cite a paper that >> actually describes the notebook and the design decisions behind it. > > There are no citation post notebook from US, we are working on it. > Can it wait a bit ? About a month. Konrad. From bussonniermatthias at gmail.com Fri Oct 31 05:46:21 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Fri, 31 Oct 2014 10:46:21 +0100 Subject: [IPython-dev] How to cite the IPython notebook? In-Reply-To: <51C405574C84F1FDAB3FCBA0@Ordinateur-de-Catherine-Konrad.local> References: <21584.53762.639725.751557@Ordinateur-de-Catherine-Konrad.local> <E3BA64A5-28EF-4A8C-AED7-11ABB2C50A2D@gmail.com> <51C405574C84F1FDAB3FCBA0@Ordinateur-de-Catherine-Konrad.local> Message-ID: <0AA07C58-3CB5-4FCF-A5C9-F824B7D2152B@gmail.com> Le 31 oct. 2014 ? 10:42, Konrad Hinsen <konrad.hinsen at fastmail.net> a ?crit : > --On 29 octobre 2014 12:46:41 +0100 Matthias Bussonnier > <bussonniermatthias at gmail.com> wrote: > >>> was before the notebook. The context of my citation is tools for >>> reproducible research, so ideally I'd like to cite a paper that >>> actually describes the notebook and the design decisions behind it. >> >> There are no citation post notebook from US, we are working on it. >> Can it wait a bit ? > > About a month. Hum, that might be a bit short then. Sorry about that. -- M From patrickfuller at gmail.com Fri Oct 31 08:05:48 2014 From: patrickfuller at gmail.com (Patrick Fuller) Date: Fri, 31 Oct 2014 07:05:48 -0500 Subject: [IPython-dev] Conflict between IPython notebook javascript and three.js? In-Reply-To: <CAGXzvie3b+uufT3wEo5wJz_65VhcAQRgPv9uRALjy4s50nSiCA@mail.gmail.com> References: <CAGXzvie3b+uufT3wEo5wJz_65VhcAQRgPv9uRALjy4s50nSiCA@mail.gmail.com> Message-ID: <CA+LJwtv39mjJkVBL4EkVbWJ74ffXE1BqRXSN9bP_BwXBSyee6g@mail.gmail.com> In case it helps, here are two projects that work the way you want with trackball: imolecule <http://patrick-fuller.com/imolecule/> and igraph <http://patrick-fuller.com/igraph/>. The code of interest is here <https://github.com/patrickfuller/igraph/blob/master/python/notebook.py#L70-L95>. It?s been a while since I?ve looked at this, but I believe my trick was to use _repr_html_ instead of _repr_javascript_ in order to make a new div. Hope this helps, Pat ? On Fri, Oct 31, 2014 at 2:19 AM, David Powell < DavidAnthonyPowell+python at gmail.com> wrote: > I am trying to display 3D objects in IPython notebooks, and so far > three.js looks like the most promising approach. In particular, it is > important that the 3D plot is still visible after converting the > notebook to html. > > So far I have succeeded in getting a basic example working, by > adapting > http://nbviewer.ipython.org/github/payne92/notebooks/blob/master/00%20Javascript%20In%20Notebooks.ipynb > > However, I run into problems when I include the trackball controls > from three.js, and restrict the controls to input only on the cavas > DOM element (so that clicking outside the canvas does not modify the > perspective). The trackball controls do not work correctly, as can be > seen by running the attached notebook example. > > When I export the notebook to html, I see that the wegbl output is > present as I wanted. Furthermore, it seems that in the html, the > trackball controls work perfectly. This suggests that the problem is > some kind of conflict with the notebook's javascript. Any hints as to > the possible cause of this problem would be greatly appreciated. > > In case it matters, I am using IPython 2.3 > > regards > David > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141031/e236c858/attachment.html> From jason-sage at creativetrax.com Fri Oct 31 09:10:30 2014 From: jason-sage at creativetrax.com (Jason Grout) Date: Fri, 31 Oct 2014 09:10:30 -0400 Subject: [IPython-dev] Conflict between IPython notebook javascript and three.js? In-Reply-To: <CAGXzvie3b+uufT3wEo5wJz_65VhcAQRgPv9uRALjy4s50nSiCA@mail.gmail.com> References: <CAGXzvie3b+uufT3wEo5wJz_65VhcAQRgPv9uRALjy4s50nSiCA@mail.gmail.com> Message-ID: <54538A46.2040509@creativetrax.com> On 10/31/14, 3:19, David Powell wrote: > I am trying to display 3D objects in IPython notebooks, and so far > three.js looks like the most promising approach. In particular, it is > important that the 3D plot is still visible after converting the > notebook to html. > > So far I have succeeded in getting a basic example working, by > adapting http://nbviewer.ipython.org/github/payne92/notebooks/blob/master/00%20Javascript%20In%20Notebooks.ipynb > > However, I run into problems when I include the trackball controls > from three.js, and restrict the controls to input only on the cavas > DOM element (so that clicking outside the canvas does not modify the > perspective). The trackball controls do not work correctly, as can be > seen by running the attached notebook example. This may or may not be an issue on top of this, but I've had problems with TrackballControls and OrbitControls (which I like better) accepting key events in the global page. See https://github.com/mrdoob/three.js/pull/5236. > > When I export the notebook to html, I see that the wegbl output is > present as I wanted. Furthermore, it seems that in the html, the > trackball controls work perfectly. This suggests that the problem is > some kind of conflict with the notebook's javascript. Any hints as to > the possible cause of this problem would be greatly appreciated. Do you see any errors in the javascript console? > > In case it matters, I am using IPython 2.3 By the way, you may be interested in the pythreejs library, which is a wrapping of three.js as IPython widgets: https://github.com/jasongrout/pythreejs/tree/ipython (the ongoing IPython notebook work is in the ipython branch) See the examples folder for a few simple (and possibly out-of-date) examples. It's still a work in progress, but it does work quite nicely already. For example, see this example: http://nbviewer.ipython.org/github/jasongrout/pythreejs/blob/ipython/examples/Surface.ipynb One disadvantage of using widgets, which may be a show-stopper for you right now, is that you can't see the 3d plot in nbviewer and with nbconvert. Jon's recent work on widget persistence should fix that, hopefully soon. We're reviewing his pull request now. The nice thing about it being a system of widgets is that you can control and adjust any parameter interactively from python or with the other widget controls. Thanks, Jason From wes.turner at gmail.com Fri Oct 31 16:31:21 2014 From: wes.turner at gmail.com (Wes Turner) Date: Fri, 31 Oct 2014 15:31:21 -0500 Subject: [IPython-dev] How to cite the IPython notebook? In-Reply-To: <5450D8AE.6020403@creativetrax.com> References: <21584.53762.639725.751557@Ordinateur-de-Catherine-Konrad.local> <E3BA64A5-28EF-4A8C-AED7-11ABB2C50A2D@gmail.com> <5450D8AE.6020403@creativetrax.com> Message-ID: <CACfEFw8n97VkB=HtuGGEysthpzx=MVLiLV7Q=TLispYdA=suPw@mail.gmail.com> https://github.com/ipython/ipython-website/blob/master/citing.rst ================ Citing IPython ================ If IPython been significant to a project that leads to an academic publication, please acknowledge that fact by citing the project. As of now, the canonical academic reference for IPython is `this paper <http://fperez.org/papers/ipython07_pe-gr_cise.pdf>`_, for which here are both a BibTex and a plaintext reference you can use:: @Article{PER-GRA:2007, Author = {P\'erez, Fernando and Granger, Brian E.}, Title = {{IP}ython: a System for Interactive Scientific Computing}, Journal = {Computing in Science and Engineering}, Volume = {9}, Number = {3}, Pages = {21--29}, month = may, year = 2007, url = "http://ipython.org", ISSN = "1521-9615", doi = {10.1109/MCSE.2007.53}, publisher = {IEEE Computer Society}, } or in plaintext: Fernando P?rez, Brian E. Granger, *IPython: A System for Interactive Scientific Computing*, Computing in Science and Engineering, vol. 9, no. 3, pp. 21-29, May/June 2007, doi:10.1109/MCSE.2007.53. URL: http://ipython.org Thank you! On Wed, Oct 29, 2014 at 7:08 AM, Jason Grout <jason-sage at creativetrax.com> wrote: > On 10/29/14, 7:46, Matthias Bussonnier wrote: > > Hi, > > > > Le 29 oct. 2014 ? 12:39, Konrad Hinsen <konrad.hinsen at fastmail.net> a > ?crit : > > > >> Hi everyone, > >> > >> I am looking for a citable reference for the IPython notebook. All I > >> could find on ipython.org is a 2007 paper describing IPython, but that > >> was before the notebook. The context of my citation is tools for > >> reproducible research, so ideally I'd like to cite a paper that > >> actually describes the notebook and the design decisions behind it. > > > > There are no citation post notebook from US, we are working on it. > > Can it wait a bit ? > > Doesn't github allow generating DOIs from software releases? Perhaps > that would be a good way to cite IPython and a version number: > > https://guides.github.com/activities/citable-code/ > > Thanks, > > Jason > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Wes Turner https://westurner.github.io/ -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141031/041b5a25/attachment.html> From wes.turner at gmail.com Fri Oct 31 16:31:42 2014 From: wes.turner at gmail.com (Wes Turner) Date: Fri, 31 Oct 2014 15:31:42 -0500 Subject: [IPython-dev] How to cite the IPython notebook? In-Reply-To: <5450D8AE.6020403@creativetrax.com> References: <21584.53762.639725.751557@Ordinateur-de-Catherine-Konrad.local> <E3BA64A5-28EF-4A8C-AED7-11ABB2C50A2D@gmail.com> <5450D8AE.6020403@creativetrax.com> Message-ID: <CACfEFw-mt-kgohHre1zWJ-9j8Ks6c+4OP5FMomb6HYAkryed+Q@mail.gmail.com> https://guides.github.com/activities/citable-code/ mentions that you can create a DOI for a GitHub project with Zenodo: * http://home.web.cern.ch/about/updates/2014/03/tool-developed-cern-makes-software-citation-easier * https://zenodo.org/account/settings/github/ You can also create a DOI for a GitHub project with FigShare: * http://figshare.com/faqs https://en.wikipedia.org/wiki/Digital_object_identifier On Wed, Oct 29, 2014 at 7:08 AM, Jason Grout <jason-sage at creativetrax.com> wrote: > On 10/29/14, 7:46, Matthias Bussonnier wrote: > > Hi, > > > > Le 29 oct. 2014 ? 12:39, Konrad Hinsen <konrad.hinsen at fastmail.net> a > ?crit : > > > >> Hi everyone, > >> > >> I am looking for a citable reference for the IPython notebook. All I > >> could find on ipython.org is a 2007 paper describing IPython, but that > >> was before the notebook. The context of my citation is tools for > >> reproducible research, so ideally I'd like to cite a paper that > >> actually describes the notebook and the design decisions behind it. > > > > There are no citation post notebook from US, we are working on it. > > Can it wait a bit ? > > Doesn't github allow generating DOIs from software releases? Perhaps > that would be a good way to cite IPython and a version number: > > https://guides.github.com/activities/citable-code/ > > Thanks, > > Jason > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Wes Turner https://westurner.github.io/ -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20141031/12fc5907/attachment.html>