From bussonniermatthias at gmail.com Wed Jan 2 18:19:58 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Thu, 3 Jan 2013 00:19:58 +0100 Subject: [IPython-dev] Multiple IPython notebook server same port / Proxy / Launcher. Message-ID: <8344A976-1DA2-4973-B613-23244885D272@gmail.com> Hi list, Pushed by PR 2694 [1], I was wondering If i would be feasible to host multiple application along side IPython notebook on the same port, just routing by url. This is how is born ipython-notebook-proxy[2] which allow you to run multiple notebooks and applications on the same port (yes port 80 I think of you, 443 you'll be next, stupid work firewall I'll get you one day). For convenience right now, it drops you in a node-REPL where you can do > start('/aaa/',8888) > start('/bbb/',8889) > start('/ccc/',8890) > start('/ddd/',8891) And it will gracefully start 4 server accessible at localhost:8000/aaa/ localhost:8000/bbb/ localhost:8000/ccc/ localhost:8000/ddd/ With a little training I'm sure it can do it with your user's logins, and by selecting port by itself. Before quitting don't forget to issue a > stop_all() Configurability for now is None. But routing rules can be changed live without dropping the current connexions. Possible use with mplh5canvas or anything else not to have to **worry** about port. Or in browser galery's demo [3] (not sure if it use a separate serve still?) I'll be happy to get feedback, and test under high load/ big number of connected user to see how it holds. PR are welcomed, Will move to IPython-organisation owned repository if it has lot's of success when a little more mature. Already available on NPM so no manual install ! $ npm install ipython-notebook-proxy And happy new year. -- Matthias [1] https://github.com/ipython/ipython/pull/2694 [2] https://npmjs.org/package/ipython-notebook-proxy [3] http://cyrille.rossant.net/galrys-story-or-the-quest-of-multi-million-plots/ -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130103/8ba35b63/attachment.html> From satra at mit.edu Thu Jan 3 20:32:41 2013 From: satra at mit.edu (Satrajit Ghosh) Date: Thu, 3 Jan 2013 20:32:41 -0500 Subject: [IPython-dev] nbviewer and dropbox Message-ID: <CA+A4wO=+bg2bYnG3ccGo+T6JEa2arOg_9f7ZCOHOFcJnAO7_nQ@mail.gmail.com> hi all, happy new year. is there a way for nbviewer to be augmented to accept shared links from dropbox of the follow form (note the ?dl=1 at the end). https://dl.dropbox.com/s/xttkmuvu7hh72vu/MyFile.pdf?dl=1 cheers, satra -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130103/f15db1da/attachment.html> From bussonniermatthias at gmail.com Fri Jan 4 06:59:07 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Fri, 4 Jan 2013 12:59:07 +0100 Subject: [IPython-dev] nbviewer and dropbox In-Reply-To: <CA+A4wO=+bg2bYnG3ccGo+T6JEa2arOg_9f7ZCOHOFcJnAO7_nQ@mail.gmail.com> References: <CA+A4wO=+bg2bYnG3ccGo+T6JEa2arOg_9f7ZCOHOFcJnAO7_nQ@mail.gmail.com> Message-ID: <9A836667-FFA5-42C7-AE5C-A2D37837828C@gmail.com> Hi Satra. Happy new year also. > > is there a way for nbviewer to be augmented to accept shared links from dropbox of the follow form (note the ?dl=1 at the end). > https://dl.dropbox.com/s/xttkmuvu7hh72vu/MyFile.pdf?dl=1 Yes, it would be doable. With the current state of nbviewer it would be a little complicated I would prefer to wait for a clean way of having special logic for different website through regexp and configurability. But you are welcome to open a feature request on nbviewer issue page. As for the link you provided I have a 404. If it needs a authentication, there is no way for nbviewer to access it (yet ?). Cheers -- Matthias From satra at mit.edu Fri Jan 4 08:16:40 2013 From: satra at mit.edu (Satrajit Ghosh) Date: Fri, 4 Jan 2013 08:16:40 -0500 Subject: [IPython-dev] nbviewer and dropbox In-Reply-To: <9A836667-FFA5-42C7-AE5C-A2D37837828C@gmail.com> References: <CA+A4wO=+bg2bYnG3ccGo+T6JEa2arOg_9f7ZCOHOFcJnAO7_nQ@mail.gmail.com> <9A836667-FFA5-42C7-AE5C-A2D37837828C@gmail.com> Message-ID: <CA+A4wOn8VZtpOVTSDYpZ1czqY1aS3gLXPXZPbPqsVa+GfN9o5g@mail.gmail.com> hi matthias, here is a more appropriate link. that one was just an example from dropbox. https://www.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb?dl=1 cheers, satra On Fri, Jan 4, 2013 at 6:59 AM, Matthias BUSSONNIER < bussonniermatthias at gmail.com> wrote: > Hi Satra. > > Happy new year also. > > > > > is there a way for nbviewer to be augmented to accept shared links from > dropbox of the follow form (note the ?dl=1 at the end). > > https://dl.dropbox.com/s/xttkmuvu7hh72vu/MyFile.pdf?dl=1 > > Yes, it would be doable. > With the current state of nbviewer it would be a little complicated I > would prefer to wait for a clean way of having special logic for different > website through regexp and configurability. > > But you are welcome to open a feature request on nbviewer issue page. > > As for the link you provided I have a 404. If it needs a authentication, > there is no way for nbviewer to access it (yet ?). > > Cheers > -- > Matthias > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130104/85164526/attachment.html> From brad.froehle at gmail.com Fri Jan 4 10:53:18 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Fri, 4 Jan 2013 07:53:18 -0800 Subject: [IPython-dev] nbviewer and dropbox In-Reply-To: <CA+A4wOn8VZtpOVTSDYpZ1czqY1aS3gLXPXZPbPqsVa+GfN9o5g@mail.gmail.com> References: <CA+A4wO=+bg2bYnG3ccGo+T6JEa2arOg_9f7ZCOHOFcJnAO7_nQ@mail.gmail.com> <9A836667-FFA5-42C7-AE5C-A2D37837828C@gmail.com> <CA+A4wOn8VZtpOVTSDYpZ1czqY1aS3gLXPXZPbPqsVa+GfN9o5g@mail.gmail.com> Message-ID: <51370C18962342F7B0FB377DB89DECF7@gmail.com> Hi satra: You should know that in this case the nbviewer works if you just remove the ?dl=1. See http://nbviewer.ipython.org/urls/dl.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb -Brad On Friday, January 4, 2013 at 5:16 AM, Satrajit Ghosh wrote: > hi matthias, > > here is a more appropriate link. that one was just an example from dropbox. > > https://www.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb?dl=1 > > cheers, > > satra > > On Fri, Jan 4, 2013 at 6:59 AM, Matthias BUSSONNIER <bussonniermatthias at gmail.com (mailto:bussonniermatthias at gmail.com)> wrote: > > Hi Satra. > > > > Happy new year also. > > > > > > > > is there a way for nbviewer to be augmented to accept shared links from dropbox of the follow form (note the ?dl=1 at the end). > > > https://dl.dropbox.com/s/xttkmuvu7hh72vu/MyFile.pdf?dl=1 > > > > > > Yes, it would be doable. > > With the current state of nbviewer it would be a little complicated I would prefer to wait for a clean way of having special logic for different > > website through regexp and configurability. > > > > But you are welcome to open a feature request on nbviewer issue page. > > > > As for the link you provided I have a 404. If it needs a authentication, there is no way for nbviewer to access it (yet ?). > > > > Cheers > > -- > > Matthias > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > http://mail.scipy.org/mailman/listinfo/ipython-dev From brad.froehle at gmail.com Fri Jan 4 10:55:51 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Fri, 4 Jan 2013 07:55:51 -0800 Subject: [IPython-dev] nbviewer and dropbox In-Reply-To: <51370C18962342F7B0FB377DB89DECF7@gmail.com> References: <CA+A4wO=+bg2bYnG3ccGo+T6JEa2arOg_9f7ZCOHOFcJnAO7_nQ@mail.gmail.com> <9A836667-FFA5-42C7-AE5C-A2D37837828C@gmail.com> <CA+A4wOn8VZtpOVTSDYpZ1czqY1aS3gLXPXZPbPqsVa+GfN9o5g@mail.gmail.com> <51370C18962342F7B0FB377DB89DECF7@gmail.com> Message-ID: <0A5F021635C24F4D8BD7BAD5E0219C0B@gmail.com> Also you can get the behavior your are looking for by encoding the url: http://nbviewer.ipython.org/urls/dl.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb%3Fdl%3D1 So there does seems to be a bug here in that we aren't url encoding the query string for urls entered on the main nbviewer page. -Brad On Friday, January 4, 2013 at 7:53 AM, Bradley M. Froehle wrote: > Hi satra: > > You should know that in this case the nbviewer works if you just remove the ?dl=1. See > http://nbviewer.ipython.org/urls/dl.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb > > -Brad > > > On Friday, January 4, 2013 at 5:16 AM, Satrajit Ghosh wrote: > > > hi matthias, > > > > here is a more appropriate link. that one was just an example from dropbox. > > > > https://www.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb?dl=1 > > > > cheers, > > > > satra > > > > On Fri, Jan 4, 2013 at 6:59 AM, Matthias BUSSONNIER <bussonniermatthias at gmail.com (mailto:bussonniermatthias at gmail.com)> wrote: > > > Hi Satra. > > > > > > Happy new year also. > > > > > > > > > > > is there a way for nbviewer to be augmented to accept shared links from dropbox of the follow form (note the ?dl=1 at the end). > > > > https://dl.dropbox.com/s/xttkmuvu7hh72vu/MyFile.pdf?dl=1 > > > > > > > > > > > > > > > Yes, it would be doable. > > > With the current state of nbviewer it would be a little complicated I would prefer to wait for a clean way of having special logic for different > > > website through regexp and configurability. > > > > > > But you are welcome to open a feature request on nbviewer issue page. > > > > > > As for the link you provided I have a 404. If it needs a authentication, there is no way for nbviewer to access it (yet ?). > > > > > > Cheers > > > -- > > > Matthias > > > _______________________________________________ > > > IPython-dev mailing list > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > http://mail.scipy.org/mailman/listinfo/ipython-dev > From satra at mit.edu Fri Jan 4 11:51:31 2013 From: satra at mit.edu (Satrajit Ghosh) Date: Fri, 4 Jan 2013 11:51:31 -0500 Subject: [IPython-dev] nbviewer and dropbox In-Reply-To: <51370C18962342F7B0FB377DB89DECF7@gmail.com> References: <CA+A4wO=+bg2bYnG3ccGo+T6JEa2arOg_9f7ZCOHOFcJnAO7_nQ@mail.gmail.com> <9A836667-FFA5-42C7-AE5C-A2D37837828C@gmail.com> <CA+A4wOn8VZtpOVTSDYpZ1czqY1aS3gLXPXZPbPqsVa+GfN9o5g@mail.gmail.com> <51370C18962342F7B0FB377DB89DECF7@gmail.com> Message-ID: <CA+A4wO=Kvuc9ydO1_n+5u4NfesBBucoicw28ojCt0KxFqM662Q@mail.gmail.com> thanks brad. i could have sworn that this didn't work yesterday. a colleague and i even had a gchat about dropbox share links and nbviewer. but if it works without the dl even better! cheers, satra On Fri, Jan 4, 2013 at 10:53 AM, Bradley M. Froehle <brad.froehle at gmail.com>wrote: > Hi satra: > > You should know that in this case the nbviewer works if you just remove > the ?dl=1. See > > http://nbviewer.ipython.org/urls/dl.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb > > -Brad > > > On Friday, January 4, 2013 at 5:16 AM, Satrajit Ghosh wrote: > > > hi matthias, > > > > here is a more appropriate link. that one was just an example from > dropbox. > > > > https://www.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb?dl=1 > > > > cheers, > > > > satra > > > > On Fri, Jan 4, 2013 at 6:59 AM, Matthias BUSSONNIER < > bussonniermatthias at gmail.com (mailto:bussonniermatthias at gmail.com)> wrote: > > > Hi Satra. > > > > > > Happy new year also. > > > > > > > > > > > is there a way for nbviewer to be augmented to accept shared links > from dropbox of the follow form (note the ?dl=1 at the end). > > > > https://dl.dropbox.com/s/xttkmuvu7hh72vu/MyFile.pdf?dl=1 > > > > > > > > > Yes, it would be doable. > > > With the current state of nbviewer it would be a little complicated I > would prefer to wait for a clean way of having special logic for different > > > website through regexp and configurability. > > > > > > But you are welcome to open a feature request on nbviewer issue page. > > > > > > As for the link you provided I have a 404. If it needs a > authentication, there is no way for nbviewer to access it (yet ?). > > > > > > Cheers > > > -- > > > Matthias > > > _______________________________________________ > > > IPython-dev mailing list > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130104/aa04497a/attachment.html> From satra at mit.edu Fri Jan 4 12:27:46 2013 From: satra at mit.edu (Satrajit Ghosh) Date: Fri, 4 Jan 2013 12:27:46 -0500 Subject: [IPython-dev] nbviewer and dropbox In-Reply-To: <CA+A4wO=Kvuc9ydO1_n+5u4NfesBBucoicw28ojCt0KxFqM662Q@mail.gmail.com> References: <CA+A4wO=+bg2bYnG3ccGo+T6JEa2arOg_9f7ZCOHOFcJnAO7_nQ@mail.gmail.com> <9A836667-FFA5-42C7-AE5C-A2D37837828C@gmail.com> <CA+A4wOn8VZtpOVTSDYpZ1czqY1aS3gLXPXZPbPqsVa+GfN9o5g@mail.gmail.com> <51370C18962342F7B0FB377DB89DECF7@gmail.com> <CA+A4wO=Kvuc9ydO1_n+5u4NfesBBucoicw28ojCt0KxFqM662Q@mail.gmail.com> Message-ID: <CA+A4wOkUgzatRwh53=0qXF1gDmvhwif6DH8QQtyvS9-dqbKDZw@mail.gmail.com> hi brad, i see the slight difference. it changed from: www.dropbox.com to dl.dropbox.com thanks for that. cheers, satra On Fri, Jan 4, 2013 at 11:51 AM, Satrajit Ghosh <satra at mit.edu> wrote: > thanks brad. > > i could have sworn that this didn't work yesterday. a colleague and i even > had a gchat about dropbox share links and nbviewer. > > but if it works without the dl even better! > > cheers, > > satra > > On Fri, Jan 4, 2013 at 10:53 AM, Bradley M. Froehle < > brad.froehle at gmail.com> wrote: > >> Hi satra: >> >> You should know that in this case the nbviewer works if you just remove >> the ?dl=1. See >> >> http://nbviewer.ipython.org/urls/dl.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb >> >> -Brad >> >> >> On Friday, January 4, 2013 at 5:16 AM, Satrajit Ghosh wrote: >> >> > hi matthias, >> > >> > here is a more appropriate link. that one was just an example from >> dropbox. >> > >> > https://www.dropbox.com/s/6jdpfaa4oek3v6u/testdwiconvert.ipynb?dl=1 >> > >> > cheers, >> > >> > satra >> > >> > On Fri, Jan 4, 2013 at 6:59 AM, Matthias BUSSONNIER < >> bussonniermatthias at gmail.com (mailto:bussonniermatthias at gmail.com)> >> wrote: >> > > Hi Satra. >> > > >> > > Happy new year also. >> > > >> > > > >> > > > is there a way for nbviewer to be augmented to accept shared links >> from dropbox of the follow form (note the ?dl=1 at the end). >> > > > https://dl.dropbox.com/s/xttkmuvu7hh72vu/MyFile.pdf?dl=1 >> > > >> > > >> > > Yes, it would be doable. >> > > With the current state of nbviewer it would be a little complicated I >> would prefer to wait for a clean way of having special logic for different >> > > website through regexp and configurability. >> > > >> > > But you are welcome to open a feature request on nbviewer issue page. >> > > >> > > As for the link you provided I have a 404. If it needs a >> authentication, there is no way for nbviewer to access it (yet ?). >> > > >> > > Cheers >> > > -- >> > > Matthias >> > > _______________________________________________ >> > > IPython-dev mailing list >> > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) >> > > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130104/40bb7566/attachment.html> From martin.zmk at gmail.com Tue Jan 8 11:26:16 2013 From: martin.zmk at gmail.com (lecast) Date: Tue, 8 Jan 2013 08:26:16 -0800 (PST) Subject: [IPython-dev] D3js and IPython Message-ID: <1357662376790-5001661.post@n6.nabble.com> This is a new thread but it is born out and related to a previous discussion <http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237> . The goal there was to live update figures created with d3js in IPython Notebook. It was suggested that a solution would be to use widgets, which I have to admit I did not have time to understand so instead I decided to create something that produces the end product I was aiming at, i.e. take output from Python, use d3js to create a table/figure, use some blackbox, have the output visible in the notebook (or be able to save it elsewhere as svg/html/png/etc). You can find an example notebook with a lot of custom tables and some figures here <http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> . They are all created based on data from Python, rendered in PhantomJs (in that case I just copy the html, but PhantomJs allows for conversion to other formats), and then published in the notebook. I created it for myself, so there is hardly any commenting in the file (I know, bad), but I have been using it for a few months now and it works really well. D3js has some great modern visualizations coded in and it takes only a few days to learn the syntax by doing. Personally I think it would be really nice to make it into an extension/package, but I lack experience/time to do that. -- View this message in context: http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html Sent from the IPython - Development mailing list archive at Nabble.com. From ellisonbg at gmail.com Tue Jan 8 11:48:03 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Tue, 8 Jan 2013 08:48:03 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <1357662376790-5001661.post@n6.nabble.com> References: <1357662376790-5001661.post@n6.nabble.com> Message-ID: <CAH4pYpRXX2sYnncBrQ+oifLGQtNhZ6q8mTh=AGHG8wGvNbTAeg@mail.gmail.com> Hi, I saw this and it looks pretty cool. We definitely want to improve our d3 support. In the next few months we are going to be improving our architecture for javascript widgets to make these things possible. I would imagine that we will have some d3 examples that emerge out of that work. In the meantime, here is a branch with some early work in this area: https://github.com/ipython/ipython/pull/2518 Please have a look at this and give us feedback. Cheers, Brian On Tue, Jan 8, 2013 at 8:26 AM, lecast <martin.zmk at gmail.com> wrote: > This is a new thread but it is born out and related to a previous discussion > <http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237> > . The goal there was to live update figures created with d3js in IPython > Notebook. It was suggested that a solution would be to use widgets, which I > have to admit I did not have time to understand so instead I decided to > create something that produces the end product I was aiming at, i.e. take > output from Python, use d3js to create a table/figure, use some blackbox, > have the output visible in the notebook (or be able to save it elsewhere as > svg/html/png/etc). > > You can find an example notebook with a lot of custom tables and some > figures here <http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> . > They are all created based on data from Python, rendered in PhantomJs (in > that case I just copy the html, but PhantomJs allows for conversion to other > formats), and then published in the notebook. > > I created it for myself, so there is hardly any commenting in the file (I > know, bad), but I have been using it for a few months now and it works > really well. D3js has some great modern visualizations coded in and it takes > only a few days to learn the syntax by doing. > > Personally I think it would be really nice to make it into an > extension/package, but I lack experience/time to do that. > > > > -- > View this message in context: http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From jason-sage at creativetrax.com Tue Jan 8 14:14:28 2013 From: jason-sage at creativetrax.com (Jason Grout) Date: Tue, 08 Jan 2013 12:14:28 -0700 Subject: [IPython-dev] Joint Math Meetings Message-ID: <50EC7014.9070100@creativetrax.com> I'm curious: are any devs planning on being at the Joint math meetings [1] this week? Thanks, Jason [1] http://jointmathematicsmeetings.org/jmm From bussonniermatthias at gmail.com Tue Jan 8 14:28:22 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Tue, 8 Jan 2013 20:28:22 +0100 Subject: [IPython-dev] D3js and IPython In-Reply-To: <1357662376790-5001661.post@n6.nabble.com> References: <1357662376790-5001661.post@n6.nabble.com> Message-ID: <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> Hi ! It look really great : A few comment : Obstacle 1 def x(): from IPython.core.display import Javascript Javascript('alert("a")') x() you probably want to `return Javascript('alert("a")')` Am I wrong ? Obstacle 2: same : `return HTML()` I guess... Please, please, please don't inline script. We will in anyway prevent script in output so this will become useless anyway. Which will deprecate _js_repr_ (at least make it useless) but Brian Json-handler branch ill work much better to do what you want. Obstacle 3/Obstacle 4 Will be solve with brian Json Handler branch. You probably want to inject your own library in the notebook, which can be done via custom.js draft doc : http://elacave.lmdb.eu/~carreau/yui/classes/IPython.customjs.html use $.getScript(url) for example : $.getScript('d3.min.js') in you have d3.min.js in .ipython/profile_xxx/static/js/d3.min.js You might be interesting in http://epmoyer.github.com/ipy_table/ To join effort. Thanks. -- Matthias Le 8 janv. 2013 ? 17:26, lecast a ?crit : > This is a new thread but it is born out and related to a previous discussion > <http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237> > . The goal there was to live update figures created with d3js in IPython > Notebook. It was suggested that a solution would be to use widgets, which I > have to admit I did not have time to understand so instead I decided to > create something that produces the end product I was aiming at, i.e. take > output from Python, use d3js to create a table/figure, use some blackbox, > have the output visible in the notebook (or be able to save it elsewhere as > svg/html/png/etc). > > You can find an example notebook with a lot of custom tables and some > figures here <http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> . > They are all created based on data from Python, rendered in PhantomJs (in > that case I just copy the html, but PhantomJs allows for conversion to other > formats), and then published in the notebook. > > I created it for myself, so there is hardly any commenting in the file (I > know, bad), but I have been using it for a few months now and it works > really well. D3js has some great modern visualizations coded in and it takes > only a few days to learn the syntax by doing. > > Personally I think it would be really nice to make it into an > extension/package, but I lack experience/time to do that. > > > > -- > View this message in context: http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From fperez.net at gmail.com Tue Jan 8 14:46:24 2013 From: fperez.net at gmail.com (Fernando Perez) Date: Tue, 8 Jan 2013 11:46:24 -0800 Subject: [IPython-dev] Joint Math Meetings In-Reply-To: <50EC7014.9070100@creativetrax.com> References: <50EC7014.9070100@creativetrax.com> Message-ID: <CAHAreOpgpt4nAJ=qRTugwVubNYaiXcgcjaaf5h32Ja5fXrok0A@mail.gmail.com> Hi Jason, On Tue, Jan 8, 2013 at 11:14 AM, Jason Grout <jason-sage at creativetrax.com> wrote: > I'm curious: are any devs planning on being at the Joint math meetings > [1] this week? Not that I know of, but perhaps Brad (who's a mathematician) might be coming? Cheers, f From brad.froehle at gmail.com Tue Jan 8 14:53:49 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Tue, 8 Jan 2013 11:53:49 -0800 Subject: [IPython-dev] Joint Math Meetings In-Reply-To: <CAHAreOpgpt4nAJ=qRTugwVubNYaiXcgcjaaf5h32Ja5fXrok0A@mail.gmail.com> References: <50EC7014.9070100@creativetrax.com> <CAHAreOpgpt4nAJ=qRTugwVubNYaiXcgcjaaf5h32Ja5fXrok0A@mail.gmail.com> Message-ID: <CAHXv-MgC9ttY1b0EfJ7fmjdH7N2T+gqp2-1eeZCY3n1-F+Kf4A@mail.gmail.com> Nope, sorry! I've been in previous years, but will not be going this year. -Brad On Tue, Jan 8, 2013 at 11:46 AM, Fernando Perez <fperez.net at gmail.com>wrote: > Hi Jason, > > On Tue, Jan 8, 2013 at 11:14 AM, Jason Grout > <jason-sage at creativetrax.com> wrote: > > I'm curious: are any devs planning on being at the Joint math meetings > > [1] this week? > > Not that I know of, but perhaps Brad (who's a mathematician) might be > coming? > > Cheers, > > f > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130108/70f1d8df/attachment.html> From martin.zmk at gmail.com Tue Jan 8 16:11:29 2013 From: martin.zmk at gmail.com (lecast) Date: Tue, 8 Jan 2013 13:11:29 -0800 (PST) Subject: [IPython-dev] D3js and IPython In-Reply-To: <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> Message-ID: <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> Thx. I will have a look at both the repository and the pull. Returning Javascript() or HTML() is not exactly what I need. In general I always need to publish both html and javascript within a function so that function that would correspond to make_table() from ipy_table creates both the element and the script that populates that element. But this is mute here, since I couldn't find a way to copy final elements from the window and saving them in the notebook for good, the only thing that actually is saved is the final html object. I don't use inline JS anywhere there. But, if you prevent inline JS in output then you will also prevent a lot of interactivity on final output that e.g. d3 generates. I mean you need to be able to have things like onClick etc. But if you mean that you will prohibit me from saving javascript in any form in the notebook, then I will probably have to stop pulling the new versions... Right now I spend all my time in Notebook, i.e. I wrote a script that converts notebooks to latex and I just write my papers in Notebook. It is nice since I see my math instantly, but I need to be able to embed some javascript that appears only in those notebooks that are really papers, e.g. to replace references or make highlights ( http://i46.tinypic.com/163qyg.png ). Customjs is ok unless you send the notebook to someone and don't tell them they need to have it as well. I wanted something that produces output that is easily replicable. Z wyrazami szacunku, Marcin Zamojski On Tue, Jan 8, 2013 at 8:56 PM, Matthias Bussonnier [via Python] < ml-node+s6n5001692h82 at n6.nabble.com> wrote: > Hi ! > > It look really great : > > A few comment : > > Obstacle 1 > def x(): > from IPython.core.display import Javascript > Javascript('alert("a")') > x() > > you probably want to `return Javascript('alert("a")')` > Am I wrong ? > > > Obstacle 2: > same : `return HTML()` I guess... > > Please, please, please don't inline script. > We will in anyway prevent script in output so this will become useless > anyway. > Which will deprecate _js_repr_ (at least make it useless) but Brian > Json-handler branch > ill work much better to do what you want. > > Obstacle 3/Obstacle 4 > Will be solve with brian Json Handler branch. > > You probably want to inject your own library in the notebook, > which can be done via custom.js > > draft doc : > http://elacave.lmdb.eu/~carreau/yui/classes/IPython.customjs.html > use $.getScript(url) > for example : > $.getScript('d3.min.js') in you have d3.min.js in > .ipython/profile_xxx/static/js/d3.min.js > > You might be interesting in > http://epmoyer.github.com/ipy_table/ > > To join effort. > > Thanks. > -- > Matthias > > > > > Le 8 janv. 2013 ? 17:26, lecast a ?crit : > > > This is a new thread but it is born out and related to a previous > discussion > > < > http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237> > > > . The goal there was to live update figures created with d3js in IPython > > Notebook. It was suggested that a solution would be to use widgets, > which I > > have to admit I did not have time to understand so instead I decided to > > create something that produces the end product I was aiming at, i.e. > take > > output from Python, use d3js to create a table/figure, use some > blackbox, > > have the output visible in the notebook (or be able to save it elsewhere > as > > svg/html/png/etc). > > > > You can find an example notebook with a lot of custom tables and some > > figures here <http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> > . > > They are all created based on data from Python, rendered in PhantomJs > (in > > that case I just copy the html, but PhantomJs allows for conversion to > other > > formats), and then published in the notebook. > > > > I created it for myself, so there is hardly any commenting in the file > (I > > know, bad), but I have been using it for a few months now and it works > > really well. D3js has some great modern visualizations coded in and it > takes > > only a few days to learn the syntax by doing. > > > > Personally I think it would be really nice to make it into an > > extension/package, but I lack experience/time to do that. > > > > > > > > -- > > View this message in context: > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html > > Sent from the IPython - Development mailing list archive at Nabble.com. > > _______________________________________________ > > IPython-dev mailing list > > [hidden email] <http://user/SendEmail.jtp?type=node&node=5001692&i=0> > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > _______________________________________________ > IPython-dev mailing list > [hidden email] <http://user/SendEmail.jtp?type=node&node=5001692&i=1> > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001692.html > To unsubscribe from D3js and IPython, click here<http://python.6.n6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=5001661&code=bWFydGluLnpta0BnbWFpbC5jb218NTAwMTY2MXw2OTczNzc0NDY=> > . > NAML<http://python.6.n6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001704.html Sent from the IPython - Development mailing list archive at Nabble.com. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130108/c2c39a33/attachment.html> From bussonniermatthias at gmail.com Tue Jan 8 17:01:25 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Tue, 8 Jan 2013 23:01:25 +0100 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> Message-ID: <2AABBE3D-24AC-4EA0-A443-598616F72D69@gmail.com> Le 8 janv. 2013 ? 22:11, lecast a ?crit : > Thx. I will have a look at both the repository and the pull. > > Returning Javascript() or HTML() is not exactly what I need. In general I always need to publish both html and javascript within a function so that function that would correspond to make_table() from ipy_table creates both the element and the script that populates that element. Doesn't Javascript have an option to also pass css/html/libraries ? > But this is mute here, since I couldn't find a way to copy final elements from the window and saving them in the notebook for good, the only thing that actually is saved is the final html object. > I don't use inline JS anywhere there. But, if you prevent inline JS in output then you will also prevent a lot of interactivity on final output that e.g. d3 generates. I mean you need to be able to have things like onClick etc. You can bind dynamically, but all script/onclick will probably be escaped. What will come is the ability to use js 'plugin' to which you can talk. you could send those 'plugin' data. This should be more than enough to do what you want. In your case that would be a plugin 'table' to which you send 'json' and that render the table. > But if you mean that you will prohibit me from saving javascript in any form in the notebook, then I will probably have to stop pulling the new versions... It will be saved, it will just not be runned by default. I would vote for a config flag to allow it, which would progressively be deprecated in a non official plugin. ANd probably a "This notebook contain Javascript, Run It" ? > Right now I spend all my time in Notebook, i.e. I wrote a script that converts notebooks to latex and I just write my papers in Notebook. Have you tried nbconvert ? there is an option for that, and we rally would like to push it forward and have testing and fixes. We want the ability in the notebook to have a 'download as PDF', so we would love your input on that. > It is nice since I see my math instantly, but I need to be able to embed some javascript that appears only in those notebooks that are really papers, e.g. to replace references or make highlights ( http://i46.tinypic.com/163qyg.png ). Oh ! This is a highly customized notebook, I would like to see the code that does it. It could become an extension and look definitively as things we want to do. > Customjs is ok unless you send the notebook to someone and don't tell them they need to have it as well. I wanted something that produces output that is easily replicable. Yes I do understand, but right now I can send you a notebook that does in js : IPython.kernel.execute('rm -rf ~/') You probably don't wan't that, and there are other security issues in js. Also in the end, we could 'detect' that some cell have data that needs some plugin and in place of that show "you need FOO-Plugin, install ?" I was skeptical in deprecating publishing JS, but after seen Brian D3 js demo and some though I do think it is the way to go. I really hope we can find a way to solve all those things, and feedback like that where you have a real use case of great things you want to to will be **really** helpfull in designing what have to be done. -- Matthias > > Z wyrazami szacunku, > Marcin Zamojski > > > On Tue, Jan 8, 2013 at 8:56 PM, Matthias Bussonnier [via Python] <[hidden email]> wrote: > Hi ! > > It look really great : > > A few comment : > > Obstacle 1 > def x(): > from IPython.core.display import Javascript > Javascript('alert("a")') > x() > > you probably want to `return Javascript('alert("a")')` > Am I wrong ? > > > Obstacle 2: > same : `return HTML()` I guess... > > Please, please, please don't inline script. > We will in anyway prevent script in output so this will become useless anyway. > Which will deprecate _js_repr_ (at least make it useless) but Brian Json-handler branch > ill work much better to do what you want. > > Obstacle 3/Obstacle 4 > Will be solve with brian Json Handler branch. > > You probably want to inject your own library in the notebook, > which can be done via custom.js > > draft doc : http://elacave.lmdb.eu/~carreau/yui/classes/IPython.customjs.html > use $.getScript(url) > for example : > $.getScript('d3.min.js') in you have d3.min.js in .ipython/profile_xxx/static/js/d3.min.js > > You might be interesting in > http://epmoyer.github.com/ipy_table/ > > To join effort. > > Thanks. > -- > Matthias > > > > > Le 8 janv. 2013 ? 17:26, lecast a ?crit : > > > This is a new thread but it is born out and related to a previous discussion > > <http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237> > > . The goal there was to live update figures created with d3js in IPython > > Notebook. It was suggested that a solution would be to use widgets, which I > > have to admit I did not have time to understand so instead I decided to > > create something that produces the end product I was aiming at, i.e. take > > output from Python, use d3js to create a table/figure, use some blackbox, > > have the output visible in the notebook (or be able to save it elsewhere as > > svg/html/png/etc). > > > > You can find an example notebook with a lot of custom tables and some > > figures here <http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> . > > They are all created based on data from Python, rendered in PhantomJs (in > > that case I just copy the html, but PhantomJs allows for conversion to other > > formats), and then published in the notebook. > > > > I created it for myself, so there is hardly any commenting in the file (I > > know, bad), but I have been using it for a few months now and it works > > really well. D3js has some great modern visualizations coded in and it takes > > only a few days to learn the syntax by doing. > > > > Personally I think it would be really nice to make it into an > > extension/package, but I lack experience/time to do that. > > > > > > > > -- > > View this message in context: http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html > > Sent from the IPython - Development mailing list archive at Nabble.com. > > _______________________________________________ > > IPython-dev mailing list > > [hidden email] > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > _______________________________________________ > IPython-dev mailing list > [hidden email] > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > If you reply to this email, your message will be added to the discussion below: > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001692.html > To unsubscribe from D3js and IPython, click here. > NAML > > > View this message in context: Re: D3js and IPython > Sent from the IPython - Development mailing list archive at Nabble.com. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From ellisonbg at gmail.com Tue Jan 8 17:04:31 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Tue, 8 Jan 2013 14:04:31 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> Message-ID: <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> Using the JS Plugins branch, you can use the following model: * Write a JS plugin that has all of the javascript code you need - you can do whatever you want. * That Js plugin will declare a handler for a particular type of data. * You can then publish JSON data to that handler using appropriate Python calls. You shouldn't ever need to use the existing Javascript object to write your JS code. Cheers, Brian On Tue, Jan 8, 2013 at 1:11 PM, lecast <martin.zmk at gmail.com> wrote: > Thx. I will have a look at both the repository and the pull. > > Returning Javascript() or HTML() is not exactly what I need. In general I > always need to publish both html and javascript within a function so that > function that would correspond to make_table() from ipy_table creates both > the element and the script that populates that element. But this is mute > here, since I couldn't find a way to copy final elements from the window and > saving them in the notebook for good, the only thing that actually is saved > is the final html object. > > I don't use inline JS anywhere there. But, if you prevent inline JS in > output then you will also prevent a lot of interactivity on final output > that e.g. d3 generates. I mean you need to be able to have things like > onClick etc. But if you mean that you will prohibit me from saving > javascript in any form in the notebook, then I will probably have to stop > pulling the new versions... Right now I spend all my time in Notebook, i.e. > I wrote a script that converts notebooks to latex and I just write my papers > in Notebook. It is nice since I see my math instantly, but I need to be able > to embed some javascript that appears only in those notebooks that are > really papers, e.g. to replace references or make highlights ( > http://i46.tinypic.com/163qyg.png ). > > Customjs is ok unless you send the notebook to someone and don't tell them > they need to have it as well. I wanted something that produces output that > is easily replicable. > > > > Z wyrazami szacunku, > Marcin Zamojski > > > On Tue, Jan 8, 2013 at 8:56 PM, Matthias Bussonnier [via Python] <[hidden > email]> wrote: >> >> Hi ! >> >> It look really great : >> >> A few comment : >> >> Obstacle 1 >> def x(): >> from IPython.core.display import Javascript >> Javascript('alert("a")') >> x() >> >> you probably want to `return Javascript('alert("a")')` >> Am I wrong ? >> >> >> Obstacle 2: >> same : `return HTML()` I guess... >> >> Please, please, please don't inline script. >> We will in anyway prevent script in output so this will become useless >> anyway. >> Which will deprecate _js_repr_ (at least make it useless) but Brian >> Json-handler branch >> ill work much better to do what you want. >> >> Obstacle 3/Obstacle 4 >> Will be solve with brian Json Handler branch. >> >> You probably want to inject your own library in the notebook, >> which can be done via custom.js >> >> draft doc : >> http://elacave.lmdb.eu/~carreau/yui/classes/IPython.customjs.html >> use $.getScript(url) >> for example : >> $.getScript('d3.min.js') in you have d3.min.js in >> .ipython/profile_xxx/static/js/d3.min.js >> >> You might be interesting in >> http://epmoyer.github.com/ipy_table/ >> >> To join effort. >> >> Thanks. >> -- >> Matthias >> >> >> >> >> Le 8 janv. 2013 ? 17:26, lecast a ?crit : >> >> > This is a new thread but it is born out and related to a previous >> > discussion >> > >> > <http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237> >> > . The goal there was to live update figures created with d3js in IPython >> > Notebook. It was suggested that a solution would be to use widgets, >> > which I >> > have to admit I did not have time to understand so instead I decided to >> > create something that produces the end product I was aiming at, i.e. >> > take >> > output from Python, use d3js to create a table/figure, use some >> > blackbox, >> > have the output visible in the notebook (or be able to save it elsewhere >> > as >> > svg/html/png/etc). >> > >> > You can find an example notebook with a lot of custom tables and some >> > figures here <http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> . >> > They are all created based on data from Python, rendered in PhantomJs >> > (in >> > that case I just copy the html, but PhantomJs allows for conversion to >> > other >> > formats), and then published in the notebook. >> > >> > I created it for myself, so there is hardly any commenting in the file >> > (I >> > know, bad), but I have been using it for a few months now and it works >> > really well. D3js has some great modern visualizations coded in and it >> > takes >> > only a few days to learn the syntax by doing. >> > >> > Personally I think it would be really nice to make it into an >> > extension/package, but I lack experience/time to do that. >> > >> > >> > >> > -- >> > View this message in context: >> > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html >> > Sent from the IPython - Development mailing list archive at Nabble.com. >> > _______________________________________________ >> > IPython-dev mailing list >> > [hidden email] >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> _______________________________________________ >> IPython-dev mailing list >> [hidden email] >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> ________________________________ >> If you reply to this email, your message will be added to the discussion >> below: >> http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001692.html >> To unsubscribe from D3js and IPython, click here. >> NAML > > > > ________________________________ > View this message in context: Re: D3js and IPython > > Sent from the IPython - Development mailing list archive at Nabble.com. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From benjaminrk at gmail.com Tue Jan 8 17:09:30 2013 From: benjaminrk at gmail.com (MinRK) Date: Tue, 8 Jan 2013 14:09:30 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> Message-ID: <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> On Tue, Jan 8, 2013 at 2:04 PM, Brian Granger <ellisonbg at gmail.com> wrote: > Using the JS Plugins branch, you can use the following model: > > * Write a JS plugin that has all of the javascript code you need - you > can do whatever you want. > * That Js plugin will declare a handler for a particular type of data. > * You can then publish JSON data to that handler using appropriate Python > calls. > > You shouldn't ever need to use the existing Javascript object to write > your JS code. > I don't think doing away with inline js is remotely feasible. For security reasons, we have to make decisions like: on load, do not run raw js, because it could do terrible things without the user being aware. But removing the general ability to run js without installing new files on the nb *server* cannot possibly be the long-term solution. > > Cheers, > > Brian > > > On Tue, Jan 8, 2013 at 1:11 PM, lecast <martin.zmk at gmail.com> wrote: > > Thx. I will have a look at both the repository and the pull. > > > > Returning Javascript() or HTML() is not exactly what I need. In general I > > always need to publish both html and javascript within a function so > that > > function that would correspond to make_table() from ipy_table creates > both > > the element and the script that populates that element. But this is mute > > here, since I couldn't find a way to copy final elements from the window > and > > saving them in the notebook for good, the only thing that actually is > saved > > is the final html object. > > > > I don't use inline JS anywhere there. But, if you prevent inline JS in > > output then you will also prevent a lot of interactivity on final output > > that e.g. d3 generates. I mean you need to be able to have things like > > onClick etc. But if you mean that you will prohibit me from saving > > javascript in any form in the notebook, then I will probably have to stop > > pulling the new versions... Right now I spend all my time in Notebook, > i.e. > > I wrote a script that converts notebooks to latex and I just write my > papers > > in Notebook. It is nice since I see my math instantly, but I need to be > able > > to embed some javascript that appears only in those notebooks that are > > really papers, e.g. to replace references or make highlights ( > > http://i46.tinypic.com/163qyg.png ). > > > > Customjs is ok unless you send the notebook to someone and don't tell > them > > they need to have it as well. I wanted something that produces output > that > > is easily replicable. > > > > > > > > Z wyrazami szacunku, > > Marcin Zamojski > > > > > > On Tue, Jan 8, 2013 at 8:56 PM, Matthias Bussonnier [via Python] <[hidden > > email]> wrote: > >> > >> Hi ! > >> > >> It look really great : > >> > >> A few comment : > >> > >> Obstacle 1 > >> def x(): > >> from IPython.core.display import Javascript > >> Javascript('alert("a")') > >> x() > >> > >> you probably want to `return Javascript('alert("a")')` > >> Am I wrong ? > >> > >> > >> Obstacle 2: > >> same : `return HTML()` I guess... > >> > >> Please, please, please don't inline script. > >> We will in anyway prevent script in output so this will become useless > >> anyway. > >> Which will deprecate _js_repr_ (at least make it useless) but Brian > >> Json-handler branch > >> ill work much better to do what you want. > >> > >> Obstacle 3/Obstacle 4 > >> Will be solve with brian Json Handler branch. > >> > >> You probably want to inject your own library in the notebook, > >> which can be done via custom.js > >> > >> draft doc : > >> http://elacave.lmdb.eu/~carreau/yui/classes/IPython.customjs.html > >> use $.getScript(url) > >> for example : > >> $.getScript('d3.min.js') in you have d3.min.js in > >> .ipython/profile_xxx/static/js/d3.min.js > >> > >> You might be interesting in > >> http://epmoyer.github.com/ipy_table/ > >> > >> To join effort. > >> > >> Thanks. > >> -- > >> Matthias > >> > >> > >> > >> > >> Le 8 janv. 2013 ? 17:26, lecast a ?crit : > >> > >> > This is a new thread but it is born out and related to a previous > >> > discussion > >> > > >> > < > http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237 > > > >> > . The goal there was to live update figures created with d3js in > IPython > >> > Notebook. It was suggested that a solution would be to use widgets, > >> > which I > >> > have to admit I did not have time to understand so instead I decided > to > >> > create something that produces the end product I was aiming at, i.e. > >> > take > >> > output from Python, use d3js to create a table/figure, use some > >> > blackbox, > >> > have the output visible in the notebook (or be able to save it > elsewhere > >> > as > >> > svg/html/png/etc). > >> > > >> > You can find an example notebook with a lot of custom tables and some > >> > figures here <http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> > . > >> > They are all created based on data from Python, rendered in PhantomJs > >> > (in > >> > that case I just copy the html, but PhantomJs allows for conversion to > >> > other > >> > formats), and then published in the notebook. > >> > > >> > I created it for myself, so there is hardly any commenting in the file > >> > (I > >> > know, bad), but I have been using it for a few months now and it works > >> > really well. D3js has some great modern visualizations coded in and it > >> > takes > >> > only a few days to learn the syntax by doing. > >> > > >> > Personally I think it would be really nice to make it into an > >> > extension/package, but I lack experience/time to do that. > >> > > >> > > >> > > >> > -- > >> > View this message in context: > >> > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html > >> > Sent from the IPython - Development mailing list archive at > Nabble.com. > >> > _______________________________________________ > >> > IPython-dev mailing list > >> > [hidden email] > >> > http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > >> _______________________________________________ > >> IPython-dev mailing list > >> [hidden email] > >> http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > >> > >> ________________________________ > >> If you reply to this email, your message will be added to the discussion > >> below: > >> http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001692.html > >> To unsubscribe from D3js and IPython, click here. > >> NAML > > > > > > > > ________________________________ > > View this message in context: Re: D3js and IPython > > > > Sent from the IPython - Development mailing list archive at Nabble.com. > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130108/36731167/attachment.html> From ellisonbg at gmail.com Tue Jan 8 19:18:07 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Tue, 8 Jan 2013 16:18:07 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> Message-ID: <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> On Tue, Jan 8, 2013 at 2:09 PM, MinRK <benjaminrk at gmail.com> wrote: > > > On Tue, Jan 8, 2013 at 2:04 PM, Brian Granger <ellisonbg at gmail.com> wrote: >> >> Using the JS Plugins branch, you can use the following model: >> >> * Write a JS plugin that has all of the javascript code you need - you >> can do whatever you want. >> * That Js plugin will declare a handler for a particular type of data. >> * You can then publish JSON data to that handler using appropriate Python >> calls. >> >> You shouldn't ever need to use the existing Javascript object to write >> your JS code. > > > I don't think doing away with inline js is remotely feasible. > For security reasons, we have to make decisions like: > > on load, do not run raw js, because it could do terrible things without the > user being aware. > > But removing the general ability to run js without installing new files on > the nb *server* cannot possibly be the long-term solution. Originally, I (obviously) thought this way. But, as I have learned more about the security vulnerabilities, I have become convinced that this is the long term solution. However, I am open to other solutions that 1) completely remove the security risks and 2) don't involve significant new complexities, such as requiring multiple domains and iframes. I should also note that I am open to the single user notebook preserving this capability - but I am a little hesitant to leave it enabled as it will encourage people to write Javascript code in this way. A separate issue is that actually writing Javascript code using the old Javascript object is horrifically painful. Errors get completely swallowed and it is nearly impossible to figure out what is going on. I think this is why very few people have actually done anything significant with the Javascript object we currently have - it just doesn't work very well. On the other hand, developing the JS plugins, gives the usual mostly pleasant development experience. Cheers, Brian >> >> >> Cheers, >> >> Brian >> >> >> On Tue, Jan 8, 2013 at 1:11 PM, lecast <martin.zmk at gmail.com> wrote: >> > Thx. I will have a look at both the repository and the pull. >> > >> > Returning Javascript() or HTML() is not exactly what I need. In general >> > I >> > always need to publish both html and javascript within a function so >> > that >> > function that would correspond to make_table() from ipy_table creates >> > both >> > the element and the script that populates that element. But this is mute >> > here, since I couldn't find a way to copy final elements from the window >> > and >> > saving them in the notebook for good, the only thing that actually is >> > saved >> > is the final html object. >> > >> > I don't use inline JS anywhere there. But, if you prevent inline JS in >> > output then you will also prevent a lot of interactivity on final output >> > that e.g. d3 generates. I mean you need to be able to have things like >> > onClick etc. But if you mean that you will prohibit me from saving >> > javascript in any form in the notebook, then I will probably have to >> > stop >> > pulling the new versions... Right now I spend all my time in Notebook, >> > i.e. >> > I wrote a script that converts notebooks to latex and I just write my >> > papers >> > in Notebook. It is nice since I see my math instantly, but I need to be >> > able >> > to embed some javascript that appears only in those notebooks that are >> > really papers, e.g. to replace references or make highlights ( >> > http://i46.tinypic.com/163qyg.png ). >> > >> > Customjs is ok unless you send the notebook to someone and don't tell >> > them >> > they need to have it as well. I wanted something that produces output >> > that >> > is easily replicable. >> > >> > >> > >> > Z wyrazami szacunku, >> > Marcin Zamojski >> > >> > >> > On Tue, Jan 8, 2013 at 8:56 PM, Matthias Bussonnier [via Python] >> > <[hidden >> > email]> wrote: >> >> >> >> Hi ! >> >> >> >> It look really great : >> >> >> >> A few comment : >> >> >> >> Obstacle 1 >> >> def x(): >> >> from IPython.core.display import Javascript >> >> Javascript('alert("a")') >> >> x() >> >> >> >> you probably want to `return Javascript('alert("a")')` >> >> Am I wrong ? >> >> >> >> >> >> Obstacle 2: >> >> same : `return HTML()` I guess... >> >> >> >> Please, please, please don't inline script. >> >> We will in anyway prevent script in output so this will become useless >> >> anyway. >> >> Which will deprecate _js_repr_ (at least make it useless) but Brian >> >> Json-handler branch >> >> ill work much better to do what you want. >> >> >> >> Obstacle 3/Obstacle 4 >> >> Will be solve with brian Json Handler branch. >> >> >> >> You probably want to inject your own library in the notebook, >> >> which can be done via custom.js >> >> >> >> draft doc : >> >> http://elacave.lmdb.eu/~carreau/yui/classes/IPython.customjs.html >> >> use $.getScript(url) >> >> for example : >> >> $.getScript('d3.min.js') in you have d3.min.js in >> >> .ipython/profile_xxx/static/js/d3.min.js >> >> >> >> You might be interesting in >> >> http://epmoyer.github.com/ipy_table/ >> >> >> >> To join effort. >> >> >> >> Thanks. >> >> -- >> >> Matthias >> >> >> >> >> >> >> >> >> >> Le 8 janv. 2013 ? 17:26, lecast a ?crit : >> >> >> >> > This is a new thread but it is born out and related to a previous >> >> > discussion >> >> > >> >> > >> >> > <http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237> >> >> > . The goal there was to live update figures created with d3js in >> >> > IPython >> >> > Notebook. It was suggested that a solution would be to use widgets, >> >> > which I >> >> > have to admit I did not have time to understand so instead I decided >> >> > to >> >> > create something that produces the end product I was aiming at, i.e. >> >> > take >> >> > output from Python, use d3js to create a table/figure, use some >> >> > blackbox, >> >> > have the output visible in the notebook (or be able to save it >> >> > elsewhere >> >> > as >> >> > svg/html/png/etc). >> >> > >> >> > You can find an example notebook with a lot of custom tables and some >> >> > figures here <http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> >> >> > . >> >> > They are all created based on data from Python, rendered in PhantomJs >> >> > (in >> >> > that case I just copy the html, but PhantomJs allows for conversion >> >> > to >> >> > other >> >> > formats), and then published in the notebook. >> >> > >> >> > I created it for myself, so there is hardly any commenting in the >> >> > file >> >> > (I >> >> > know, bad), but I have been using it for a few months now and it >> >> > works >> >> > really well. D3js has some great modern visualizations coded in and >> >> > it >> >> > takes >> >> > only a few days to learn the syntax by doing. >> >> > >> >> > Personally I think it would be really nice to make it into an >> >> > extension/package, but I lack experience/time to do that. >> >> > >> >> > >> >> > >> >> > -- >> >> > View this message in context: >> >> > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html >> >> > Sent from the IPython - Development mailing list archive at >> >> > Nabble.com. >> >> > _______________________________________________ >> >> > IPython-dev mailing list >> >> > [hidden email] >> >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> _______________________________________________ >> >> IPython-dev mailing list >> >> [hidden email] >> >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> >> >> ________________________________ >> >> If you reply to this email, your message will be added to the >> >> discussion >> >> below: >> >> http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001692.html >> >> To unsubscribe from D3js and IPython, click here. >> >> NAML >> > >> > >> > >> > ________________________________ >> > View this message in context: Re: D3js and IPython >> > >> > Sent from the IPython - Development mailing list archive at Nabble.com. >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From damianavila at gmail.com Tue Jan 8 19:35:18 2013 From: damianavila at gmail.com (=?ISO-8859-1?Q?Dami=E1n_Avila?=) Date: Tue, 8 Jan 2013 21:35:18 -0300 Subject: [IPython-dev] nbviewer enhancement: pad In-Reply-To: <CAH+mRR3FTJjKoXYUFxGHUQH2Nb4ZvoAbcbzKmphojd05zjBr4g@mail.gmail.com> References: <CAH+mRR01hoK77CFDLEsVagBYaxBCvtTZE2VQF0Bzb+SVEu148g@mail.gmail.com> <CAH+mRR3-9dmOUr-ZBMtkeg0r0L0UUvNCm5x2q+X9og3cSQscCw@mail.gmail.com> <CAH+mRR3FTJjKoXYUFxGHUQH2Nb4ZvoAbcbzKmphojd05zjBr4g@mail.gmail.com> Message-ID: <CAH+mRR3jtixUhK9W77ESytG9AbZeE-caDPQFAVAiOuSKGvzvvA@mail.gmail.com> I wanted to discuss about some notebook, I wanted some kind of collaboration... So... check this out and let me know what do you think: http://nbviewerpad.herokuapp.com/urls/raw.github.com/ipython/ipython/master/docs/examples/notebooks/00_notebook_tour.ipynb Dami?n. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130108/a68fc57a/attachment.html> From benjaminrk at gmail.com Tue Jan 8 19:45:47 2013 From: benjaminrk at gmail.com (MinRK) Date: Tue, 8 Jan 2013 16:45:47 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> Message-ID: <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> On Tue, Jan 8, 2013 at 4:18 PM, Brian Granger <ellisonbg at gmail.com> wrote: > On Tue, Jan 8, 2013 at 2:09 PM, MinRK <benjaminrk at gmail.com> wrote: > > > > > > On Tue, Jan 8, 2013 at 2:04 PM, Brian Granger <ellisonbg at gmail.com> > wrote: > >> > >> Using the JS Plugins branch, you can use the following model: > >> > >> * Write a JS plugin that has all of the javascript code you need - you > >> can do whatever you want. > >> * That Js plugin will declare a handler for a particular type of data. > >> * You can then publish JSON data to that handler using appropriate > Python > >> calls. > >> > >> You shouldn't ever need to use the existing Javascript object to write > >> your JS code. > > > > > > I don't think doing away with inline js is remotely feasible. > > For security reasons, we have to make decisions like: > > > > on load, do not run raw js, because it could do terrible things without > the > > user being aware. > > > > But removing the general ability to run js without installing new files > on > > the nb *server* cannot possibly be the long-term solution. > > Originally, I (obviously) thought this way. But, as I have learned > more about the security vulnerabilities, I have become convinced that > this is the long term solution. However, I am open to other solutions > that 1) completely remove the security risks and 2) don't involve > significant new complexities, such as requiring multiple domains and > iframes. I should also note that I am open to the single user > notebook preserving this capability - but I am a little hesitant to > leave it enabled as it will encourage people to write Javascript code > in this way. > I do appreciate the concern, and we need a solution to the issue. I just don't think we have a complete one yet. Right now, we have a supremely flexible (and thus insecure) situation, whereas jsplugins-only is secure, but not remotely flexible from a user's perspective. This is an extremely serious incapacitation of the notebook. The trouble is that jsplugins is a relatively tolerable substitue for the single-user notebook, but where the problem is worst is when users don't actually have access to the server to install jsplugins. So it's precisely the case where we would not allow custom js that jsplugins fail most dramatically as a substitute. Is it really our intention to require *server* installation of a plugin for a user to gain access to a new widget? That seems to eliminate a *huge* portion of exactly what makes the notebook interesting. If we have a way that js plugins can be loaded at runtime by the user without access to the server (presumably with a 'do you trust this guy?' confirmation), then that would go a long way toward preventing the total castration of the notebook. > > A separate issue is that actually writing Javascript code using the > old Javascript object is horrifically painful. Errors get completely > swallowed and it is nearly impossible to figure out what is going on. > I think this is why very few people have actually done anything > significant with the Javascript object we currently have - it just > doesn't work very well. On the other hand, developing the JS plugins, > gives the usual mostly pleasant development experience. > This isn't entirely accurate, as errors in js do show up in the notebook. Just try %%javascript a = doesnt_exist But I do appreciate the pain - I've taken to writing new inline js code in .js files locally, just so my editor can help me out, which is similar in practice to jsplugins and definitely an improvement over typing js in Python strings. > Cheers, > > Brian > > >> > >> > >> Cheers, > >> > >> Brian > >> > >> > >> On Tue, Jan 8, 2013 at 1:11 PM, lecast <martin.zmk at gmail.com> wrote: > >> > Thx. I will have a look at both the repository and the pull. > >> > > >> > Returning Javascript() or HTML() is not exactly what I need. In > general > >> > I > >> > always need to publish both html and javascript within a function so > >> > that > >> > function that would correspond to make_table() from ipy_table creates > >> > both > >> > the element and the script that populates that element. But this is > mute > >> > here, since I couldn't find a way to copy final elements from the > window > >> > and > >> > saving them in the notebook for good, the only thing that actually is > >> > saved > >> > is the final html object. > >> > > >> > I don't use inline JS anywhere there. But, if you prevent inline JS in > >> > output then you will also prevent a lot of interactivity on final > output > >> > that e.g. d3 generates. I mean you need to be able to have things like > >> > onClick etc. But if you mean that you will prohibit me from saving > >> > javascript in any form in the notebook, then I will probably have to > >> > stop > >> > pulling the new versions... Right now I spend all my time in Notebook, > >> > i.e. > >> > I wrote a script that converts notebooks to latex and I just write my > >> > papers > >> > in Notebook. It is nice since I see my math instantly, but I need to > be > >> > able > >> > to embed some javascript that appears only in those notebooks that are > >> > really papers, e.g. to replace references or make highlights ( > >> > http://i46.tinypic.com/163qyg.png ). > >> > > >> > Customjs is ok unless you send the notebook to someone and don't tell > >> > them > >> > they need to have it as well. I wanted something that produces output > >> > that > >> > is easily replicable. > >> > > >> > > >> > > >> > Z wyrazami szacunku, > >> > Marcin Zamojski > >> > > >> > > >> > On Tue, Jan 8, 2013 at 8:56 PM, Matthias Bussonnier [via Python] > >> > <[hidden > >> > email]> wrote: > >> >> > >> >> Hi ! > >> >> > >> >> It look really great : > >> >> > >> >> A few comment : > >> >> > >> >> Obstacle 1 > >> >> def x(): > >> >> from IPython.core.display import Javascript > >> >> Javascript('alert("a")') > >> >> x() > >> >> > >> >> you probably want to `return Javascript('alert("a")')` > >> >> Am I wrong ? > >> >> > >> >> > >> >> Obstacle 2: > >> >> same : `return HTML()` I guess... > >> >> > >> >> Please, please, please don't inline script. > >> >> We will in anyway prevent script in output so this will become > useless > >> >> anyway. > >> >> Which will deprecate _js_repr_ (at least make it useless) but Brian > >> >> Json-handler branch > >> >> ill work much better to do what you want. > >> >> > >> >> Obstacle 3/Obstacle 4 > >> >> Will be solve with brian Json Handler branch. > >> >> > >> >> You probably want to inject your own library in the notebook, > >> >> which can be done via custom.js > >> >> > >> >> draft doc : > >> >> http://elacave.lmdb.eu/~carreau/yui/classes/IPython.customjs.html > >> >> use $.getScript(url) > >> >> for example : > >> >> $.getScript('d3.min.js') in you have d3.min.js in > >> >> .ipython/profile_xxx/static/js/d3.min.js > >> >> > >> >> You might be interesting in > >> >> http://epmoyer.github.com/ipy_table/ > >> >> > >> >> To join effort. > >> >> > >> >> Thanks. > >> >> -- > >> >> Matthias > >> >> > >> >> > >> >> > >> >> > >> >> Le 8 janv. 2013 ? 17:26, lecast a ?crit : > >> >> > >> >> > This is a new thread but it is born out and related to a previous > >> >> > discussion > >> >> > > >> >> > > >> >> > < > http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237 > > > >> >> > . The goal there was to live update figures created with d3js in > >> >> > IPython > >> >> > Notebook. It was suggested that a solution would be to use widgets, > >> >> > which I > >> >> > have to admit I did not have time to understand so instead I > decided > >> >> > to > >> >> > create something that produces the end product I was aiming at, > i.e. > >> >> > take > >> >> > output from Python, use d3js to create a table/figure, use some > >> >> > blackbox, > >> >> > have the output visible in the notebook (or be able to save it > >> >> > elsewhere > >> >> > as > >> >> > svg/html/png/etc). > >> >> > > >> >> > You can find an example notebook with a lot of custom tables and > some > >> >> > figures here < > http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> > >> >> > . > >> >> > They are all created based on data from Python, rendered in > PhantomJs > >> >> > (in > >> >> > that case I just copy the html, but PhantomJs allows for conversion > >> >> > to > >> >> > other > >> >> > formats), and then published in the notebook. > >> >> > > >> >> > I created it for myself, so there is hardly any commenting in the > >> >> > file > >> >> > (I > >> >> > know, bad), but I have been using it for a few months now and it > >> >> > works > >> >> > really well. D3js has some great modern visualizations coded in and > >> >> > it > >> >> > takes > >> >> > only a few days to learn the syntax by doing. > >> >> > > >> >> > Personally I think it would be really nice to make it into an > >> >> > extension/package, but I lack experience/time to do that. > >> >> > > >> >> > > >> >> > > >> >> > -- > >> >> > View this message in context: > >> >> > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html > >> >> > Sent from the IPython - Development mailing list archive at > >> >> > Nabble.com. > >> >> > _______________________________________________ > >> >> > IPython-dev mailing list > >> >> > [hidden email] > >> >> > http://mail.scipy.org/mailman/listinfo/ipython-dev > >> >> > >> >> _______________________________________________ > >> >> IPython-dev mailing list > >> >> [hidden email] > >> >> http://mail.scipy.org/mailman/listinfo/ipython-dev > >> >> > >> >> > >> >> ________________________________ > >> >> If you reply to this email, your message will be added to the > >> >> discussion > >> >> below: > >> >> > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001692.html > >> >> To unsubscribe from D3js and IPython, click here. > >> >> NAML > >> > > >> > > >> > > >> > ________________________________ > >> > View this message in context: Re: D3js and IPython > >> > > >> > Sent from the IPython - Development mailing list archive at > Nabble.com. > >> > > >> > _______________________________________________ > >> > IPython-dev mailing list > >> > IPython-dev at scipy.org > >> > http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > > >> > >> > >> > >> -- > >> Brian E. Granger > >> Cal Poly State University, San Luis Obispo > >> bgranger at calpoly.edu and ellisonbg at gmail.com > >> _______________________________________________ > >> IPython-dev mailing list > >> IPython-dev at scipy.org > >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130108/ec666aae/attachment.html> From satshabad.music at gmail.com Tue Jan 8 23:36:57 2013 From: satshabad.music at gmail.com (satshabad khalsa) Date: Tue, 8 Jan 2013 20:36:57 -0800 Subject: [IPython-dev] New developers looking to help Message-ID: <CAC8xyJyk10BtpXXe+BZx9hCrQXCErTD7Gzg=26yZuvqcUj7ZhA@mail.gmail.com> Hi IPython community, My friend Zack (cc'ed) and I are seniors at Cal Poly Pomona studying computer science. In our current class we have a term assignment to go out and find an open source project and submit two patches. We wanted to contribute to Ipython because it's awesome. I use it all the time to start prototyping python projects and even as my calculator. I also think the Ipython notebook thing is pretty rad as well. We were wondering if anyone was willing to give us a few nudges in the right direction as to which issues would be good ones to work on? They don't have to be easy (in fact we get more points if they're not). If someone wouldn't mind pointing us in the right direction please get in touch. I've started reading the developer's guide<http://ipython.org/ipython-doc/dev/development/index.html>and getting an idea of how Ipython works, but as for choosing which issues need work, and would be do-able for 2 students in a matter of weeks, I'm not so sure. I hope that from this school assignment I can become a regular contributor to the Ipython community. Thanks and keep up the awesome work, Satshabad Khalsa -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130108/d1f3f3b1/attachment.html> From benjaminrk at gmail.com Wed Jan 9 01:23:07 2013 From: benjaminrk at gmail.com (MinRK) Date: Tue, 8 Jan 2013 22:23:07 -0800 Subject: [IPython-dev] New developers looking to help In-Reply-To: <CAC8xyJyk10BtpXXe+BZx9hCrQXCErTD7Gzg=26yZuvqcUj7ZhA@mail.gmail.com> References: <CAC8xyJyk10BtpXXe+BZx9hCrQXCErTD7Gzg=26yZuvqcUj7ZhA@mail.gmail.com> Message-ID: <CAHNn8BVv0Kr7yEt5dwH=bb3KgC58svs7A1LM1JnuuYfBEzDUhg@mail.gmail.com> On Tue, Jan 8, 2013 at 8:36 PM, satshabad khalsa <satshabad.music at gmail.com>wrote: > Hi IPython community, > > My friend Zack (cc'ed) and I are seniors at Cal Poly Pomona studying > computer science. In our current class we have a term assignment to go out > and find an open source project and submit two patches. We wanted to > contribute to Ipython because it's awesome. I use it all the time to start > prototyping python projects and even as my calculator. I also think the > Ipython notebook thing is pretty rad as well. > > We were wondering if anyone was willing to give us a few nudges in the > right direction as to which issues would be good ones to work on? They > don't have to be easy (in fact we get more points if they're not). > > If someone wouldn't mind pointing us in the right direction please get in > touch. I've started reading the developer's guide<http://ipython.org/ipython-doc/dev/development/index.html>and getting an idea of how Ipython works, but as for choosing which issues > need work, and would be do-able for 2 students in a matter of weeks, I'm > not so sure. I hope that from this school assignment I can become a regular > contributor to the Ipython community. > We try to mark some of the easier to fix issues with 'Sprint-Friendly<https://github.com/ipython/ipython/issues?labels=Sprint-Friendly>' or 'quickfix <https://github.com/ipython/ipython/issues?labels=quickfix>'. These are the places we recommend new contributors start looking (also docs, but it sounds like that's not what you need for your assignment). Or you can just browse our rather large Issues list<https://github.com/ipython/ipython/issues> for something that strikes your fancy. Our GitHub notes <https://github.com/ipython/ipython/wiki/IPython-on-GitHub> have some information on making contributions. Looking forward to your pull requests! -MinRK > Thanks and keep up the awesome work, > Satshabad Khalsa > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130108/1b73ef86/attachment.html> From bussonniermatthias at gmail.com Wed Jan 9 02:37:45 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Wed, 9 Jan 2013 08:37:45 +0100 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> Message-ID: <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> > I do appreciate the concern, and we need a solution to the issue. > I just don't think we have a complete one yet. > Right now, we have a supremely flexible (and thus insecure) situation, > whereas jsplugins-only is secure, but not remotely flexible from a user's perspective. > > This is an extremely serious incapacitation of the notebook. > The trouble is that jsplugins is a relatively tolerable substitue > for the single-user notebook, but where the problem is worst > is when users don't actually have access to the server > to install jsplugins. So it's precisely the case where we > would not allow custom js that jsplugins fail most dramatically > as a substitute. > > Is it really our intention to require *server* installation of a plugin > for a user to gain access to a new widget? That seems to eliminate a *huge* portion of exactly what makes the notebook interesting. > > If we have a way that js plugins can be loaded at runtime by the user without access to the server (presumably with a 'do you trust this guy?' confirmation), > then that would go a long way toward preventing the total castration of the notebook. > The problem is that if we escape javascript in output to prevent js execution at load time we do make injecting javascript **script tag** useless in markdown and cell ouput. This is a slight difference than displaying javascript with the Javascript object that actually evaluate the string of code. It is also dangerous in multi-user context, even if this javascript is not runned at load time. I think that Json plugin are much better than current structure because one of the first plugin you can write can evaluate javascript code, so it actually does the same as Javascript object. But, If you design a custom plugin that deal with a specific type of json data, then you get the ability for this data to be used at load time as the json repr is stored. And I do agree that we need to give users a way to still display JS. I still think we should **strongly** encourage them not to use Javascript object because of it's inherent evaluation which is not stored. It is nice for prototyping, but it does more harm than anything for sharing. Finally I suppose it will be doable and a good thing to develop the ability to plug those jsplugin to nbviewer. -- Matthias From martin.zmk at gmail.com Wed Jan 9 06:57:38 2013 From: martin.zmk at gmail.com (lecast) Date: Wed, 9 Jan 2013 03:57:38 -0800 (PST) Subject: [IPython-dev] D3js and IPython In-Reply-To: <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> Message-ID: <CAFkD3Z_BXM=QUM=Qzy81Pz_0r_Fy-X2wDJTEAh3BAK74wgxiEQ@mail.gmail.com> I had a look at jsplugins and indeed it makes sense to use that in my context, although I would still keep my class for rendering static things or things that use css for interactivity. However, the way I understand is that js in unwanted in the saved output because it may communicate with the kernel, and that in turn can do whatever. Wouldn't escaping just such calls be an option too? For the jsplugins to work I think there should be an install function within IPython where you point at some url that hosts the plugin. And, there should be an easy way to extend plugins from within IPython so that the user doesn't have to have file system access to add a script. Also, the base of the code for my papers-style notebooks that extracts footnotes is at http://nbviewer.ipython.org/4492534/ Z wyrazami szacunku, Marcin Zamojski On Wed, Jan 9, 2013 at 8:37 AM, Matthias Bussonnier [via Python] < ml-node+s6n5001731h91 at n6.nabble.com> wrote: > > > I do appreciate the concern, and we need a solution to the issue. > > I just don't think we have a complete one yet. > > Right now, we have a supremely flexible (and thus insecure) situation, > > whereas jsplugins-only is secure, but not remotely flexible from a > user's perspective. > > > > This is an extremely serious incapacitation of the notebook. > > The trouble is that jsplugins is a relatively tolerable substitue > > for the single-user notebook, but where the problem is worst > > is when users don't actually have access to the server > > to install jsplugins. So it's precisely the case where we > > would not allow custom js that jsplugins fail most dramatically > > as a substitute. > > > > Is it really our intention to require *server* installation of a plugin > > for a user to gain access to a new widget? That seems to eliminate a > *huge* portion of exactly what makes the notebook interesting. > > > > If we have a way that js plugins can be loaded at runtime by the user > without access to the server (presumably with a 'do you trust this guy?' > confirmation), > > then that would go a long way toward preventing the total castration of > the notebook. > > > > The problem is that if we escape javascript in output to prevent js > execution at load time we do make > injecting javascript **script tag** useless in markdown and cell ouput. > > This is a slight difference than displaying javascript with the Javascript > object that actually evaluate the string of code. > It is also dangerous in multi-user context, even if this javascript is not > runned at load time. > > I think that Json plugin are much better than current structure because > one of the first plugin you can write can evaluate javascript > code, so it actually does the same as Javascript object. > But, If you design a custom plugin that deal with a specific type of json > data, then you get the ability for this data to be used > at load time as the json repr is stored. > > And I do agree that we need to give users a way to still display JS. > > I still think we should **strongly** encourage them not to use Javascript > object because of it's inherent evaluation > which is not stored. It is nice for prototyping, but it does more harm > than anything for sharing. > > Finally I suppose it will be doable and a good thing to develop the > ability to plug those jsplugin to nbviewer. > -- > Matthias > > > > _______________________________________________ > IPython-dev mailing list > [hidden email] <http://user/SendEmail.jtp?type=node&node=5001731&i=0> > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001731.html > To unsubscribe from D3js and IPython, click here<http://python.6.n6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=5001661&code=bWFydGluLnpta0BnbWFpbC5jb218NTAwMTY2MXw2OTczNzc0NDY=> > . > NAML<http://python.6.n6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001767.html Sent from the IPython - Development mailing list archive at Nabble.com. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/ad9dc329/attachment.html> From michael.kraus at ipp.mpg.de Wed Jan 9 07:12:19 2013 From: michael.kraus at ipp.mpg.de (Michael Kraus) Date: Wed, 9 Jan 2013 13:12:19 +0100 Subject: [IPython-dev] TikZ Magics Message-ID: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> Dear all, I tried to send this mail to the list a few days ago, but it seems it didn't make it. Fist of all, thanks a lot for the great work on the IPython Notebook. I'm using it a lot and really like it. Especially the LaTeX support is great and extraordinary useful! However, I'm using TikZ quite a lot as well, for drawing figures and sketches. I thought it would be really nice to do that within the IPython Notebook. So I created TikZ magics that aim at allowing exactly that. Of course, it needs an existing LaTeX installation to run properly (and probably convert from ImageMagick). So far it's mostly a quick hack based on the Octave magics. Right now only PNG works fine. The JPG and SVG output of the LaTeX Standalone module seems to be pretty crappy so that the result is rather useless. Nevertheless, the support for SVG and JPG is in the module, just in case the LaTeX (or convert) guys get that working properly. One can also think about using convert to go from PNG to JPG, which should work better. For SVG I don't have a workaround, yet. If it's interesting for anybody, the tikzmagic module can be found at [1] and an IPython notebook with some examples can be found at [2]. I have just tested it in the Notebook where it seems to work fine. Cheers, Michael [1] http://www.ipp.mpg.de/~mkraus/python/tikzmagic.py [2] http://www.ipp.mpg.de/~mkraus/python/tikzmagic_test.ipynb From zvoros at gmail.com Wed Jan 9 07:46:04 2013 From: zvoros at gmail.com (=?ISO-8859-1?Q?Zolt=E1n_V=F6r=F6s?=) Date: Wed, 09 Jan 2013 13:46:04 +0100 Subject: [IPython-dev] TikZ Magics In-Reply-To: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> References: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> Message-ID: <50ED668C.7050603@gmail.com> On 01/09/2013 01:12 PM, Michael Kraus wrote: > Dear all, > > I tried to send this mail to the list a few days ago, but it seems it didn't make it. > > Fist of all, thanks a lot for the great work on the IPython Notebook. I'm using it a lot and really like it. Especially the LaTeX support is great and extraordinary useful! > > However, I'm using TikZ quite a lot as well, for drawing figures and sketches. I thought it would be really nice to do that within the IPython Notebook. So I created TikZ magics that aim at allowing exactly that. Of course, it needs an existing LaTeX installation to run properly (and probably convert from ImageMagick). > > So far it's mostly a quick hack based on the Octave magics. Right now only PNG works fine. The JPG and SVG output of the LaTeX Standalone module seems to be pretty crappy so that the result is rather useless. Nevertheless, the support for SVG and JPG is in the module, just in case the LaTeX (or convert) guys get that working properly. One can also think about using convert to go from PNG to JPG, which should work better. For SVG I don't have a workaround, yet. But shouldn't it be possible to run pdflatex on the tikz code, and then call pdf2svg? I do that all the time. You can't create a decent vector image out of PNG. Cheers, Zolt?n From michael.kraus at ipp.mpg.de Wed Jan 9 07:50:22 2013 From: michael.kraus at ipp.mpg.de (Michael Kraus) Date: Wed, 9 Jan 2013 13:50:22 +0100 Subject: [IPython-dev] TikZ Magics In-Reply-To: <50ED668C.7050603@gmail.com> References: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> <50ED668C.7050603@gmail.com> Message-ID: <FB6B89CB-7B54-4437-8EBF-0DF3952C0D0F@ipp.mpg.de> On 09.01.2013, at 13:46, Zolt?n V?r?s <zvoros at gmail.com> wrote: > On 01/09/2013 01:12 PM, Michael Kraus wrote: >> Dear all, >> >> I tried to send this mail to the list a few days ago, but it seems it didn't make it. >> >> Fist of all, thanks a lot for the great work on the IPython Notebook. I'm using it a lot and really like it. Especially the LaTeX support is great and extraordinary useful! >> >> However, I'm using TikZ quite a lot as well, for drawing figures and sketches. I thought it would be really nice to do that within the IPython Notebook. So I created TikZ magics that aim at allowing exactly that. Of course, it needs an existing LaTeX installation to run properly (and probably convert from ImageMagick). >> >> So far it's mostly a quick hack based on the Octave magics. Right now only PNG works fine. The JPG and SVG output of the LaTeX Standalone module seems to be pretty crappy so that the result is rather useless. Nevertheless, the support for SVG and JPG is in the module, just in case the LaTeX (or convert) guys get that working properly. One can also think about using convert to go from PNG to JPG, which should work better. For SVG I don't have a workaround, yet. > But shouldn't it be possible to run pdflatex on the tikz code, and then call pdf2svg? I do that all the time. You can't create a decent vector image out of PNG. That would be an option, but how default is pdf2svg? I mean which Linux / TeX distributions ship it? It doesn't come with MacTeX? Of course you cannot create a decent vector image out of PNG, but a decent JPG should be possible. Cheers, Michael From zvoros at gmail.com Wed Jan 9 07:53:06 2013 From: zvoros at gmail.com (=?windows-1252?Q?Zolt=E1n_V=F6r=F6s?=) Date: Wed, 09 Jan 2013 13:53:06 +0100 Subject: [IPython-dev] TikZ Magics In-Reply-To: <FB6B89CB-7B54-4437-8EBF-0DF3952C0D0F@ipp.mpg.de> References: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> <50ED668C.7050603@gmail.com> <FB6B89CB-7B54-4437-8EBF-0DF3952C0D0F@ipp.mpg.de> Message-ID: <50ED6832.2040205@gmail.com> On 01/09/2013 01:50 PM, Michael Kraus wrote: > >> But shouldn't it be possible to run pdflatex on the tikz code, and then call pdf2svg? I do that all the time. You can't create a decent vector image out of PNG. > That would be an option, but how default is pdf2svg? I mean which Linux / TeX distributions ship it? It doesn't come with MacTeX? On Linux, it is pretty standard. I can't comment on other OSs. Cheers, Zolt?n From michael.kraus at ipp.mpg.de Wed Jan 9 08:22:10 2013 From: michael.kraus at ipp.mpg.de (Michael Kraus) Date: Wed, 9 Jan 2013 14:22:10 +0100 Subject: [IPython-dev] TikZ Magics In-Reply-To: <50ED6832.2040205@gmail.com> References: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> <50ED668C.7050603@gmail.com> <FB6B89CB-7B54-4437-8EBF-0DF3952C0D0F@ipp.mpg.de> <50ED6832.2040205@gmail.com> Message-ID: <7EE6912B-59CF-43B4-A288-DE321A453149@ipp.mpg.de> On 09.01.2013, at 13:53, Zolt?n V?r?s <zvoros at gmail.com> wrote: >>> But shouldn't it be possible to run pdflatex on the tikz code, and then call pdf2svg? I do that all the time. You can't create a decent vector image out of PNG. >> That would be an option, but how default is pdf2svg? I mean which Linux / TeX distributions ship it? It doesn't come with MacTeX? > On Linux, it is pretty standard. I can't comment on other OSs. Ok, it's also included with MacPorts. I updated the script to do the conversion to JPG via convert and the one to SVG via pdf2svg. I also understand now why LaTeX standalone produces crappy JPGs. Maybe that can be worked around directly? For now, the new files can be found at http://www.ipp.mpg.de/~mkraus/python/tikzmagic.py http://www.ipp.mpg.de/~mkraus/python/tikzmagic_test.ipynb Cheers, Michael From zvoros at gmail.com Wed Jan 9 08:35:40 2013 From: zvoros at gmail.com (=?windows-1252?Q?Zolt=E1n_V=F6r=F6s?=) Date: Wed, 09 Jan 2013 14:35:40 +0100 Subject: [IPython-dev] TikZ Magics In-Reply-To: <7EE6912B-59CF-43B4-A288-DE321A453149@ipp.mpg.de> References: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> <50ED668C.7050603@gmail.com> <FB6B89CB-7B54-4437-8EBF-0DF3952C0D0F@ipp.mpg.de> <50ED6832.2040205@gmail.com> <7EE6912B-59CF-43B4-A288-DE321A453149@ipp.mpg.de> Message-ID: <50ED722C.5070607@gmail.com> On 01/09/2013 02:22 PM, Michael Kraus wrote: > Ok, it's also included with MacPorts. > > I updated the script to do the conversion to JPG via convert and the one to SVG via pdf2svg. But is there a reason to convert anything to JPG? Plots in IPython are in png by default, and if you have thin lines in a sketch or whatever produces by tikz, then JPG is not going to look good anyway... I might just overlook something, but to me, JPG doesn't appear an extremely useful format in the present case, unless, you are really concerned about file size. Cheers, Zolt?n From michael.kraus at ipp.mpg.de Wed Jan 9 08:42:50 2013 From: michael.kraus at ipp.mpg.de (Michael Kraus) Date: Wed, 9 Jan 2013 14:42:50 +0100 Subject: [IPython-dev] TikZ Magics In-Reply-To: <50ED722C.5070607@gmail.com> References: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> <50ED668C.7050603@gmail.com> <FB6B89CB-7B54-4437-8EBF-0DF3952C0D0F@ipp.mpg.de> <50ED6832.2040205@gmail.com> <7EE6912B-59CF-43B4-A288-DE321A453149@ipp.mpg.de> <50ED722C.5070607@gmail.com> Message-ID: <7DFBD398-36D6-41E2-BF60-2599BD69DEF6@ipp.mpg.de> On 09.01.2013, at 14:35, Zolt?n V?r?s <zvoros at gmail.com> wrote: >> I updated the script to do the conversion to JPG via convert and the one to SVG via pdf2svg. > But is there a reason to convert anything to JPG? Plots in IPython are in png by default, and if you have thin lines in a sketch or whatever produces by tikz, then JPG is not going to look good anyway... I might just overlook something, but to me, JPG doesn't appear an extremely useful format in the present case, unless, you are really concerned about file size. Well, the default format in my module is PNG as well. I was just following the OctaveMagics example which also features JPG (for whatever reason). But I fully agree, PNG and SVG are much more useful than JPG. Cheers, Michael From bussonniermatthias at gmail.com Wed Jan 9 11:55:44 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Wed, 9 Jan 2013 17:55:44 +0100 Subject: [IPython-dev] TikZ Magics In-Reply-To: <7EE6912B-59CF-43B4-A288-DE321A453149@ipp.mpg.de> References: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> <50ED668C.7050603@gmail.com> <FB6B89CB-7B54-4437-8EBF-0DF3952C0D0F@ipp.mpg.de> <50ED6832.2040205@gmail.com> <7EE6912B-59CF-43B4-A288-DE321A453149@ipp.mpg.de> Message-ID: <6FE9EA96-D93D-4CD1-BB93-D48E22F9495F@gmail.com> > Ok, it's also included with MacPorts. And homebrew which is a little lighter? > I updated the script to do the conversion to JPG via convert and the one to SVG via pdf2svg. I also understand now why LaTeX standalone produces crappy JPGs. Maybe that can be worked around directly? > > For now, the new files can be found at > > http://www.ipp.mpg.de/~mkraus/python/tikzmagic.py > http://www.ipp.mpg.de/~mkraus/python/tikzmagic_test.ipynb Would you like to add this to the Extension index on IPython wiki ? -- Matthias From bussonniermatthias at gmail.com Wed Jan 9 12:13:49 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Wed, 9 Jan 2013 18:13:49 +0100 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAFkD3Z_BXM=QUM=Qzy81Pz_0r_Fy-X2wDJTEAh3BAK74wgxiEQ@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> <CAFkD3Z_BXM=QUM=Qzy81Pz_0r_Fy-X2wDJTEAh3BAK74wgxiEQ@mail.gmail.com> Message-ID: <0D481D70-8E82-4215-8522-31F6E48C7D95@gmail.com> Le 9 janv. 2013 ? 12:57, lecast a ?crit : > I had a look at jsplugins and indeed it makes sense to use that in my context, although I would still keep my class for rendering static things or things that use css for interactivity. > > However, the way I understand is that js in unwanted in the saved output because it may communicate with the kernel, and that in turn can do whatever. > Wouldn't escaping just such calls be an option too? I'm not sure I understand the question here. Removing js evaluation and injection of script tag through IPython is not enough as one can actually forge a file that have embedded js. So we need to be carefull > For the jsplugins to work I think there should be an install function within IPython where you point at some url that hosts the plugin. > And, there should be an easy way to extend plugins from within IPython so that the user doesn't have to have file system access to add a script. Yes, sure. Plugin will probably be mostly js that can be served from urls. So that shouldn't be too hard. But I'm not sure user can have IPython access without filesystem access. I don't really see the point of an online computing software if you can't store data or save your notebook... > Also, the base of the code for my papers-style notebooks that extracts footnotes is at http://nbviewer.ipython.org/4492534/ Great ! I'll have a look. -- Matthias -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/95b3d8dc/attachment.html> From benjaminrk at gmail.com Wed Jan 9 13:32:27 2013 From: benjaminrk at gmail.com (Min RK) Date: Wed, 9 Jan 2013 10:32:27 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <0D481D70-8E82-4215-8522-31F6E48C7D95@gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> <CAFkD3Z_BXM=QUM=Qzy81Pz_0r_Fy-X2wDJTEAh3BAK74wgxiEQ@mail.gmail.com> <0D481D70-8E82-4215-8522-31F6E48C7D95@gmail.com> Message-ID: <500CC1D3-FC7E-4BDE-A47F-0EED3A86138B@gmail.com> On Jan 9, 2013, at 9:13, Matthias BUSSONNIER <bussonniermatthias at gmail.com> wrote: > > Le 9 janv. 2013 ? 12:57, lecast a ?crit : > >> I had a look at jsplugins and indeed it makes sense to use that in my context, although I would still keep my class for rendering static things or things that use css for interactivity. >> >> However, the way I understand is that js in unwanted in the saved output because it may communicate with the kernel, and that in turn can do whatever. > > >> Wouldn't escaping just such calls be an option too? > > I'm not sure I understand the question here. > Removing js evaluation and injection of script tag through IPython is not enough as one can actually forge > a file that have embedded js. So we need to be carefull > >> For the jsplugins to work I think there should be an install function within IPython where you point at some url that hosts the plugin. >> And, there should be an easy way to extend plugins from within IPython so that the user doesn't have to have file system access to add a script. > > Yes, sure. Plugin will probably be mostly js that can be served from urls. So that shouldn't be too hard. > But I'm not sure user can have IPython access without filesystem access. I don't really see the point of > an online computing software if you can't store data or save your notebook... You forget that notebook / kernel access and *server* filesystem access are not going to be the same thing for long. For multiuser, it is a safe assumption that n-1 users will *not* have access to installing js plugins (not to mention the fact that current design requires nb server restart, which users also do not have permissions to do). > >> Also, the base of the code for my papers-style notebooks that extracts footnotes is at http://nbviewer.ipython.org/4492534/ > > Great ! I'll have a look. > -- > Matthias > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/ed6a228d/attachment.html> From bussonniermatthias at gmail.com Wed Jan 9 13:43:49 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Wed, 9 Jan 2013 19:43:49 +0100 Subject: [IPython-dev] D3js and IPython In-Reply-To: <500CC1D3-FC7E-4BDE-A47F-0EED3A86138B@gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> <CAFkD3Z_BXM=QUM=Qzy81Pz_0r_Fy-X2wDJTEAh3BAK74wgxiEQ@mail.gmail.com> <0D481D70-8E82-4215-8522-31F6E48C7D95@gmail.com> <500CC1D3-FC7E-4BDE-A47F-0EED3A86138B@gmail.com> Message-ID: <178C4C33-22BC-489F-9AE8-040E5B899F93@gmail.com> Le 9 janv. 2013 ? 19:32, Min RK a ?crit : > You forget that notebook / kernel access and *server* filesystem access are not going to be the same thing for long. For multiuser, it is a safe assumption that n-1 users will *not* have access to installing js plugins (not to mention the fact that current design requires nb server restart, which users also do not have permissions to do). I was more thinking of profile directory. I though profile would be writable to allow custom config... And ipynb files are not on kernel side either... You really can't do much with only kernel side... As for the JS plugin I though the reloading would be on page reload not server-restart. I'll try to look at that again. -- Matthias From ellisonbg at gmail.com Wed Jan 9 14:12:50 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Wed, 9 Jan 2013 11:12:50 -0800 Subject: [IPython-dev] Feature and scope creep in IPython Message-ID: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> Hi, Over the last few weeks, a few of us on the core dev team have been having conversations about the increased development activity that the Sloan foundation money will bring to the project. In case you haven't noticed, we are already bursting at the seams with pull requests and GitHub issues. This raises the question of how on earth will we manage all the *additional* activity. I stared to write an email to this list about these issues, but the email grew into two blog posts about the general question: how do open source projects decide which features to implement? Here are the blog posts: http://bit.ly/Wsd8sx http://bit.ly/VPG9jc I think this issue is really important for the project to consider if we are going to successfully scale our efforts. Please read this, think about it, and post your thoughts here, as it related to IPython. At a practical level, we need to figure out better work flow for our GitHub issues, especially ones for new features. I propose one option in my blog post, but I am sure there are others. Cheers, Brian -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From benjaminrk at gmail.com Wed Jan 9 14:42:18 2013 From: benjaminrk at gmail.com (MinRK) Date: Wed, 9 Jan 2013 11:42:18 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <178C4C33-22BC-489F-9AE8-040E5B899F93@gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> <CAFkD3Z_BXM=QUM=Qzy81Pz_0r_Fy-X2wDJTEAh3BAK74wgxiEQ@mail.gmail.com> <0D481D70-8E82-4215-8522-31F6E48C7D95@gmail.com> <500CC1D3-FC7E-4BDE-A47F-0EED3A86138B@gmail.com> <178C4C33-22BC-489F-9AE8-040E5B899F93@gmail.com> Message-ID: <CAHNn8BVymRTFS+NU_9XVELBmQTm3ngM91kf6dQzFHXLgX7UEfQ@mail.gmail.com> On Wed, Jan 9, 2013 at 10:43 AM, Matthias BUSSONNIER < bussonniermatthias at gmail.com> wrote: > > Le 9 janv. 2013 ? 19:32, Min RK a ?crit : > > > You forget that notebook / kernel access and *server* filesystem access > are not going to be the same thing for long. For multiuser, it is a safe > assumption that n-1 users will *not* have access to installing js plugins > (not to mention the fact that current design requires nb server restart, > which users also do not have permissions to do). > > I was more thinking of profile directory. > I though profile would be writable to allow custom config... > And ipynb files are not on kernel side either... > > You really can't do much with only kernel side... > And that's exactly the point - an important user case in the long term (students, non-admin users in multi-user deployment, etc.) will have no access to the notebook *server's* profile / config. Any time we make decisions that require nb-server config, we have to take this into account. We have to be aware that we are adding configuration decisions that admins have to make on behalf of users. That's not to say this is necessarily inappropriate, but it sucks a lot for admins and users alike, so we have to be careful. > > As for the JS plugin I though the reloading would be on page reload not > server-restart. > I'll try to look at that again. > I think it constructs the list when it first renders the page template - it shouldn't be tricky to rebuild the list. That's not a particularly important point (though we should make the change if my memory was correct). > > -- > Matthias > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/c994255d/attachment.html> From ellisonbg at gmail.com Wed Jan 9 17:18:17 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Wed, 9 Jan 2013 14:18:17 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> Message-ID: <CAH4pYpTT6o0rzQS4aBh=U0Y+TpxhM1YDVaB-f_8p0Be2AC0jFQ@mail.gmail.com> > I do appreciate the concern, and we need a solution to the issue. > I just don't think we have a complete one yet. > Right now, we have a supremely flexible (and thus insecure) situation, > whereas jsplugins-only is secure, but not remotely flexible from a user's > perspective. > > This is an extremely serious incapacitation of the notebook. > The trouble is that jsplugins is a relatively tolerable substitue > for the single-user notebook, but where the problem is worst > is when users don't actually have access to the server > to install jsplugins. So it's precisely the case where we > would not allow custom js that jsplugins fail most dramatically > as a substitute. Yes, the jsplugins do represent a problem in multiuser settings where each user might way different plugins installed. It is also difficult to have to involve the server admin to install things like this. At the same time, the same server admin would have to be involved if a user wanted to install a new python package, so maybe there is not that big of a difference. > Is it really our intention to require *server* installation of a plugin > for a user to gain access to a new widget? That seems to eliminate a *huge* > portion of exactly what makes the notebook interesting. The *idea* was to use the server side install requirement as the step that says "I trust this code." If we can implement that check in a robust way that people won't step over without really understanding what they are doing, that would be great. > If we have a way that js plugins can be loaded at runtime by the user > without access to the server (presumably with a 'do you trust this guy?' > confirmation), > then that would go a long way toward preventing the total castration of the > notebook. We should definitely think about that, as it might provide a nice balance of the two options. >> >> >> A separate issue is that actually writing Javascript code using the >> old Javascript object is horrifically painful. Errors get completely >> swallowed and it is nearly impossible to figure out what is going on. >> I think this is why very few people have actually done anything >> significant with the Javascript object we currently have - it just >> doesn't work very well. On the other hand, developing the JS plugins, >> gives the usual mostly pleasant development experience. > > > This isn't entirely accurate, as errors in js do show up in the notebook. > Just try > > %%javascript > a = doesnt_exist Some errors do show up - but many others do not. I have never been able to figure out which do and which don't. When I have encountered silent errors, in some cases I could never find them and had to rewrite the code carefully from scratch. Eventually they disappeared. > But I do appreciate the pain - I've taken to writing new inline js code in > .js files locally, > just so my editor can help me out, which is similar in practice to jsplugins > and definitely an improvement over typing js in Python strings. Yes, I have done this as well and it helps somethings. Cheers, Brian >> >> Cheers, >> >> Brian >> >> >> >> >> >> >> Cheers, >> >> >> >> Brian >> >> >> >> >> >> On Tue, Jan 8, 2013 at 1:11 PM, lecast <martin.zmk at gmail.com> wrote: >> >> > Thx. I will have a look at both the repository and the pull. >> >> > >> >> > Returning Javascript() or HTML() is not exactly what I need. In >> >> > general >> >> > I >> >> > always need to publish both html and javascript within a function so >> >> > that >> >> > function that would correspond to make_table() from ipy_table creates >> >> > both >> >> > the element and the script that populates that element. But this is >> >> > mute >> >> > here, since I couldn't find a way to copy final elements from the >> >> > window >> >> > and >> >> > saving them in the notebook for good, the only thing that actually is >> >> > saved >> >> > is the final html object. >> >> > >> >> > I don't use inline JS anywhere there. But, if you prevent inline JS >> >> > in >> >> > output then you will also prevent a lot of interactivity on final >> >> > output >> >> > that e.g. d3 generates. I mean you need to be able to have things >> >> > like >> >> > onClick etc. But if you mean that you will prohibit me from saving >> >> > javascript in any form in the notebook, then I will probably have to >> >> > stop >> >> > pulling the new versions... Right now I spend all my time in >> >> > Notebook, >> >> > i.e. >> >> > I wrote a script that converts notebooks to latex and I just write my >> >> > papers >> >> > in Notebook. It is nice since I see my math instantly, but I need to >> >> > be >> >> > able >> >> > to embed some javascript that appears only in those notebooks that >> >> > are >> >> > really papers, e.g. to replace references or make highlights ( >> >> > http://i46.tinypic.com/163qyg.png ). >> >> > >> >> > Customjs is ok unless you send the notebook to someone and don't tell >> >> > them >> >> > they need to have it as well. I wanted something that produces output >> >> > that >> >> > is easily replicable. >> >> > >> >> > >> >> > >> >> > Z wyrazami szacunku, >> >> > Marcin Zamojski >> >> > >> >> > >> >> > On Tue, Jan 8, 2013 at 8:56 PM, Matthias Bussonnier [via Python] >> >> > <[hidden >> >> > email]> wrote: >> >> >> >> >> >> Hi ! >> >> >> >> >> >> It look really great : >> >> >> >> >> >> A few comment : >> >> >> >> >> >> Obstacle 1 >> >> >> def x(): >> >> >> from IPython.core.display import Javascript >> >> >> Javascript('alert("a")') >> >> >> x() >> >> >> >> >> >> you probably want to `return Javascript('alert("a")')` >> >> >> Am I wrong ? >> >> >> >> >> >> >> >> >> Obstacle 2: >> >> >> same : `return HTML()` I guess... >> >> >> >> >> >> Please, please, please don't inline script. >> >> >> We will in anyway prevent script in output so this will become >> >> >> useless >> >> >> anyway. >> >> >> Which will deprecate _js_repr_ (at least make it useless) but Brian >> >> >> Json-handler branch >> >> >> ill work much better to do what you want. >> >> >> >> >> >> Obstacle 3/Obstacle 4 >> >> >> Will be solve with brian Json Handler branch. >> >> >> >> >> >> You probably want to inject your own library in the notebook, >> >> >> which can be done via custom.js >> >> >> >> >> >> draft doc : >> >> >> http://elacave.lmdb.eu/~carreau/yui/classes/IPython.customjs.html >> >> >> use $.getScript(url) >> >> >> for example : >> >> >> $.getScript('d3.min.js') in you have d3.min.js in >> >> >> .ipython/profile_xxx/static/js/d3.min.js >> >> >> >> >> >> You might be interesting in >> >> >> http://epmoyer.github.com/ipy_table/ >> >> >> >> >> >> To join effort. >> >> >> >> >> >> Thanks. >> >> >> -- >> >> >> Matthias >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> Le 8 janv. 2013 ? 17:26, lecast a ?crit : >> >> >> >> >> >> > This is a new thread but it is born out and related to a previous >> >> >> > discussion >> >> >> > >> >> >> > >> >> >> > >> >> >> > <http://python.6.n6.nabble.com/experiment-remote-execution-of-jquery-and-d3-code-into-the-browser-via-ipython-td4633053.html#a4955237> >> >> >> > . The goal there was to live update figures created with d3js in >> >> >> > IPython >> >> >> > Notebook. It was suggested that a solution would be to use >> >> >> > widgets, >> >> >> > which I >> >> >> > have to admit I did not have time to understand so instead I >> >> >> > decided >> >> >> > to >> >> >> > create something that produces the end product I was aiming at, >> >> >> > i.e. >> >> >> > take >> >> >> > output from Python, use d3js to create a table/figure, use some >> >> >> > blackbox, >> >> >> > have the output visible in the notebook (or be able to save it >> >> >> > elsewhere >> >> >> > as >> >> >> > svg/html/png/etc). >> >> >> > >> >> >> > You can find an example notebook with a lot of custom tables and >> >> >> > some >> >> >> > figures here >> >> >> > <http://nbviewer.ipython.org/4484816/ipyD3sample.ipynb> >> >> >> > . >> >> >> > They are all created based on data from Python, rendered in >> >> >> > PhantomJs >> >> >> > (in >> >> >> > that case I just copy the html, but PhantomJs allows for >> >> >> > conversion >> >> >> > to >> >> >> > other >> >> >> > formats), and then published in the notebook. >> >> >> > >> >> >> > I created it for myself, so there is hardly any commenting in the >> >> >> > file >> >> >> > (I >> >> >> > know, bad), but I have been using it for a few months now and it >> >> >> > works >> >> >> > really well. D3js has some great modern visualizations coded in >> >> >> > and >> >> >> > it >> >> >> > takes >> >> >> > only a few days to learn the syntax by doing. >> >> >> > >> >> >> > Personally I think it would be really nice to make it into an >> >> >> > extension/package, but I lack experience/time to do that. >> >> >> > >> >> >> > >> >> >> > >> >> >> > -- >> >> >> > View this message in context: >> >> >> > http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661.html >> >> >> > Sent from the IPython - Development mailing list archive at >> >> >> > Nabble.com. >> >> >> > _______________________________________________ >> >> >> > IPython-dev mailing list >> >> >> > [hidden email] >> >> >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> >> >> _______________________________________________ >> >> >> IPython-dev mailing list >> >> >> [hidden email] >> >> >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> >> >> >> >> >> ________________________________ >> >> >> If you reply to this email, your message will be added to the >> >> >> discussion >> >> >> below: >> >> >> >> >> >> http://python.6.n6.nabble.com/D3js-and-IPython-tp5001661p5001692.html >> >> >> To unsubscribe from D3js and IPython, click here. >> >> >> NAML >> >> > >> >> > >> >> > >> >> > ________________________________ >> >> > View this message in context: Re: D3js and IPython >> >> > >> >> > Sent from the IPython - Development mailing list archive at >> >> > Nabble.com. >> >> > >> >> > _______________________________________________ >> >> > IPython-dev mailing list >> >> > IPython-dev at scipy.org >> >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > >> >> >> >> >> >> >> >> -- >> >> Brian E. Granger >> >> Cal Poly State University, San Luis Obispo >> >> bgranger at calpoly.edu and ellisonbg at gmail.com >> >> _______________________________________________ >> >> IPython-dev mailing list >> >> IPython-dev at scipy.org >> >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> > >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From ellisonbg at gmail.com Wed Jan 9 17:21:11 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Wed, 9 Jan 2013 14:21:11 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> Message-ID: <CAH4pYpSeYV2-99er=6JbEyjwVdxhTUdafiiOK9jBhybTanWcMQ@mail.gmail.com> On Tue, Jan 8, 2013 at 11:37 PM, Matthias BUSSONNIER <bussonniermatthias at gmail.com> wrote: > >> I do appreciate the concern, and we need a solution to the issue. >> I just don't think we have a complete one yet. >> Right now, we have a supremely flexible (and thus insecure) situation, >> whereas jsplugins-only is secure, but not remotely flexible from a user's perspective. >> >> This is an extremely serious incapacitation of the notebook. >> The trouble is that jsplugins is a relatively tolerable substitue >> for the single-user notebook, but where the problem is worst >> is when users don't actually have access to the server >> to install jsplugins. So it's precisely the case where we >> would not allow custom js that jsplugins fail most dramatically >> as a substitute. >> >> Is it really our intention to require *server* installation of a plugin >> for a user to gain access to a new widget? That seems to eliminate a *huge* portion of exactly what makes the notebook interesting. >> >> If we have a way that js plugins can be loaded at runtime by the user without access to the server (presumably with a 'do you trust this guy?' confirmation), >> then that would go a long way toward preventing the total castration of the notebook. >> > > The problem is that if we escape javascript in output to prevent js execution at load time we do make > injecting javascript **script tag** useless in markdown and cell ouput. I don't see any way that we can allow <script> tags in markdown and HTML output. Those is the most dangerous case as they are run at notebook load time and there is no hook for us to prevent that. All we can do it strip them. > This is a slight difference than displaying javascript with the Javascript object that actually evaluate the string of code. > It is also dangerous in multi-user context, even if this javascript is not runned at load time. > > I think that Json plugin are much better than current structure because one of the first plugin you can write can evaluate javascript > code, so it actually does the same as Javascript object. > But, If you design a custom plugin that deal with a specific type of json data, then you get the ability for this data to be used > at load time as the json repr is stored. > > And I do agree that we need to give users a way to still display JS. > > I still think we should **strongly** encourage them not to use Javascript object because of it's inherent evaluation > which is not stored. It is nice for prototyping, but it does more harm than anything for sharing. > > Finally I suppose it will be doable and a good thing to develop the ability to plug those jsplugin to nbviewer. Yes, I agree. > -- > Matthias > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From benjaminrk at gmail.com Wed Jan 9 17:38:05 2013 From: benjaminrk at gmail.com (MinRK) Date: Wed, 9 Jan 2013 14:38:05 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAH4pYpSeYV2-99er=6JbEyjwVdxhTUdafiiOK9jBhybTanWcMQ@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> <CAH4pYpSeYV2-99er=6JbEyjwVdxhTUdafiiOK9jBhybTanWcMQ@mail.gmail.com> Message-ID: <CAHNn8BXHyR6cOJ3y43onYj+Zk6+OnC1g5xD-WgybQ4L9aRvu6g@mail.gmail.com> On Wed, Jan 9, 2013 at 2:21 PM, Brian Granger <ellisonbg at gmail.com> wrote: > On Tue, Jan 8, 2013 at 11:37 PM, Matthias BUSSONNIER > <bussonniermatthias at gmail.com> wrote: > > > >> I do appreciate the concern, and we need a solution to the issue. > >> I just don't think we have a complete one yet. > >> Right now, we have a supremely flexible (and thus insecure) situation, > >> whereas jsplugins-only is secure, but not remotely flexible from a > user's perspective. > >> > >> This is an extremely serious incapacitation of the notebook. > >> The trouble is that jsplugins is a relatively tolerable substitue > >> for the single-user notebook, but where the problem is worst > >> is when users don't actually have access to the server > >> to install jsplugins. So it's precisely the case where we > >> would not allow custom js that jsplugins fail most dramatically > >> as a substitute. > >> > >> Is it really our intention to require *server* installation of a plugin > >> for a user to gain access to a new widget? That seems to eliminate a > *huge* portion of exactly what makes the notebook interesting. > >> > >> If we have a way that js plugins can be loaded at runtime by the user > without access to the server (presumably with a 'do you trust this guy?' > confirmation), > >> then that would go a long way toward preventing the total castration of > the notebook. > >> > > > > The problem is that if we escape javascript in output to prevent js > execution at load time we do make > > injecting javascript **script tag** useless in markdown and cell ouput. > > I don't see any way that we can allow <script> tags in markdown and > HTML output. Those is the most dangerous case as they are run at > notebook load time and there is no hook for us to prevent that. All > we can do it strip them. > I really can't imagine that it will come to this - you are talking about disabling pandas table printing, and simple rich text reprs. That doesn't seem tenable. It's also disabling sized images, since our message spec so far has foolishly excluded shape information for images, etc, or the ability to display any kind of formatting (e.g. two images side-by-side). We should be able to sanitize<http://stackoverflow.com/questions/295566/sanitize-rewrite-html-on-the-client-side>Javascript from HTML - both in rendered markdown and HTML output data. This, in turn, could allow script detection and give an 'unsafe dynamic content, only allow if you trust...' message. The cost of what you are proposing is *extremely* high. > > > This is a slight difference than displaying javascript with the > Javascript object that actually evaluate the string of code. > > It is also dangerous in multi-user context, even if this javascript is > not runned at load time. > > > > I think that Json plugin are much better than current structure because > one of the first plugin you can write can evaluate javascript > > code, so it actually does the same as Javascript object. > > But, If you design a custom plugin that deal with a specific type of > json data, then you get the ability for this data to be used > > at load time as the json repr is stored. > > > > And I do agree that we need to give users a way to still display JS. > > > > I still think we should **strongly** encourage them not to use > Javascript object because of it's inherent evaluation > > which is not stored. It is nice for prototyping, but it does more harm > than anything for sharing. > > > > Finally I suppose it will be doable and a good thing to develop the > ability to plug those jsplugin to nbviewer. > > Yes, I agree. > > > -- > > Matthias > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/e36065df/attachment.html> From satshabad.music at gmail.com Wed Jan 9 18:18:09 2013 From: satshabad.music at gmail.com (satshabad khalsa) Date: Wed, 9 Jan 2013 15:18:09 -0800 Subject: [IPython-dev] New developers looking to help In-Reply-To: <CAHNn8BVv0Kr7yEt5dwH=bb3KgC58svs7A1LM1JnuuYfBEzDUhg@mail.gmail.com> References: <CAC8xyJyk10BtpXXe+BZx9hCrQXCErTD7Gzg=26yZuvqcUj7ZhA@mail.gmail.com> <CAHNn8BVv0Kr7yEt5dwH=bb3KgC58svs7A1LM1JnuuYfBEzDUhg@mail.gmail.com> Message-ID: <CAC8xyJwXQ3N2gtVPR8eRER63O-+GoOs4UuX65pr_HzD-BDMJ3Q@mail.gmail.com> Awesome! We found issue 1393<https://github.com/ipython/ipython/issues/1393>to be pretty cool. It's the ctrl-r history search functionality for the qtconsole frontend. Is anyone actively working on this? In the docs it's mentioned that the Ipython terminal uses the GNU readline library for it's ctrl-r functionality, but on this issue MinRK said it would have to be implemented from scratch because qtconsole doesn't use readline. Is there a specific reason it doesn't use that library? If we could use it would implementing this involve just connecting the right pieces in the right places? If not, where would it be best implemented from scratch? Thanks! Satshabad -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/1014e0ac/attachment.html> From carl.input at gmail.com Wed Jan 9 18:23:53 2013 From: carl.input at gmail.com (Carl Smith) Date: Wed, 9 Jan 2013 23:23:53 +0000 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> Message-ID: <CAP-uhDfszKhF1kV3__Gygq1zJ1G6eHAbQbMd0gFx4XAn+aBWaQ@mail.gmail.com> The second blog link isn't working for me?? -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/2c9f6c9a/attachment.html> From carl.input at gmail.com Wed Jan 9 18:24:41 2013 From: carl.input at gmail.com (Carl Smith) Date: Wed, 9 Jan 2013 23:24:41 +0000 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CAP-uhDfszKhF1kV3__Gygq1zJ1G6eHAbQbMd0gFx4XAn+aBWaQ@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAP-uhDfszKhF1kV3__Gygq1zJ1G6eHAbQbMd0gFx4XAn+aBWaQ@mail.gmail.com> Message-ID: <CAP-uhDeYYTjLUD9bAMYKvh8rbPtGqwmtg9BYY9zYWQ2AOWhgVA@mail.gmail.com> Sorry - it's working now. Strange. On Jan 9, 2013 11:23 PM, "Carl Smith" <carl.input at gmail.com> wrote: > The second blog link isn't working for me?? > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/2186a49d/attachment.html> From rmcgibbo at gmail.com Wed Jan 9 18:34:07 2013 From: rmcgibbo at gmail.com (Robert McGibbon) Date: Wed, 9 Jan 2013 15:34:07 -0800 Subject: [IPython-dev] New developers looking to help In-Reply-To: <CAC8xyJwXQ3N2gtVPR8eRER63O-+GoOs4UuX65pr_HzD-BDMJ3Q@mail.gmail.com> References: <CAC8xyJyk10BtpXXe+BZx9hCrQXCErTD7Gzg=26yZuvqcUj7ZhA@mail.gmail.com> <CAHNn8BVv0Kr7yEt5dwH=bb3KgC58svs7A1LM1JnuuYfBEzDUhg@mail.gmail.com> <CAC8xyJwXQ3N2gtVPR8eRER63O-+GoOs4UuX65pr_HzD-BDMJ3Q@mail.gmail.com> Message-ID: <B7608BF6-1C40-445C-949D-A31A1C1DDA1D@gmail.com> GNU readline is specifically for tty terminals. It's the library that (among other things) lets the client read what's been entered into the terminal before the <enter> key is pressed and the characters are sent to standard in. It also has other stuff for registering crtl- keypresses, remembering history, implementing tab completion, etc. In the qtconsole and notebook, all of that stuff has to be done differently because the mechanisms for reading from the input line are different. -Robert On Jan 9, 2013, at 3:18 PM, satshabad khalsa wrote: > Awesome! We found issue 1393 to be pretty cool. It's the ctrl-r history search functionality for the qtconsole frontend. Is anyone actively working on this? > > In the docs it's mentioned that the Ipython terminal uses the GNU readline library for it's ctrl-r functionality, but on this issue MinRK said it would have to be implemented from scratch because qtconsole doesn't use readline. Is there a specific reason it doesn't use that library? If we could use it would implementing this involve just connecting the right pieces in the right places? If not, where would it be best implemented from scratch? > > Thanks! > Satshabad > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/a4cb1c6a/attachment.html> From takowl at gmail.com Wed Jan 9 19:34:33 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 10 Jan 2013 00:34:33 +0000 Subject: [IPython-dev] Frozen IPython Message-ID: <CAOvn4qj5mZU18dtUZ60m8YsBpyvQ-b9FeuVKPXsSJi94aLtzmg@mail.gmail.com> Hi Almar, I know Pyzo includes a frozen IPython executable. IPython has some particular behaviour when frozen, left over from IpyKit, a project from several years ago. Specifically, it uses a configuration directory next to the package, rather than under the user's home directory. This is now causing problems, and we're considering dropping the special case for running frozen: https://github.com/ipython/ipython/issues/2702 Do you rely on that behaviour for Pyzo? I expect we could find a way to preserve it, but there's no point spending time on it if no-one needs it. Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130110/29eaee11/attachment.html> From takowl at gmail.com Wed Jan 9 19:46:07 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 10 Jan 2013 00:46:07 +0000 Subject: [IPython-dev] Migrating wiki again Message-ID: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> A few days ago, @dttocs on Github tipped us off that our Wiki was serving spam about prescription drugs. I cleaned it up and upgraded Mediawiki, but it's already reappeared, so evidently the loophole that was used before is still open. This isn't just the regular spam pages, which are mostly under control; something is able to modify .htaccess . I'm not a sysadmin, and we've got better uses for our time than battling malware. Unless someone feels confident they can maintain it securely, I suggest that we abandon our experiment with Mediawiki, and start moving the content to a Github wiki. Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130110/40ac4eb7/attachment.html> From ellisonbg at gmail.com Wed Jan 9 19:47:04 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Wed, 9 Jan 2013 16:47:04 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> Message-ID: <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> I am +1 on this plan. On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com> wrote: > A few days ago, @dttocs on Github tipped us off that our Wiki was serving > spam about prescription drugs. I cleaned it up and upgraded Mediawiki, but > it's already reappeared, so evidently the loophole that was used before is > still open. This isn't just the regular spam pages, which are mostly under > control; something is able to modify .htaccess . > > I'm not a sysadmin, and we've got better uses for our time than battling > malware. Unless someone feels confident they can maintain it securely, I > suggest that we abandon our experiment with Mediawiki, and start moving the > content to a Github wiki. > > Thanks, > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From ellisonbg at gmail.com Wed Jan 9 19:49:28 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Wed, 9 Jan 2013 16:49:28 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAHNn8BXHyR6cOJ3y43onYj+Zk6+OnC1g5xD-WgybQ4L9aRvu6g@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> <CAH4pYpSeYV2-99er=6JbEyjwVdxhTUdafiiOK9jBhybTanWcMQ@mail.gmail.com> <CAHNn8BXHyR6cOJ3y43onYj+Zk6+OnC1g5xD-WgybQ4L9aRvu6g@mail.gmail.com> Message-ID: <CAH4pYpSD4Q7OzgB7obc22WfYw1MAxZuUxtsJZTdh8TbOaUzCyQ@mail.gmail.com> > I really can't imagine that it will come to this - you are talking about > disabling pandas table printing, > and simple rich text reprs. That doesn't seem tenable. It's also disabling > sized images, since our message spec so far has foolishly excluded shape > information for images, etc, or the ability to display any kind of > formatting (e.g. two images side-by-side). Sorry I wasn't clear. I meant to just remove the <script> tags, not all of the HTML ouput. In your language "sanitize" it. > We should be able to sanitize Javascript from HTML - both in rendered > markdown and HTML output data. This, in turn, could allow script detection > and give an 'unsafe dynamic content, only allow if you trust...' message. Yep. Brian > The cost of what you are proposing is *extremely* high. > >> >> >> > This is a slight difference than displaying javascript with the >> > Javascript object that actually evaluate the string of code. >> > It is also dangerous in multi-user context, even if this javascript is >> > not runned at load time. >> > >> > I think that Json plugin are much better than current structure because >> > one of the first plugin you can write can evaluate javascript >> > code, so it actually does the same as Javascript object. >> > But, If you design a custom plugin that deal with a specific type of >> > json data, then you get the ability for this data to be used >> > at load time as the json repr is stored. >> > >> > And I do agree that we need to give users a way to still display JS. >> > >> > I still think we should **strongly** encourage them not to use >> > Javascript object because of it's inherent evaluation >> > which is not stored. It is nice for prototyping, but it does more harm >> > than anything for sharing. >> > >> > Finally I suppose it will be doable and a good thing to develop the >> > ability to plug those jsplugin to nbviewer. >> >> Yes, I agree. >> >> > -- >> > Matthias >> > >> > >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From benjaminrk at gmail.com Wed Jan 9 20:28:17 2013 From: benjaminrk at gmail.com (MinRK) Date: Wed, 9 Jan 2013 17:28:17 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> Message-ID: <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> plus a million. I know Thomas did the moin->mediawiki migration, and I don't want to make him do it all over again. I can look into this migration next week. For now, can we 'lock' the current wiki, so there can't be any more edits? -MinRK On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com> wrote: > I am +1 on this plan. > > On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com> wrote: > > A few days ago, @dttocs on Github tipped us off that our Wiki was serving > > spam about prescription drugs. I cleaned it up and upgraded Mediawiki, > but > > it's already reappeared, so evidently the loophole that was used before > is > > still open. This isn't just the regular spam pages, which are mostly > under > > control; something is able to modify .htaccess . > > > > I'm not a sysadmin, and we've got better uses for our time than battling > > malware. Unless someone feels confident they can maintain it securely, I > > suggest that we abandon our experiment with Mediawiki, and start moving > the > > content to a Github wiki. > > > > Thanks, > > Thomas > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/23ea08ad/attachment.html> From benjaminrk at gmail.com Wed Jan 9 20:34:30 2013 From: benjaminrk at gmail.com (MinRK) Date: Wed, 9 Jan 2013 17:34:30 -0800 Subject: [IPython-dev] D3js and IPython In-Reply-To: <CAH4pYpSD4Q7OzgB7obc22WfYw1MAxZuUxtsJZTdh8TbOaUzCyQ@mail.gmail.com> References: <1357662376790-5001661.post@n6.nabble.com> <4326ADEE-35E7-4655-9A37-FCE5FF41351B@gmail.com> <CAFkD3Z9t3Bqrqqbv+=1CADWpE8_CZzWvJq7rH68gV1cQ9Wb2uA@mail.gmail.com> <CAH4pYpR9EEW96NzzMz8DEKr9KG-p9pp9i-0j7XH1cnSE5cjB7g@mail.gmail.com> <CAHNn8BVyAQ+vLVTuBxCX8eyPL_OMMi3bzD-9WD9UPdzUxiJkaw@mail.gmail.com> <CAH4pYpRtVKH4w2c1_fZqMnuvGxnPKK_Mwq5-vZ3KgR+cstQmJA@mail.gmail.com> <CAHNn8BW2AH2KWiUdp0Ey5-UQ-z9KoZwutyzkjsQagKY3-QcEbA@mail.gmail.com> <5D9E7C17-2F72-4DFD-8E2B-B0D003881A8A@gmail.com> <CAH4pYpSeYV2-99er=6JbEyjwVdxhTUdafiiOK9jBhybTanWcMQ@mail.gmail.com> <CAHNn8BXHyR6cOJ3y43onYj+Zk6+OnC1g5xD-WgybQ4L9aRvu6g@mail.gmail.com> <CAH4pYpSD4Q7OzgB7obc22WfYw1MAxZuUxtsJZTdh8TbOaUzCyQ@mail.gmail.com> Message-ID: <CAHNn8BUYidgNKzr+6AbH3ms0FX-S4xqzmzsfwi2d0xqZRYNtAg@mail.gmail.com> On Wed, Jan 9, 2013 at 4:49 PM, Brian Granger <ellisonbg at gmail.com> wrote: > > I really can't imagine that it will come to this - you are talking about > > disabling pandas table printing, > > and simple rich text reprs. That doesn't seem tenable. It's also > disabling > > sized images, since our message spec so far has foolishly excluded shape > > information for images, etc, or the ability to display any kind of > > formatting (e.g. two images side-by-side). > > Sorry I wasn't clear. I meant to just remove the <script> tags, not > all of the HTML ouput. In your language "sanitize" it. > > > We should be able to sanitize Javascript from HTML - both in rendered > > markdown and HTML output data. This, in turn, could allow script > detection > > and give an 'unsafe dynamic content, only allow if you trust...' message. > > Yep. > Ah, sorry I misunderstood. I thought you were saying we were going to remove HTML reprs entirely, not scrub javascript from existing HTML reprs. I still think we might want to have a warn/allow mechanism, rather than a strict 'no js' policy, but 90% of the work for those two is actually the same, so we can fight over that molehill when we get there :) > > Brian > > > The cost of what you are proposing is *extremely* high. > > > >> > >> > >> > This is a slight difference than displaying javascript with the > >> > Javascript object that actually evaluate the string of code. > >> > It is also dangerous in multi-user context, even if this javascript is > >> > not runned at load time. > >> > > >> > I think that Json plugin are much better than current structure > because > >> > one of the first plugin you can write can evaluate javascript > >> > code, so it actually does the same as Javascript object. > >> > But, If you design a custom plugin that deal with a specific type of > >> > json data, then you get the ability for this data to be used > >> > at load time as the json repr is stored. > >> > > >> > And I do agree that we need to give users a way to still display JS. > >> > > >> > I still think we should **strongly** encourage them not to use > >> > Javascript object because of it's inherent evaluation > >> > which is not stored. It is nice for prototyping, but it does more harm > >> > than anything for sharing. > >> > > >> > Finally I suppose it will be doable and a good thing to develop the > >> > ability to plug those jsplugin to nbviewer. > >> > >> Yes, I agree. > >> > >> > -- > >> > Matthias > >> > > >> > > >> > > >> > _______________________________________________ > >> > IPython-dev mailing list > >> > IPython-dev at scipy.org > >> > http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > >> > >> > >> -- > >> Brian E. Granger > >> Cal Poly State University, San Luis Obispo > >> bgranger at calpoly.edu and ellisonbg at gmail.com > >> _______________________________________________ > >> IPython-dev mailing list > >> IPython-dev at scipy.org > >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/1e7a005c/attachment.html> From brad.froehle at gmail.com Wed Jan 9 23:55:23 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Wed, 9 Jan 2013 20:55:23 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> Message-ID: <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> Yes, I think this is a good idea too. I can attempt the migration if I can get a dump of the wiki contents in some usable fashion. -Brad On Wed, Jan 9, 2013 at 5:28 PM, MinRK <benjaminrk at gmail.com> wrote: > plus a million. I know Thomas did the moin->mediawiki migration, > and I don't want to make him do it all over again. > I can look into this migration next week. > > For now, can we 'lock' the current wiki, so there can't be any more edits? > > -MinRK > > > On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com> wrote: > >> I am +1 on this plan. >> >> On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com> wrote: >> > A few days ago, @dttocs on Github tipped us off that our Wiki was >> serving >> > spam about prescription drugs. I cleaned it up and upgraded Mediawiki, >> but >> > it's already reappeared, so evidently the loophole that was used before >> is >> > still open. This isn't just the regular spam pages, which are mostly >> under >> > control; something is able to modify .htaccess . >> > >> > I'm not a sysadmin, and we've got better uses for our time than battling >> > malware. Unless someone feels confident they can maintain it securely, I >> > suggest that we abandon our experiment with Mediawiki, and start moving >> the >> > content to a Github wiki. >> > >> > Thanks, >> > Thomas >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/dd66fc4e/attachment.html> From benjaminrk at gmail.com Thu Jan 10 00:39:58 2013 From: benjaminrk at gmail.com (MinRK) Date: Wed, 9 Jan 2013 21:39:58 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> Message-ID: <CAHNn8BU1+ea9Gz3d7t2EZoZPseJQkaUwjtXmdfinjLjjfgFwvQ@mail.gmail.com> Based on the mediawiki guide<http://meta.wikimedia.org/wiki/Help:Export#1._Get_the_names_of_pages_to_export> , I think I exported all of the pages to a single XML file: https://www.dropbox.com/s/5ogy0xg2lkuo1rf/IPython-20130110012347.xml That should be easy to parse down to individual pages. I don't know how easy mediawiki->markdown is, but there's not a lot of content to convert. -MinRK On Wed, Jan 9, 2013 at 8:55 PM, Bradley M. Froehle <brad.froehle at gmail.com>wrote: > Yes, I think this is a good idea too. > > I can attempt the migration if I can get a dump of the wiki contents in > some usable fashion. > > -Brad > > > On Wed, Jan 9, 2013 at 5:28 PM, MinRK <benjaminrk at gmail.com> wrote: > >> plus a million. I know Thomas did the moin->mediawiki migration, >> and I don't want to make him do it all over again. >> I can look into this migration next week. >> >> For now, can we 'lock' the current wiki, so there can't be any more edits? >> >> -MinRK >> >> >> On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com>wrote: >> >>> I am +1 on this plan. >>> >>> On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com> wrote: >>> > A few days ago, @dttocs on Github tipped us off that our Wiki was >>> serving >>> > spam about prescription drugs. I cleaned it up and upgraded Mediawiki, >>> but >>> > it's already reappeared, so evidently the loophole that was used >>> before is >>> > still open. This isn't just the regular spam pages, which are mostly >>> under >>> > control; something is able to modify .htaccess . >>> > >>> > I'm not a sysadmin, and we've got better uses for our time than >>> battling >>> > malware. Unless someone feels confident they can maintain it securely, >>> I >>> > suggest that we abandon our experiment with Mediawiki, and start >>> moving the >>> > content to a Github wiki. >>> > >>> > Thanks, >>> > Thomas >>> > >>> > _______________________________________________ >>> > IPython-dev mailing list >>> > IPython-dev at scipy.org >>> > http://mail.scipy.org/mailman/listinfo/ipython-dev >>> > >>> >>> >>> >>> -- >>> Brian E. Granger >>> Cal Poly State University, San Luis Obispo >>> bgranger at calpoly.edu and ellisonbg at gmail.com >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/a8932337/attachment.html> From brad.froehle at gmail.com Thu Jan 10 01:10:38 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Wed, 9 Jan 2013 22:10:38 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> Message-ID: <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> Min: Thanks for the XML file. I had just built a script to scrape http://wiki.ipython.org/Special:AllPages so I could use http://wiki.ipython.org/Special:Export. (https://gist.github.com/4499750#file-ipython_all_pages-py). Anyway, this mw-to-gollum.rb script (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work okay. I've run it and pushed the results to https://github.com/bfroehle/ipython/wiki/Main-Page There are a few issues: 1. Some pages need to be manually cleaned up: e.g., https://github.com/bfroehle/ipython/wiki/Extensions-Index 2. Github uses gollum which does not use directories --- everything is in a flat namespace. I've worked around this by replacing all subdirectories with dashes. (See the tr('/', '-') in the script). This seems to keep most of the links working, but some are still broken (see https://github.com/bfroehle/ipython/wiki/Cookbook, for example). -Brad On Wednesday, January 9, 2013 at 8:55 PM, Bradley M. Froehle wrote: > Yes, I think this is a good idea too. > > I can attempt the migration if I can get a dump of the wiki contents in some usable fashion. > > -Brad > > > On Wed, Jan 9, 2013 at 5:28 PM, MinRK <benjaminrk at gmail.com (mailto:benjaminrk at gmail.com)> wrote: > > plus a million. I know Thomas did the moin->mediawiki migration, > > and I don't want to make him do it all over again. > > I can look into this migration next week. > > > > For now, can we 'lock' the current wiki, so there can't be any more edits? > > > > -MinRK > > > > > > On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com (mailto:ellisonbg at gmail.com)> wrote: > > > I am +1 on this plan. > > > > > > On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com (mailto:takowl at gmail.com)> wrote: > > > > A few days ago, @dttocs on Github tipped us off that our Wiki was serving > > > > spam about prescription drugs. I cleaned it up and upgraded Mediawiki, but > > > > it's already reappeared, so evidently the loophole that was used before is > > > > still open. This isn't just the regular spam pages, which are mostly under > > > > control; something is able to modify .htaccess . > > > > > > > > I'm not a sysadmin, and we've got better uses for our time than battling > > > > malware. Unless someone feels confident they can maintain it securely, I > > > > suggest that we abandon our experiment with Mediawiki, and start moving the > > > > content to a Github wiki. > > > > > > > > Thanks, > > > > Thomas > > > > > > > > _______________________________________________ > > > > IPython-dev mailing list > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > > > > > > -- > > > Brian E. Granger > > > Cal Poly State University, San Luis Obispo > > > bgranger at calpoly.edu (mailto:bgranger at calpoly.edu) and ellisonbg at gmail.com (mailto:ellisonbg at gmail.com) > > > _______________________________________________ > > > IPython-dev mailing list > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > http://mail.scipy.org/mailman/listinfo/ipython-dev > From benjaminrk at gmail.com Thu Jan 10 01:13:29 2013 From: benjaminrk at gmail.com (MinRK) Date: Wed, 9 Jan 2013 22:13:29 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> Message-ID: <CAHNn8BXSsvXrpKoqzjgHR_L8h26-ci6hEcDMLL=_cG-yHVSLiw@mail.gmail.com> On Wed, Jan 9, 2013 at 10:10 PM, Bradley M. Froehle <brad.froehle at gmail.com>wrote: > Min: Thanks for the XML file. I had just built a script to scrape > http://wiki.ipython.org/Special:AllPages so I could use > http://wiki.ipython.org/Special:Export. ( > https://gist.github.com/4499750#file-ipython_all_pages-py). > > Anyway, this mw-to-gollum.rb script ( > https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work okay. > > I've run it and pushed the results to > https://github.com/bfroehle/ipython/wiki/Main-Page > > There are a few issues: > 1. Some pages need to be manually cleaned up: e.g., > https://github.com/bfroehle/ipython/wiki/Extensions-Index > 2. Github uses gollum which does not use directories --- everything is in > a flat namespace. I've worked around this by replacing all subdirectories > with dashes. (See the tr('/', '-') in the script). This seems to keep most > of the links working, but some are still broken (see > https://github.com/bfroehle/ipython/wiki/Cookbook, for example). > Pretty good! There aren't too many pages, so I think we can probably start with that, and do a bit of cleanup and be set. > > > -Brad > > > On Wednesday, January 9, 2013 at 8:55 PM, Bradley M. Froehle wrote: > > > Yes, I think this is a good idea too. > > > > I can attempt the migration if I can get a dump of the wiki contents in > some usable fashion. > > > > -Brad > > > > > > On Wed, Jan 9, 2013 at 5:28 PM, MinRK <benjaminrk at gmail.com (mailto: > benjaminrk at gmail.com)> wrote: > > > plus a million. I know Thomas did the moin->mediawiki migration, > > > and I don't want to make him do it all over again. > > > I can look into this migration next week. > > > > > > For now, can we 'lock' the current wiki, so there can't be any more > edits? > > > > > > -MinRK > > > > > > > > > On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com(mailto: > ellisonbg at gmail.com)> wrote: > > > > I am +1 on this plan. > > > > > > > > On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com(mailto: > takowl at gmail.com)> wrote: > > > > > A few days ago, @dttocs on Github tipped us off that our Wiki was > serving > > > > > spam about prescription drugs. I cleaned it up and upgraded > Mediawiki, but > > > > > it's already reappeared, so evidently the loophole that was used > before is > > > > > still open. This isn't just the regular spam pages, which are > mostly under > > > > > control; something is able to modify .htaccess . > > > > > > > > > > I'm not a sysadmin, and we've got better uses for our time than > battling > > > > > malware. Unless someone feels confident they can maintain it > securely, I > > > > > suggest that we abandon our experiment with Mediawiki, and start > moving the > > > > > content to a Github wiki. > > > > > > > > > > Thanks, > > > > > Thomas > > > > > > > > > > _______________________________________________ > > > > > IPython-dev mailing list > > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > > > > > > > > > > > -- > > > > Brian E. Granger > > > > Cal Poly State University, San Luis Obispo > > > > bgranger at calpoly.edu (mailto:bgranger at calpoly.edu) and > ellisonbg at gmail.com (mailto:ellisonbg at gmail.com) > > > > _______________________________________________ > > > > IPython-dev mailing list > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > > > _______________________________________________ > > > IPython-dev mailing list > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/0d75ff37/attachment.html> From ellisonbg at gmail.com Thu Jan 10 01:41:35 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Wed, 9 Jan 2013 22:41:35 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAHNn8BXSsvXrpKoqzjgHR_L8h26-ci6hEcDMLL=_cG-yHVSLiw@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAHNn8BXSsvXrpKoqzjgHR_L8h26-ci6hEcDMLL=_cG-yHVSLiw@mail.gmail.com> Message-ID: <CAH4pYpQZujajCX5Xj9brKsC_zJoBiMYHpesAC7XqKc+YCzmNVQ@mail.gmail.com> Great, thanks for doing this, it shouldn't be too bad to clean everything up. On Wed, Jan 9, 2013 at 10:13 PM, MinRK <benjaminrk at gmail.com> wrote: > > > On Wed, Jan 9, 2013 at 10:10 PM, Bradley M. Froehle <brad.froehle at gmail.com> > wrote: >> >> Min: Thanks for the XML file. I had just built a script to scrape >> http://wiki.ipython.org/Special:AllPages so I could use >> http://wiki.ipython.org/Special:Export. >> (https://gist.github.com/4499750#file-ipython_all_pages-py). >> >> Anyway, this mw-to-gollum.rb script >> (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work okay. >> >> I've run it and pushed the results to >> https://github.com/bfroehle/ipython/wiki/Main-Page >> >> There are a few issues: >> 1. Some pages need to be manually cleaned up: e.g., >> https://github.com/bfroehle/ipython/wiki/Extensions-Index >> 2. Github uses gollum which does not use directories --- everything is in >> a flat namespace. I've worked around this by replacing all subdirectories >> with dashes. (See the tr('/', '-') in the script). This seems to keep most >> of the links working, but some are still broken (see >> https://github.com/bfroehle/ipython/wiki/Cookbook, for example). > > > Pretty good! There aren't too many pages, so I think we can probably start > with that, and do a bit of cleanup and be set. > >> >> >> >> -Brad >> >> >> On Wednesday, January 9, 2013 at 8:55 PM, Bradley M. Froehle wrote: >> >> > Yes, I think this is a good idea too. >> > >> > I can attempt the migration if I can get a dump of the wiki contents in >> > some usable fashion. >> > >> > -Brad >> > >> > >> > On Wed, Jan 9, 2013 at 5:28 PM, MinRK <benjaminrk at gmail.com >> > (mailto:benjaminrk at gmail.com)> wrote: >> > > plus a million. I know Thomas did the moin->mediawiki migration, >> > > and I don't want to make him do it all over again. >> > > I can look into this migration next week. >> > > >> > > For now, can we 'lock' the current wiki, so there can't be any more >> > > edits? >> > > >> > > -MinRK >> > > >> > > >> > > On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com >> > > (mailto:ellisonbg at gmail.com)> wrote: >> > > > I am +1 on this plan. >> > > > >> > > > On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com >> > > > (mailto:takowl at gmail.com)> wrote: >> > > > > A few days ago, @dttocs on Github tipped us off that our Wiki was >> > > > > serving >> > > > > spam about prescription drugs. I cleaned it up and upgraded >> > > > > Mediawiki, but >> > > > > it's already reappeared, so evidently the loophole that was used >> > > > > before is >> > > > > still open. This isn't just the regular spam pages, which are >> > > > > mostly under >> > > > > control; something is able to modify .htaccess . >> > > > > >> > > > > I'm not a sysadmin, and we've got better uses for our time than >> > > > > battling >> > > > > malware. Unless someone feels confident they can maintain it >> > > > > securely, I >> > > > > suggest that we abandon our experiment with Mediawiki, and start >> > > > > moving the >> > > > > content to a Github wiki. >> > > > > >> > > > > Thanks, >> > > > > Thomas >> > > > > >> > > > > _______________________________________________ >> > > > > IPython-dev mailing list >> > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) >> > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > >> > > > >> > > > >> > > > >> > > > -- >> > > > Brian E. Granger >> > > > Cal Poly State University, San Luis Obispo >> > > > bgranger at calpoly.edu (mailto:bgranger at calpoly.edu) and >> > > > ellisonbg at gmail.com (mailto:ellisonbg at gmail.com) >> > > > _______________________________________________ >> > > > IPython-dev mailing list >> > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) >> > > > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > >> > > >> > > >> > > _______________________________________________ >> > > IPython-dev mailing list >> > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) >> > > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From benjaminrk at gmail.com Thu Jan 10 02:11:38 2013 From: benjaminrk at gmail.com (MinRK) Date: Wed, 9 Jan 2013 23:11:38 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAH4pYpQZujajCX5Xj9brKsC_zJoBiMYHpesAC7XqKc+YCzmNVQ@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAHNn8BXSsvXrpKoqzjgHR_L8h26-ci6hEcDMLL=_cG-yHVSLiw@mail.gmail.com> <CAH4pYpQZujajCX5Xj9brKsC_zJoBiMYHpesAC7XqKc+YCzmNVQ@mail.gmail.com> Message-ID: <CAHNn8BVA2dH_y37eBvpGfC3_9qn+cohapM5Ts5b2wOVHDP+mhw@mail.gmail.com> We can even open an Issue with the new task list<https://github.com/blog/1375-task-lists-in-gfm-issues-pulls-comments>, to mark off which pages have had a manual clean/check pass. On Wed, Jan 9, 2013 at 10:41 PM, Brian Granger <ellisonbg at gmail.com> wrote: > Great, thanks for doing this, it shouldn't be too bad to clean everything > up. > > On Wed, Jan 9, 2013 at 10:13 PM, MinRK <benjaminrk at gmail.com> wrote: > > > > > > On Wed, Jan 9, 2013 at 10:10 PM, Bradley M. Froehle < > brad.froehle at gmail.com> > > wrote: > >> > >> Min: Thanks for the XML file. I had just built a script to scrape > >> http://wiki.ipython.org/Special:AllPages so I could use > >> http://wiki.ipython.org/Special:Export. > >> (https://gist.github.com/4499750#file-ipython_all_pages-py). > >> > >> Anyway, this mw-to-gollum.rb script > >> (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work > okay. > >> > >> I've run it and pushed the results to > >> https://github.com/bfroehle/ipython/wiki/Main-Page > >> > >> There are a few issues: > >> 1. Some pages need to be manually cleaned up: e.g., > >> https://github.com/bfroehle/ipython/wiki/Extensions-Index > >> 2. Github uses gollum which does not use directories --- everything is > in > >> a flat namespace. I've worked around this by replacing all > subdirectories > >> with dashes. (See the tr('/', '-') in the script). This seems to keep > most > >> of the links working, but some are still broken (see > >> https://github.com/bfroehle/ipython/wiki/Cookbook, for example). > > > > > > Pretty good! There aren't too many pages, so I think we can probably > start > > with that, and do a bit of cleanup and be set. > > > >> > >> > >> > >> -Brad > >> > >> > >> On Wednesday, January 9, 2013 at 8:55 PM, Bradley M. Froehle wrote: > >> > >> > Yes, I think this is a good idea too. > >> > > >> > I can attempt the migration if I can get a dump of the wiki contents > in > >> > some usable fashion. > >> > > >> > -Brad > >> > > >> > > >> > On Wed, Jan 9, 2013 at 5:28 PM, MinRK <benjaminrk at gmail.com > >> > (mailto:benjaminrk at gmail.com)> wrote: > >> > > plus a million. I know Thomas did the moin->mediawiki migration, > >> > > and I don't want to make him do it all over again. > >> > > I can look into this migration next week. > >> > > > >> > > For now, can we 'lock' the current wiki, so there can't be any more > >> > > edits? > >> > > > >> > > -MinRK > >> > > > >> > > > >> > > On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com > >> > > (mailto:ellisonbg at gmail.com)> wrote: > >> > > > I am +1 on this plan. > >> > > > > >> > > > On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com > >> > > > (mailto:takowl at gmail.com)> wrote: > >> > > > > A few days ago, @dttocs on Github tipped us off that our Wiki > was > >> > > > > serving > >> > > > > spam about prescription drugs. I cleaned it up and upgraded > >> > > > > Mediawiki, but > >> > > > > it's already reappeared, so evidently the loophole that was used > >> > > > > before is > >> > > > > still open. This isn't just the regular spam pages, which are > >> > > > > mostly under > >> > > > > control; something is able to modify .htaccess . > >> > > > > > >> > > > > I'm not a sysadmin, and we've got better uses for our time than > >> > > > > battling > >> > > > > malware. Unless someone feels confident they can maintain it > >> > > > > securely, I > >> > > > > suggest that we abandon our experiment with Mediawiki, and start > >> > > > > moving the > >> > > > > content to a Github wiki. > >> > > > > > >> > > > > Thanks, > >> > > > > Thomas > >> > > > > > >> > > > > _______________________________________________ > >> > > > > IPython-dev mailing list > >> > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > >> > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > > > > >> > > > > >> > > > > >> > > > > >> > > > -- > >> > > > Brian E. Granger > >> > > > Cal Poly State University, San Luis Obispo > >> > > > bgranger at calpoly.edu (mailto:bgranger at calpoly.edu) and > >> > > > ellisonbg at gmail.com (mailto:ellisonbg at gmail.com) > >> > > > _______________________________________________ > >> > > > IPython-dev mailing list > >> > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > >> > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > > > >> > > > >> > > > >> > > _______________________________________________ > >> > > IPython-dev mailing list > >> > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > >> > > http://mail.scipy.org/mailman/listinfo/ipython-dev > >> > > >> > >> > >> > >> _______________________________________________ > >> IPython-dev mailing list > >> IPython-dev at scipy.org > >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > bgranger at calpoly.edu and ellisonbg at gmail.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130109/078bf575/attachment.html> From ellisonbg at gmail.com Thu Jan 10 02:13:02 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Wed, 9 Jan 2013 23:13:02 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAHNn8BVA2dH_y37eBvpGfC3_9qn+cohapM5Ts5b2wOVHDP+mhw@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAHNn8BXSsvXrpKoqzjgHR_L8h26-ci6hEcDMLL=_cG-yHVSLiw@mail.gmail.com> <CAH4pYpQZujajCX5Xj9brKsC_zJoBiMYHpesAC7XqKc+YCzmNVQ@mail.gmail.com> <CAHNn8BVA2dH_y37eBvpGfC3_9qn+cohapM5Ts5b2wOVHDP+mhw@mail.gmail.com> Message-ID: <CAH4pYpRA6s9dtuP17oiyB8OX8dHJP_AxsrSk1sQgbxb-iUbqmA@mail.gmail.com> Yes, the new task list on GiuHub is simple awesome. On Wed, Jan 9, 2013 at 11:11 PM, MinRK <benjaminrk at gmail.com> wrote: > We can even open an Issue with the new task list, to mark off which pages > have had a manual clean/check pass. > > > On Wed, Jan 9, 2013 at 10:41 PM, Brian Granger <ellisonbg at gmail.com> wrote: >> >> Great, thanks for doing this, it shouldn't be too bad to clean everything >> up. >> >> On Wed, Jan 9, 2013 at 10:13 PM, MinRK <benjaminrk at gmail.com> wrote: >> > >> > >> > On Wed, Jan 9, 2013 at 10:10 PM, Bradley M. Froehle >> > <brad.froehle at gmail.com> >> > wrote: >> >> >> >> Min: Thanks for the XML file. I had just built a script to scrape >> >> http://wiki.ipython.org/Special:AllPages so I could use >> >> http://wiki.ipython.org/Special:Export. >> >> (https://gist.github.com/4499750#file-ipython_all_pages-py). >> >> >> >> Anyway, this mw-to-gollum.rb script >> >> (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work >> >> okay. >> >> >> >> I've run it and pushed the results to >> >> https://github.com/bfroehle/ipython/wiki/Main-Page >> >> >> >> There are a few issues: >> >> 1. Some pages need to be manually cleaned up: e.g., >> >> https://github.com/bfroehle/ipython/wiki/Extensions-Index >> >> 2. Github uses gollum which does not use directories --- everything is >> >> in >> >> a flat namespace. I've worked around this by replacing all >> >> subdirectories >> >> with dashes. (See the tr('/', '-') in the script). This seems to keep >> >> most >> >> of the links working, but some are still broken (see >> >> https://github.com/bfroehle/ipython/wiki/Cookbook, for example). >> > >> > >> > Pretty good! There aren't too many pages, so I think we can probably >> > start >> > with that, and do a bit of cleanup and be set. >> > >> >> >> >> >> >> >> >> -Brad >> >> >> >> >> >> On Wednesday, January 9, 2013 at 8:55 PM, Bradley M. Froehle wrote: >> >> >> >> > Yes, I think this is a good idea too. >> >> > >> >> > I can attempt the migration if I can get a dump of the wiki contents >> >> > in >> >> > some usable fashion. >> >> > >> >> > -Brad >> >> > >> >> > >> >> > On Wed, Jan 9, 2013 at 5:28 PM, MinRK <benjaminrk at gmail.com >> >> > (mailto:benjaminrk at gmail.com)> wrote: >> >> > > plus a million. I know Thomas did the moin->mediawiki migration, >> >> > > and I don't want to make him do it all over again. >> >> > > I can look into this migration next week. >> >> > > >> >> > > For now, can we 'lock' the current wiki, so there can't be any more >> >> > > edits? >> >> > > >> >> > > -MinRK >> >> > > >> >> > > >> >> > > On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com >> >> > > (mailto:ellisonbg at gmail.com)> wrote: >> >> > > > I am +1 on this plan. >> >> > > > >> >> > > > On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com >> >> > > > (mailto:takowl at gmail.com)> wrote: >> >> > > > > A few days ago, @dttocs on Github tipped us off that our Wiki >> >> > > > > was >> >> > > > > serving >> >> > > > > spam about prescription drugs. I cleaned it up and upgraded >> >> > > > > Mediawiki, but >> >> > > > > it's already reappeared, so evidently the loophole that was >> >> > > > > used >> >> > > > > before is >> >> > > > > still open. This isn't just the regular spam pages, which are >> >> > > > > mostly under >> >> > > > > control; something is able to modify .htaccess . >> >> > > > > >> >> > > > > I'm not a sysadmin, and we've got better uses for our time than >> >> > > > > battling >> >> > > > > malware. Unless someone feels confident they can maintain it >> >> > > > > securely, I >> >> > > > > suggest that we abandon our experiment with Mediawiki, and >> >> > > > > start >> >> > > > > moving the >> >> > > > > content to a Github wiki. >> >> > > > > >> >> > > > > Thanks, >> >> > > > > Thomas >> >> > > > > >> >> > > > > _______________________________________________ >> >> > > > > IPython-dev mailing list >> >> > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) >> >> > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > > >> >> > > > >> >> > > > >> >> > > > >> >> > > > -- >> >> > > > Brian E. Granger >> >> > > > Cal Poly State University, San Luis Obispo >> >> > > > bgranger at calpoly.edu (mailto:bgranger at calpoly.edu) and >> >> > > > ellisonbg at gmail.com (mailto:ellisonbg at gmail.com) >> >> > > > _______________________________________________ >> >> > > > IPython-dev mailing list >> >> > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) >> >> > > > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > >> >> > > >> >> > > >> >> > > _______________________________________________ >> >> > > IPython-dev mailing list >> >> > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) >> >> > > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > >> >> >> >> >> >> >> >> _______________________________________________ >> >> IPython-dev mailing list >> >> IPython-dev at scipy.org >> >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> > >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From brad.froehle at gmail.com Thu Jan 10 02:27:26 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Wed, 9 Jan 2013 23:27:26 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAH4pYpRA6s9dtuP17oiyB8OX8dHJP_AxsrSk1sQgbxb-iUbqmA@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAHNn8BXSsvXrpKoqzjgHR_L8h26-ci6hEcDMLL=_cG-yHVSLiw@mail.gmail.com> <CAH4pYpQZujajCX5Xj9brKsC_zJoBiMYHpesAC7XqKc+YCzmNVQ@mail.gmail.com> <CAHNn8BVA2dH_y37eBvpGfC3_9qn+cohapM5Ts5b2wOVHDP+mhw@mail.gmail.com> <CAH4pYpRA6s9dtuP17oiyB8OX8dHJP_AxsrSk1sQgbxb-iUbqmA@mail.gmail.com> Message-ID: <1F1CAF71C8424804B35653F528CE59D2@gmail.com> How are we going to handle redirecting traffic from the old site? Just dump everybody at github's landing page? Or do we want to set up redirection for individual pages? I assume that we can't just snapshot mediawiki given that it keeps getting defaced. On Wednesday, January 9, 2013 at 11:13 PM, Brian Granger wrote: > Yes, the new task list on GiuHub is simple awesome. > > On Wed, Jan 9, 2013 at 11:11 PM, MinRK <benjaminrk at gmail.com (mailto:benjaminrk at gmail.com)> wrote: > > We can even open an Issue with the new task list, to mark off which pages > > have had a manual clean/check pass. > > > > > > On Wed, Jan 9, 2013 at 10:41 PM, Brian Granger <ellisonbg at gmail.com (mailto:ellisonbg at gmail.com)> wrote: > > > > > > Great, thanks for doing this, it shouldn't be too bad to clean everything > > > up. > > > > > > On Wed, Jan 9, 2013 at 10:13 PM, MinRK <benjaminrk at gmail.com (mailto:benjaminrk at gmail.com)> wrote: > > > > > > > > > > > > On Wed, Jan 9, 2013 at 10:10 PM, Bradley M. Froehle > > > > <brad.froehle at gmail.com (mailto:brad.froehle at gmail.com)> > > > > wrote: > > > > > > > > > > Min: Thanks for the XML file. I had just built a script to scrape > > > > > http://wiki.ipython.org/Special:AllPages so I could use > > > > > http://wiki.ipython.org/Special:Export. > > > > > (https://gist.github.com/4499750#file-ipython_all_pages-py). > > > > > > > > > > Anyway, this mw-to-gollum.rb script > > > > > (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work > > > > > okay. > > > > > > > > > > I've run it and pushed the results to > > > > > https://github.com/bfroehle/ipython/wiki/Main-Page > > > > > > > > > > There are a few issues: > > > > > 1. Some pages need to be manually cleaned up: e.g., > > > > > https://github.com/bfroehle/ipython/wiki/Extensions-Index > > > > > 2. Github uses gollum which does not use directories --- everything is > > > > > in > > > > > a flat namespace. I've worked around this by replacing all > > > > > subdirectories > > > > > with dashes. (See the tr('/', '-') in the script). This seems to keep > > > > > most > > > > > of the links working, but some are still broken (see > > > > > https://github.com/bfroehle/ipython/wiki/Cookbook, for example). > > > > > > > > > > > > > > > > > > > > Pretty good! There aren't too many pages, so I think we can probably > > > > start > > > > with that, and do a bit of cleanup and be set. > > > > > > > > > > > > > > > > > > > > > > > > -Brad > > > > > > > > > > > > > > > On Wednesday, January 9, 2013 at 8:55 PM, Bradley M. Froehle wrote: > > > > > > > > > > > Yes, I think this is a good idea too. > > > > > > > > > > > > I can attempt the migration if I can get a dump of the wiki contents > > > > > > in > > > > > > some usable fashion. > > > > > > > > > > > > -Brad > > > > > > > > > > > > > > > > > > On Wed, Jan 9, 2013 at 5:28 PM, MinRK <benjaminrk at gmail.com (mailto:benjaminrk at gmail.com) > > > > > > (mailto:benjaminrk at gmail.com)> wrote: > > > > > > > plus a million. I know Thomas did the moin->mediawiki migration, > > > > > > > and I don't want to make him do it all over again. > > > > > > > I can look into this migration next week. > > > > > > > > > > > > > > For now, can we 'lock' the current wiki, so there can't be any more > > > > > > > edits? > > > > > > > > > > > > > > -MinRK > > > > > > > > > > > > > > > > > > > > > On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com (mailto:ellisonbg at gmail.com) > > > > > > > (mailto:ellisonbg at gmail.com)> wrote: > > > > > > > > I am +1 on this plan. > > > > > > > > > > > > > > > > On Wed, Jan 9, 2013 at 4:46 PM, Thomas Kluyver <takowl at gmail.com (mailto:takowl at gmail.com) > > > > > > > > (mailto:takowl at gmail.com)> wrote: > > > > > > > > > A few days ago, @dttocs on Github tipped us off that our Wiki > > > > > > > > > was > > > > > > > > > serving > > > > > > > > > spam about prescription drugs. I cleaned it up and upgraded > > > > > > > > > Mediawiki, but > > > > > > > > > it's already reappeared, so evidently the loophole that was > > > > > > > > > used > > > > > > > > > before is > > > > > > > > > still open. This isn't just the regular spam pages, which are > > > > > > > > > mostly under > > > > > > > > > control; something is able to modify .htaccess . > > > > > > > > > > > > > > > > > > I'm not a sysadmin, and we've got better uses for our time than > > > > > > > > > battling > > > > > > > > > malware. Unless someone feels confident they can maintain it > > > > > > > > > securely, I > > > > > > > > > suggest that we abandon our experiment with Mediawiki, and > > > > > > > > > start > > > > > > > > > moving the > > > > > > > > > content to a Github wiki. > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > Thomas > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > > > > > IPython-dev mailing list > > > > > > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > > > > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > Brian E. Granger > > > > > > > > Cal Poly State University, San Luis Obispo > > > > > > > > bgranger at calpoly.edu (mailto:bgranger at calpoly.edu) and > > > > > > > > ellisonbg at gmail.com (mailto:ellisonbg at gmail.com) > > > > > > > > _______________________________________________ > > > > > > > > IPython-dev mailing list > > > > > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > > > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > > > IPython-dev mailing list > > > > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > IPython-dev mailing list > > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > IPython-dev mailing list > > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > > > > > > > > > -- > > > Brian E. Granger > > > Cal Poly State University, San Luis Obispo > > > bgranger at calpoly.edu (mailto:bgranger at calpoly.edu) and ellisonbg at gmail.com (mailto:ellisonbg at gmail.com) > > > _______________________________________________ > > > IPython-dev mailing list > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > bgranger at calpoly.edu (mailto:bgranger at calpoly.edu) and ellisonbg at gmail.com (mailto:ellisonbg at gmail.com) > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > http://mail.scipy.org/mailman/listinfo/ipython-dev From takowl at gmail.com Thu Jan 10 05:21:27 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 10 Jan 2013 10:21:27 +0000 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> Message-ID: <CAOvn4qi9EhBX9ZJfcwb761TMsUEHgQ6pJGCE+j+z+d_pkmKFFQ@mail.gmail.com> On 10 January 2013 06:10, Bradley M. Froehle <brad.froehle at gmail.com> wrote: > Min: Thanks for the XML file. I had just built a script to scrape > http://wiki.ipython.org/Special:AllPages so I could use > http://wiki.ipython.org/Special:Export. ( > https://gist.github.com/4499750#file-ipython_all_pages-py). > > Anyway, this mw-to-gollum.rb script ( > https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work okay. > > I've run it and pushed the results to > https://github.com/bfroehle/ipython/wiki/Main-Page > We've tried to keep a substantial portion of the wiki content in reST, so that we can easily move content between the wiki and the docs. Github wikis can handle reST natively, so it should be easy to fix pages like https://github.com/bfroehle/ipython/wiki/Extensions-Index Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130110/8fa3946a/attachment.html> From brad.froehle at gmail.com Thu Jan 10 11:24:31 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Thu, 10 Jan 2013 08:24:31 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAOvn4qi9EhBX9ZJfcwb761TMsUEHgQ6pJGCE+j+z+d_pkmKFFQ@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAOvn4qi9EhBX9ZJfcwb761TMsUEHgQ6pJGCE+j+z+d_pkmKFFQ@mail.gmail.com> Message-ID: <ECE636627482406ABDDED16BFF5947BA@gmail.com> I've updated the mw-to-gollum.rb gist https://gist.github.com/4499750#file-mw-to-gollum-rb to automatically handle these <rst> pages. The rest of the files are uploaded to github in the mediawiki format. -Brad On Thursday, January 10, 2013 at 2:21 AM, Thomas Kluyver wrote: > On 10 January 2013 06:10, Bradley M. Froehle <brad.froehle at gmail.com (mailto:brad.froehle at gmail.com)> wrote: > > Min: Thanks for the XML file. I had just built a script to scrape http://wiki.ipython.org/Special:AllPages so I could use http://wiki.ipython.org/Special:Export. (https://gist.github.com/4499750#file-ipython_all_pages-py). > > > > Anyway, this mw-to-gollum.rb script (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work okay. > > > > I've run it and pushed the results to https://github.com/bfroehle/ipython/wiki/Main-Page > We've tried to keep a substantial portion of the wiki content in reST, so that we can easily move content between the wiki and the docs. Github wikis can handle reST natively, so it should be easy to fix pages like https://github.com/bfroehle/ipython/wiki/Extensions-Index > > Thomas > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > http://mail.scipy.org/mailman/listinfo/ipython-dev From takowl at gmail.com Thu Jan 10 11:59:09 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 10 Jan 2013 16:59:09 +0000 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <ECE636627482406ABDDED16BFF5947BA@gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAOvn4qi9EhBX9ZJfcwb761TMsUEHgQ6pJGCE+j+z+d_pkmKFFQ@mail.gmail.com> <ECE636627482406ABDDED16BFF5947BA@gmail.com> Message-ID: <CAOvn4qhzsxjAq709JxqQR4wx0vh5OPG=7w467vCwVJyrv8cDPQ@mail.gmail.com> Great, thanks. Do you know what the issue is with the red links on https://github.com/bfroehle/ipython/wiki/Cookbook ? Is it as simple as replacing some _ with -? Thomas On 10 January 2013 16:24, Bradley M. Froehle <brad.froehle at gmail.com> wrote: > I've updated the mw-to-gollum.rb gist > https://gist.github.com/4499750#file-mw-to-gollum-rb to automatically > handle these <rst> pages. > > The rest of the files are uploaded to github in the mediawiki format. > > -Brad > > > On Thursday, January 10, 2013 at 2:21 AM, Thomas Kluyver wrote: > > > On 10 January 2013 06:10, Bradley M. Froehle <brad.froehle at gmail.com(mailto: > brad.froehle at gmail.com)> wrote: > > > Min: Thanks for the XML file. I had just built a script to scrape > http://wiki.ipython.org/Special:AllPages so I could use > http://wiki.ipython.org/Special:Export. ( > https://gist.github.com/4499750#file-ipython_all_pages-py). > > > > > > Anyway, this mw-to-gollum.rb script ( > https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work okay. > > > > > > I've run it and pushed the results to > https://github.com/bfroehle/ipython/wiki/Main-Page > > We've tried to keep a substantial portion of the wiki content in reST, > so that we can easily move content between the wiki and the docs. Github > wikis can handle reST natively, so it should be easy to fix pages like > https://github.com/bfroehle/ipython/wiki/Extensions-Index > > > > Thomas > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130110/18cd644b/attachment.html> From brad.froehle at gmail.com Thu Jan 10 12:06:05 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Thu, 10 Jan 2013 09:06:05 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAOvn4qhzsxjAq709JxqQR4wx0vh5OPG=7w467vCwVJyrv8cDPQ@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAOvn4qi9EhBX9ZJfcwb761TMsUEHgQ6pJGCE+j+z+d_pkmKFFQ@mail.gmail.com> <ECE636627482406ABDDED16BFF5947BA@gmail.com> <CAOvn4qhzsxjAq709JxqQR4wx0vh5OPG=7w467vCwVJyrv8cDPQ@mail.gmail.com> Message-ID: <21AD558D69854014994F20F99F923D1F@gmail.com> Yes, the links should be of the form [[Cookbook/Branded Notebook Interactive Tutorial]] instead of [[Cookbook/Branded_Notebook_Interactive_Tutorial]]. Those will need to be fixed by hand. Another issue is uploaded files, like at https://github.com/bfroehle/ipython/wiki/Cookbook-Styling-Notebook -Brad On Thursday, January 10, 2013 at 8:59 AM, Thomas Kluyver wrote: > Great, thanks. Do you know what the issue is with the red links on https://github.com/bfroehle/ipython/wiki/Cookbook ? Is it as simple as replacing some _ with -? > > Thomas > > > On 10 January 2013 16:24, Bradley M. Froehle <brad.froehle at gmail.com (mailto:brad.froehle at gmail.com)> wrote: > > I've updated the mw-to-gollum.rb gist https://gist.github.com/4499750#file-mw-to-gollum-rb to automatically handle these <rst> pages. > > > > The rest of the files are uploaded to github in the mediawiki format. > > > > -Brad > > > > > > On Thursday, January 10, 2013 at 2:21 AM, Thomas Kluyver wrote: > > > > > On 10 January 2013 06:10, Bradley M. Froehle <brad.froehle at gmail.com (mailto:brad.froehle at gmail.com) (mailto:brad.froehle at gmail.com)> wrote: > > > > Min: Thanks for the XML file. I had just built a script to scrape http://wiki.ipython.org/Special:AllPages so I could use http://wiki.ipython.org/Special:Export. (https://gist.github.com/4499750#file-ipython_all_pages-py). > > > > > > > > Anyway, this mw-to-gollum.rb script (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work okay. > > > > > > > > I've run it and pushed the results to https://github.com/bfroehle/ipython/wiki/Main-Page > > > We've tried to keep a substantial portion of the wiki content in reST, so that we can easily move content between the wiki and the docs. Github wikis can handle reST natively, so it should be easy to fix pages like https://github.com/bfroehle/ipython/wiki/Extensions-Index > > > > > > Thomas > > > _______________________________________________ > > > IPython-dev mailing list > > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) (mailto:IPython-dev at scipy.org) > > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > http://mail.scipy.org/mailman/listinfo/ipython-dev From ellisonbg at gmail.com Thu Jan 10 13:04:32 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Thu, 10 Jan 2013 10:04:32 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAOvn4qi9EhBX9ZJfcwb761TMsUEHgQ6pJGCE+j+z+d_pkmKFFQ@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAOvn4qi9EhBX9ZJfcwb761TMsUEHgQ6pJGCE+j+z+d_pkmKFFQ@mail.gmail.com> Message-ID: <CAH4pYpTsYsjy8a6kq+L-V0GFEeQuX4xg926r-Y+Ltmh4REgdNA@mail.gmail.com> I know our docs use reST, but as time goes along, I am using reST less and less in favor of markdown. Personally, I would prefer to use Markdown, at least for our new wiki pages. On Thu, Jan 10, 2013 at 2:21 AM, Thomas Kluyver <takowl at gmail.com> wrote: > On 10 January 2013 06:10, Bradley M. Froehle <brad.froehle at gmail.com> wrote: >> >> Min: Thanks for the XML file. I had just built a script to scrape >> http://wiki.ipython.org/Special:AllPages so I could use >> http://wiki.ipython.org/Special:Export. >> (https://gist.github.com/4499750#file-ipython_all_pages-py). >> >> Anyway, this mw-to-gollum.rb script >> (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work okay. >> >> I've run it and pushed the results to >> https://github.com/bfroehle/ipython/wiki/Main-Page > > > We've tried to keep a substantial portion of the wiki content in reST, so > that we can easily move content between the wiki and the docs. Github wikis > can handle reST natively, so it should be easy to fix pages like > https://github.com/bfroehle/ipython/wiki/Extensions-Index > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From brad.froehle at gmail.com Thu Jan 10 13:17:52 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Thu, 10 Jan 2013 10:17:52 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAH4pYpTsYsjy8a6kq+L-V0GFEeQuX4xg926r-Y+Ltmh4REgdNA@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAOvn4qi9EhBX9ZJfcwb761TMsUEHgQ6pJGCE+j+z+d_pkmKFFQ@mail.gmail.com> <CAH4pYpTsYsjy8a6kq+L-V0GFEeQuX4xg926r-Y+Ltmh4REgdNA@mail.gmail.com> Message-ID: <CAHXv-MhLH9wqvbJ+S8_uvqtqK1zw8s4MrNcuDo0p2xZTNh3VzA@mail.gmail.com> Well the good news is that the github system supports a number of formats, including rst, mediawiki, and markdown. In the initial import I think we should just preserve the existing format. We can then convert pages at our leisure and suggest that new pages use our preferred format. Brad On Thursday, January 10, 2013, Brian Granger wrote: > I know our docs use reST, but as time goes along, I am using reST less > and less in favor of markdown. Personally, I would prefer to use > Markdown, at least for our new wiki pages. > > On Thu, Jan 10, 2013 at 2:21 AM, Thomas Kluyver <takowl at gmail.com<javascript:;>> > wrote: > > On 10 January 2013 06:10, Bradley M. Froehle <brad.froehle at gmail.com<javascript:;>> > wrote: > >> > >> Min: Thanks for the XML file. I had just built a script to scrape > >> http://wiki.ipython.org/Special:AllPages so I could use > >> http://wiki.ipython.org/Special:Export. > >> (https://gist.github.com/4499750#file-ipython_all_pages-py). > >> > >> Anyway, this mw-to-gollum.rb script > >> (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work > okay. > >> > >> I've run it and pushed the results to > >> https://github.com/bfroehle/ipython/wiki/Main-Page > > > > > > We've tried to keep a substantial portion of the wiki content in reST, so > > that we can easily move content between the wiki and the docs. Github > wikis > > can handle reST natively, so it should be easy to fix pages like > > https://github.com/bfroehle/ipython/wiki/Extensions-Index > > > > Thomas > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org <javascript:;> > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > > -- > Brian E. Granger > Cal Poly State University, San Luis Obispo > bgranger at calpoly.edu <javascript:;> and ellisonbg at gmail.com <javascript:;> > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org <javascript:;> > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130110/8af38298/attachment.html> From ellisonbg at gmail.com Thu Jan 10 13:19:33 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Thu, 10 Jan 2013 10:19:33 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAHXv-MhLH9wqvbJ+S8_uvqtqK1zw8s4MrNcuDo0p2xZTNh3VzA@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHNn8BVZsuoc3UHmo7RPPRha-LKYwW1TT==tAfAWbTaFVXKHZw@mail.gmail.com> <CAHXv-MhhOMg78R8SGGSU-X3CPuY2fsC_b_-6wCsMuq0_NhSscA@mail.gmail.com> <4BE2B5EF5C554E45892C6BE227C6FE48@gmail.com> <CAOvn4qi9EhBX9ZJfcwb761TMsUEHgQ6pJGCE+j+z+d_pkmKFFQ@mail.gmail.com> <CAH4pYpTsYsjy8a6kq+L-V0GFEeQuX4xg926r-Y+Ltmh4REgdNA@mail.gmail.com> <CAHXv-MhLH9wqvbJ+S8_uvqtqK1zw8s4MrNcuDo0p2xZTNh3VzA@mail.gmail.com> Message-ID: <CAH4pYpRgwMaDVabMgmXsLZh51+kSsd66-wCEy1OjXNxcXw+K+g@mail.gmail.com> Sounds good. On Thu, Jan 10, 2013 at 10:17 AM, Bradley M. Froehle <brad.froehle at gmail.com> wrote: > Well the good news is that the github system supports a number of formats, > including rst, mediawiki, and markdown. In the initial import I think we > should just preserve the existing format. > > We can then convert pages at our leisure and suggest that new pages use our > preferred format. > > Brad > > > On Thursday, January 10, 2013, Brian Granger wrote: >> >> I know our docs use reST, but as time goes along, I am using reST less >> and less in favor of markdown. Personally, I would prefer to use >> Markdown, at least for our new wiki pages. >> >> On Thu, Jan 10, 2013 at 2:21 AM, Thomas Kluyver <takowl at gmail.com> wrote: >> > On 10 January 2013 06:10, Bradley M. Froehle <brad.froehle at gmail.com> >> > wrote: >> >> >> >> Min: Thanks for the XML file. I had just built a script to scrape >> >> http://wiki.ipython.org/Special:AllPages so I could use >> >> http://wiki.ipython.org/Special:Export. >> >> (https://gist.github.com/4499750#file-ipython_all_pages-py). >> >> >> >> Anyway, this mw-to-gollum.rb script >> >> (https://gist.github.com/4499750#file-mw-to-gollum-rb) seems to work >> >> okay. >> >> >> >> I've run it and pushed the results to >> >> https://github.com/bfroehle/ipython/wiki/Main-Page >> > >> > >> > We've tried to keep a substantial portion of the wiki content in reST, >> > so >> > that we can easily move content between the wiki and the docs. Github >> > wikis >> > can handle reST natively, so it should be easy to fix pages like >> > https://github.com/bfroehle/ipython/wiki/Extensions-Index >> > >> > Thomas >> > >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> > >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> bgranger at calpoly.edu and ellisonbg at gmail.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From fperez.net at gmail.com Thu Jan 10 20:38:16 2013 From: fperez.net at gmail.com (Fernando Perez) Date: Thu, 10 Jan 2013 17:38:16 -0800 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> Message-ID: <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> Hi folks, On Wed, Jan 9, 2013 at 11:12 AM, Brian Granger <ellisonbg at gmail.com> wrote: > I think this issue is really important for the project to consider if > we are going to successfully scale our efforts. Please read this, > think about it, and post your thoughts here, as it related to IPython. > At a practical level, we need to figure out better work flow for our > GitHub issues, especially ones for new features. I propose one option > in my blog post, but I am sure there are others. I just wanted to mention that Brian has encapsulated here very much my thoughts as well (and not by accident, as we've been talking a lot about this). It's important to note that this is NOT a 'hostile' attitude towards new contributions, since we are keenly aware that the value of IPython is in its utility to end users, who tend to always want new features for their problems. And who are kind and energetic enough to often go out and contribute them, for which we're incredibly grateful. But this is a careful consideration of the painful reality that it's possible for a project to die under the weight of too much code, too many features. So the challenge we are facing is how to keep a project that is very, very useful to people and allows them to do novel things, and yet stays tight and solid enough to be comprehensible and manageable by a relatively small team. I want to illustrate the kind of thing I see as where we want to go, with some examples from our own development: - the cell magics work: it enabled a ton of new features, but the underlying implementation was actually a major *reduction* of internal complexity, as we were able to factor a bunch of scattered functionality into a single model. - the merge of the parallel and interactive kernel into a single object: again, less code to be maintained but the automatic gain of all 'real ipython' functionality (magics, special syntax, etc) in all parallel contexts. - the ongoing effort to rationalize our input transformation machinery (IPEP 2 and PR #2447): while not done yet, we're trying precisely to get all the functionality we want with an ultimately simpler system. So we hope that it's clear that the vision carefully detailed by Brian is not a user-hostile position, quite the opposite. It's simply driven by a very strong desire to ensure that, two years after we have put a solid team working full time on this, we are standing in front of a project that is tight, comprehensible and a very robust foundation for the work of others, and not a sprawling mess of many features that nobody understands internally. It is very easy to die under the weight of complexity, and we really, really want to avoid that. A big thanks to Brian for taking the time to articulate these ideas so well; one of the things we'll be doing more as we move forward (and Aaron pointed that out in the comments) is trying to lay out these ideas and vision in an explicit way, so that everyone has a common reference point they can go to, rather than working off implicit assumptions and finding out after a lot of work they had gone in the wrong direction. Cheers, f From fperez.net at gmail.com Thu Jan 10 21:13:53 2013 From: fperez.net at gmail.com (Fernando Perez) Date: Thu, 10 Jan 2013 18:13:53 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> Message-ID: <CAHAreOr+i6rXbejNr0RHq4Sbm-GsGmZMBwzBWa64Jd9CyRp1fw@mail.gmail.com> On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com> wrote: > I am +1 on this plan. Just for the record, me too. We've got better things to do than fighting spammers right now... Thanks to everyone who pitched in quickly to make it happen! Cheers, f From brad.froehle at gmail.com Thu Jan 10 21:30:37 2013 From: brad.froehle at gmail.com (Bradley M. Froehle) Date: Thu, 10 Jan 2013 18:30:37 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <CAHAreOr+i6rXbejNr0RHq4Sbm-GsGmZMBwzBWa64Jd9CyRp1fw@mail.gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHAreOr+i6rXbejNr0RHq4Sbm-GsGmZMBwzBWa64Jd9CyRp1fw@mail.gmail.com> Message-ID: <6CB635F5959D4A199DB53BFAFBE5EA5D@gmail.com> I've posted a new issue https://github.com/ipython/ipython/issues/2771 to track the progress of the manual page cleanup. On Thursday, January 10, 2013 at 6:13 PM, Fernando Perez wrote: > On Wed, Jan 9, 2013 at 4:47 PM, Brian Granger <ellisonbg at gmail.com (mailto:ellisonbg at gmail.com)> wrote: > > I am +1 on this plan. > > > > Just for the record, me too. We've got better things to do than > fighting spammers right now... > > Thanks to everyone who pitched in quickly to make it happen! > > Cheers, > > f > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org (mailto:IPython-dev at scipy.org) > http://mail.scipy.org/mailman/listinfo/ipython-dev From fperez.net at gmail.com Thu Jan 10 21:32:34 2013 From: fperez.net at gmail.com (Fernando Perez) Date: Thu, 10 Jan 2013 18:32:34 -0800 Subject: [IPython-dev] Migrating wiki again In-Reply-To: <6CB635F5959D4A199DB53BFAFBE5EA5D@gmail.com> References: <CAOvn4qij1X6gBb0fd_h77+bzDqvVK9fS0ov0qiDC3RqxbTSE-A@mail.gmail.com> <CAH4pYpTMsGX-xMNqGOSEsVJoJw8=TwS6+Ka__k6xMs9T+P+EcA@mail.gmail.com> <CAHAreOr+i6rXbejNr0RHq4Sbm-GsGmZMBwzBWa64Jd9CyRp1fw@mail.gmail.com> <6CB635F5959D4A199DB53BFAFBE5EA5D@gmail.com> Message-ID: <CAHAreOojsqiaxckLp7Vw=dPXQDWJ1h02xgwBSYC2JD+7shO=Tw@mail.gmail.com> On Thu, Jan 10, 2013 at 6:30 PM, Bradley M. Froehle <brad.froehle at gmail.com> wrote: > I've posted a new issue https://github.com/ipython/ipython/issues/2771 to track the progress of the manual page cleanup. Awesome! This must be one of the best uses of the new task list feature :) Cheers, f From jiffyclub at gmail.com Thu Jan 10 21:54:40 2013 From: jiffyclub at gmail.com (Matt) Date: Thu, 10 Jan 2013 21:54:40 -0500 Subject: [IPython-dev] ipythonblocks & PyCon Talk Message-ID: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> Hi all, One of the (many) reasons I love the IPython Notebook is its potential for education. One way it can be leveraged is via the rich outputs possible, which allowed me to write the ipythonblocks package. ipythonblocks provides an object that displays itself as a colored HTML table that students can manipulate. See my blog post here: http://j.mp/ZNEBM5. The Notebook has other education friendly properties, especially its ability to stand alone as a self-contained environment. No switching between editors, shells, and docs? At PyCon in March I'm going to be giving a talk on teaching with the Notebook (http://j.mp/TNSzda). I'll probably spend a couple minutes of the talk relaying thoughts and anecdotes from other Software Carpentry instructors and I'd like to invite anyone here who uses the Notebook as a teaching tool to send me any particularly compelling stories that illustrate the Notebook's value in the classroom. Thanks, Matt From ellisonbg at gmail.com Thu Jan 10 22:45:20 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Thu, 10 Jan 2013 19:45:20 -0800 Subject: [IPython-dev] ipythonblocks & PyCon Talk In-Reply-To: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> References: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> Message-ID: <CAH4pYpQf5hbOkCcCmj22q3Eofv51XWXQAo-Rzw+cdqhzw_vUnw@mail.gmail.com> Matt, This is really great, thanks for posting. I hadn't looked at the PyCon talks yet - it is great to see one on the Notebook. It will be good to meet you there as well. Cheers, Brian On Thu, Jan 10, 2013 at 6:54 PM, Matt <jiffyclub at gmail.com> wrote: > Hi all, > > One of the (many) reasons I love the IPython Notebook is its potential for education. One way it can be leveraged is via the rich outputs possible, which allowed me to write the ipythonblocks package. ipythonblocks provides an object that displays itself as a colored HTML table that students can manipulate. See my blog post here: http://j.mp/ZNEBM5. > > The Notebook has other education friendly properties, especially its ability to stand alone as a self-contained environment. No switching between editors, shells, and docs? At PyCon in March I'm going to be giving a talk on teaching with the Notebook (http://j.mp/TNSzda). I'll probably spend a couple minutes of the talk relaying thoughts and anecdotes from other Software Carpentry instructors and I'd like to invite anyone here who uses the Notebook as a teaching tool to send me any particularly compelling stories that illustrate the Notebook's value in the classroom. > > Thanks, > Matt > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From michael.kraus at ipp.mpg.de Fri Jan 11 03:21:51 2013 From: michael.kraus at ipp.mpg.de (Michael Kraus) Date: Fri, 11 Jan 2013 09:21:51 +0100 Subject: [IPython-dev] TikZ Magics In-Reply-To: <6FE9EA96-D93D-4CD1-BB93-D48E22F9495F@gmail.com> References: <6F69D108-582B-44F6-A966-164731753ED0@ipp.mpg.de> <50ED668C.7050603@gmail.com> <FB6B89CB-7B54-4437-8EBF-0DF3952C0D0F@ipp.mpg.de> <50ED6832.2040205@gmail.com> <7EE6912B-59CF-43B4-A288-DE321A453149@ipp.mpg.de> <6FE9EA96-D93D-4CD1-BB93-D48E22F9495F@gmail.com> Message-ID: <B14483BC-C575-4E26-B425-558D0543E4ED@ipp.mpg.de> On 09.01.2013, at 17:55, Matthias BUSSONNIER <bussonniermatthias at gmail.com> wrote: >> For now, the new files can be found at >> >> http://www.ipp.mpg.de/~mkraus/python/tikzmagic.py >> http://www.ipp.mpg.de/~mkraus/python/tikzmagic_test.ipynb > > Would you like to add this to the Extension index on IPython wiki ? That probably is a good idea. But maybe I first should move them somewhere else (e.g. github) and create a short documentation. Cheers, Michael From dave.hirschfeld at gmail.com Fri Jan 11 10:19:11 2013 From: dave.hirschfeld at gmail.com (David Hirschfeld) Date: Fri, 11 Jan 2013 15:19:11 +0000 Subject: [IPython-dev] IPython Parallel Context Manager Message-ID: <CACGp2_PqwUxDrJq3Gan7DR=sonjmcFb0x9jQ2sOxh5Sf-u=HZw@mail.gmail.com> I've created a context manger which can be used to instantiate and shutdown an IPython cluster. I'm posting it here in the hope that others may find it useful and also for any feedback on how it could be implemented better, especially in regards to the ugly sleep calls where I found no better way of waiting until the client had connected to the instantiated engines. Demo code below and context manager below that. HTH, Dave ``` In [4]: from IPython.utils.path import locate_profile ...: from IPython.parallel.apps.launcher import LocalControllerLauncher, LocalEngineLauncher ...: from IPython.parallel import Client In [5]: rc = Client() # No controller running, expect error Traceback (most recent call last): File "<ipython-input-5-3adcc54b8411>", line 1, in <module> rc = Client() File "c:\dev\code\ipython\IPython\parallel\client\client.py", line 409, in __init__ with open(url_file) as f: IOError: [Errno 2] No such file or directory: u'C:\\Users\\dhirschfeld\\.ipython\\profile_default\\security\\ipcontroller-client.json' In [6]: with ParallelView(nengines=4, start_hub=True) as view: ...: print view.targets ...: # ...: Starting LocalControllerLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 7208 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 4292 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 6320 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 8804 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 5712 [0, 1, 2, 3] In [7]: rc = Client() # Instantiated controller shutdown on exit, expect error Traceback (most recent call last): File "<ipython-input-7-3adcc54b8411>", line 1, in <module> rc = Client() File "c:\dev\code\ipython\IPython\parallel\client\client.py", line 409, in __init__ with open(url_file) as f: IOError: [Errno 2] No such file or directory: u'C:\\Users\\dhirschfeld\\.ipython\\profile_default\\security\\ipcontroller-client.json' In [8]: controller = LocalControllerLauncher(profile_dir=locate_profile()) ...: controller.start() In [9]: with ParallelView(nengines=4) as view: ...: print view.targets ...: # ...: Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 8580 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 7524 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 11064 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 8144 [0, 1, 2, 3] In [10]: rc = Client() # Engines only shutdown on exit, expect empty list ...: rc.ids Out[10]: [] In [11]: engine = LocalEngineLauncher(profile_dir=locate_profile()) ...: engine.start() In [12]: engine = LocalEngineLauncher(profile_dir=locate_profile()) ...: engine.start() In [13]: rc.ids Out[13]: [4, 5] In [14]: with ParallelView(nengines=4) as view: # Expect only instantiated engines in targets ...: print view.targets ...: # ...: Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 6344 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 7532 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 10032 Starting LocalEngineLauncher: <snip> Process 'C:\\dev\\bin\\Python27\\python.exe' started: 10236 [8, 9, 6, 7] In [15]: rc.ids # Instantiated engines shutdown, original engines remain Out[15]: [4, 5] In [16]: ``` class ParallelView(object): def __init__(self, nengines=1, start_hub=False, type='load_balanced', profile='default', logger=None, delay=0.1): """Context mangager which will return a view [1]_ on an IPython cluster, optionally instantiating one if it is not already running. Parameters ---------- nengines : int The number of engine instances to instantiate start_hub : bool Whether or not to instantiate the controller as well type : str Either 'load_balanced' or 'direct' profile : str The name of the IPython to use logger : a `logging.Logger` instance If None a default logger writing to `sys.stdout` will be used delay : float How long between engine instantiations to delay References ---------- .. [1] http://ipython.org/ipython-doc/dev/api/generated/IPython.parallel.client.view.html#IPython.parallel.client.view.View """ import time from IPython.utils.path import locate_profile from IPython.config import PyFileConfigLoader self.rc = None self.ids = None self.delay = delay self.nengines = int(nengines) self.engines = [] self.type = str(type).lower() if self.type not in ('load_balanced','direct'): msg = "Expected `type` to be one of 'load_balanced' or 'direct' but got %s." % type raise ValueError(msg) if profile is None: self.profile_dir = locate_profile() else: self.profile_dir = locate_profile(profile=profile) self.profile = profile self.config = PyFileConfigLoader('ipython_config.py', self.profile_dir).load_config() if logger is None: import logging import sys logger = logging.Logger('ipcluster') logger.setLevel(logging.DEBUG) logger.addHandler(logging.StreamHandler(sys.stdout)) self.logger = logger if start_hub: from IPython.parallel.apps.launcher import LocalControllerLauncher controller = LocalControllerLauncher(config=self.config, log=self.logger, profile_dir=self.profile_dir) controller.start() time.sleep(2) self.start_hub = bool(start_hub) # def __enter__(self): from IPython.parallel.apps.launcher import LocalEngineLauncher from IPython.parallel import Client import time self.rc = Client(profile=self.profile) self.ids = set(self.rc.ids) for i in range(self.nengines): engine = LocalEngineLauncher(config=self.config, log=self.logger, profile_dir=self.profile_dir) self.engines.append(engine) engine.start() time.sleep(self.delay) MAX_LOOPS = 20 while len(set(self.rc.ids).difference(self.ids)) < sum(e.running for e in self.engines): time.sleep(10*self.delay) MAX_LOOPS -= 1 if MAX_LOOPS < 0: break self.ids = list(set(self.rc.ids).difference(self.ids)) if self.type == 'load_balanced': return self.rc.load_balanced_view(self.ids) return self.rc[self.ids] # def __exit__(self, *exc_info): self.rc.shutdown(self.ids, hub=self.start_hub) # From satshabad.music at gmail.com Fri Jan 11 13:10:14 2013 From: satshabad.music at gmail.com (satshabad khalsa) Date: Fri, 11 Jan 2013 10:10:14 -0800 Subject: [IPython-dev] New developers looking to help In-Reply-To: <B7608BF6-1C40-445C-949D-A31A1C1DDA1D@gmail.com> References: <CAC8xyJyk10BtpXXe+BZx9hCrQXCErTD7Gzg=26yZuvqcUj7ZhA@mail.gmail.com> <CAHNn8BVv0Kr7yEt5dwH=bb3KgC58svs7A1LM1JnuuYfBEzDUhg@mail.gmail.com> <CAC8xyJwXQ3N2gtVPR8eRER63O-+GoOs4UuX65pr_HzD-BDMJ3Q@mail.gmail.com> <B7608BF6-1C40-445C-949D-A31A1C1DDA1D@gmail.com> Message-ID: <CAC8xyJwophZNyyniWg3Lx9MRFmoCA7bs0y+H_aewv3_pqg3ffQ@mail.gmail.com> On Wed, Jan 9, 2013 at 3:34 PM, Robert McGibbon <rmcgibbo at gmail.com> wrote: In the qtconsole and notebook, all of that stuff has to be done differently > because the mechanisms for reading from the input line are different. > Cool, so is this something worth working on (if it's finished, will the patch be accepted)? If so, would someone mind pointing out the documentation where we could get started, or even just the hooks in the code? Thanks for all your help! Satshabad -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130111/bee3f454/attachment.html> From nick.bollweg at gmail.com Fri Jan 11 15:50:13 2013 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Fri, 11 Jan 2013 15:50:13 -0500 Subject: [IPython-dev] ipythonblocks & PyCon Talk In-Reply-To: <CAH4pYpQf5hbOkCcCmj22q3Eofv51XWXQAo-Rzw+cdqhzw_vUnw@mail.gmail.com> References: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> <CAH4pYpQf5hbOkCcCmj22q3Eofv51XWXQAo-Rzw+cdqhzw_vUnw@mail.gmail.com> Message-ID: <CACejjWxsU9hZigOEMH6hwBBLDYv2p0Ve5NxJAFn=FscrDo6H5g@mail.gmail.com> Matt: Looks neat. Can it do higher-level matrices, blown out into small multiples? In related block efforts: I've also got a thin wrapper around Blockly put together for the notebook: https://github.com/bollwyvl/ipython/tree/blockly Not sure if this can be of use to you! -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130111/2f8bec8c/attachment.html> From jiffyclub at gmail.com Fri Jan 11 15:55:34 2013 From: jiffyclub at gmail.com (Matt Davis) Date: Fri, 11 Jan 2013 15:55:34 -0500 Subject: [IPython-dev] ipythonblocks & PyCon Talk In-Reply-To: <CACejjWxsU9hZigOEMH6hwBBLDYv2p0Ve5NxJAFn=FscrDo6H5g@mail.gmail.com> References: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> <CAH4pYpQf5hbOkCcCmj22q3Eofv51XWXQAo-Rzw+cdqhzw_vUnw@mail.gmail.com> <CACejjWxsU9hZigOEMH6hwBBLDYv2p0Ve5NxJAFn=FscrDo6H5g@mail.gmail.com> Message-ID: <CAMqnrZrYJQ+q=oO8jmdXcFY-QhKcOWpL_g6abQ0iy+Xx6raO9w@mail.gmail.com> Hi Nicholas, At the moment it's limited to 2D. In fact, there isn't even a real 1D option, though you can certainly set one or both of the two dimensions to one. Best, Matt On Fri, Jan 11, 2013 at 3:50 PM, Nicholas Bollweg <nick.bollweg at gmail.com>wrote: > Matt: > Looks neat. Can it do higher-level matrices, blown out into small > multiples? > > In related block efforts: I've also got a thin wrapper around Blockly put > together for the notebook: > > https://github.com/bollwyvl/ipython/tree/blockly > > Not sure if this can be of use to you! > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130111/f03887b3/attachment.html> From bussonniermatthias at gmail.com Fri Jan 11 16:05:51 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Fri, 11 Jan 2013 22:05:51 +0100 Subject: [IPython-dev] New developers looking to help In-Reply-To: <CAC8xyJwophZNyyniWg3Lx9MRFmoCA7bs0y+H_aewv3_pqg3ffQ@mail.gmail.com> References: <CAC8xyJyk10BtpXXe+BZx9hCrQXCErTD7Gzg=26yZuvqcUj7ZhA@mail.gmail.com> <CAHNn8BVv0Kr7yEt5dwH=bb3KgC58svs7A1LM1JnuuYfBEzDUhg@mail.gmail.com> <CAC8xyJwXQ3N2gtVPR8eRER63O-+GoOs4UuX65pr_HzD-BDMJ3Q@mail.gmail.com> <B7608BF6-1C40-445C-949D-A31A1C1DDA1D@gmail.com> <CAC8xyJwophZNyyniWg3Lx9MRFmoCA7bs0y+H_aewv3_pqg3ffQ@mail.gmail.com> Message-ID: <6547165B-B0C7-4D39-855B-F2D7E8A8A60B@gmail.com> Le 11 janv. 2013 ? 19:10, satshabad khalsa a ?crit : > > On Wed, Jan 9, 2013 at 3:34 PM, Robert McGibbon <rmcgibbo at gmail.com> wrote: > > In the qtconsole and notebook, all of that stuff has to be done differently because the mechanisms for reading from the input line are different. So, Qtconsole is mostly a custom Qt/PyQt RichTextWidget. You would have to look to IPython/frontend/qt/console/ probably console_widget.py We have not defined any specific UI for the search so you are pretty free with that. The tricky part will probably be the search in the pager that has, I guess custom scrolling, and IIRC is monkey patch somewhere when docutils is installed to show formatted test. I have no idea on how to search on a QTextEdit, already knowing this would be a first step. Feel free to open a Draft Pull request to show what you are working on. > Cool, so is this something worth working on (if it's finished, will the patch be accepted)? If so, would someone mind pointing out the documentation where we could get started, or even just the hooks in the code? You do not need to implement the full feature. If you can already layout some utility function that will help to implement the search it would already be really good. Something working is not always accepted as is, there are often code style/naming/testing that will be needed around. But if there is already part of the logic that is well written documented and tested it has high chance of being merge, and it will already be a big step forward that will be greatly appreciated. So again don't hesitate to open a PR even early on dev process to get feedback. We'll do our best to follow. I think the most useful part would be the ability to search through the pager when a lot of text is send. cf def _page(self, text, html=False): of above cited file Feel free to ask more question or more precisions. dev doc is availlable here http://ipython.org/ipython-doc/dev but I'm not sure it is really consistent for the qtconsole. partial daily build is available on rtfd here https://ipython.readthedocs.org/en/latest/ -- Matthias > > Thanks for all your help! > Satshabad > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From takowl at gmail.com Fri Jan 11 19:03:17 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Sat, 12 Jan 2013 00:03:17 +0000 Subject: [IPython-dev] New developers looking to help In-Reply-To: <CAC8xyJwophZNyyniWg3Lx9MRFmoCA7bs0y+H_aewv3_pqg3ffQ@mail.gmail.com> References: <CAC8xyJyk10BtpXXe+BZx9hCrQXCErTD7Gzg=26yZuvqcUj7ZhA@mail.gmail.com> <CAHNn8BVv0Kr7yEt5dwH=bb3KgC58svs7A1LM1JnuuYfBEzDUhg@mail.gmail.com> <CAC8xyJwXQ3N2gtVPR8eRER63O-+GoOs4UuX65pr_HzD-BDMJ3Q@mail.gmail.com> <B7608BF6-1C40-445C-949D-A31A1C1DDA1D@gmail.com> <CAC8xyJwophZNyyniWg3Lx9MRFmoCA7bs0y+H_aewv3_pqg3ffQ@mail.gmail.com> Message-ID: <CAOvn4qjs3OkHrE6PjFoW2he=vuZ6dV94wCxaZRHXFZXF7VB7aA@mail.gmail.com> On 11 January 2013 18:10, satshabad khalsa <satshabad.music at gmail.com>wrote: > Cool, so is this something worth working on (if it's finished, will the > patch be accepted)? If so, would someone mind pointing out the > documentation where we could get started, or even just the hooks in the > code? > I don't want to dissuade you from working on this, but if you're looking to get your first patch accepted promptly, you might be better starting with a relatively simple bugfix, rather than implementing a new feature. We often set the bar quite high for new features, because a feature that 80% works can be worse than not having that feature at all. If you do want to work on Ctrl+r in the Qt console, hunt out the code path that runs when you type something in and press the up-arrow. Best wishes, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130112/96d612de/attachment.html> From erik.m.bray at gmail.com Fri Jan 11 19:42:08 2013 From: erik.m.bray at gmail.com (Erik Bray) Date: Fri, 11 Jan 2013 19:42:08 -0500 Subject: [IPython-dev] nbviewer enhancement: pad In-Reply-To: <CAH+mRR3jtixUhK9W77ESytG9AbZeE-caDPQFAVAiOuSKGvzvvA@mail.gmail.com> References: <CAH+mRR01hoK77CFDLEsVagBYaxBCvtTZE2VQF0Bzb+SVEu148g@mail.gmail.com> <CAH+mRR3-9dmOUr-ZBMtkeg0r0L0UUvNCm5x2q+X9og3cSQscCw@mail.gmail.com> <CAH+mRR3FTJjKoXYUFxGHUQH2Nb4ZvoAbcbzKmphojd05zjBr4g@mail.gmail.com> <CAH+mRR3jtixUhK9W77ESytG9AbZeE-caDPQFAVAiOuSKGvzvvA@mail.gmail.com> Message-ID: <CAOTD34Z7i5yXoUPp8Kw17t=C0jnyqE1v3uXLCedQcJMXTX5m8Q@mail.gmail.com> On Tue, Jan 8, 2013 at 7:35 PM, Dami?n Avila <damianavila at gmail.com> wrote: > I wanted to discuss about some notebook, I wanted some kind of > collaboration... So... check this out and let me know what do you think: > http://nbviewerpad.herokuapp.com/urls/raw.github.com/ipython/ipython/master/docs/examples/notebooks/00_notebook_tour.ipynb > > Dami?n. Nice! This would work as a reasonable alternative or at least addendum to my desirement to add a drawing overlay to nbviewer. From shaklev at gmail.com Sat Jan 12 16:56:46 2013 From: shaklev at gmail.com (=?UTF-8?Q?Stian_H=C3=A5klev?=) Date: Sat, 12 Jan 2013 16:56:46 -0500 Subject: [IPython-dev] Where to look: extending Markdown, and including NB in other webpages Message-ID: <CAEKz3thnMZ30F6uV+RhK1yrZBy3r+UHvs2tiriAP=0G1X9Ezjw@mail.gmail.com> Hi. I'm coming from the Ruby world, but have been blown away by IPython and Notebook, as well as the incredible support for scientific computing, statistics etc. I'm a PhD student in education, and have decided to try to use IPython for my statistical analysis, instead of SPSS etc. Also very interested in open scholarship/reproducible research etc. I've been working on an "open scholar" workflow, using Ruby+AppScript to integrate a citation manager, PDF reader, and Dokuwiki into a pretty neat system (see http://reganmian.net/wiki/researchr:start). I'm currently thinking about how to integrate IPython with my workflow. I have two ideas, and in both cases, I'd love a little pointer as to where to look (I realize I'll have to dig through some code, and learn more Python, to get there). 1. How easy is it to write a "plugin" for the Markdown parser? In my wiki, [@citekey] is replaced with a proper citation, with a link to the relevant article page etc. I also wrote a plugin for Wordpress to do the same (they get the info from a pre-processed JSON file). For WordPress this is as easy as a small php file with a regexp. How would I do some similar "post-processing" on Markdown cells? 2. A more ambitious idea would be to try to integrate Notebook with Dokuwiki. My idea would be to have a php plugin which started an IPython instance, and then sent each code block on the page to the server, and got back output, which was written to the page (which is then cached, so it doesn't have to be re-run until the page changes). I was thinking of having a markup like <IPython>plot(x,y)</IPython> - possibly also with the option of hiding the Python code and only showing the output (this would make it more similar to knitr), or also showing the color highlighted Python code... I'm not sure how easy this would be - I need to understand more about how to start and communicate with an IPython kernel, and what exactly it sends back (ie. how much of the HTML processing etc gets done in Notebook, as opposed to in the kernel, etc). Has anyone else tried to do something similar? Again, pointers to where I should start to look would be useful! I will of course share anything I come up with! Thanks again for an amazing project. I look forward to the first Coursera course (or similar) using IPython and Numpy+Scipy+Pandas instead of R (I am thinking of trying to take one of the courses, and doing all the exercises in IPython instead). Stian Haklev Curriculum, Teaching and Learning, University of Toronto -- http://reganmian.net/blog -- Random Stuff that Matters -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130112/6bef69da/attachment.html> From bussonniermatthias at gmail.com Sun Jan 13 04:08:55 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Sun, 13 Jan 2013 10:08:55 +0100 Subject: [IPython-dev] Where to look: extending Markdown, and including NB in other webpages In-Reply-To: <CAEKz3thnMZ30F6uV+RhK1yrZBy3r+UHvs2tiriAP=0G1X9Ezjw@mail.gmail.com> References: <CAEKz3thnMZ30F6uV+RhK1yrZBy3r+UHvs2tiriAP=0G1X9Ezjw@mail.gmail.com> Message-ID: <7CB0F1C4-0811-4B61-A844-54CB014AA8F9@gmail.com> HI, Le 12 janv. 2013 ? 22:56, Stian H?klev a ?crit : > Hi. I'm coming from the Ruby world, You might be interested /could help with https://github.com/ipython/ipython/pull/2643 > but have been blown away by IPython and Notebook, as well as the incredible support for scientific computing, statistics etc. I'm a PhD student in education, and have decided to try to use IPython for my statistical analysis, instead of SPSS etc. Also very interested in open scholarship/reproducible research etc. > I've been working on an "open scholar" workflow, using Ruby+AppScript to integrate a citation manager, PDF reader, and Dokuwiki into a pretty neat system (see http://reganmian.net/wiki/researchr:start). I'm currently thinking about how to integrate IPython with my workflow. I have two ideas, and in both cases, I'd love a little pointer as to where to look (I realize I'll have to dig through some code, and learn more Python, to get there). > > 1. How easy is it to write a "plugin" for the Markdown parser? In my wiki, [@citekey] is replaced with a proper citation, with a link to the relevant article page etc. I also wrote a plugin for Wordpress to do the same (they get the info from a pre-processed JSON file). For WordPress this is as easy as a small php file with a regexp. How would I do some similar "post-processing" on Markdown cells? Shouldn't be too hard, But IMHO it will probably not be accepted in the core. If you need modification for plugin those might be accepted like a prerender-hook or a post render hook. If you do such modification like that, be aware that they will probably be needed for nbconvert : https://github.com/ipython/nbconvert > 2. A more ambitious idea would be to try to integrate Notebook with Dokuwiki. My idea would be to have a php plugin which started an IPython instance, and then sent each code block on the page to the server, and got back output, which was written to the page (which is then cached, so it doesn't have to be re-run until the page changes). I suggest you have a look to nbconvert which is beeing rewritten right now, so ask before sending any PR or extending it for yourself as the API will probably change soon. > I was thinking of having a markup like > <IPython>plot(x,y)</IPython> - possibly also with the option of hiding the Python code and only showing the output (this would make it more similar to knitr), or also showing the color highlighted Python code... > > I'm not sure how easy this would be - I need to understand more about how to start and communicate with an IPython kernel, and what exactly it sends back (ie. how much of the HTML processing etc gets done in Notebook, as opposed to in the kernel, etc). Has anyone else tried to do something similar? IMHO nbconvert is what you are looking for. It takes an ipynb file and generate HTML/rst/markdown to be integrated. > Again, pointers to where I should start to look would be useful! I will of course share anything I come up with! > > Thanks again for an amazing project. I look forward to the first Coursera course (or similar) using IPython and Numpy+Scipy+Pandas instead of R (I am thinking of trying to take one of the courses, and doing all the exercises in IPython instead). Thanks ! Matthias From ellisonbg at gmail.com Sun Jan 13 14:11:23 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Sun, 13 Jan 2013 11:11:23 -0800 Subject: [IPython-dev] Where to look: extending Markdown, and including NB in other webpages In-Reply-To: <CAEKz3thnMZ30F6uV+RhK1yrZBy3r+UHvs2tiriAP=0G1X9Ezjw@mail.gmail.com> References: <CAEKz3thnMZ30F6uV+RhK1yrZBy3r+UHvs2tiriAP=0G1X9Ezjw@mail.gmail.com> Message-ID: <CAH4pYpTn5DXWSzZ46Wji=hyqAyL4g_8JthXe=pSTG2Uhz8bkXw@mail.gmail.com> Hi, On Sat, Jan 12, 2013 at 1:56 PM, Stian H?klev <shaklev at gmail.com> wrote: > Hi. I'm coming from the Ruby world, but have been blown away by IPython and > Notebook, as well as the incredible support for scientific computing, > statistics etc. I'm a PhD student in education, and have decided to try to > use IPython for my statistical analysis, instead of SPSS etc. Also very > interested in open scholarship/reproducible research etc. Glad you like it! > I've been working on an "open scholar" workflow, using Ruby+AppScript to > integrate a citation manager, PDF reader, and Dokuwiki into a pretty neat > system (see http://reganmian.net/wiki/researchr:start). I'm currently > thinking about how to integrate IPython with my workflow. I have two ideas, > and in both cases, I'd love a little pointer as to where to look (I realize > I'll have to dig through some code, and learn more Python, to get there). > > 1. How easy is it to write a "plugin" for the Markdown parser? In my wiki, > [@citekey] is replaced with a proper citation, with a link to the relevant > article page etc. I also wrote a plugin for Wordpress to do the same (they > get the info from a pre-processed JSON file). For WordPress this is as easy > as a small php file with a regexp. How would I do some similar > "post-processing" on Markdown cells? As Matthias said, it could definitely be done, but we probably wouldn't accept it into the project. By putting a custom.js file in the right place in your IPython directory: IPYTHONDIR/profile_default/static/js/custom.js You can add anything you want to the notebook. > 2. A more ambitious idea would be to try to integrate Notebook with > Dokuwiki. My idea would be to have a php plugin which started an IPython > instance, and then sent each code block on the page to the server, and got > back output, which was written to the page (which is then cached, so it > doesn't have to be re-run until the page changes). If you want to integrate the notebook into other websites, you have two options: 1. Simply start the existing notebook server and use a proxy, such as node-http-proxy to tie it into your site. 2. Just start to dig into the code and actually hack on it to build what you want. This is more general, but a ton more work. Also, keep in mind that the notebook server is equivalent to giving someone a shell account on your system. You should not expect to to offer the notebook to untrusted users on the web sithout a massive investment in a comprehensive security architecture. The scope of the IPython notebook is on *trusted* users where no additional security infrastucture is needed, so you will have to build this yourself. > I was thinking of having a markup like > <IPython>plot(x,y)</IPython> - possibly also with the option of hiding the > Python code and only showing the output (this would make it more similar to > knitr), or also showing the color highlighted Python code... > > I'm not sure how easy this would be - I need to understand more about how to > start and communicate with an IPython kernel, and what exactly it sends back > (ie. how much of the HTML processing etc gets done in Notebook, as opposed > to in the kernel, etc). Has anyone else tried to do something similar? Honestly, I am not sure. I would just start to dig into the code - it is somewhat complex and you should know that the actual backend for the web app is very unstable. If you develop against it at this point, you will have to change your code moving forward. > Again, pointers to where I should start to look would be useful! I will of > course share anything I come up with! Here is the notebook code: https://github.com/ipython/ipython/tree/master/IPython/frontend/html/notebook All of the kernel stuff is here: https://github.com/ipython/ipython/tree/master/IPython/zmq Cheers, Brian > Thanks again for an amazing project. I look forward to the first Coursera > course (or similar) using IPython and Numpy+Scipy+Pandas instead of R (I am > thinking of trying to take one of the courses, and doing all the exercises > in IPython instead). > > Stian Haklev > Curriculum, Teaching and Learning, University of Toronto > > -- > http://reganmian.net/blog -- Random Stuff that Matters > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From nick.bollweg at gmail.com Mon Jan 14 10:53:23 2013 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Mon, 14 Jan 2013 10:53:23 -0500 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> Message-ID: <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> I started reading the thread back in december answering the perceived question "i'm not core: should I keep helping?" and started writing code as this is related to some of the research in which i am involved, and needed something to do. :) I have used a lot of code/effort management tools (open source and otherwise), and pretty much none of their project concepts really scale in all the dimensions that IPython is growing: codebase, distributed users, platforms, security concerns, management (not in the bad sense), modularity. How can the dense graph of information related to the broader effort be parsed, quickly and visually, to find and answer the core questions that are afflicting the project, such as the ones matthias mentioned, specifically for pull requests: * This pr has 3 "merge ok", I just have to read add mine and I can merge. * This PR has already 2 dev with are "involved" I can worry of others. * This one has nobody I'll look after it. Further, why should the choice of tools for one aspect of the community (such as repos: monolithic vs modular, git vs hg, etc.) dominate the interaction the developers and leaders experience (such as issues)? Why should the data model of an upstream data vendor dictate what the users can do, such as the inability for non-collabs to label tickets, when a beeelion sites exist for doing tagging? Here is the result (with the earliest bits of IPython's meta loaded)... https://fra.gl/?/config/ipython a lot remains to be done, but i think i can answer the latter two, I still need to do some thinking about the former: you do have to log in to github over oauth, and then configure the columns on the tables to start seeing what i'm talking about. working on better doc/screencast! Here is the code (bootstrap+d3... flask for OAuth. fabric for automation): https://github.com/bollwyvl/fragile metameta: https://fra.gl/?/config/fragile I was hoping to get it a bit further, but since this has come back up, I thought I'd do the reveal, and maybe spark some interest. I am also interested in taking this work and doing some experimental stuff, hopefully to be written up as a(n) paper(s). If you're interested, check out: https://github.com/bollwyvl/fragile-papers But the end goal is to help make transitions like the kind that IPython is experiencing less painful. On Thu, Jan 10, 2013 at 8:38 PM, Fernando Perez <fperez.net at gmail.com>wrote: > Hi folks, > > On Wed, Jan 9, 2013 at 11:12 AM, Brian Granger <ellisonbg at gmail.com> > wrote: > > I think this issue is really important for the project to consider if > > we are going to successfully scale our efforts. Please read this, > > think about it, and post your thoughts here, as it related to IPython. > > At a practical level, we need to figure out better work flow for our > > GitHub issues, especially ones for new features. I propose one option > > in my blog post, but I am sure there are others. > > I just wanted to mention that Brian has encapsulated here very much my > thoughts as well (and not by accident, as we've been talking a lot > about this). It's important to note that this is NOT a 'hostile' > attitude towards new contributions, since we are keenly aware that the > value of IPython is in its utility to end users, who tend to always > want new features for their problems. And who are kind and energetic > enough to often go out and contribute them, for which we're incredibly > grateful. > > But this is a careful consideration of the painful reality that it's > possible for a project to die under the weight of too much code, too > many features. So the challenge we are facing is how to keep a > project that is very, very useful to people and allows them to do > novel things, and yet stays tight and solid enough to be > comprehensible and manageable by a relatively small team. > > I want to illustrate the kind of thing I see as where we want to go, > with some examples from our own development: > > - the cell magics work: it enabled a ton of new features, but the > underlying implementation was actually a major *reduction* of internal > complexity, as we were able to factor a bunch of scattered > functionality into a single model. > > - the merge of the parallel and interactive kernel into a single > object: again, less code to be maintained but the automatic gain of > all 'real ipython' functionality (magics, special syntax, etc) in all > parallel contexts. > > - the ongoing effort to rationalize our input transformation machinery > (IPEP 2 and PR #2447): while not done yet, we're trying precisely to > get all the functionality we want with an ultimately simpler system. > > So we hope that it's clear that the vision carefully detailed by Brian > is not a user-hostile position, quite the opposite. It's simply > driven by a very strong desire to ensure that, two years after we have > put a solid team working full time on this, we are standing in front > of a project that is tight, comprehensible and a very robust > foundation for the work of others, and not a sprawling mess of many > features that nobody understands internally. > > It is very easy to die under the weight of complexity, and we really, > really want to avoid that. > > A big thanks to Brian for taking the time to articulate these ideas so > well; one of the things we'll be doing more as we move forward (and > Aaron pointed that out in the comments) is trying to lay out these > ideas and vision in an explicit way, so that everyone has a common > reference point they can go to, rather than working off implicit > assumptions and finding out after a lot of work they had gone in the > wrong direction. > > Cheers, > > f > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130114/4de517b4/attachment.html> From takowl at gmail.com Mon Jan 14 11:10:08 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 14 Jan 2013 16:10:08 +0000 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> Message-ID: <CAOvn4qiJs2USi1kYYVax8Fwfg=nQmgWrxO0XpsLdfiz73824qg@mail.gmail.com> On 14 January 2013 15:53, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > Here is the result (with the earliest bits of IPython's meta loaded)... > https://fra.gl/?/config/ipython > a lot remains to be done, but i think i can answer the latter two, I still > need to do some thinking about the former: you do have to log in to github > over oauth, and then configure the columns on the tables to start seeing > what i'm talking about. working on better doc/screencast! > Sorry, I'm lost here. I see a small image that appears to be the cover page of an example notebook rendered in reveal.js, and a set of buttons across the bottom that don't do anything. The page you describe as 'metameta' doesn't really make anything clearer. Can you give us some idea of what fra.gl is supposed to be? Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130114/ecaf023c/attachment.html> From bussonniermatthias at gmail.com Mon Jan 14 11:56:02 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Mon, 14 Jan 2013 17:56:02 +0100 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CAOvn4qiJs2USi1kYYVax8Fwfg=nQmgWrxO0XpsLdfiz73824qg@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> <CAOvn4qiJs2USi1kYYVax8Fwfg=nQmgWrxO0XpsLdfiz73824qg@mail.gmail.com> Message-ID: <D703F51F-F7ED-43D3-B208-229C98729BBB@gmail.com> Le 14 janv. 2013 ? 17:10, Thomas Kluyver a ?crit : > On 14 January 2013 15:53, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > Here is the result (with the earliest bits of IPython's meta loaded)... > https://fra.gl/?/config/ipython > a lot remains to be done, but i think i can answer the latter two, I still need to do some thinking about the former: you do have to log in to github over oauth, and then configure the columns on the tables to start seeing what i'm talking about. working on better doc/screencast! > > Sorry, I'm lost here. I see a small image that appears to be the cover page of an example notebook rendered in reveal.js, and a set of buttons across the bottom that don't do anything. The page you describe as 'metameta' doesn't really make anything clearer. > > Can you give us some idea of what fra.gl is supposed to be? You have to login on the bottom right, Look nice. As 'github requests' (5000/day?) is almost full, i'll do a quick description: repo represented as those rectangle map that show the size of each element. below, two customizable column that allow custom repr of issue/pr list. screenshot attached. My mouse is hovering the grey rectangle that represent IPython/deathrow/ibrowse.py Looking forward for the rest ! -- Matthias > > Thanks, > Thomas > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130114/2d7f324f/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: Capture d??cran 2013-01-14 ? 17.54.10.png Type: image/png Size: 301293 bytes Desc: not available URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130114/2d7f324f/attachment.png> From ondrej.certik at gmail.com Mon Jan 14 14:48:23 2013 From: ondrej.certik at gmail.com (=?UTF-8?B?T25kxZllaiDEjGVydMOtaw==?=) Date: Mon, 14 Jan 2013 11:48:23 -0800 Subject: [IPython-dev] Policy for closing pull requests In-Reply-To: <CAH4pYpTwE2Tx-3xJa2AfiC+9qZuzN=sp4wShD6vVG8hf3oTy1Q@mail.gmail.com> References: <CAH4pYpQO=5Khyu_KBW+7E5bEuLWF3VduWowSpnh51nr8y230Xw@mail.gmail.com> <CAKgW=6KQWmY+6cimjOK5C2s=Mcw+hvrZkHYNR9172t+4=pZWhw@mail.gmail.com> <CAHAreOqCpzqvyEdbtNTbA1WdOTYwOGZuVQuf4R6VDHew6krL5Q@mail.gmail.com> <CAH4pYpSqPZCxLZvw2hqFvk_dRvoO7=j8uoBxbQd-kjstv5FNXg@mail.gmail.com> <CAHAreOo7rswY-qGGbNyNpp8UQc1=X=r0okh8jMvkTawVo38-=g@mail.gmail.com> <CAH4pYpSwLKoPwjAoZfz08VimJ3fg3BvS0K38kHTvygex72_tiQ@mail.gmail.com> <CAHAreOrnqfYV4WHTMGLrbYHm+AFofBV0dUa1-9vHtF+q4XnxWQ@mail.gmail.com> <CAH4pYpTwE2Tx-3xJa2AfiC+9qZuzN=sp4wShD6vVG8hf3oTy1Q@mail.gmail.com> Message-ID: <CADDwiVB5nXi6mqMa_TSzXA_pBiLvT4-c86YSOy+j+95sqTpBXw@mail.gmail.com> On Tue, Oct 2, 2012 at 1:21 PM, Brian Granger <ellisonbg at gmail.com> wrote: > https://github.com/ipython/ipython/wiki/Policy:-Closing-pull-requests > > Please make edits if I have missed anything. Thanks for working on this. I agree with this, also I agree with the point of rather using a human to decide on a case by case basis, rather than a hard rule. I also noticed this recent feature of github: https://github.com/blog/1378-view-long-running-pull-requests which might help to concentrate on issues that have activity, but take forever to finish. Ondrej From fperez.net at gmail.com Mon Jan 14 14:48:36 2013 From: fperez.net at gmail.com (Fernando Perez) Date: Mon, 14 Jan 2013 11:48:36 -0800 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CAOvn4qiJs2USi1kYYVax8Fwfg=nQmgWrxO0XpsLdfiz73824qg@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> <CAOvn4qiJs2USi1kYYVax8Fwfg=nQmgWrxO0XpsLdfiz73824qg@mail.gmail.com> Message-ID: <CAHAreOoh3BT6vYR9=BrFOxY9wQRajMQK==HMncWGoKVAZodvRg@mail.gmail.com> n Mon, Jan 14, 2013 at 8:10 AM, Thomas Kluyver <takowl at gmail.com> wrote: > Sorry, I'm lost here. I see a small image that appears to be the cover page > of an example notebook rendered in reveal.js, and a set of buttons across > the bottom that don't do anything. The page you describe as 'metameta' > doesn't really make anything clearer. BTW, even after logging in, firefox doesn't render anything. I had to log in with Chrome to see anything... From ellisonbg at gmail.com Mon Jan 14 16:50:42 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Mon, 14 Jan 2013 13:50:42 -0800 Subject: [IPython-dev] Woohoo! Message-ID: <CAH4pYpSuB-L=K6L6uC+x0THnnYHVKHthKM6DCY67xCPixkBznQ@mail.gmail.com> We are below 30 open pull requests! Time to open a few more... -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From takowl at gmail.com Mon Jan 14 17:20:36 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 14 Jan 2013 22:20:36 +0000 Subject: [IPython-dev] Woohoo! In-Reply-To: <CAH4pYpSuB-L=K6L6uC+x0THnnYHVKHthKM6DCY67xCPixkBznQ@mail.gmail.com> References: <CAH4pYpSuB-L=K6L6uC+x0THnnYHVKHthKM6DCY67xCPixkBznQ@mail.gmail.com> Message-ID: <CAOvn4qhTYmC5aV7fnQ+J6Ugx_wHAn-fU6h1cUymXap+Vc9udJg@mail.gmail.com> On 14 January 2013 21:50, Brian Granger <ellisonbg at gmail.com> wrote: > We are below 30 open pull requests! Time to open a few more... > Congratulations everyone. I think we've closed 10 today. Keep up the good work. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130114/e5668e59/attachment.html> From fperez.net at gmail.com Mon Jan 14 18:42:44 2013 From: fperez.net at gmail.com (Fernando Perez) Date: Mon, 14 Jan 2013 15:42:44 -0800 Subject: [IPython-dev] ipythonblocks & PyCon Talk In-Reply-To: <CAH4pYpQf5hbOkCcCmj22q3Eofv51XWXQAo-Rzw+cdqhzw_vUnw@mail.gmail.com> References: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> <CAH4pYpQf5hbOkCcCmj22q3Eofv51XWXQAo-Rzw+cdqhzw_vUnw@mail.gmail.com> Message-ID: <CAHAreOrvq2pr-WL__sXJXsMrc6q118ZAgLaXdb5X7X=+b714ZA@mail.gmail.com> On Thu, Jan 10, 2013 at 7:45 PM, Brian Granger <ellisonbg at gmail.com> wrote: > Matt, > > This is really great, thanks for posting. I hadn't looked at the > PyCon talks yet - it is great to see one on the Notebook. It will be > good to meet you there as well. Yup, fantastic! Note that we'll have a booth up in the vendor section as an open source 'sponsor', we'll give you the booth location when we know it so you can put that in your talk: the booth is a great way to engage people one-on-one beyond the time allotted to a talk. Cheers, f From nick.bollweg at gmail.com Mon Jan 14 23:23:02 2013 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Mon, 14 Jan 2013 23:23:02 -0500 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CAHAreOoh3BT6vYR9=BrFOxY9wQRajMQK==HMncWGoKVAZodvRg@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> <CAOvn4qiJs2USi1kYYVax8Fwfg=nQmgWrxO0XpsLdfiz73824qg@mail.gmail.com> <CAHAreOoh3BT6vYR9=BrFOxY9wQRajMQK==HMncWGoKVAZodvRg@mail.gmail.com> Message-ID: <CACejjWxHgqgyQ3+j5QiNKGBLV2EL6X71GbbYpTdmHCC0ts00yQ@mail.gmail.com> Sorry guys, bad pitch! Thank you so much for the input! Let's try this: fra.gl is a browser-based app for visualizing the relationships between the community artifacts of open source project such as repos, issues, pull requests and collaborators. Like I was saying, it's a bit of an pre-alpha release of some technology demonstrations that I wanted to get more functional before releasing more broadly, but thought it could contribute to the discussion here. BTW, even after logging in, firefox doesn't render anything. I had to > log in with Chrome to see anything... > Issue created! https://github.com/bollwyvl/fragile/issues/8 Sorry, I'm lost here. I see a small image that appears to be the cover > page of an example notebook rendered in reveal.js, and > Again, a proof of concept... that is an HTML->PDF->SVG of the most recent reveal.js demo of nbviewer I had at the time. Part of the concept is having data-driven SVG presentations that may include project data... right now it is just kind of bad build powerpoint decks. a set of buttons across the bottom that don't do anything. > Yes, these need to be hidden until a more thorough implementation is made of them and explained... for example, adding new project streams to a configuration. Added to ticket. > The page you describe as 'metameta' doesn't really make anything clearer. > Definitely, need to add some more explanatory stuff to the SVG up front... however, the issues created right now do already show up there :) In a sense, this early feedback from you guys serves as the direction for what it should become. Issue created! https://github.com/bollwyvl/fragile/issues/9 Thanks again! Will update in separate thread. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130114/19051068/attachment.html> From jason-sage at creativetrax.com Tue Jan 15 00:21:37 2013 From: jason-sage at creativetrax.com (Jason Grout) Date: Mon, 14 Jan 2013 22:21:37 -0700 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> Message-ID: <50F4E761.80303@creativetrax.com> On 1/14/13 8:53 AM, Nicholas Bollweg wrote: > and then configure the columns on the tables to start seeing what i'm > talking about. Can you elaborate on how to interpret the "graphical depiction of comment stream"? This looks really cool. I agree that the toolset that github provides can be really improved. Thanks, Jason From nick.bollweg at gmail.com Tue Jan 15 01:53:15 2013 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Tue, 15 Jan 2013 01:53:15 -0500 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <50F4E761.80303@creativetrax.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> <50F4E761.80303@creativetrax.com> Message-ID: <CACejjWz-K3C-2Jouq9AW1gtUv=S5n9ms2Fo=XuG-Hk4mrOHBjA@mail.gmail.com> > Can you elaborate on how to interpret the "graphical depiction of comment > stream"? > I am struggling with the right perspective, which probably means it needs to be a lot more configurable, and as you point out, labeled... it shows much of the same high level information as the avatar view column, but could show a trend such as "there was a lot of activity up front by core devs, then they didn't comment much". Here's the current scheme, as implemented: - Marks: each block is a comment - x: date of comment from (right to left) creation of ticket to tomorrow: off by one feature of my use of d3, i think :) - y: which # of comment on that day (5 comments will be a stack of 5 blocks)... not super meaningful, except in aggregate - color: collaborators (e.g. IPython committers) are shown in one of the d3.scale.category20 colors, "others" in grey. > This looks really cool. > Thanks for the encouragement! Banging out bugs/inconsistencies right now, but really, really want to get back into the visualization parts! I think a touch more interactivity would bring out this content a bit more... for example, tooltips seem like low-hanging fruit (as I already have the user and full text sitting around... watch the API burn!), while I really would like to pull the touched paths from a pull request and light them up when you hover a ticket... as well as generally indicate "hot" paths across pull requests, showing where the "wild west" is. > I agree that the toolset that github provides can be really improved. > Hey, they're doing great stuff! The new task list thing is really cool... haven't looked into what it looks like coming off the API, as that would be a great way to show progress on a ticket, which otherwise would have to be pulled out of the unstructured text (bleah). Thanks, > > Jason > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130115/ea724868/attachment.html> From jason-sage at creativetrax.com Tue Jan 15 11:07:31 2013 From: jason-sage at creativetrax.com (Jason Grout) Date: Tue, 15 Jan 2013 09:07:31 -0700 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CACejjWz-K3C-2Jouq9AW1gtUv=S5n9ms2Fo=XuG-Hk4mrOHBjA@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> <50F4E761.80303@creativetrax.com> <CACejjWz-K3C-2Jouq9AW1gtUv=S5n9ms2Fo=XuG-Hk4mrOHBjA@mail.gmail.com> Message-ID: <50F57EC3.3010705@creativetrax.com> On 1/14/13 11:53 PM, Nicholas Bollweg wrote: > I agree that the toolset that github provides can be really improved. > > Hey, they're doing great stuff! I should clarify: they are doing some fantastic stuff, and they've really pushed the boundary in some areas. But things like managing large numbers of tickets, status changes, pull requests, collaborators, etc., is still more awkward than you'd hope, based on other existing tools. That's why I'm glad that (a) they have a fantastic API and (b) people like you are experimenting with the information organization. Thanks again! Jason From ellisonbg at gmail.com Tue Jan 15 13:58:09 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Tue, 15 Jan 2013 10:58:09 -0800 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <50F57EC3.3010705@creativetrax.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> <50F4E761.80303@creativetrax.com> <CACejjWz-K3C-2Jouq9AW1gtUv=S5n9ms2Fo=XuG-Hk4mrOHBjA@mail.gmail.com> <50F57EC3.3010705@creativetrax.com> Message-ID: <CAH4pYpS_iLPx+uR9RikvDyomqL=SwSyAgqSoL-5JHhw-FPQunQ@mail.gmail.com> One point: while some of our scope and feature creep problems can be solved by good workflows and tools, others can't. I don't think we need tools to better manage more and more new features, we need tools to help us better manage fewer new features *well*. And maybe that is another way of putting it: I am arguing for quality, not quantity of features. From bussonniermatthias at gmail.com Tue Jan 15 14:24:28 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Tue, 15 Jan 2013 20:24:28 +0100 Subject: [IPython-dev] EuroSciPy 2013 organisation. Message-ID: <41BE8833-A6A1-4A10-859D-C0AFD92F2C06@gmail.com> Hi everyone, As everyone knows, time goes really fast, and it is (already) time to plan for future conferences. So I'm turning to you to know who will be present at EuroSciPy this year, and if you are talking/planning to talk, will you be using IPython/ The IPython notebook ? If so To which Level ? For those also interested, I'll be doing a 1h30 advance tutorial on IPython, and as you know, hopefully IPython will be moving fast in the next month, so what would be you expectation for such a tutorial ? Thanks, -- Matthias From nick.bollweg at gmail.com Tue Jan 15 16:48:53 2013 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Tue, 15 Jan 2013 16:48:53 -0500 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CAH4pYpS_iLPx+uR9RikvDyomqL=SwSyAgqSoL-5JHhw-FPQunQ@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> <50F4E761.80303@creativetrax.com> <CACejjWz-K3C-2Jouq9AW1gtUv=S5n9ms2Fo=XuG-Hk4mrOHBjA@mail.gmail.com> <50F57EC3.3010705@creativetrax.com> <CAH4pYpS_iLPx+uR9RikvDyomqL=SwSyAgqSoL-5JHhw-FPQunQ@mail.gmail.com> Message-ID: <CACejjWw=re0y6X4hR1sj+i4vs+f0i+08wXqsMMrxXH-=0kYAXw@mail.gmail.com> On Tue, Jan 15, 2013 at 1:58 PM, Brian Granger <ellisonbg at gmail.com> wrote: > One point: while some of our scope and feature creep problems can be > solved by good workflows and tools, others can't. I don't think we > need tools to better manage more and more new features, we need tools > to help us better manage fewer new features *well*. And maybe that is > another way of putting it: I am arguing for quality, not quantity of > features. > This is a very good point, but since i'm on a kick: what is the means for determining quality? For the kernel? For the notebook? For the various frontends? Does every committer weigh in on every decision? What is the role of non-committers? "Plebiscite" style decision making would probably be crippling. If a project can start determining what these heuristics are, maybe the data from its various feeds can help. I liked some of the discussion on your blog post (I think) by the SymPy guys: their users "only use 20%" of SymPy... but every user has a different 20%! What is the broader community's usage of IPython like? Has this been captured before? -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130115/82b3df06/attachment.html> From erik.m.bray at gmail.com Tue Jan 15 18:07:12 2013 From: erik.m.bray at gmail.com (Erik Bray) Date: Tue, 15 Jan 2013 18:07:12 -0500 Subject: [IPython-dev] ipythonblocks & PyCon Talk In-Reply-To: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> References: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> Message-ID: <CAOTD34aYFaGtjPvYMAeyeMifnCvr73uz_AuTQGDNqPrJbTCs9Q@mail.gmail.com> On Thu, Jan 10, 2013 at 9:54 PM, Matt <jiffyclub at gmail.com> wrote: > Hi all, > > One of the (many) reasons I love the IPython Notebook is its potential for education. One way it can be leveraged is via the rich outputs possible, which allowed me to write the ipythonblocks package. ipythonblocks provides an object that displays itself as a colored HTML table that students can manipulate. See my blog post here: http://j.mp/ZNEBM5. > > The Notebook has other education friendly properties, especially its ability to stand alone as a self-contained environment. No switching between editors, shells, and docs? At PyCon in March I'm going to be giving a talk on teaching with the Notebook (http://j.mp/TNSzda). I'll probably spend a couple minutes of the talk relaying thoughts and anecdotes from other Software Carpentry instructors and I'd like to invite anyone here who uses the Notebook as a teaching tool to send me any particularly compelling stories that illustrate the Notebook's value in the classroom. This reminds me--if you haven't already you might want to consider demonstrating ipython_nose in your PyCon talk. Your mention of never having to leave ipython notebook reminded me of it. It should "just work" if you `pip install git+https://github.com/taavi/ipython_nose.git` and then in IPython do %load_ext ipython_nose. Then you can write nose tests right in IPython and run them with %nose. It works in the CLI, but is especially slick in the notebook. From takowl at gmail.com Wed Jan 16 07:47:34 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 16 Jan 2013 12:47:34 +0000 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CACejjWw=re0y6X4hR1sj+i4vs+f0i+08wXqsMMrxXH-=0kYAXw@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> <50F4E761.80303@creativetrax.com> <CACejjWz-K3C-2Jouq9AW1gtUv=S5n9ms2Fo=XuG-Hk4mrOHBjA@mail.gmail.com> <50F57EC3.3010705@creativetrax.com> <CAH4pYpS_iLPx+uR9RikvDyomqL=SwSyAgqSoL-5JHhw-FPQunQ@mail.gmail.com> <CACejjWw=re0y6X4hR1sj+i4vs+f0i+08wXqsMMrxXH-=0kYAXw@mail.gmail.com> Message-ID: <CAOvn4qhPD_b87DYthOmKKWhFUnyHNo-NbNF9F-nbd+8s2ZBWMQ@mail.gmail.com> On 15 January 2013 21:48, Nicholas Bollweg <nick.bollweg at gmail.com> wrote: > This is a very good point, but since i'm on a kick: what is the means for > determining quality? For the kernel? For the notebook? For the various > frontends? Does every committer weigh in on every decision? What is the > role of non-committers? "Plebiscite" style decision making would probably > be crippling. If a project can start determining what these heuristics are, > maybe the data from its various feeds can help. > At least one core developer has to agree with it, to do the merge. Generally, the larger the change, the more people we'll want to confirm it - but nothing requires the input of the whole core team. We also have a rough guideline that if core contributors disagree about something, we're probably missing something important, and we should spend more time thinking about it. We do, of course, listen to non-committers, but the core developers sometimes decide that a particular feature would be best developed outside of IPython. There are various technical mechanisms to allow separate pieces of code to work with IPython. I think this is a key part of what Brian was talking about - we can't and shouldn't maintain code for everything anyone wants to do in IPython. > I liked some of the discussion on your blog post (I think) by the SymPy > guys: their users "only use 20%" of SymPy... but every user has a different > 20%! What is the broader community's usage of IPython like? Has this been > captured before? > Yes, I have some concerns around this as well - I suspect that many of our features are useful to a large minority of our users, and I don't think that's necessarily a problem. Where the user-threshold should be, I'm not sure. We did do a simple survey in 2011 (http://ipython.org/usersurvey2011.html). We hope to repeat it this year with a bit more detail. Best wishes, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130116/53120d93/attachment.html> From jiffyclub at gmail.com Wed Jan 16 10:57:02 2013 From: jiffyclub at gmail.com (Matt Davis) Date: Wed, 16 Jan 2013 10:57:02 -0500 Subject: [IPython-dev] ipythonblocks & PyCon Talk In-Reply-To: <CAOTD34aYFaGtjPvYMAeyeMifnCvr73uz_AuTQGDNqPrJbTCs9Q@mail.gmail.com> References: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> <CAOTD34aYFaGtjPvYMAeyeMifnCvr73uz_AuTQGDNqPrJbTCs9Q@mail.gmail.com> Message-ID: <CAMqnrZrY+_s2_1sPAST4ZLOL9CYstUcw2t41T_pOjqe0J7Nu6g@mail.gmail.com> Definitely want to show that and Brian's pythontutor plugin. - Matt On Tue, Jan 15, 2013 at 6:07 PM, Erik Bray <erik.m.bray at gmail.com> wrote: > On Thu, Jan 10, 2013 at 9:54 PM, Matt <jiffyclub at gmail.com> wrote: > > Hi all, > > > > One of the (many) reasons I love the IPython Notebook is its potential > for education. One way it can be leveraged is via the rich outputs > possible, which allowed me to write the ipythonblocks package. > ipythonblocks provides an object that displays itself as a colored HTML > table that students can manipulate. See my blog post here: > http://j.mp/ZNEBM5. > > > > The Notebook has other education friendly properties, especially its > ability to stand alone as a self-contained environment. No switching > between editors, shells, and docs? At PyCon in March I'm going to be giving > a talk on teaching with the Notebook (http://j.mp/TNSzda). I'll probably > spend a couple minutes of the talk relaying thoughts and anecdotes from > other Software Carpentry instructors and I'd like to invite anyone here who > uses the Notebook as a teaching tool to send me any particularly compelling > stories that illustrate the Notebook's value in the classroom. > > This reminds me--if you haven't already you might want to consider > demonstrating ipython_nose in your PyCon talk. Your mention of never > having to leave ipython notebook reminded me of it. It should "just > work" if you `pip install > git+https://github.com/taavi/ipython_nose.git` and then in IPython do > %load_ext ipython_nose. Then you can write nose tests right in > IPython and run them with %nose. It works in the CLI, but is > especially slick in the notebook. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130116/f7b15869/attachment.html> From massimodisasha at gmail.com Wed Jan 16 11:40:43 2013 From: massimodisasha at gmail.com (epi) Date: Wed, 16 Jan 2013 11:40:43 -0500 Subject: [IPython-dev] Multiple IPython notebook server same port / Proxy / Launcher. In-Reply-To: <8344A976-1DA2-4973-B613-23244885D272@gmail.com> References: <8344A976-1DA2-4973-B613-23244885D272@gmail.com> Message-ID: <C687CEF6-B417-410C-A1A6-8B8CADC908D7@gmail.com> Hi i'm trying the ipython-notebook-proxy on osx i installed Node and i cloned the git repository then : epi:IPython-notebook-proxy epi$ ./bin/notebook-proxy.js ================================== QuickStart > start("/ipython/",8888) go to "localhost:8000/ipython/" > start("/ipython-more/",7777 go to "localhost:8000/ipython-more/" > stop_all() > help() For more info ================================== > > start("/ipython/",8888) { 'localhost/ipython/': 'http://localhost:8888/ipython/' } undefined > child process terminated due to receipt of signal null undefined > have you any clue on how to fix it ? thanks! Massimo. Il giorno 02/gen/2013, alle ore 18:19, Matthias BUSSONNIER <bussonniermatthias at gmail.com> ha scritto: > Hi list, > > Pushed by PR 2694 [1], I was wondering If i would be feasible to host multiple application > along side IPython notebook on the same port, just routing by url. > > This is how is born ipython-notebook-proxy[2] which allow you to run multiple notebooks and applications > on the same port (yes port 80 I think of you, 443 you'll be next, stupid work firewall I'll get you one day). > > For convenience right now, it drops you in a node-REPL where you can do > > > start('/aaa/',8888) > > start('/bbb/',8889) > > start('/ccc/',8890) > > start('/ddd/',8891) > > And it will gracefully start 4 server accessible at > > localhost:8000/aaa/ > localhost:8000/bbb/ > localhost:8000/ccc/ > localhost:8000/ddd/ > > With a little training I'm sure it can do it with your user's logins, and by selecting port by itself. > > Before quitting don't forget to issue a > > > stop_all() > > Configurability for now is None. > > But routing rules can be changed live without dropping the current connexions. > Possible use with mplh5canvas or anything else not to have to **worry** about port. > Or in browser galery's demo [3] (not sure if it use a separate serve still?) > > I'll be happy to get feedback, and test under high load/ big number of connected user to > see how it holds. > > PR are welcomed, > Will move to IPython-organisation owned repository if it has lot's of success when a little more mature. > > Already available on NPM so no manual install ! > > $ npm install ipython-notebook-proxy > > And happy new year. > -- > Matthias > > > [1] https://github.com/ipython/ipython/pull/2694 > [2] https://npmjs.org/package/ipython-notebook-proxy > [3] http://cyrille.rossant.net/galrys-story-or-the-quest-of-multi-million-plots/ > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130116/6c936448/attachment.html> From damianavila at gmail.com Wed Jan 16 14:32:08 2013 From: damianavila at gmail.com (=?ISO-8859-1?Q?Dami=E1n_Avila?=) Date: Wed, 16 Jan 2013 16:32:08 -0300 Subject: [IPython-dev] Feature and scope creep in IPython In-Reply-To: <CAH4pYpS_iLPx+uR9RikvDyomqL=SwSyAgqSoL-5JHhw-FPQunQ@mail.gmail.com> References: <CAH4pYpTCfZKPJH6TmGqXda22Ahds4VHQ3u70kuvzd_epWduWrw@mail.gmail.com> <CAHAreOpo8bbL5JZ=pSce+SuX022_6bBH3YojxM1AOk6CULUveA@mail.gmail.com> <CACejjWztBPgVWrea-X08gMeTPi0-r0CNYFkYbhZE0=7xWMo4og@mail.gmail.com> <50F4E761.80303@creativetrax.com> <CACejjWz-K3C-2Jouq9AW1gtUv=S5n9ms2Fo=XuG-Hk4mrOHBjA@mail.gmail.com> <50F57EC3.3010705@creativetrax.com> <CAH4pYpS_iLPx+uR9RikvDyomqL=SwSyAgqSoL-5JHhw-FPQunQ@mail.gmail.com> Message-ID: <50F70038.7030106@gmail.com> We really need that core developers expend their time in few but well defined features. As a user, and a beginner developer, I want to get more features (probably is a tendency of all of us)... but we really need to understand that our wishes are not good for the project as a whole. The community of user and/or other developers can/have to develop *modular* enhancements to fit their needs, but outside the main project... We have a structure to do this kind of stuff... and this is because we have a solid core... So, we need that the core developers concentrate his efforts to maintain this solid core and to get it even more solid, with the proper features. Few but great features... defined by the current scope (that would be great if it is explained in detail by core dev). In this way, we can go further with stronger steps... Dami?n. El 15/01/13 15:58, Brian Granger escribi?: > One point: while some of our scope and feature creep problems can be > solved by good workflows and tools, others can't. I don't think we > need tools to better manage more and more new features, we need tools > to help us better manage fewer new features *well*. And maybe that is > another way of putting it: I am arguing for quality, not quantity of > features. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From damianavila at gmail.com Wed Jan 16 15:04:57 2013 From: damianavila at gmail.com (=?ISO-8859-1?Q?Dami=E1n_Avila?=) Date: Wed, 16 Jan 2013 17:04:57 -0300 Subject: [IPython-dev] EuroSciPy 2013 organisation. In-Reply-To: <41BE8833-A6A1-4A10-859D-C0AFD92F2C06@gmail.com> References: <41BE8833-A6A1-4A10-859D-C0AFD92F2C06@gmail.com> Message-ID: <50F707E9.5060507@gmail.com> Not sure because I have been a happy father recently, but maybe, I could go there... (I also need to get some financial support... and, at the same time, will be the International Congress of Immunology, so maybe I can get 2x1...). I will confirm you in a few weeks. If I get there, I have plans to propose a poster/talk talking about vIPer (I have some enhancement to come...). For a tutorial, I would hope to be centered around the notebook, with all the more interesting features available, and even some from the the IPython parallel engine... I think there are hot topics, we the capacity to bring useful tools for people who does not know (or known a few) the project. Dami?n. El 15/01/13 16:24, Matthias BUSSONNIER escribi?: > Hi everyone, > > As everyone knows, time goes really fast, and it is (already) time to plan for future conferences. > So I'm turning to you to know who will be present at EuroSciPy this year, and if you > are talking/planning to talk, will you be using IPython/ The IPython notebook ? If so To which Level ? > > > For those also interested, I'll be doing a 1h30 advance tutorial on IPython, and > as you know, hopefully IPython will be moving fast in the next month, so what > would be you expectation for such a tutorial ? > > Thanks, From damianavila at gmail.com Wed Jan 16 15:08:10 2013 From: damianavila at gmail.com (=?ISO-8859-1?Q?Dami=E1n_Avila?=) Date: Wed, 16 Jan 2013 17:08:10 -0300 Subject: [IPython-dev] ipythonblocks & PyCon Talk In-Reply-To: <CAMqnrZrY+_s2_1sPAST4ZLOL9CYstUcw2t41T_pOjqe0J7Nu6g@mail.gmail.com> References: <CCF324FE-1824-4B17-BF9B-2F73688A9851@gmail.com> <CAOTD34aYFaGtjPvYMAeyeMifnCvr73uz_AuTQGDNqPrJbTCs9Q@mail.gmail.com> <CAMqnrZrY+_s2_1sPAST4ZLOL9CYstUcw2t41T_pOjqe0J7Nu6g@mail.gmail.com> Message-ID: <50F708AA.9010202@gmail.com> Matt, Maybe you can use the reveal_converter to do the slides for your talk. A few days ago, the UI to get the *label* of each cell, to render properly as a slideshow, was merged to the ipython dev master repository... The converter will be reviewed soon, but you can use it if you want... Here is the curret PR: https://github.com/ipython/nbconvert/pull/69 And here you have an example of what can be done: http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/example_nb_tour.ipynb <http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/example_nb_tour.ipynb#/> I will publish soon a kind of tutorial slideshow to show the main features of this converter... Cheers. Dami?n. El 16/01/13 12:57, Matt Davis escribi?: > Definitely want to show that and Brian's pythontutor plugin. > > - Matt > > > On Tue, Jan 15, 2013 at 6:07 PM, Erik Bray <erik.m.bray at gmail.com > <mailto:erik.m.bray at gmail.com>> wrote: > > On Thu, Jan 10, 2013 at 9:54 PM, Matt <jiffyclub at gmail.com > <mailto:jiffyclub at gmail.com>> wrote: > > Hi all, > > > > One of the (many) reasons I love the IPython Notebook is its > potential for education. One way it can be leveraged is via the > rich outputs possible, which allowed me to write the ipythonblocks > package. ipythonblocks provides an object that displays itself as > a colored HTML table that students can manipulate. See my blog > post here: http://j.mp/ZNEBM5. > > > > The Notebook has other education friendly properties, especially > its ability to stand alone as a self-contained environment. No > switching between editors, shells, and docs... At PyCon in March > I'm going to be giving a talk on teaching with the Notebook > (http://j.mp/TNSzda). I'll probably spend a couple minutes of the > talk relaying thoughts and anecdotes from other Software Carpentry > instructors and I'd like to invite anyone here who uses the > Notebook as a teaching tool to send me any particularly compelling > stories that illustrate the Notebook's value in the classroom. > > This reminds me--if you haven't already you might want to consider > demonstrating ipython_nose in your PyCon talk. Your mention of never > having to leave ipython notebook reminded me of it. It should "just > work" if you `pip install > git+https://github.com/taavi/ipython_nose.git` > <https://github.com/taavi/ipython_nose.git%60> and then in IPython do > %load_ext ipython_nose. Then you can write nose tests right in > IPython and run them with %nose. It works in the CLI, but is > especially slick in the notebook. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org <mailto:IPython-dev at scipy.org> > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130116/95c84255/attachment.html> From fperez.net at gmail.com Thu Jan 17 04:29:26 2013 From: fperez.net at gmail.com (Fernando Perez) Date: Thu, 17 Jan 2013 01:29:26 -0800 Subject: [IPython-dev] Quick question: status of the slideshow PRs? Message-ID: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> Hey guys, with the merge of #2333/#2687, what's the status for using the slideshow mode? I'm teaching a workshop next week in Norway and I'm willing to try to do the whole thing as notebooks, but I couldn't find the PR for the actual slideshow usage (Only the toolbar seems to be working, not the actual switching into slideshow mode. Should I merge Matthias' old branch? I figured that probably doesn't work quite right now... Sorry for being so out of the loop, I've been dealing with a few remaining local issues... Once this long workshop is over, gears are switching completely back into IPython (at last, as being away now that we have the resources is driving me positively mad). thanks! f From bussonniermatthias at gmail.com Thu Jan 17 05:18:41 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Thu, 17 Jan 2013 11:18:41 +0100 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> Message-ID: <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> Hi Fernando, Old branch should still work with the text markers, Current master should be able to produce ipynb file usable with dami?n's slideviewer on heroku, but not able to run live. I'll try to update the presentation mode to work with the new metadata and write you a small how-to. -- Matthias Le 17 janv. 2013 ? 10:29, Fernando Perez a ?crit : > Hey guys, > > with the merge of #2333/#2687, what's the status for using the > slideshow mode? I'm teaching a workshop next week in Norway and I'm > willing to try to do the whole thing as notebooks, but I couldn't find > the PR for the actual slideshow usage (Only the toolbar seems to be > working, not the actual switching into slideshow mode. Should I merge > Matthias' old branch? I figured that probably doesn't work quite > right now... > > Sorry for being so out of the loop, I've been dealing with a few > remaining local issues... Once this long workshop is over, gears are > switching completely back into IPython (at last, as being away now > that we have the resources is driving me positively mad). > > thanks! > > f -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130117/62e87123/attachment.html> From fperez.net at gmail.com Thu Jan 17 06:06:12 2013 From: fperez.net at gmail.com (Fernando Perez) Date: Thu, 17 Jan 2013 03:06:12 -0800 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> Message-ID: <CAHAreOoGj=guQ8RuH7kHqo7d9iJq9B-y22M7xmQq-i07UNBxrQ@mail.gmail.com> On Thu, Jan 17, 2013 at 2:18 AM, Matthias BUSSONNIER <bussonniermatthias at gmail.com> wrote: > Current master should be able to produce ipynb file usable with dami?n's > slideviewer on heroku, but not able to run live. > > I'll try to update the presentation mode to work with the new metadata and > write you a small how-to. Great, thanks! I can always present in normal mode, but it would be nice to have 8 hours of lectures all in proper notebook/slide combos, and it looks like we're almost there. Cheers, f From damianavila at gmail.com Thu Jan 17 06:29:06 2013 From: damianavila at gmail.com (=?ISO-8859-1?Q?Dami=E1n_Avila?=) Date: Thu, 17 Jan 2013 08:29:06 -0300 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> Message-ID: <50F7E082.9000802@gmail.com> El 17/01/13 06:29, Fernando Perez escribi?: > Hey guys, > > with the merge of #2333/#2687, what's the status for using the > slideshow mode? I'm teaching a workshop next week in Norway and I'm > willing to try to do the whole thing as notebooks, but I couldn't find > the PR for the actual slideshow usage (Only the toolbar seems to be > working, not the actual switching into slideshow mode. Should I merge > Matthias' old branch? I figured that probably doesn't work quite > right now... > > Sorry for being so out of the loop, I've been dealing with a few > remaining local issues... Once this long workshop is over, gears are > switching completely back into IPython (at last, as being away now > that we have the resources is driving me positively mad). > > thanks! > > f > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev Hi Fernando... (como estas?) OK, with the current merged #2333/#2687 into master... you have only to my **reveal_branch** in nbconvert... here is the PR: https://github.com/ipython/nbconvert/pull/69 and here is my clone: https://github.com/damianavila/nbconvert.git I have updated the PR (a few days ago) according with the last changes in #2333/#2687, so you only have to use the Cell Tool Bar to give the label to each cell as you wish and finally convert it in my branch of nbconvert with: $python nbconvert.py -f reveal your_notebook.ipynb Or if you want, you can use my nbviewer mirror here (I will update it with the last changes in a few minutes): http://slideviewer.herokuapp.com <http://slideviewer.herokuapp.com/> I am also working in a tutorial slideshow to show you all the power behind reveal framework, I will be finishing it by today or tomorrow. I do not know if Matthias has a working version of the **live** presentation with the last changes. Hope it helps... If you need any assistance, let me know... Dami?n. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130117/2010c257/attachment.html> From damianavila at gmail.com Thu Jan 17 07:22:39 2013 From: damianavila at gmail.com (=?ISO-8859-1?Q?Dami=E1n_Avila?=) Date: Thu, 17 Jan 2013 09:22:39 -0300 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <CAHAreOoGj=guQ8RuH7kHqo7d9iJq9B-y22M7xmQq-i07UNBxrQ@mail.gmail.com> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> <CAHAreOoGj=guQ8RuH7kHqo7d9iJq9B-y22M7xmQq-i07UNBxrQ@mail.gmail.com> Message-ID: <50F7ED0F.80305@gmail.com> El 17/01/13 08:06, Fernando Perez escribi?: > On Thu, Jan 17, 2013 at 2:18 AM, Matthias BUSSONNIER > <bussonniermatthias at gmail.com> wrote: >> Current master should be able to produce ipynb file usable with dami?n's >> slideviewer on heroku, but not able to run live. >> >> I'll try to update the presentation mode to work with the new metadata and >> write you a small how-to. > > Great, thanks! I can always present in normal mode, but it would be > nice to have 8 hours of lectures all in proper notebook/slide combos, > and it looks like we're almost there. > > Cheers, > > f > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev OK, my branch of nbviewer is updated to last changes... http://slideviewer.herokuapp.com <http://slideviewer.herokuapp.com/> You can see an example here: http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb <http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb#/> Cheers. Dami?n. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130117/96187540/attachment.html> From shaklev at gmail.com Thu Jan 17 07:27:21 2013 From: shaklev at gmail.com (=?UTF-8?Q?Stian_H=C3=A5klev?=) Date: Thu, 17 Jan 2013 07:27:21 -0500 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> Message-ID: <CAEKz3tgUDuC4rL8Z5-Rn5=XuBcxV7sHFcVuiGMu2aWPYqzT7Aw@mail.gmail.com> It's funny, I'm a Norwegian in Toronto, but I both missed your great presentation at PyCon this fall, and I'll miss the workshop in Norway :) Hope you are able to do it all as notebooks, and share those afterwards. Have a good trip, and dress warm :) Stian On Thu, Jan 17, 2013 at 4:29 AM, Fernando Perez <fperez.net at gmail.com>wrote: > Hey guys, > > with the merge of #2333/#2687, what's the status for using the > slideshow mode? I'm teaching a workshop next week in Norway and I'm > willing to try to do the whole thing as notebooks, but I couldn't find > the PR for the actual slideshow usage (Only the toolbar seems to be > working, not the actual switching into slideshow mode. Should I merge > Matthias' old branch? I figured that probably doesn't work quite > right now... > > Sorry for being so out of the loop, I've been dealing with a few > remaining local issues... Once this long workshop is over, gears are > switching completely back into IPython (at last, as being away now > that we have the resources is driving me positively mad). > > thanks! > > f > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- http://reganmian.net/blog -- Random Stuff that Matters -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130117/0c3b778b/attachment.html> From satra at mit.edu Thu Jan 17 09:33:17 2013 From: satra at mit.edu (Satrajit Ghosh) Date: Thu, 17 Jan 2013 09:33:17 -0500 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> Message-ID: <CA+A4wOnqwkcyZ_0rZyz6j+6zTY_+uZowMMrhv3mSEUpixfQukg@mail.gmail.com> hi matthias, please do post a link to the howto on the mailing list. this will be quite useful. cheers, satra On Thu, Jan 17, 2013 at 5:18 AM, Matthias BUSSONNIER < bussonniermatthias at gmail.com> wrote: > Hi Fernando, > > > Old branch should still work with the text markers, > > Current master should be able to produce ipynb file usable with dami?n's > slideviewer on heroku, but not able to run live. > > I'll try to update the presentation mode to work with the new metadata and > write you a small how-to. > > -- > Matthias > > > Le 17 janv. 2013 ? 10:29, Fernando Perez a ?crit : > > Hey guys, > > with the merge of #2333/#2687, what's the status for using the > slideshow mode? I'm teaching a workshop next week in Norway and I'm > willing to try to do the whole thing as notebooks, but I couldn't find > the PR for the actual slideshow usage (Only the toolbar seems to be > working, not the actual switching into slideshow mode. Should I merge > Matthias' old branch? I figured that probably doesn't work quite > right now... > > Sorry for being so out of the loop, I've been dealing with a few > remaining local issues... Once this long workshop is over, gears are > switching completely back into IPython (at last, as being away now > that we have the resources is driving me positively mad). > > thanks! > > f > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130117/0d203e52/attachment.html> From bussonniermatthias at gmail.com Thu Jan 17 11:25:24 2013 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Thu, 17 Jan 2013 17:25:24 +0100 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <CA+A4wOnqwkcyZ_0rZyz6j+6zTY_+uZowMMrhv3mSEUpixfQukg@mail.gmail.com> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> <CA+A4wOnqwkcyZ_0rZyz6j+6zTY_+uZowMMrhv3mSEUpixfQukg@mail.gmail.com> Message-ID: <CA111EC7-40F5-430A-9F8F-CC044334576D@gmail.com> Le 17 janv. 2013 ? 15:33, Satrajit Ghosh a ?crit : > hi matthias, > > please do post a link to the howto on the mailing list. this will be quite useful. Don't worry, it will become full part of IPython, it is planned. I just need to get time to write it properly. -- Matthias From javi.martinez.lopez at gmail.com Mon Jan 21 04:11:17 2013 From: javi.martinez.lopez at gmail.com (=?ISO-8859-1?Q?Javier_Mart=EDnez=2DL=F3pez?=) Date: Mon, 21 Jan 2013 10:11:17 +0100 Subject: [IPython-dev] Rmagic under Debian Squeeze problem Message-ID: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> *Dear all, I need to run R code with the IPython notebook in my Debian squeeze desktop computer. **I can apparently load the rmagic extension but when I try to run R code I get the following error message: *AttributeError Traceback (most recent call last) <ipython-input-4-9de0d21a54a2> in <module>() ----> 1 get_ipython()._run_cached_cell_magic(u'R', u'') /home/user/ipython/IPython/core/interactiveshell.pyc in _run_cached_cell_magic(self, magic_name, line) 2550 cell = self._current_cell_magic_body 2551 self._current_cell_magic_body = None -> 2552 return self.run_cell_magic(magic_name, line, cell) 2553 2554 def run_cell(self, raw_cell, store_history=False, silent=False, shell_futures=True): /home/user/ipython/IPython/core/interactiveshell.pyc in run_cell_magic(self, magic_name, line, cell) 2130 magic_arg_s = self.var_expand(line, stack_depth) 2131 with self.builtin_trap: -> 2132 result = fn(magic_arg_s, cell) 2133 return result 2134 <string> in R(self, line, cell, local_ns) /home/user/ipython/IPython/core/magic.pyc in <lambda>(f, *a, **k) 189 # but it's overkill for just that one bit of state. 190 def magic_deco(arg): --> 191 call = lambda f, *a, **k: f(*a, **k) 192 193 if callable(arg): /home/user/ipython/IPython/extensions/rmagic.py in R(self, line, cell, local_ns) 550 return_output = False 551 else: --> 552 text_result, result = self.eval(code) 553 text_output += text_result 554 /home/user/ipython/IPython/extensions/rmagic.py in eval(self, line) 156 ri.set_writeconsole(self.write_console) 157 try: --> 158 value = ri.baseenv['eval'](ri.parse(line)) 159 except (ri.RRuntimeError, ValueError) as exception: 160 warning_or_other_msg = self.flush() # otherwise next return seems to have copy of error AttributeError: 'module' object has no attribute 'arse' *After an iptest, I get:* Status: ERROR - 3 out of 10 test groups failed. ---------------------------------------- Runner failed: IPython.core You may wish to rerun this one individually, with: /usr/bin/python /usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/testing/iptest.py IPython.core ---------------------------------------- Runner failed: IPython.extensions You may wish to rerun this one individually, with: /usr/bin/python /usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/testing/iptest.py IPython.extensions ---------------------------------------- Runner failed: IPython.utils You may wish to rerun this one individually, with: /usr/bin/python /usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/testing/iptest.py IPython.utils * And after the specific test for extensions**, I get:* ERROR: IPython.extensions.tests.test_rmagic.test_Rconverter ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python2.6/dist-packages/nose-1.2.1-py2.6.egg/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/extensions/tests/test_rmagic.py", line 31, in test_Rconverter v = ip.run_line_magic('Rget', '-d datapy') File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/core/interactiveshell.py", line 2062, in run_line_magic result = fn(*args) File "<string>", line 2, in Rget File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/core/magic.py", line 191, in <lambda> call = lambda f, *a, **k: f(*a, **k) File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/extensions/rmagic.py", line 299, in Rget return self.Rconverter(self.r(output[0]),dataframe=args.as_dataframe) File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/extensions/rmagic.py", line 107, in Rconverter if cols != ri.NULL: AttributeError: 'module' object has no attribute 'NULL' ====================================================================== ERROR: IPython.extensions.tests.test_rmagic.test_cell_magic ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python2.6/dist-packages/nose-1.2.1-py2.6.egg/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/extensions/tests/test_rmagic.py", line 60, in test_cell_magic ip.run_cell_magic('R', '-i x,y -o r,xc a=lm(y~x)', snippet) File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/core/interactiveshell.py", line 2093, in run_cell_magic result = fn(line, cell) File "<string>", line 2, in R File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/core/magic.py", line 191, in <lambda> call = lambda f, *a, **k: f(*a, **k) File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/extensions/rmagic.py", line 516, in R text_result, result = self.eval(code) File "/usr/local/lib/python2.6/dist-packages/ipython-0.13.1-py2.6.egg/IPython/extensions/rmagic.py", line 158, in eval value = ri.baseenv['eval'](ri.parse(line)) AttributeError: 'module' object has no attribute 'parse' ---------------------------------------------------------------------- Ran 16 tests in 1.177s FAILED (errors=2) *... Does anyone has a clue?* *Thank you very much!* Kind regards, Javier -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130121/4202d713/attachment.html> From takowl at gmail.com Mon Jan 21 04:44:41 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 21 Jan 2013 09:44:41 +0000 Subject: [IPython-dev] Rmagic under Debian Squeeze problem In-Reply-To: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> References: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> Message-ID: <CAOvn4qiCEf7=Wt1S_GeBEJwcMFc3EEdzf5yUw7m4L8re5HGL4Q@mail.gmail.com> On 21 January 2013 09:11, Javier Mart?nez-L?pez < javi.martinez.lopez at gmail.com> wrote: > AttributeError: 'module' object has no attribute 'arse' ...it can't find it's arse with both hands? ;-) Joking aside, what do you get if you try these lines at the prompt: import rpy2.rinterface rpy2.rinterface rpy2.rinterface.parse Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130121/0a0fd727/attachment.html> From javi.martinez.lopez at gmail.com Mon Jan 21 04:56:05 2013 From: javi.martinez.lopez at gmail.com (=?ISO-8859-1?Q?Javier_Mart=EDnez=2DL=F3pez?=) Date: Mon, 21 Jan 2013 10:56:05 +0100 Subject: [IPython-dev] Rmagic under Debian Squeeze problem In-Reply-To: <CAOvn4qiCEf7=Wt1S_GeBEJwcMFc3EEdzf5yUw7m4L8re5HGL4Q@mail.gmail.com> References: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> <CAOvn4qiCEf7=Wt1S_GeBEJwcMFc3EEdzf5yUw7m4L8re5HGL4Q@mail.gmail.com> Message-ID: <CAKgwV9=+7Owjr1KZbjQoyxuAgKviJJnR0n0TVoHrktwVfzhk2g@mail.gmail.com> This is the output at the IPython notebook: In [1]: import rpy2.rinterface In [2]: rpy2.rinterface <module 'rpy2.rinterface' from '/usr/lib/python2.6/dist-packages/rpy2/rinterface/__init__.pyc'> In [3]: rpy2.rinterface.parse --------------------------------------------------------------------------AttributeError Traceback (most recent call last)<ipython-input-2-ed04621bc7ce> in <module>()----> 1 rpy2.rinterface.parse AttributeError: 'module' object has no attribute 'parse' Thank you very much! ; ) On Mon, Jan 21, 2013 at 10:44 AM, Thomas Kluyver <takowl at gmail.com> wrote: > On 21 January 2013 09:11, Javier Mart?nez-L?pez < > javi.martinez.lopez at gmail.com> wrote: > >> AttributeError: 'module' object has no attribute 'arse' > > > ...it can't find it's arse with both hands? ;-) > > Joking aside, what do you get if you try these lines at the prompt: > > import rpy2.rinterface > rpy2.rinterface > rpy2.rinterface.parse > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130121/c400efaa/attachment.html> From takowl at gmail.com Mon Jan 21 05:13:44 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 21 Jan 2013 10:13:44 +0000 Subject: [IPython-dev] Rmagic under Debian Squeeze problem In-Reply-To: <CAKgwV9=+7Owjr1KZbjQoyxuAgKviJJnR0n0TVoHrktwVfzhk2g@mail.gmail.com> References: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> <CAOvn4qiCEf7=Wt1S_GeBEJwcMFc3EEdzf5yUw7m4L8re5HGL4Q@mail.gmail.com> <CAKgwV9=+7Owjr1KZbjQoyxuAgKviJJnR0n0TVoHrktwVfzhk2g@mail.gmail.com> Message-ID: <CAOvn4qiC+-fZEzKAB9O+vPWkJudf2zVu2zMEW71hfJw1-upczA@mail.gmail.com> On 21 January 2013 09:56, Javier Mart?nez-L?pez < javi.martinez.lopez at gmail.com> wrote: > > <module 'rpy2.rinterface' from '/usr/lib/python2.6/dist-packages/rpy2/rinterface/__init__.pyc'> > > If you're still on Python 2.6, I'm guessing that your version of rpy2 is too old. From the docs, it looks like parse() was added in 2.2. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130121/691b9ea1/attachment.html> From javi.martinez.lopez at gmail.com Mon Jan 21 05:16:12 2013 From: javi.martinez.lopez at gmail.com (=?ISO-8859-1?Q?Javier_Mart=EDnez=2DL=F3pez?=) Date: Mon, 21 Jan 2013 11:16:12 +0100 Subject: [IPython-dev] Rmagic under Debian Squeeze problem In-Reply-To: <CAOvn4qiC+-fZEzKAB9O+vPWkJudf2zVu2zMEW71hfJw1-upczA@mail.gmail.com> References: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> <CAOvn4qiCEf7=Wt1S_GeBEJwcMFc3EEdzf5yUw7m4L8re5HGL4Q@mail.gmail.com> <CAKgwV9=+7Owjr1KZbjQoyxuAgKviJJnR0n0TVoHrktwVfzhk2g@mail.gmail.com> <CAOvn4qiC+-fZEzKAB9O+vPWkJudf2zVu2zMEW71hfJw1-upczA@mail.gmail.com> Message-ID: <CAKgwV9=u3vwbjA7cL+G8QTRmzEYDo+88i216-3GpsNRWMYxkhw@mail.gmail.com> ok, I will try to upgrade to 2.7! Thanks On Mon, Jan 21, 2013 at 11:13 AM, Thomas Kluyver <takowl at gmail.com> wrote: > On 21 January 2013 09:56, Javier Mart?nez-L?pez < > javi.martinez.lopez at gmail.com> wrote: > >> <module 'rpy2.rinterface' from '/usr/lib/python2.6/dist-packages/rpy2/rinterface/__init__.pyc'> >> >> > If you're still on Python 2.6, I'm guessing that your version of rpy2 is > too old. From the docs, it looks like parse() was added in 2.2. > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130121/ce2ee127/attachment.html> From takowl at gmail.com Mon Jan 21 05:25:06 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 21 Jan 2013 10:25:06 +0000 Subject: [IPython-dev] Rmagic under Debian Squeeze problem In-Reply-To: <CAKgwV9=u3vwbjA7cL+G8QTRmzEYDo+88i216-3GpsNRWMYxkhw@mail.gmail.com> References: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> <CAOvn4qiCEf7=Wt1S_GeBEJwcMFc3EEdzf5yUw7m4L8re5HGL4Q@mail.gmail.com> <CAKgwV9=+7Owjr1KZbjQoyxuAgKviJJnR0n0TVoHrktwVfzhk2g@mail.gmail.com> <CAOvn4qiC+-fZEzKAB9O+vPWkJudf2zVu2zMEW71hfJw1-upczA@mail.gmail.com> <CAKgwV9=u3vwbjA7cL+G8QTRmzEYDo+88i216-3GpsNRWMYxkhw@mail.gmail.com> Message-ID: <CAOvn4qj9qveY6Yz+KmFgHVWESmgP1K20Md95xj9nm=LZOYKifg@mail.gmail.com> On 21 January 2013 10:16, Javier Mart?nez-L?pez < javi.martinez.lopez at gmail.com> wrote: > ok, I will try to upgrade to 2.7! Thanks To be clear, it's rpy2 that you need to upgrade, and the current release is 2.3.0. I mentioned the Python version because it indicates that your packages are a bit older, but IPython should work with Python 2.6. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130121/8e6a223e/attachment.html> From javi.martinez.lopez at gmail.com Mon Jan 21 05:37:02 2013 From: javi.martinez.lopez at gmail.com (=?ISO-8859-1?Q?Javier_Mart=EDnez=2DL=F3pez?=) Date: Mon, 21 Jan 2013 11:37:02 +0100 Subject: [IPython-dev] Rmagic under Debian Squeeze problem In-Reply-To: <CAOvn4qj9qveY6Yz+KmFgHVWESmgP1K20Md95xj9nm=LZOYKifg@mail.gmail.com> References: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> <CAOvn4qiCEf7=Wt1S_GeBEJwcMFc3EEdzf5yUw7m4L8re5HGL4Q@mail.gmail.com> <CAKgwV9=+7Owjr1KZbjQoyxuAgKviJJnR0n0TVoHrktwVfzhk2g@mail.gmail.com> <CAOvn4qiC+-fZEzKAB9O+vPWkJudf2zVu2zMEW71hfJw1-upczA@mail.gmail.com> <CAKgwV9=u3vwbjA7cL+G8QTRmzEYDo+88i216-3GpsNRWMYxkhw@mail.gmail.com> <CAOvn4qj9qveY6Yz+KmFgHVWESmgP1K20Md95xj9nm=LZOYKifg@mail.gmail.com> Message-ID: <CAKgwV9kVgc_uCwB5=gE+MhC1d7XH5Se2LqyhLg+1zG6mmxohOg@mail.gmail.com> ok, thanks! I think that I need Python 2.7 to run this version of rpy2, as well: import rpy2.rinterface ---------------------------------------------------------------------------AttributeError Traceback (most recent call last)<ipython-input-1-676c977874d9> in <module>()----> 1 import rpy2.rinterface /usr/local/lib/python2.6/dist-packages/rpy2/rinterface/__init__.py in <module>() 1 import os, sys 2 ----> 3 if (sys.version_info.major == 2) and (sys.version_info.minor < 7): 4 raise RuntimeError("Python 2.7 or 3.3 are required to run rpy2") 5 AttributeError: 'tuple' object has no attribute 'major' On Mon, Jan 21, 2013 at 11:25 AM, Thomas Kluyver <takowl at gmail.com> wrote: > On 21 January 2013 10:16, Javier Mart?nez-L?pez < > javi.martinez.lopez at gmail.com> wrote: > >> ok, I will try to upgrade to 2.7! Thanks > > > To be clear, it's rpy2 that you need to upgrade, and the current release > is 2.3.0. I mentioned the Python version because it indicates that your > packages are a bit older, but IPython should work with Python 2.6. > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130121/eb939a49/attachment.html> From takowl at gmail.com Mon Jan 21 05:54:50 2013 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 21 Jan 2013 10:54:50 +0000 Subject: [IPython-dev] Rmagic under Debian Squeeze problem In-Reply-To: <CAKgwV9kVgc_uCwB5=gE+MhC1d7XH5Se2LqyhLg+1zG6mmxohOg@mail.gmail.com> References: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> <CAOvn4qiCEf7=Wt1S_GeBEJwcMFc3EEdzf5yUw7m4L8re5HGL4Q@mail.gmail.com> <CAKgwV9=+7Owjr1KZbjQoyxuAgKviJJnR0n0TVoHrktwVfzhk2g@mail.gmail.com> <CAOvn4qiC+-fZEzKAB9O+vPWkJudf2zVu2zMEW71hfJw1-upczA@mail.gmail.com> <CAKgwV9=u3vwbjA7cL+G8QTRmzEYDo+88i216-3GpsNRWMYxkhw@mail.gmail.com> <CAOvn4qj9qveY6Yz+KmFgHVWESmgP1K20Md95xj9nm=LZOYKifg@mail.gmail.com> <CAKgwV9kVgc_uCwB5=gE+MhC1d7XH5Se2LqyhLg+1zG6mmxohOg@mail.gmail.com> Message-ID: <CAOvn4qip2gWy35qn5cEC5GA6_1iMNkcrq3edNWjvh8j0asHtpg@mail.gmail.com> On 21 January 2013 10:37, Javier Mart?nez-L?pez < javi.martinez.lopez at gmail.com> wrote: > ok, thanks! I think that I need Python 2.7 to run this version of rpy2, as > well: I think the 2.2 series will work with Python 2.6 - that may be easier than upgrading Python as well. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130121/763ec7ca/attachment.html> From javi.martinez.lopez at gmail.com Mon Jan 21 07:01:41 2013 From: javi.martinez.lopez at gmail.com (=?ISO-8859-1?Q?Javier_Mart=EDnez=2DL=F3pez?=) Date: Mon, 21 Jan 2013 13:01:41 +0100 Subject: [IPython-dev] Rmagic under Debian Squeeze problem In-Reply-To: <CAOvn4qip2gWy35qn5cEC5GA6_1iMNkcrq3edNWjvh8j0asHtpg@mail.gmail.com> References: <CAKgwV9n-umb2yBgAgjyVPnjL65-+ywsqrkY=D-kTaqJF3GiUTg@mail.gmail.com> <CAOvn4qiCEf7=Wt1S_GeBEJwcMFc3EEdzf5yUw7m4L8re5HGL4Q@mail.gmail.com> <CAKgwV9=+7Owjr1KZbjQoyxuAgKviJJnR0n0TVoHrktwVfzhk2g@mail.gmail.com> <CAOvn4qiC+-fZEzKAB9O+vPWkJudf2zVu2zMEW71hfJw1-upczA@mail.gmail.com> <CAKgwV9=u3vwbjA7cL+G8QTRmzEYDo+88i216-3GpsNRWMYxkhw@mail.gmail.com> <CAOvn4qj9qveY6Yz+KmFgHVWESmgP1K20Md95xj9nm=LZOYKifg@mail.gmail.com> <CAKgwV9kVgc_uCwB5=gE+MhC1d7XH5Se2LqyhLg+1zG6mmxohOg@mail.gmail.com> <CAOvn4qip2gWy35qn5cEC5GA6_1iMNkcrq3edNWjvh8j0asHtpg@mail.gmail.com> Message-ID: <CAKgwV9=TDiPa0yhurAsDHO9dHAkL0S9+8EMZXeYer-fvyZ9vuA@mail.gmail.com> I finally managed to do it using Pythonbrew ( http://www.howopensource.com/2011/05/how-to-install-and-manage-different-versions-of-python-in-linux/) and reinstalling everything on my home directory... Thanks! On Mon, Jan 21, 2013 at 11:54 AM, Thomas Kluyver <takowl at gmail.com> wrote: > On 21 January 2013 10:37, Javier Mart?nez-L?pez < > javi.martinez.lopez at gmail.com> wrote: > >> ok, thanks! I think that I need Python 2.7 to run this version of rpy2, >> as well: > > > I think the 2.2 series will work with Python 2.6 - that may be easier than > upgrading Python as well. > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130121/1e722fca/attachment.html> From pivanov314 at gmail.com Tue Jan 22 00:25:01 2013 From: pivanov314 at gmail.com (Paul Ivanov) Date: Mon, 21 Jan 2013 21:25:01 -0800 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <50F7ED0F.80305@gmail.com> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> <CAHAreOoGj=guQ8RuH7kHqo7d9iJq9B-y22M7xmQq-i07UNBxrQ@mail.gmail.com> <50F7ED0F.80305@gmail.com> Message-ID: <20130122052501.GB32348@HbI-OTOH.berkeley.edu> Dami?n Avila, on 2013-01-17 09:22, wrote: > OK, my branch of nbviewer is updated to last changes... > http://slideviewer.herokuapp.com <http://slideviewer.herokuapp.com/> > > You can see an example here: http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb <http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb#/> Dami?n, this is very cool, I love the possibilitie of doing a 2D layout for a presentation! best, -- Paul Ivanov 314 address only used for lists, off-list direct email at: http://pirsquared.org | GPG/PGP key id: 0x0F3E28F7 From scopatz at gmail.com Tue Jan 22 01:21:33 2013 From: scopatz at gmail.com (Anthony Scopatz) Date: Tue, 22 Jan 2013 00:21:33 -0600 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <20130122052501.GB32348@HbI-OTOH.berkeley.edu> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> <CAHAreOoGj=guQ8RuH7kHqo7d9iJq9B-y22M7xmQq-i07UNBxrQ@mail.gmail.com> <50F7ED0F.80305@gmail.com> <20130122052501.GB32348@HbI-OTOH.berkeley.edu> Message-ID: <CAPk-6T5u9PedGw0NK8pP0Uzodayw81vqsEvKYc425kiRyBB5rQ@mail.gmail.com> On Mon, Jan 21, 2013 at 11:25 PM, Paul Ivanov <pivanov314 at gmail.com> wrote: > Dami?n Avila, on 2013-01-17 09:22, wrote: > > OK, my branch of nbviewer is updated to last changes... > > http://slideviewer.herokuapp.com <http://slideviewer.herokuapp.com/> > > > > You can see an example here: > http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb< > http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb#/ > > > > Dami?n, > > this is very cool, I love the possibilitie of doing a 2D layout > for a presentation! > +1 That is awesome! > > best, > -- > Paul Ivanov > 314 address only used for lists, off-list direct email at: > http://pirsquared.org | GPG/PGP key id: 0x0F3E28F7 > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130122/70fea965/attachment.html> From damianavila at gmail.com Tue Jan 22 06:16:26 2013 From: damianavila at gmail.com (=?ISO-8859-1?Q?Dami=E1n_Avila?=) Date: Tue, 22 Jan 2013 08:16:26 -0300 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <20130122052501.GB32348@HbI-OTOH.berkeley.edu> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> <CAHAreOoGj=guQ8RuH7kHqo7d9iJq9B-y22M7xmQq-i07UNBxrQ@mail.gmail.com> <50F7ED0F.80305@gmail.com> <20130122052501.GB32348@HbI-OTOH.berkeley.edu> Message-ID: <50FE750A.8050502@gmail.com> El 22/01/13 02:25, Paul Ivanov escribi?: > Dami?n Avila, on 2013-01-17 09:22, wrote: >> OK, my branch of nbviewer is updated to last changes... >> http://slideviewer.herokuapp.com <http://slideviewer.herokuapp.com/> >> >> You can see an example here: http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb <http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb#/> > Dami?n, > > this is very cool, I love the possibilitie of doing a 2D layout > for a presentation! > > best, Thanks! If you want to join the discussion here is the current PR: https://github.com/ipython/nbconvert/pull/69 Now, we have the UI for metadata cell landed, so I hope this PR to be reviewed soon. You can go there and make some noise, here I waiting... :-) Regards. Dami?n. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130122/35001a01/attachment.html> From damianavila at gmail.com Tue Jan 22 06:21:00 2013 From: damianavila at gmail.com (=?ISO-8859-1?Q?Dami=E1n_Avila?=) Date: Tue, 22 Jan 2013 08:21:00 -0300 Subject: [IPython-dev] Quick question: status of the slideshow PRs? In-Reply-To: <CAPk-6T5u9PedGw0NK8pP0Uzodayw81vqsEvKYc425kiRyBB5rQ@mail.gmail.com> References: <CAHAreOqrSYGNn=_dUt3ocytU81uTCqdhtZAq5OiYWEaQVGwL4w@mail.gmail.com> <6D8ECA45-839D-4446-8F0D-5001112E17F0@gmail.com> <CAHAreOoGj=guQ8RuH7kHqo7d9iJq9B-y22M7xmQq-i07UNBxrQ@mail.gmail.com> <50F7ED0F.80305@gmail.com> <20130122052501.GB32348@HbI-OTOH.berkeley.edu> <CAPk-6T5u9PedGw0NK8pP0Uzodayw81vqsEvKYc425kiRyBB5rQ@mail.gmail.com> Message-ID: <50FE761C.5070800@gmail.com> El 22/01/13 03:21, Anthony Scopatz escribi?: > > On Mon, Jan 21, 2013 at 11:25 PM, Paul Ivanov <pivanov314 at gmail.com > <mailto:pivanov314 at gmail.com>> wrote: > > Dami?n Avila, on 2013-01-17 09:22, wrote: > > OK, my branch of nbviewer is updated to last changes... > > http://slideviewer.herokuapp.com <http://slideviewer.herokuapp.com/> > > > > You can see an example here: > http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb > <http://slideviewer.herokuapp.com/url/www.slideviper.oquanta.info/nbcreveal/reveal.orig.ipynb#/> > > Dami?n, > > this is very cool, I love the possibilitie of doing a 2D layout > for a presentation! > > > +1 That is awesome! > > > best, > -- > Paul Ivanov > 314 address only used for lists, off-list direct email at: > http://pirsquared.org | GPG/PGP key id: 0x0F3E28F7 > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org <mailto:IPython-dev at scipy.org> > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev Thanks! Reveal.js library is very powerful, so we have a lot of interesting features in this slideshow mode. I will post (soon) a "tutorial" slideshow showing some of these features. If you want to join the discussion, go to the current PR: https://github.com/ipython/nbconvert/pull/69 Regards. Dami?n. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130122/d245a038/attachment.html> From wking at tremily.us Mon Jan 28 21:02:13 2013 From: wking at tremily.us (W. Trevor King) Date: Mon, 28 Jan 2013 21:02:13 -0500 Subject: [IPython-dev] Collaborative IPython frontends Message-ID: <20130129020213.GE13367@odin.tremily.us> I've been browsing through the docs and source off and on over the past few days trying to get a handle on a collaborative IPython workflow. There's a ?collaborative scenarios? hint in docs/source/development/messaging.txt and talk of an --existing option in docs/source/interactive/qtconsole.txt. It looks like the support for the connect_info magic lives in IPython/zmq/zmqshell.py, but support for --existing seems spotty (it's only supported by the IPython/frontend/consoleapp.py, IPython/frontend/terminal/console/app.py, and IPython/frontend/qt/console/qtconsoleapp.py frontends, as far as I can tell). Is this still a work in progress? Is some sort of collaborative session sharing in the pipes? It looks like the kernel only handles Python command execution (without notebook extensions like input cells and Markdown rendering), so the collaborative use would only be sharing a central, kernel-bound Python context. My end-goal is to get some sort of recording and playback for notebooks at the cell-action level (e.g. Markdown cell rendering, Python cell execution, ?), and it seemed like a logging ?frontend? could be attached as a collaborator to an existing notebook frontend/kernel. Then the log could be played back using a playback ?frontend? and viewed in a collaborating notebook. Thanks, Trevor -- This email may be signed or encrypted with GnuPG (http://www.gnupg.org). For more information, see http://en.wikipedia.org/wiki/Pretty_Good_Privacy -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 836 bytes Desc: OpenPGP digital signature URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130128/85a9cfd7/attachment.sig> From benjaminrk at gmail.com Mon Jan 28 23:04:27 2013 From: benjaminrk at gmail.com (MinRK) Date: Mon, 28 Jan 2013 20:04:27 -0800 Subject: [IPython-dev] Collaborative IPython frontends In-Reply-To: <20130129020213.GE13367@odin.tremily.us> References: <20130129020213.GE13367@odin.tremily.us> Message-ID: <CAHNn8BVLnrHFQqshqEy0A0-eKzsBAuM==r-xsA7o_RVJ7Dewfw@mail.gmail.com> On Mon, Jan 28, 2013 at 6:02 PM, W. Trevor King <wking at tremily.us> wrote: > I've been browsing through the docs and source off and on over the > past few days trying to get a handle on a collaborative IPython > workflow. There's a ?collaborative scenarios? hint in > docs/source/development/messaging.txt and talk of an --existing option > in docs/source/interactive/qtconsole.txt. It looks like the support > for the connect_info magic lives in IPython/zmq/zmqshell.py, but > support for --existing seems spotty (it's only supported by the > IPython/frontend/consoleapp.py, > IPython/frontend/terminal/console/app.py, and > IPython/frontend/qt/console/qtconsoleapp.py frontends, as far as I can > tell). > > Is this still a work in progress? Is some sort of collaborative > session sharing in the pipes? It looks like the kernel only handles > Python command execution (without notebook extensions like input cells > and Markdown rendering), so the collaborative use would only be > sharing a central, kernel-bound Python context. > Real collaborative integration is absolutely in the works for the notebook. This will require a significant change to how the notebook handles saving and document state, but it is one of our highest priorities. Note that notebook session sharing and kernel sharing are two related, but not identical things. Sharing a notebook means sharing the entire document state (cells, etc.). Sharing a kernel *only* means sharing execution state - this is what we already have today in all contexts (including the notebook with the caveat that notebooks cannot connect to kernels started outside the notebook server). The kernel is never going to get document state. We do not have any plans to have synchronous sessions including input and output in the terminal or qtconsole, though the only missing piece is actually the UI - 100% of the technical considerations are already done, as input and output are broadcast to peer frontends. Currently, however, those messages are discarded by the peers, but they could just as easily be displayed. > > My end-goal is to get some sort of recording and playback for > notebooks at the cell-action level (e.g. Markdown cell rendering, > Python cell execution, ?), and it seemed like a logging ?frontend? > could be attached as a collaborator to an existing notebook > frontend/kernel. Then the log could be played back using a playback > ?frontend? and viewed in a collaborating notebook. > This is our goal as well. We are currently working on a Javascript 'playback' mode for notebook-as-screencast type work (#2832<https://github.com/ipython/ipython/issues/2832> ), which is a different, and significantly simpler problem relative to live collaboration. > > Thanks, > Trevor > > -- > This email may be signed or encrypted with GnuPG (http://www.gnupg.org). > For more information, see http://en.wikipedia.org/wiki/Pretty_Good_Privacy > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130128/4eecef3d/attachment.html> From ellisonbg at gmail.com Mon Jan 28 23:14:46 2013 From: ellisonbg at gmail.com (Brian Granger) Date: Mon, 28 Jan 2013 20:14:46 -0800 Subject: [IPython-dev] Collaborative IPython frontends In-Reply-To: <CAHNn8BVLnrHFQqshqEy0A0-eKzsBAuM==r-xsA7o_RVJ7Dewfw@mail.gmail.com> References: <20130129020213.GE13367@odin.tremily.us> <CAHNn8BVLnrHFQqshqEy0A0-eKzsBAuM==r-xsA7o_RVJ7Dewfw@mail.gmail.com> Message-ID: <CAH4pYpRXJ4mR9UO-UiHXHaPb1=hoXiDzg7DbNL_PWHc7uM1prw@mail.gmail.com> Min has made most of the points already but just to agree with him: * Much of the notebook/kernel architecture is already "collaboration enabled" * This is pretty high on our priority. * It will be a significant amount of work = rewriting much of the server+client side notebook. * We are just not there yet and because of other work going on right now we are not ready to tackle this yet. It is not a question of manpower, it is a question of focus for the project. * Please be patient with us in the meantime... Cheers, Brian On Mon, Jan 28, 2013 at 8:04 PM, MinRK <benjaminrk at gmail.com> wrote: > > > On Mon, Jan 28, 2013 at 6:02 PM, W. Trevor King <wking at tremily.us> wrote: >> >> I've been browsing through the docs and source off and on over the >> past few days trying to get a handle on a collaborative IPython >> workflow. There's a ?collaborative scenarios? hint in >> docs/source/development/messaging.txt and talk of an --existing option >> in docs/source/interactive/qtconsole.txt. It looks like the support >> for the connect_info magic lives in IPython/zmq/zmqshell.py, but >> support for --existing seems spotty (it's only supported by the >> IPython/frontend/consoleapp.py, >> IPython/frontend/terminal/console/app.py, and >> IPython/frontend/qt/console/qtconsoleapp.py frontends, as far as I can >> tell). >> >> Is this still a work in progress? Is some sort of collaborative >> session sharing in the pipes? It looks like the kernel only handles >> Python command execution (without notebook extensions like input cells >> and Markdown rendering), so the collaborative use would only be >> sharing a central, kernel-bound Python context. > > > Real collaborative integration is absolutely in the works for the notebook. > This will require a significant change to how the notebook handles saving > and document state, but it is one of our highest priorities. > > Note that notebook session sharing and kernel sharing are two related, but > not identical things. > Sharing a notebook means sharing the entire document state (cells, etc.). > Sharing a kernel *only* means sharing execution state - this is what we > already have today in all contexts (including the notebook with the caveat > that notebooks cannot connect to kernels started outside the notebook > server). > The kernel is never going to get document state. > > We do not have any plans to have synchronous sessions > including input and output in the terminal or qtconsole, > though the only missing piece is actually the UI - 100% of the > technical considerations are already done, > as input and output are broadcast to peer frontends. > Currently, however, those messages are discarded by the peers, > but they could just as easily be displayed. > >> >> >> My end-goal is to get some sort of recording and playback for >> notebooks at the cell-action level (e.g. Markdown cell rendering, >> Python cell execution, ?), and it seemed like a logging ?frontend? >> could be attached as a collaborator to an existing notebook >> frontend/kernel. Then the log could be played back using a playback >> ?frontend? and viewed in a collaborating notebook. > > > This is our goal as well. We are currently working on a Javascript > 'playback' > mode for notebook-as-screencast type work (#2832), > which is a different, and significantly simpler problem relative to live > collaboration. > >> >> >> Thanks, >> Trevor >> >> -- >> This email may be signed or encrypted with GnuPG (http://www.gnupg.org). >> For more information, see http://en.wikipedia.org/wiki/Pretty_Good_Privacy >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From wking at tremily.us Tue Jan 29 07:45:12 2013 From: wking at tremily.us (W. Trevor King) Date: Tue, 29 Jan 2013 07:45:12 -0500 Subject: [IPython-dev] Collaborative IPython frontends In-Reply-To: <CAHNn8BVLnrHFQqshqEy0A0-eKzsBAuM==r-xsA7o_RVJ7Dewfw@mail.gmail.com> References: <20130129020213.GE13367@odin.tremily.us> <CAHNn8BVLnrHFQqshqEy0A0-eKzsBAuM==r-xsA7o_RVJ7Dewfw@mail.gmail.com> Message-ID: <20130129124512.GA16737@odin.tremily.us> On Mon, Jan 28, 2013 at 08:04:27PM -0800, MinRK wrote: > This is our goal as well. We are currently working on a Javascript > 'playback' > mode for notebook-as-screencast type work > (#2832<https://github.com/ipython/ipython/issues/2832> > ), > which is a different, and significantly simpler problem relative to live > collaboration. Ah, thanks for the pointer. -- This email may be signed or encrypted with GnuPG (http://www.gnupg.org). For more information, see http://en.wikipedia.org/wiki/Pretty_Good_Privacy -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 836 bytes Desc: OpenPGP digital signature URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20130129/5d75b6fa/attachment.sig> From roberto.colistete at gmail.com Thu Jan 31 22:55:20 2013 From: roberto.colistete at gmail.com (Roberto Colistete Jr.) Date: Fri, 01 Feb 2013 01:55:20 -0200 Subject: [IPython-dev] IPython 0.13.1 with Notebook and Qt console working on smartphone In-Reply-To: <CAHAreOqd_4u8-Kk7+URqfiUWAz_H6J_sYFcaAZdeRQdEa7Y2VQ@mail.gmail.com> References: <CAOvn4qj4T1h_j72g7K3U4NObpnFBPQ5gBQ4fv8Hwgr1pAjsKbA@mail.gmail.com> <CAHAreOqd_4u8-Kk7+URqfiUWAz_H6J_sYFcaAZdeRQdEa7Y2VQ@mail.gmail.com> Message-ID: <510B3CA8.4020005@gmail.com> Hi, MeeGo Harmattan OS (for Nokia N9/N950 smartphones) now runs full IPython 0.13.1, including Notebook and Qt console interfaces. See the Talk Maemo.org topic : http://talk.maemo.org/showthread.php?p=1123672 MeeGo Harmattan OS also has NumPy 1.4.1, MatPlotLib 1.0.0 and SymPy 0.7.2 packages with easy installation. I have also tested my Nokia N9 running IPython Notebook server and web clients on many devices : PC's, Android tablets, Maemo 5/Nokia N900 smartphone, etc. It works very well. As Nokia N9 has WiFi hotspot, we can have a full IPython 0.13.1 in your pocket, accessible to any computer/tablet/smartphone without IPython but with good web browser (with websockets and MathJax support). Regards, Roberto Colistete Jr.