Possible solution to binary distributionproblems for numpy on linux?
Hi there, I came across an interesting post on Miguel De Icaza's blog this week-end: http://tirania.org/blog/archive/2007/Jan-26.html The build system used in opensuse is open sourced for a few weeks. The basic idea is that it provides a build farm to build packages for most major distributions, automatically, with automatic dependency tracking for rebuilding a package when its dependencies changed, etc... [1] My questions are: - does it seem interesting to numpy developers ? My impression is that binary distribution of numpy is a big problem for many linux users, and that is entry barrier for many users (I may be wrong, that's just an impression from the ML). - the registration requires agreement from the open build system's team for now. I would be interesting in trying this out, but I didn't want to "proclaim" myself as a numpy developer without consent from the numpy dev team. cheers, David [1]I have not studied throughly, but the idea is: - you submit the sources of your package + a description file - you upload it to the build system - the build systeme consists in a build farm to build binary packages automatically for many distribution (including opensuse, Suse, fedora, ubuntu and debian; the biggest distribution in term of marketshare which are not there are slackware + gentoo, but I guess users of those distribution would know enough to compile packages themselves). Besides the build farm, some advantages are: - automatic rebuilding when one of the dependency changed (let's say the fortran compiler changed in debian -> numpy which depends on it would be rebuilt automatically) - a system for mirroring. The system is still in beta, and requires registration for trying it as a developer.
Hello David! You may get in contact with Werner Hoch. He currently creates NumPy, SciPy, and Matplotlib packages for Opensuse. werner dot ho (at the server) gmx dot de The packages are here: http://repos.opensuse.org/science/ Regards Eike.
On 2/11/07, David Cournapeau <david@ar.media.kyoto-u.ac.jp> wrote:
My impression is that binary distribution of numpy is a big problem for many linux users, and that is entry barrier for many users (I may be wrong, that's just an impression from the ML).
Do all of the major GNU/Linux distributions have recent versions of NumPy? Debian Etch is at NumPy 1.0.1
Keith Goodman wrote:
On 2/11/07, David Cournapeau <david@ar.media.kyoto-u.ac.jp> wrote:
My impression is that binary distribution of numpy is a big problem for many linux users, and that is entry barrier for many users (I may be wrong, that's just an impression from the ML).
Do all of the major GNU/Linux distributions have recent versions of NumPy?
Debian Etch is at NumPy 1.0.1 I think debian has numpy now (I am not using debian on workstation anymore, so I am not really following), but what about new versions of numpy/scipy ? If I want to give some of my code to people in my lab who do not use the same distribution than me, can I give a 10 minutes instructions set to have everything ?
If you read the wiki for linux, you have all kind of information distribution specific, which demands some knowledge about compiler and co, etc... If opensuse build system works as I think it does, this would be kind of helpful. Particularly the rebuilding of packages when one of the dependency changed. cheers, David
David Cournapeau wrote:
Keith Goodman wrote:
On 2/11/07, David Cournapeau <david@ar.media.kyoto-u.ac.jp> wrote:
My impression is that binary distribution of numpy is a big problem for many linux users, and that is entry barrier for many users (I may be wrong, that's just an impression from the ML). Do all of the major GNU/Linux distributions have recent versions of NumPy?
Debian Etch is at NumPy 1.0.1 I think debian has numpy now (I am not using debian on workstation anymore, so I am not really following), but what about new versions of numpy/scipy ? If I want to give some of my code to people in my lab who do not use the same distribution than me, can I give a 10 minutes instructions set to have everything ?
"Bleeding-edge apt-get repository" according to their web page. "To use it add the following line to you /etc/apt/sources.list" deb http://deb-scipy.alioth.debian.org/apt ./ Regards, ST --
On 2/12/07, LUK ShunTim <shuntim.luk@polyu.edu.hk> wrote:
Keith Goodman wrote:
On 2/11/07, David Cournapeau <david@ar.media.kyoto-u.ac.jp> wrote:
My impression is that binary distribution of numpy is a big problem for many linux users, and that is entry barrier for many users (I may be wrong,
David Cournapeau wrote: that's just
an impression from the ML). Do all of the major GNU/Linux distributions have recent versions of NumPy?
Debian Etch is at NumPy 1.0.1 I think debian has numpy now (I am not using debian on workstation anymore, so I am not really following), but what about new versions of numpy/scipy ? If I want to give some of my code to people in my lab who do not use the same distribution than me, can I give a 10 minutes instructions set to have everything ?
"Bleeding-edge apt-get repository" according to their web page. "To use it add the following line to you /etc/apt/sources.list"
Yep. In general, if you are using a Linux distro it is quite easy to use the svn repository. It seem to be on the Mac and Windows that folks have problems, particularly in filling the dependencies on Atlas if they want efficiency. That said, Numpy and MatplotLab have settled enough that the standard packages are probably adequate. Chuck
On 2/15/07, Charles R Harris <charlesr.harris@gmail.com> wrote:
On 2/12/07, LUK ShunTim <shuntim.luk@polyu.edu.hk> wrote:
David Cournapeau wrote:
Keith Goodman wrote:
On 2/11/07, David Cournapeau <david@ar.media.kyoto-u.ac.jp> wrote:
My impression is that binary distribution of numpy is a big problem for many linux users, and that is entry barrier for many users (I may be wrong, that's just an impression from the ML). Do all of the major GNU/Linux distributions have recent versions of NumPy? Debian Etch is at NumPy 1.0.1 I think debian has numpy now (I am not using debian on workstation anymore, so I am not really following), but what about new versions of numpy/scipy ? If I want to give some of my code to people in my lab who do not use the same distribution than me, can I give a 10 minutes instructions set to have everything ?
"Bleeding-edge apt-get repository" according to their web page. "To use it add the following line to you /etc/apt/sources.list"
Yep. In general, if you are using a Linux distro it is quite easy to use the svn repository. It seem to be on the Mac and Windows that folks have problems, particularly in filling the dependencies on Atlas if they want efficiency.
That said, Numpy and MatplotLab have settled enough that the standard packages are probably adequate.
While this is true for people admining their own machines, this is not the case for people without root access. For example, it is a major hassle to install numpy on the computers at my university for exactly this reason. It would be nice to have a self contained build of numpy/scipy/matplotlib for these cases. Keir
Keir Mierle wrote:
On 2/15/07, Charles R Harris <charlesr.harris@gmail.com> wrote:
David Cournapeau wrote:
Keith Goodman wrote:
On 2/11/07, David Cournapeau <david@ar.media.kyoto-u.ac.jp> wrote:
My impression is that binary distribution of numpy is a big problem for many linux users, and that is entry barrier for many users (I may be wrong, that's just an impression from the ML). Do all of the major GNU/Linux distributions have recent versions of NumPy? Debian Etch is at NumPy 1.0.1 I think debian has numpy now (I am not using debian on workstation anymore, so I am not really following), but what about new versions of numpy/scipy ? If I want to give some of my code to people in my lab who do not use the same distribution than me, can I give a 10 minutes instructions set to have everything ?
"Bleeding-edge apt-get repository" according to their web page. "To use it add the following line to you /etc/apt/sources.list"
deb http://deb-scipy.alioth.debian.org/apt ./ Yep. In general, if you are using a Linux distro it is quite easy to use the svn repository. It seem to be on the Mac and Windows that folks have
On 2/12/07, LUK ShunTim <shuntim.luk@polyu.edu.hk> wrote: problems, particularly in filling the dependencies on Atlas if they want efficiency.
That said, Numpy and MatplotLab have settled enough that the standard packages are probably adequate.
While this is true for people admining their own machines, this is not the case for people without root access. For example, it is a major hassle to install numpy on the computers at my university for exactly this reason.
Probably OT now, ... Ya, I can understand your feeling very well and therefore, I administer my own box. :-) A possible workaround for Debian is debootstrap, which enables one to build a chroot debian system inside an existing one. Some infromation here http://wiki.debian.org/Debootstrap Regards, ST --
participants (6)
-
Charles R Harris -
David Cournapeau -
Eike Welk -
Keir Mierle -
Keith Goodman -
LUK ShunTim