[Numpy-discussion] Help using numPy to create a very large multi dimensional array

Vincent Nijs v-nijs at kellogg.northwestern.edu
Sun Apr 22 11:43:04 EDT 2007


It seems to be a lot slower than pylab.load for large arrays. Also, it
doesn't handle dates.

Vincent

On 4/22/07 10:33 AM, "Markus Rosenstihl"
<markusro at element.fkp.physik.tu-darmstadt.de> wrote:

> Whats wrong with scipy.io.read_array?
> 
> Am 19.04.2007 um 15:50 schrieb Lisandro Dalcin:
> 
>> On 4/19/07, Travis Oliphant <oliphant.travis at ieee.org> wrote:
>>> Nick Fotopoulos wrote:
>>>> Devs, is there any possibility of moving/copying pylab.load to numpy?
>>>> I don't see anything in the source that requires the rest of
>>>> matplotlib.  Among convenience functions, I think that this function
>>>> ranks pretty highly in convenience.
>>>> 
>>> 
>>> I'm supportive of this.  But, it can't be named numpy.load.
>>> 
>> 
>> I am also +1 on this, but this functionality should be implemented in
>> C, I think. I've just tested numpy.fromfile('name.txt', sep=' ')
>> against pylab.load('name.txt') for a 35MB text file, the number are:
>> 
>> numpy.fromfile: 2.66 sec.
>> pylab.load:  16.64 sec.
>> 
>> 
>> -- 
>> Lisandro Dalcín
>> ---------------
>> Centro Internacional de Métodos Computacionales en Ingeniería (CIMEC)
>> Instituto de Desarrollo Tecnológico para la Industria Química (INTEC)
>> Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET)
>> PTLC - Güemes 3450, (3000) Santa Fe, Argentina
>> Tel/Fax: +54-(0)342-451.1594
>> _______________________________________________
>> Numpy-discussion mailing list
>> Numpy-discussion at scipy.org
>> http://projects.scipy.org/mailman/listinfo/numpy-discussion
> _______________________________________________
> Numpy-discussion mailing list
> Numpy-discussion at scipy.org
> http://projects.scipy.org/mailman/listinfo/numpy-discussion

-- 
Vincent R. Nijs
Assistant Professor of Marketing
Kellogg School of Management, Northwestern University
2001 Sheridan Road, Evanston, IL 60208-2001
Phone: +1-847-491-4574 Fax: +1-847-491-2498
E-mail: v-nijs at kellogg.northwestern.edu
Skype: vincentnijs






More information about the NumPy-Discussion mailing list