[Numpy-discussion] "import numpy" is slow

Nathan Bell wnbell at gmail.com
Thu Jul 31 08:46:20 EDT 2008


On Thu, Jul 31, 2008 at 7:31 AM, Hanni Ali <hanni.ali at gmail.com> wrote:
>
> I would just to highlight an alternate use of numpy to interactive use. We
> have a cluster of machines which process tasks on an individual basis where
> a master tasks may spawn 600 slave tasks to be processed. These tasks are
> spread across the cluster and processed as scripts in a individual python
> thread. Although reducing the process time by 300 seconds for the master
> task is only about a 1.5% speedup (total time can be i excess of 24000s). We
> process large number of these tasks in any given year and every little
> helps!
>

There are other components of NumPy/SciPy that are more worthy of
optimization.  Given that programmer time is a scarce resource, it's
more sensible to direct our efforts towards making the other 98.5% of
the computation faster.

/law of diminishing returns

-- 
Nathan Bell wnbell at gmail.com
http://graphics.cs.uiuc.edu/~wnbell/



More information about the NumPy-Discussion mailing list