On Sat, 21 Feb 2009 00:25:04 -0800 Matthew Brett <matthew.brett@gmail.com> wrote:
Hi,
On Fri, Feb 20, 2009 at 11:58 PM, Matthew Brett <matthew.brett@gmail.com> wrote:
Hi,
I finally got a chance to test with my nasty file, and with r5561, it now takes ~32 minutes of cpu time to load (as compared to ~5 minutes for 0.7.0, and 3 seconds for 0.6.0). All the time is in zlibstreams.py:read.
Actually, thinking about it, I wonder if it's the string slicing in getting the data out of zlibstream that is taking the time. I suppose that might happen if you have lots of tiny matrices in there. Could you try:
import scipy.io.matlab as matlab matlab.bench()
What kind of numbers do you get?
Best,
Matthew
Hi Matthew, I just run the benchmark. Here are the results:
matlab.bench() Running benchmarks for scipy.io.matlab NumPy version 1.3.0.dev6436 NumPy is installed in /home/nwagner/local/lib64/python2.6/site-packages/numpy SciPy version 0.8.0.dev5581 SciPy is installed in /home/nwagner/local/lib64/python2.6/site-packages/scipy Python version 2.6 (r26:66714, Feb 3 2009, 20:49:49) [GCC 4.3.2 [gcc-4_3-branch revision 141291]] nose version 0.10.4
<class 'scipy.io.matlab.zlibstreams.ZlibInputStream'> reading gzip streams ======================================== time(s) | nbytes ---------------------------------------- 0.060 | 1.500 | 4000000 0.240 | 1.200 | 20000000 <class 'scipy.io.matlab.zlibstreams.TwoShotZlibInputStream'> reading gzip streams ======================================== time(s) | nbytes ---------------------------------------- 0.060 | 1.500 | 4000000 0.240 | 1.333 | 20000000 . ---------------------------------------------------------------------- Ran 1 test in 10.152s OK True Nils