[SciPy-user] Fastest way to save/load fairly large (sparse) matrices

Andrew Straw strawman at astraw.com
Wed Jul 18 16:59:06 EDT 2007


Dear David, this code works for me. It's not the most elegant, but at 
least you get the idea. See the test() function for the example usage.

David Warde-Farley wrote:
> Hi folks,
> 
> I've been wrestling with this problem for some time now. Essentially  
> I'm using Numpy/Scipy as the backend in a python-based web  
> application and need a way of serializing the contents of a fairly  
> large, but sparsely populated, symmetric matrix to disk. So far I've  
> experimented with just ASCII dumps and pickling, but neither really  
> has the kind of speed that I'm looking for (and is kind of necessary  
> for an interactive web application). Is there some better way?
> 
> To give you an idea of the scale, I'm hoping to get this to work with  
> 20000x20000 matrices that are about 1% full.
> 
> Thanks,
> 
> David
> _______________________________________________
> SciPy-user mailing list
> SciPy-user at scipy.org
> http://projects.scipy.org/mailman/listinfo/scipy-user

-------------- next part --------------
A non-text attachment was scrubbed...
Name: ashelf.py
Type: text/x-python
Size: 3201 bytes
Desc: not available
URL: <http://mail.scipy.org/pipermail/scipy-user/attachments/20070718/8bb776b9/attachment.py>


More information about the SciPy-User mailing list