[Numpy-discussion] [ANN] carray: an in-memory compressed data container
Francesc Alted
faltet at pytables.org
Fri Aug 20 11:27:24 EDT 2010
======================
Announcing carray 0.1
======================
What it is
==========
carray is a container for numerical data that can be compressed
in-memory. The compresion process is carried out internally by Blosc,
a high-performance compressor that is optimized for binary data.
Having data compressed in-memory can reduce the stress of the memory
subsystem. The net result is that carray operations can be faster
than using a traditional ndarray object from NumPy.
What's new
==========
Everything ;-) This is the first public release of carray, and it is
more a proof of concept to see which possibilities opens efficient
compression for in-memory data containers.
Currently carray 0.1 implements the basic container creation and
enlargeability. Multidimensional arrays are not supported yet, and
elements cannot be modified either (i.e. no `__setitem__()` support).
Resources
=========
Visit the main carray site repository at:
http://github.com/FrancescAlted/carray
You can download a source package from:
http://github.com/FrancescAlted/carray/downloads
Short tutorial:
http://github.com/FrancescAlted/carray/blob/master/USAGE.txt
Home of Blosc compressor:
http://blosc.pytables.org
Share your experience
=====================
Let us know of any bugs, suggestions, gripes, kudos, etc. you may
have.
----
Enjoy!
--
Francesc Alted
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/numpy-discussion/attachments/20100820/e67521c6/attachment.html>
More information about the NumPy-Discussion
mailing list