[Numpy-discussion] [ANN] carray: an in-memory compressed data container

Francesc Alted faltet at pytables.org
Fri Aug 20 11:27:24 EDT 2010


======================
 Announcing carray 0.1
======================

What it is
==========

carray is a container for numerical data that can be compressed
in-memory.  The compresion process is carried out internally by Blosc,
a high-performance compressor that is optimized for binary data.

Having data compressed in-memory can reduce the stress of the memory
subsystem.  The net result is that carray operations can be faster
than using a traditional ndarray object from NumPy.

What's new
==========

Everything ;-) This is the first public release of carray, and it is
more a proof of concept to see which possibilities opens efficient
compression for in-memory data containers.

Currently carray 0.1 implements the basic container creation and
enlargeability.  Multidimensional arrays are not supported yet, and
elements cannot be modified either (i.e. no `__setitem__()` support).

Resources
=========

Visit the main carray site repository at:
http://github.com/FrancescAlted/carray

You can download a source package from:
http://github.com/FrancescAlted/carray/downloads

Short tutorial:
http://github.com/FrancescAlted/carray/blob/master/USAGE.txt

Home of Blosc compressor:
http://blosc.pytables.org

Share your experience
=====================

Let us know of any bugs, suggestions, gripes, kudos, etc. you may
have.

----

   Enjoy!

-- 
Francesc Alted
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/numpy-discussion/attachments/20100820/e67521c6/attachment.html>


More information about the NumPy-Discussion mailing list