[Neuroimaging] indexed access to gziped files

[Gael Varoquaux]

Indeed, Paul did that at the brain hack. It's a great initiative.

Two caveats. First it needs compiled code (which means that it cannot
just be copied in nibabel). Second, it's quite slow and cannot be made
faster without changing the file format.

One of the problems is that gzip isn't a good compression at all for
these purposes. The people behind the use of nii.gz didn't have such
things in mind. It would be great to make sure that the next iteration is
a bit more thought through. Maybe it's just a question how using a
different compressor than gzip.

Gaël

On Thu, Mar 10, 2016 at 04:32:41PM -0800, Chris Filo Gorgolewski wrote:
> check this out: https://github.com/pauldmccarthy/indexed_gzip/

> It could be incorporated in nibabel to provide memory mapped access to .nii.gz
> files!

> Best,
> Chris

> _______________________________________________
> Neuroimaging mailing list
> Neuroimaging at python.org
> https://mail.python.org/mailman/listinfo/neuroimaging


-- 
    Gael Varoquaux
    Researcher, INRIA Parietal
    NeuroSpin/CEA Saclay , Bat 145, 91191 Gif-sur-Yvette France
    Phone:  ++ 33-1-69-08-79-68
    http://gael-varoquaux.info            http://twitter.com/GaelVaroquaux