[Neuroimaging] indexed access to gziped files

[Brendan Moloney]

I don't see any mention of memmaps on the github page. It seems like the code is just storing extra bits of info for different "seek points" that allow you to access random parts of the file without decompressing everything before it.  So I think this could help with doing partial loading of the dataobj even without memmaps. Unless I am missing something...

- Brendan


________________________________
From: Neuroimaging [neuroimaging-bounces+moloney=ohsu.edu at python.org] on behalf of Samuel St-Jean [stjeansam at gmail.com]
Sent: Friday, March 11, 2016 12:39 AM
To: Neuroimaging analysis in Python
Subject: Re: [Neuroimaging] indexed access to gziped files

If you ever go for all memmaped files, please also provide an easy way to return plain numpy arrays (like the unload arg for nibabel.load). Memmaps don't support all the kwargs in subfunctions, which can lead to weird broadcasting behavior.

2016-03-11 9:11 GMT+01:00 Chris Filo Gorgolewski <krzysztof.gorgolewski at gmail.com<mailto:krzysztof.gorgolewski at gmail.com>>:

On Mar 10, 2016 11:00 PM, "Matthew Brett" <matthew.brett at gmail.com<mailto:matthew.brett at gmail.com>> wrote:
>
> On Thu, Mar 10, 2016 at 10:33 PM, Gael Varoquaux
> <gael.varoquaux at normalesup.org<mailto:gael.varoquaux at normalesup.org>> wrote:
> > Indeed, Paul did that at the brain hack. It's a great initiative.
> >
> > Two caveats. First it needs compiled code (which means that it cannot
> > just be copied in nibabel).
>
> No, but it could be an optional package used for gzip files if importable.
+1! It would be a great optional feature.
>
> Cheers,
>
> Matthew
> _______________________________________________
> Neuroimaging mailing list
> Neuroimaging at python.org<mailto:Neuroimaging at python.org>
> https://mail.python.org/mailman/listinfo/neuroimaging

_______________________________________________
Neuroimaging mailing list
Neuroimaging at python.org<mailto:Neuroimaging at python.org>
https://mail.python.org/mailman/listinfo/neuroimaging


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/neuroimaging/attachments/20160311/7dc7199d/attachment.html>