[Neuroimaging] indexed access to gziped files

Yaroslav Halchenko yoh at onerussian.com
Mon Jun 27 18:24:51 EDT 2016


Hi Paul,

I just want to say - carry on! 
I haven't tried it yet but we might later make use of your project within datalad project to access content within archives... I hope we will investigate that opportunity in the near future

Related issue https://github.com/datalad/datalad/issues/373

Cheers

On June 27, 2016 5:49:11 PM GMT+02:00, paul mccarthy <pauldmccarthy at gmail.com> wrote:
>Howdy all,
>
>Apologies for taking so long on this - I've been busy with my real
>work.
>But I've managed to get my indexed gzip project to a useable state -
>check
>it out here:
>
>https://github.com/pauldmccarthy/indexed_gzip
>
>I've tested it a fair bit via direct usage, but would like to add a bit
>more test coverage. And I'd like to add some basic write support - a
>function which writes out the full file, but re-builds the index as it
>does
>so, so the file can then be re-opened, with fast random-access
>available
>immediately.
>
>Apart from that, it's ready to be used.
>
>As far as nibabel integration goes, I'm not really sure if any changes
>to
>nibabel are necessary - I think it would be perfectly reasonable to put
>the
>onus on the user to manage their own file handle, and create their
>nibabel
>images via a file map.
>
>The only potential change that I think would be useful is the ability
>to
>create an image directly from a file handle (instead of using
>from_file_map). What does everybody think?
>
>Cheers,
>
>Paul
>
>On 15 March 2016 at 01:58, Matthew Brett <matthew.brett at gmail.com>
>wrote:
>
>> Hi,
>>
>> On Mon, Mar 14, 2016 at 2:12 PM, paul mccarthy
><pauldmccarthy at gmail.com>
>> wrote:
>> > Hi Matthew,
>> >
>> > Thanks for clarifying the flieobj 'dance'!
>> >
>> > I had meant to ask you about cython - it looks like a good option
>(and is
>> > recommended in the official docs -
>> > https://docs.python.org/3/howto/cporting.html), so I'll look into
>it.
>> > Perhaps the best way forward would be for me to drop the mailing
>list a
>> line
>> > when I've got something in a more useable state.
>>
>> That would be great.  Please feel free to ask for help with Cython,
>we
>> have a lot of collective experience here on the list.
>>
>> Cheers,
>>
>> Matthew
>> _______________________________________________
>> Neuroimaging mailing list
>> Neuroimaging at python.org
>> https://mail.python.org/mailman/listinfo/neuroimaging
>>
>
>
>------------------------------------------------------------------------
>
>_______________________________________________
>Neuroimaging mailing list
>Neuroimaging at python.org
>https://mail.python.org/mailman/listinfo/neuroimaging

-- 
Sent from a phone which beats iPhone.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/neuroimaging/attachments/20160628/e6a01909/attachment.html>


More information about the Neuroimaging mailing list