Fast forward-backward (write-read)

Virgil Stokes vs at it.uu.se
Sun Oct 28 10:20:45 EDT 2012


On 28-Oct-2012 12:18, Dave Angel wrote:
> On 10/24/2012 03:14 AM, Virgil Stokes wrote:
>> On 24-Oct-2012 01:46, Paul Rubin wrote:
>>> Virgil Stokes <vs at it.uu.se> writes:
>>>> Yes, I do wish to inverse the order,  but the "forward in time" file
>>>> will be in binary.
>>> I really think it will be simplest to just write the file in forward
>>> order, then use mmap to read it one record at a time.  It might be
>>> possible to squeeze out a little more performance with reordering tricks
>>> but that's the first thing to try.
>> Thanks Paul,
>> I am working on this approach now...
> If you're using mmap to map the whole file, you'll need 64bit Windows to
> start with.  I'd be interested to know if Windows will allow you to mmap
> 100gb at one stroke.  Have you tried it, or are you starting by figuring
> how to access the data from the mmap?
Thanks very much for pursuing my query, Dave.

I have not tried it yet --- temporarily side-tracked; but, I will post my 
findings on this issue.



More information about the Python-list mailing list