working with a large file

Wolfgang Rohdewald wolfgang at rohdewald.de
Mon Sep 12 12:45:00 CEST 2011


On Montag 12 September 2011, Rita wrote:
> I have a large file, 18gb uncompressed, and I would like to
> know what is the preferred method to read this file for
> random access. I have several processes reading the file
> which different calculate arguments. My server has 64gb of
> memory. Not sure what is the preferred way to do this?

if the data is structured, you could store it in 
something like sqlite

-- 
Wolfgang



More information about the Python-list mailing list