[Tutor] memory management

Arne Mueller a.mueller@icrf.icnet.uk
Sun, 18 Apr 1999 18:43:10 +0100


Dear All,

David Ascher wrote:
> 
> On Fri, 16 Apr 1999, Arne Mueller wrote:
> 
> 
> When posting code, please post working code, not pseudocode -- Python is
> so simple and clear, there's no need to make up a new syntax.

Sorry for that, yes it was quick & dirty posting and it's not correct, I
appoligize for that!

> 
> Christian's comment about rethinking the code is a valid one -- it might
> save you time to think a bit about whether you really need to have all 100
> Mb in memory at the same time, or whether you can pipeline the process
> somewhat.  Without knowing more about the specifics, it's hard to know how
> to help.

Hm, 100 MB memory usage is not a big problem, 200 MB is (in my case)!
However, in I summary: I've to read in data. Whether a dataset is read
into memory depends on what is already in the datastructure, it may
replace an existing dataset or not, so I've to compare each new dataset
to all existing datasets. After reading in the data, a sorting is
applied to the structure, the sorted datastructure is written to a file.

        greetings,
        Arne