[Tutor] reading output from a c executable.

[Ravi Kondamuru]

Denis, These are 32bit, 64bit counters (essentially numbers).
Bob, There are well over 10K counters in the log file that are updated every
5 secs. If a counter1's graph was requested, log will have to be parsed once
to get the data points. If a user asked for a counter2, now it needs to be
retrieved from the log file. Which essentially means having to go through
the logfile again. This is because i want to try to avoid using a database
to store values after parsing the file.
thanks,
Ravi.


On Thu, Dec 11, 2008 at 7:54 PM, bob gailer <bgailer at gmail.com> wrote:

> Ravi Kondamuru wrote:
>
>> Reasons for C:
>> 1. The log files I am working are 60-100MB files. I *assumed* using C will
>> reduce the parse time.
>> 2. The records themselves are variable length and hence was concerned
>> about the complexity for implementation in python.
>> 3. Since I am not using a database, each request to refresh the graph
>> (changing time duration for display) will have to re-parse the file all over
>> again. And hence speed in parsing the log is important.
>>
>
> There should never be a need to reparse the same file. Please present the
> case more specifically.
>
>
> --
> Bob Gailer
> Chapel Hill NC 919-636-4239
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/tutor/attachments/20081212/e4004410/attachment.htm>