[Tutor] Timing a python program

[CL Talk]

Thanks to all the responses. I have started looking at the
documentation and will be implementing it. Thanks for the direction.

I only have megabytes of data files. I think that the program can be
optimized and am hoping that with the profiler I will be able to get
some insight.

Thanks again.

On Fri, Jan 16, 2015 at 3:33 PM, Danny Yoo <dyoo at hashcollision.org> wrote:
> On Thu, Jan 15, 2015 at 9:02 PM, CL Talk <cltalk at gmail.com> wrote:
>> Hello - I have a python program that reads data from data files and
>> does manipulation on the data and writes back to output files. I am
>> developing this program on a macbook with python 2.7.6.
>>
>> This program takes close to 10 minutes on my machine to run. But, the
>> issue is that it is not take the same amount of time on almost similar
>> data files.
>>
>> I am trying to see how I can time the whole program as well as various
>> functions that are part of the program.
>>
>> Say, that I have 5 functions in this program how can i time the whole
>> program and time each individual function for every run?
>
>
> The use of the profiler, as the others have discussed, is the right
> approach here.  It's hard to say what's really going on without good
> timing data, and the profiler should help.
>
> Once you get that data, please feel free to share it on the mailing
> list if you can; folks here can help analyze what you're seeing too.
> Also, please put your source code somewhere for folks to inspect.
>
> Finally, if you can say how large your input and output are, that
> would also be helpful.  If we're talking about megabytes, then since
> you're seeing minutes of runtime, I'd expect that the algorithms used
> are prime culprits, and good targets for chasing for optimizations.
>
> But if we're talking about terabytes, maybe your program is fine, and
> you just have a lot of data that needs chugging through.  :P
>
>
> Good luck!