[Cython] Speedup hudson job with ccache

Vitja Makarov vitja.makarov at gmail.com
Thu Jul 7 09:05:16 CEST 2011


2011/7/7 Vitja Makarov <vitja.makarov at gmail.com>

>
>
> 2011/7/7 Stefan Behnel <stefan_ml at behnel.de>
>
>> Vitja Makarov, 07.07.2011 08:32:
>>
>>> 2011/7/7 Stefan Behnel
>>>
>>>  Robert Bradshaw, 06.07.2011 21:32:
>>>>
>>>>  We should get ccache on sage.math to start using it on hudson.
>>>>
>>>>>
>>>>>
>>>> It's just a single binary when installed. I have a copy in my
>>>> ~/ccache/bin.
>>>> Changing the Jenkins jobs now.
>>>>
>>>>
>>>>  Is that already used?
>>>
>>
>> Actually, no. I noticed that it would a) require changes to all test jobs,
>> and b) prevent us from getting clean test runs. I prefer a safe and clean
>> run over a fast one.
>>
>>
> a) you can set CYTHON_RUNTESTS_CCACHE globaly somewhere inside ~/.profile
>
>
>
>> Also, the test runner clears the target directory on startup. I wonder
>> where you got your numbers from...
>>
>>
> By default ccache stores object files inside ~/.ccache directory, how it
> works:
>
> 1. It runs preprocessor (cpp), then adds compiler version, compilation
> flags and so on.
> 2. Calculates checksum (md5? I don't know)
> 3. Check if it's already in the cache, no compilation is required
>
> http://ccache.samba.org/
>
> So I think that would be safe to use ccache here.
>
>

How it works:
http://ccache.samba.org/manual.html#_how_ccache_works

Ccache >=3.0 has new "direct mode" think we should disable this, I was
running ccache 2.4 that allways do full preprocessing




-- 
vitja.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/cython-devel/attachments/20110707/60743c60/attachment-0001.html>


More information about the cython-devel mailing list