[Distutils] short circuiting module lookups

[Noah Gift]

On Wed, Apr 8, 2009 at 7:44 PM, Marius Gedminas <marius at pov.lt> wrote:
> On Tue, Apr 07, 2009 at 02:23:50PM -0400, Jim Fulton wrote:
>> On Apr 7, 2009, at 9:28 AM, P.J. Eby wrote:
>>> At 11:54 PM 4/7/2009 +1200, Noah Gift wrote:
>>>> 1.  In the case of entry points for setuptools, it actually recurses
>>>> into EVERY egg directory in your path, not just the egg you
>>>> requested, adds them to your sys.path and additionally looks for
>>>> four files inside of every egg.  On a laptop on local storage, this
>>>> doesn't matter, but when thousands of machines hit the same filer,
>>>> with many python processes, bad things happen...
>>>
>>> Install your eggs with --multi-version, and then only the eggs that
>>> are required for the running script will be added to sys.path or have
>>> their contents opened.  (Installing them as zip files rather than
>>> directories may also speed this up.)
>>
>> My experience on Linux is that installing eggs as Zip files slows
>> imports.
>
> Was that in the presence of NFS?

yes.
>
> Marius Gedminas
> --
> We have an advanced scalable groupware communication environment (email)
>        -- Alan Cox
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.9 (GNU/Linux)
>
> iD8DBQFJ3FXakVdEXeem148RAtLXAJ9cn0H26iHmwCEsjA2c8hctwp6BBgCcCMhQ
> gEaVFxdg6wsSWOx0doulsM0=
> =qWLt
> -----END PGP SIGNATURE-----
>
> _______________________________________________
> Distutils-SIG maillist  -  Distutils-SIG at python.org
> http://mail.python.org/mailman/listinfo/distutils-sig
>
>



-- 
Cheers,

Noah