Mailman 3 December 2009 - Distutils-SIG

[issue99] easy_install does not honour exec-prefix for platform-dependent eggs
by Phil Mitchell Dec. 19, 2009

Dec. 19, 2009

New submission from Phil Mitchell <philip.mitchell(a)gmail.com>: When running easy_install with a platform-dependent egg on a python installation whose exec-prefix differs from its prefix, the egg is installed in the platform-independent site-packages directory. In some senses, this seems okay because the egg name contains the platform name, but the easy_install.pth file only includes the egg from one platform, and if multiple eggs with the same name (but different platform) are added to the easy_install.pth file, then only the first will be considered. This comes up when using a common installation of python on a network share with different exec-prefix settings for each platform. This would not be an issue if easy_install were to install platform-dependent eggs into the platform-specific site-packages location and set up the easy_install.pth for that location appropriately. I am able to set things up this way manually, but it is not quite as "easy" to "install." ---------- messages: 477 nosy: philbert priority: bug status: unread title: easy_install does not honour exec-prefix for platform-dependent eggs _______________________________________________ Setuptools tracker <setuptools(a)bugs.python.org> <http://bugs.python.org/setuptools/issue99> _______________________________________________

1 0

Re: [Distutils] install_requires option to force pypi url or a better approach?
by P.J. Eby Dec. 18, 2009

Dec. 18, 2009

At 06:12 PM 12/18/2009 +0100, Aljoa MohoroviÄ wrote: >i've setup private pypi where i can upload some packages that are >not suitable for pypi.python.org. my package, let's call it myapp, >contains "install_requires=['django',]" but with that requirement i >can't install it. -------------------------------------------------- >$ virtualenv --no-site-packages --distribute env New python >executable in env/bin/python A globally installed setuptools was >found (in /usr/lib/python2.6/dist-packages) Use the >--no-site-packages option to use distribute in the virtualenv. >Installing >distribute...........................................................................................................................................................................done. >$ . env/bin/activate $ pip freeze distribute==0.6.8 wsgiref==0.1.2 $ >pip install myapp -i http://pypi.example.com Downloading/unpacking >myapp Â Using download cache from /home/aljosa/.pip-cache/<MYAPP PKG >URL> Â Running setup.py egg_info for package myapp >Downloading/unpacking django (from myapp) Â Could not find any >downloads that satisfy the requirement django (from myapp) No >distributions at all found for django (from myapp) >-------------------------------------------------- since i can >normally install django with "pip install django" i assume that when >i set "-i http://pypi.example.com" it's also used for >install_requires. any tips on using multiple pypi repositories? is >there some way to define which pypi url to use for package installation? You would probably be better off using the find_links option in your setup(), to indicate additional URLs where packages can be found. e.g. find_links=['http://pypi.example.com/somepackage', 'http://pypi.example.com/otherpackage']. This will tell easy_install (or other packaging tools) to check these pages in addition to the standard package-index pages, when seeking out your dependencies.

2 1

install_requires option to force pypi url or a better approach?
by Aljoša Mohorović Dec. 18, 2009

Dec. 18, 2009

i've setup private pypi where i can upload some packages that are not suitable for pypi.python.org. my package, let's call it myapp, contains "install_requires=['django',]" but with that requirement i can't install it. -------------------------------------------------- $ virtualenv --no-site-packages --distribute env New python executable in env/bin/python A globally installed setuptools was found (in /usr/lib/python2.6/dist-packages) Use the --no-site-packages option to use distribute in the virtualenv. Installing distribute...........................................................................................................................................................................done. $ . env/bin/activate $ pip freeze distribute==0.6.8 wsgiref==0.1.2 $ pip install myapp -i http://pypi.example.com Downloading/unpacking myapp Using download cache from /home/aljosa/.pip-cache/<MYAPP PKG URL> Running setup.py egg_info for package myapp Downloading/unpacking django (from myapp) Could not find any downloads that satisfy the requirement django (from myapp) No distributions at all found for django (from myapp) -------------------------------------------------- since i can normally install django with "pip install django" i assume that when i set "-i http://pypi.example.com" it's also used for install_requires. any tips on using multiple pypi repositories? is there some way to define which pypi url to use for package installation? Aljosa Mohorovic

2 4

Re: [Distutils] Install egg from SVN sources => AttributeError: 'module' object has no attribute '__getstate__'
by P.J. Eby Dec. 18, 2009

Dec. 18, 2009

At 06:10 PM 12/17/2009 +0200, Eemeli Kantola wrote: >Hi all, > >I'm getting a crash in setuptools-0.6c11-py2.6 when trying to install >an egg directly from SVN sources. This happens both on OSX and Ubuntu, >versions: > >Python 2.6.1 (r261:67515, Jul 7 2009, 23:51:51) [GCC 4.2.1 (Apple >Inc. build 5646)] on darwin >Python 2.6.2 (release26-maint, Apr 19 2009, 01:56:41) [GCC 4.3.3] on linux2 > >Command and stack trace: >... > >So is this a bug? My fix is presumably only treating the symptoms, >because I've got only little clue of what is happening in the code... My guess is that you've got some other pkg_resources module on your sys.path, such as from an older version of setuptools. Could you check the following from your Python prompt? >>> import pkg_resources, setuptools >>> print pkg_resources.__file__ >>> print setuptools.__file__ >>> print setuptools.__version__ Thanks.

2 1

Install egg from SVN sources => AttributeError: 'module' object has no attribute '__getstate__'
by Eemeli Kantola Dec. 17, 2009

Dec. 17, 2009

Hi all, I'm getting a crash in setuptools-0.6c11-py2.6 when trying to install an egg directly from SVN sources. This happens both on OSX and Ubuntu, versions: Python 2.6.1 (r261:67515, Jul 7 2009, 23:51:51) [GCC 4.2.1 (Apple Inc. build 5646)] on darwin Python 2.6.2 (release26-maint, Apr 19 2009, 01:56:41) [GCC 4.3.3] on linux2 Command and stack trace: $ sudo easy_install https://asibsync.svn.sourceforge.net/svnroot/asibsync/src/asilib Downloading https://asibsync.svn.sourceforge.net/svnroot/asibsync/src/asilib Doing subversion checkout from https://asibsync.svn.sourceforge.net/svnroot/asibsync/src/asilib to /tmp/easy_install-WYCRs6/asilib Processing asilib Running setup.py -q bdist_egg --dist-dir /tmp/easy_install-WYCRs6/asilib/egg-dist-tmp-6_PSoY Traceback (most recent call last): File "/usr/local/bin/easy_install", line 8, in <module> load_entry_point('setuptools==0.6c11', 'console_scripts', 'easy_install')() File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/command/easy_install.py", line 1712, in main File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/command/easy_install.py", line 1700, in with_ei_usage File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/command/easy_install.py", line 1716, in <lambda> File "/usr/lib/python2.6/distutils/core.py", line 152, in setup dist.run_commands() File "/usr/lib/python2.6/distutils/dist.py", line 975, in run_commands self.run_command(cmd) File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command cmd_obj.run() File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/command/easy_install.py", line 211, in run File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/command/easy_install.py", line 422, in easy_install File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/command/easy_install.py", line 476, in install_item File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/command/easy_install.py", line 655, in install_eggs File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/command/easy_install.py", line 930, in build_and_install File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/command/easy_install.py", line 919, in run_setup File "/usr/local/lib/python2.6/dist-packages/setuptools-0.6c11-py2.6.egg/setuptools/sandbox.py", line 52, in run_setup AttributeError: 'module' object has no attribute '__getstate__' This is the first time I look at setuptools' code, but it seems the problem goes away when I conditionally disabled the __getstate__ and __setstate__ lines in sandbox.py, as per this batch: --- sandbox.py.old 2009-10-19 13:35:44.000000000 +0300 +++ sandbox.py 2009-12-17 17:49:10.000000000 +0200 @@ -49,7 +49,8 @@ if not os.path.isdir(temp_dir): os.makedirs(temp_dir) save_tmp = tempfile.tempdir save_modules = sys.modules.copy() - pr_state = pkg_resources.__getstate__() + if hasattr(pkg_resources, '__getstate__'): + pr_state = pkg_resources.__getstate__() try: tempfile.tempdir = temp_dir; os.chdir(setup_dir) try: @@ -69,7 +70,8 @@ raise # Normal exit, just return finally: - pkg_resources.__setstate__(pr_state) + if hasattr(pkg_resources, '__getstate__'): + pkg_resources.__setstate__(pr_state) sys.modules.update(save_modules) for key in list(sys.modules): if key not in save_modules: del sys.modules[key] So is this a bug? My fix is presumably only treating the symptoms, because I've got only little clue of what is happening in the code... Best, Eemeli Kantola

1 0

install_requires vs requires
by David Cournapeau Dec. 16, 2009

Dec. 16, 2009

Hi, I am working on a new packaging solution, and I want to convert existing setup.py. I noticed that the install_requires as used by setuptools is not put into PKG-INFO as requires. Is this expected ? What is the difference between requires and require_install ? What happens when both have different values ? cheers, David

4 4

Re: [Distutils] [Bug] Failed installation. setuptools-0.6c11.win32-py2.6.exe
by Andrey Andreev Dec. 15, 2009

Dec. 15, 2009

Hi Rune, I had a similar issue on Windows Server 2008 R2. You are probably running Win 7 (64bit). I ran procmon, and found out that the installer is looking for the keys under: HKEY_LOCAL_MACHINE\Software\Wow6432Node\Python\PythonCore HKEY_CURRENT_USER\Software\Python\PythonCore so I modified the register.py discussed above to write to HKEY_CURRENT_USER instead of HKEY_LOCAL_MACHINE, which solved the issue. Cheers, Andrey

2 2

[buildout] "Couldn't find index page for" in tests
by Chris Withers Dec. 15, 2009

Dec. 15, 2009

Hi All, I see a few tests for buildout recipes that use zc.buildout.testing but also use a RENormalizer to hide "Couldn't find index page for" errors.. Why is this error showing up and why is it okay to hide it? not-joining-the-cargo-cult-ly yours, Chris -- Simplistix - Content Management, Batch Processing & Python Consulting - http://www.simplistix.co.uk

3 3

Should pip support extras? Was: [venv] question about future pip capabilities
by Jorge Vargas Dec. 14, 2009

Dec. 14, 2009

On Thu, Dec 10, 2009 at 3:58 PM, Darren Dale <dsdale24(a)gmail.com> wrote: > On Thu, Dec 10, 2009 at 2:30 PM, Ian Bicking <ianb(a)colorstudy.com> wrote: >> On Thu, Dec 10, 2009 at 11:18 AM, Darren Dale <dsdale24(a)gmail.com> wrote: >> There isn't really; extras would be nice, but there hasn't been much >> demand for them. pip requirement files serve a similar purpose though >> in a somewhat different way. > > I brought this up on the virtualenv mailing list once before. > Requirements files serve a very different use-case. If I want to > define a project extra like foo[traits_qt4] that depends on a project > with an extra like traits[qt4] > 3.2.0, I can't just list traits[qt4] >> 3.2.0 in my requirements file, because pip is not designed to > recursively check the (arbitrarily-named) requirements files of the > dependencies I declare in my own requirements file. I have to keep > track of not only my projects dependencies, but my dependencies > dependencies, and on and on. > I think the problem with extras is that the concept itself is flawed. python lacks this optional dependecies paradigm and we end up with a bunch of hacks to get the optional dependencies to work. And in the end you get to maintain code that checks at runtime which "option" to choose making the extras stuff redundant at best. I can't really think of a case where pip install lib backend1 pip install lib backend2 can't replace pip install lib[backend1] pip install lib[backend2] as for requirements being a replacement what's wrong with having several files? sure it's a little duplication (and it may get exponential if you depend on a package that depends on other optional dependencies) but seriously which % of package suffer from that? IMO extras was a misfeature that should be slowly deprecated. > Regards, > Darren > _______________________________________________ > Distutils-SIG maillist - Distutils-SIG(a)python.org > http://mail.python.org/mailman/listinfo/distutils-sig >

2 1

Problem with buildout and zc.recipe.cmmi
by James J Myers Dec. 12, 2009

Dec. 12, 2009

Next try was to change buildout to use minitage.recipe.cmmi and that works! So it appears that something changed in zc.recipe.cmmi in December that broke it.

6 18