Mailman 3 July 2010 - Distutils-SIG

buildout and issues with dependencies and patch.
by Xavier Ordoquy July 30, 2010

July 30, 2010

Hi, I am currently trying to get buildout as my default deploy system however, I'm facing two issues for which I don't understand buildout well enough and for which I haven't found answers on the net. My first issue is I need to get both numpy and matplotlib installed. So I added both to the eggs section of buildout. numpy seems to get downloaded and installed fine, however, matplotlib won't. The latest complains numpy isn't installed. At this point, my guesses - after investigations - are that matplotlib checks numpy availability by importing it. However, as buildout has not set the numpy egg in the path, matplotlib fails and ends. I have noticed there's a way to set headers and library path for compilers but I can't find a way to set the numpy's egg path, even when I move matplotlib to a section with the egg receipe. Does someone know a way to get numpy eggs prepend to the paths so that matplotlib can detect it ? My second question is, I also want to install pysvn. This package needs a patch to be setuptool friendly. I would like to know if there's a simple way within the buildout.cfg file to apply a patch to a package before it gets eggified ? Regards, Xavier.

4 3

Re: [Distutils] Force easy_install to use .tar.gz (sdist) instead of bdist/bdist_egg
by P.J. Eby July 29, 2010

July 29, 2010

At 10:45 AM 7/28/2010 +0200, Hartmut Goebel wrote: >Am 27.07.2010 22:38, schrieb P.J. Eby: > > > "easy_install -eb tmpdir requirement" will download and unpack source > > (or check out from svn:) to tmpdir/projectname (with projectname in > > all-lowercase). > >Unfortunately this does not install from source. "easy_install -eb tmpdir requirement && easy_install tmpdir/projectnameinalllowercase" will, though. (As will "easy_install -eb tmpdir requirement && cd tmpdir/projectnamelower && python setup.py install", though this latter choice may or may not do an egg-based install.)

2 1

buildout: build options for dependencies of recipes
by Leonardo Rochael Almeida July 28, 2010

July 28, 2010

Hi all The zc.recipe.egg:custom recipe allows the specification of build options for a custom egg. But what do we do if we want to specify custom build options for an egg that is a dependency of a recipe (or perhaps the recipe itself)? Case in point We have a recipe, erp5.recipe.mysqldatabase, that uses the MySQL-python. However, since we have a non-distribution installation of MySQL (we need to patch it with the Senna full text index), we need to pass compilation instructions to MySQL-python so that it actually finds the correct MySQL include and lib directories, which we do through zc.recipe.egg:custom. This works for buildout parts with recipes based on zc.recipe.egg (e.g. collective.recipe.zope2instance), even if some of the eggs mentioned depend on MySQL-python, as long as the zc.recipe.egg:custom part for MySQL-python runs first. But if the recipe itself depends on MySQL-python, we don't get the opportunity to pass custom build options to MySQL-python, since buildout will try to satisfy the recipe dependencies of all parts even before installing the zc.recipe.egg:custom part. zc.buildout has APIs [1] [2] for passing custom build options for eggs, but appart from zc.recipe.egg:custom, I couldn't find any way to use these APIs for dependencies of recipes. [1] http://pypi.python.org/pypi/zc.buildout#handling-custom-build-options-for-e… [2] http://pypi.python.org/pypi/zc.buildout#handling-custom-build-options-for-e… Since we can specify versions for eggs by specifying a section with version information, I was hoping that we could also specify build options somehow. Since there are many pieces of information (including environment variables). I think that we'd need a whole section for each egg. Something on the lines of: [buildout] build-options-sufix = -options ... [MySQL-python-options] # options like the ones for the zc.recipe.egg:custom recipe Is there something like this available, and I just missed it? Can something like this be implemented as a buildout extension? Cheers, Leo PS: Conversely, it would also be nice to be able to specify different "versions" sections per zc.recipe.egg part instead of a single global one, exactly so that we can compare different version combinations with a single buildout.

1 0

Force easy_install to use .tar.gz (sdist) instead of bdist/bdist_egg
by Alan Franzoni July 27, 2010

July 27, 2010

Hello, like other people, I'm experiencing some problems with binary dists and eggs across different linux distros. Is it possibile to tell easy_install or pip just to ignore any egg or bdist which can be found on the index and just use the sdist? And is there any way to integrate such behaviour with zc.buildout automatic dep fetching? Thank you! Alan Franzoni

2 1

`setup.py register` can't create PyPI account.
by Takayuki Shimizukawa July 26, 2010

July 26, 2010

Hi. I wasn't able to make an account in PyPI using `setup.py register`. http://pypi.python.org/pypi?:action=register_form require 'I agree' checkbox, but `distutils/command/register.py` doesn't seem to send a 'agree' form key/value to the PyPI server. This problem occurs in the major python versions (include 2.7). This introduced for PyPI site by https://svn.python.org/packages/trunk/pypi/webui.py rev-690. regards. -- Takayuki SHIMIZUKAWA

8 26

Beta release of zc.buildout 1.5.0
by Gary Poster July 23, 2010

July 23, 2010

I have made a beta release of zc.buildout 1.5.0. Among other changes, this release includes the ability to use zc.buildout with a system Python, if you use the new z3c.recipe.scripts instead of zc.recipe.egg for generating scripts. Changelog: http://pypi.python.org/pypi/zc.buildout/1.5.0b1#b1-2010-04-29 In my experience, working with a system ("non-clean") Python can be fragile in many ways. However, this release addresses the problems I have encountered so far. Your feedback is welcome. I hope to make a final release sometime next week. Gary

10 28

distutils.Extension : setting a concurrency level
by Florian Le Goff July 23, 2010

July 23, 2010

Hi, I'm wondering how to reproduce the equivalent of "make -j<n>" on a setup.py script. In my setup, I'm using distutils.Extension to build a C(++, somehow) extension to Python 2.6. I have a few dozens files in the "sources" parameter of the Extension module and I would like to get a chance to use my multi-core CPU to speed up my extension's build. My desired outcome: having setup.py build using a few instances of my C-compiler in the same time, instead of only one. There are probably an environnement var or two that I'm missing. Or maybe it could be an interesting feature for distutils2 ? Thank you for your help. -- Florian Le Goff Lille, France

2 1

Failing test on zc.buildout.
by Lennart Regebro July 22, 2010

July 22, 2010

I was going to update zc.buildout to use doctest instead of zope.testing.doctest and zope.testrunner instead of zope.testing.testrunner, and I noticed trunk has some failing tests. They all use the --setup-source option, but: bootstrap.py: error: no such option: --setup-source So there is something wrong there. I'll probably comment those failing tests out for the moment, unless somebody fixes them or tells me to remove them completely. :-) -- Lennart Regebro: http://regebro.wordpress.com/ Python 3 Porting: http://python3porting.com/ +33 661 58 14 64

2 1

[OT] Caching 2to3 results
by Pauli Virtanen July 18, 2010

July 18, 2010

[shameless plug] For those of you tired of waiting for 2to3 after "rm -rf build": http://github.com/pv/lib2to3cache and cd numpy/ USE_2TO3CACHE=1 python3 setup.py build -- Pauli Virtanen

1 1

Installing distribute with Python 3.0 / 3.1
by Michael Foord July 14, 2010

July 14, 2010

I get the following error attempting to install distribute 0.6.13 with Python 3.0 / 3.1: python3.0 setup.py install creating build creating build/src creating build/src/docs creating build/src/docs/_templates creating build/src/docs/_theme creating build/src/docs/_theme/nature creating build/src/docs/_theme/nature/static creating build/src/setuptools creating build/src/setuptools/command creating build/src/setuptools/tests creating build/src/tests creating build/src/tests/shlib_test copying setuptools/__init__.py -> build/src/setuptools copying setuptools/archive_util.py -> build/src/setuptools copying setuptools/depends.py -> build/src/setuptools copying setuptools/dist.py -> build/src/setuptools copying setuptools/extension.py -> build/src/setuptools copying setuptools/package_index.py -> build/src/setuptools copying setuptools/sandbox.py -> build/src/setuptools copying setuptools/tests/__init__.py -> build/src/setuptools/tests copying setuptools/tests/doctest.py -> build/src/setuptools/tests copying setuptools/tests/server.py -> build/src/setuptools/tests copying setuptools/tests/test_build_ext.py -> build/src/setuptools/tests copying setuptools/tests/test_develop.py -> build/src/setuptools/tests copying setuptools/tests/test_easy_install.py -> build/src/setuptools/tests copying setuptools/tests/test_packageindex.py -> build/src/setuptools/tests copying setuptools/tests/test_resources.py -> build/src/setuptools/tests copying setuptools/tests/test_sandbox.py -> build/src/setuptools/tests copying setuptools/tests/test_upload_docs.py -> build/src/setuptools/tests copying setuptools/command/__init__.py -> build/src/setuptools/command copying setuptools/command/alias.py -> build/src/setuptools/command copying setuptools/command/bdist_egg.py -> build/src/setuptools/command copying setuptools/command/bdist_rpm.py -> build/src/setuptools/command copying setuptools/command/bdist_wininst.py -> build/src/setuptools/command copying setuptools/command/build_ext.py -> build/src/setuptools/command copying setuptools/command/build_py.py -> build/src/setuptools/command copying setuptools/command/develop.py -> build/src/setuptools/command copying setuptools/command/easy_install.py -> build/src/setuptools/command copying setuptools/command/easy_install2.py -> build/src/setuptools/command copying setuptools/command/egg_info.py -> build/src/setuptools/command copying setuptools/command/install.py -> build/src/setuptools/command copying setuptools/command/install_egg_info.py -> build/src/setuptools/command copying setuptools/command/install_lib.py -> build/src/setuptools/command copying setuptools/command/install_scripts.py -> build/src/setuptools/command copying setuptools/command/register.py -> build/src/setuptools/command copying setuptools/command/rotate.py -> build/src/setuptools/command copying setuptools/command/saveopts.py -> build/src/setuptools/command copying setuptools/command/sdist.py -> build/src/setuptools/command copying setuptools/command/setopt.py -> build/src/setuptools/command copying setuptools/command/test.py -> build/src/setuptools/command copying setuptools/command/upload.py -> build/src/setuptools/command copying setuptools/command/upload_docs.py -> build/src/setuptools/command copying setuptools/tests/win_script_wrapper.txt -> build/src/setuptools/tests copying setuptools/cli.exe -> build/src/setuptools copying setuptools/gui.exe -> build/src/setuptools copying tests/install_test.py -> build/src/tests copying tests/manual_test.py -> build/src/tests copying tests/test_distribute_setup.py -> build/src/tests copying tests/shlib_test/setup.py -> build/src/tests/shlib_test copying tests/shlib_test/test_hello.py -> build/src/tests/shlib_test copying tests/shlib_test/hello.c -> build/src/tests/shlib_test copying tests/shlib_test/hellolib.c -> build/src/tests/shlib_test copying tests/shlib_test/hello.pyx -> build/src/tests/shlib_test copying tests/api_tests.txt -> build/src/tests RefactoringTool: Skipping implicit fixer: buffer RefactoringTool: Skipping implicit fixer: idioms RefactoringTool: Skipping implicit fixer: set_literal RefactoringTool: Skipping implicit fixer: ws_comma --- build/src/tests/api_tests.txt (original) +++ build/src/tests/api_tests.txt (refactored) @@ -39,7 +39,7 @@ >>> dist.py_version == sys.version[:3] True - >>> print dist.platform + >>> print(dist.platform) None Including various computed attributes:: @@ -199,7 +199,7 @@ You can ask a WorkingSet to ``find()`` a distribution matching a requirement:: >>> from pkg_resources import Requirement - >>> print ws.find(Requirement.parse("Foo==1.0")) # no match, return None + >>> print(ws.find(Requirement.parse("Foo==1.0"))) # no match, return None None >>> ws.find(Requirement.parse("Bar==0.9")) # match, return distribution @@ -211,7 +211,7 @@ >>> try: ... ws.find(Requirement.parse("Bar==1.0")) ... except VersionConflict: - ... print 'ok' + ... print('ok') ok You can subscribe a callback function to receive notifications whenever a new @@ -219,7 +219,7 @@ once for each existing distribution in the working set, and then is called again for new distributions added thereafter:: - >>> def added(dist): print "Added", dist + >>> def added(dist): print("Added", dist) >>> ws.subscribe(added) Added Bar 0.9 >>> foo12 = Distribution(project_name="Foo", version="1.2", location="f12") RefactoringTool: Files that were modified: RefactoringTool: build/src/tests/api_tests.txt copying docs/conf.py -> build/src/docs copying docs/easy_install.txt -> build/src/docs copying docs/index.txt -> build/src/docs copying docs/pkg_resources.txt -> build/src/docs copying docs/python3.txt -> build/src/docs copying docs/roadmap.txt -> build/src/docs copying docs/setuptools.txt -> build/src/docs copying docs/using.txt -> build/src/docs copying docs/_theme/nature/theme.conf -> build/src/docs/_theme/nature copying docs/_theme/nature/static/pygments.css -> build/src/docs/_theme/nature/static copying docs/_theme/nature/static/nature.css_t -> build/src/docs/_theme/nature/static copying docs/Makefile -> build/src/docs copying docs/_templates/indexsidebar.html -> build/src/docs/_templates copying distribute_setup.py -> build/src copying easy_install.py -> build/src copying pkg_resources.py -> build/src copying setup.py -> build/src copying site.py -> build/src copying CHANGES.txt -> build/src copying CONTRIBUTORS.txt -> build/src copying DEVGUIDE.txt -> build/src copying pip-log.txt -> build/src copying README.txt -> build/src copying MANIFEST.in -> build/src copying launcher.c -> build/src Skipping implicit fixer: buffer Skipping implicit fixer: idioms Skipping implicit fixer: set_literal Skipping implicit fixer: ws_comma Before install bootstrap. Scanning installed packages No setuptools distribution found running install Traceback (most recent call last): File "setup.py", line 211, in <module> scripts = scripts, File "/Library/Frameworks/Python.framework/Versions/3.0/lib/python3.0/distutils/core.py", line 149, in setup dist.run_commands() File "/Library/Frameworks/Python.framework/Versions/3.0/lib/python3.0/distutils/dist.py", line 942, in run_commands self.run_command(cmd) File "/Library/Frameworks/Python.framework/Versions/3.0/lib/python3.0/distutils/dist.py", line 962, in run_command cmd_obj.run() File "build/src/setuptools/command/install.py", line 73, in run self.do_egg_install() File "build/src/setuptools/command/install.py", line 82, in do_egg_install easy_install = self.distribution.get_command_class('easy_install') File "build/src/setuptools/dist.py", line 361, in get_command_class self.cmdclass[command] = cmdclass = ep.load() File "build/src/pkg_resources.py", line 1954, in load entry = __import__(self.module_name, globals(),globals(), ['__name__']) File "build/src/setuptools/command/easy_install.py", line 16, in <module> from setuptools.sandbox import run_setup File "build/src/setuptools/sandbox.py", line 232, in <module> WRITE_FLAGS = reduce( NameError: name 'reduce' is not defined bigmac:distribute-0.6.13 michael$ python3.1 setup.py install Before install bootstrap. Scanning installed packages No setuptools distribution found running install Traceback (most recent call last): File "setup.py", line 211, in <module> scripts = scripts, File "/Library/Frameworks/Python.framework/Versions/3.1/lib/python3.1/distutils/core.py", line 149, in setup dist.run_commands() File "/Library/Frameworks/Python.framework/Versions/3.1/lib/python3.1/distutils/dist.py", line 919, in run_commands self.run_command(cmd) File "/Library/Frameworks/Python.framework/Versions/3.1/lib/python3.1/distutils/dist.py", line 938, in run_command cmd_obj.run() File "build/src/setuptools/command/install.py", line 73, in run self.do_egg_install() File "build/src/setuptools/command/install.py", line 82, in do_egg_install easy_install = self.distribution.get_command_class('easy_install') File "build/src/setuptools/dist.py", line 361, in get_command_class self.cmdclass[command] = cmdclass = ep.load() File "build/src/pkg_resources.py", line 1954, in load entry = __import__(self.module_name, globals(),globals(), ['__name__']) File "build/src/setuptools/command/easy_install.py", line 16, in <module> from setuptools.sandbox import run_setup File "build/src/setuptools/sandbox.py", line 232, in <module> WRITE_FLAGS = reduce( NameError: name 'reduce' is not defined -- http://www.voidspace.org.uk

3 5