Mailman 3 February 2007 - Distutils-SIG

Alternates in SetupTools dependencies?
by Mike C. Fletcher Feb. 11, 2007

Feb. 11, 2007

I'm starting to package OpenGLContext as a series of .eggs but I seem to be missing something key: What's the syntax for declaring "I require numpy or Numeric" I could declare them as "extras", but it's not that they are individually extras, one or the other is *required* for the PyVRML97 library. Similar problem with "PyGame or PyGame-ctypes" they are work-alikes (or closely enough to use either) and we can work with whichever one is installed (preferably choosing the items in order to attempt installation). I don't see any documentation for this (extremely common) case on the setuptools page. Is it just some obvious thing that I'm missing? Thanks all, Mike -- ________________________________________________ Mike C. Fletcher Designer, VR Plumber, Coder http://www.vrplumber.com http://blog.vrplumber.com

2 1

Best practices for accelerator modules?
by Mike C. Fletcher Feb. 11, 2007

Feb. 11, 2007

In a number of my OpenGLContext projects I have "accelerator" modules, small, optional C extensions which are optional, and thus likely "extra_requires" candidates. I gather the best practice for these things is to create a separate .egg with some name like "PyVRML97-frustum-accelerators-numpy" with some weird internal package name that won't create a new conflict in the global namespace? Is that a correct understanding? (The situation is actually somewhat more complex in that some of the accelerators are actually numpy/Numeric version dependent (that is, they can only run against the version of numpy/Numeric against which they were built). I'm planning on handling that by having the accelerator module examine the Numeric/numpy version and add that explicit version to its dependencies so that only that version will satisfy the dependency.) i.e. I'm thinking of an egg named PyVRML97-frustum-accelerators-numpy with a package/module named 'PyVRML97-frustum-accelerators-numpy' so that the pollution of the top-level namespace will be minimised with the package's entry points being used to resolve the references without regard to their "unimportability". And that rather convoluted plan makes me think "is this really recommended practice"? Mike -- ________________________________________________ Mike C. Fletcher Designer, VR Plumber, Coder http://www.vrplumber.com http://blog.vrplumber.com

2 1

Confusion about the effect of eggs on import
by skip＠pobox.com Feb. 10, 2007

Feb. 10, 2007

(I'm sending this to distutils because I have this vague notion that the problem might have something to do with setuptools or eggs on sys.path.) We have a weird issue trying to import matplotlib at work. Sameer has matplotlib, numpy and scipy installed in his local directory tree: % ls -l /home/titan/sameer/local/lib/python2.4/site-packages total 20 drwxr-xr-x 5 sameer research 2560 Feb 9 13:09 IPython drwxr-xr-x 7 sameer research 2560 Feb 9 14:06 matplotlib drwxr-xr-x 14 sameer research 1024 Feb 9 13:02 numpy -rw-r--r-- 1 sameer research 31 Dec 9 2004 pylab.py -rw-r--r-- 1 sameer research 180 Feb 9 13:46 pylab.pyc drwxr-xr-x 22 sameer research 1024 Feb 9 13:09 scipy If sys.path doesn't contain any eggs matplotlib is imported from Sameer's directory. If it does contain eggs, no matter if they are at the start or the end, his version of matplotlib isn't found. Instead, the centrally installed version is imported. Sameer's versions of numpy and scipy are always imported as expected. Here are three sessions which demonstrate the problem. In the first session I explicitly remove the two eggs from sys.path: % PYTHONPATH=/home/titan/sameer/local/lib/python2.4/site-packages python Python 2.4.2 (#1, Feb 23 2006, 12:48:31) [GCC 3.4.1] on sunos5 Type "help", "copyright", "credits" or "license" for more information. >>> import sys.path >>> sys.path ['/home/titan/skipm/misc/python/python2', '/home/titan/skipm/misc/python', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/gtk-2.6', '', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/setuptools-0.6c3-py2.4.egg', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/SQLAlchemy-0.3.3-py2.4.egg', '/home/titan/sameer/local/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4', '/opt/app/g++lib6/python-2.4/lib/python2.4/plat-sunos5', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-tk', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-dynload', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/Numeric', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/f2py2e', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/scipy_distutils'] >>> noneggs = [p for p in sys.path if not p.endswith(".egg")] >>> noneggs ['/home/titan/skipm/misc/python/python2', '/home/titan/skipm/misc/python', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/gtk-2.6', '', '/home/titan/sameer/local/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4', '/opt/app/g++lib6/python-2.4/lib/python2.4/plat-sunos5', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-tk', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-dynload', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/Numeric', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/f2py2e', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/scipy_distutils'] >>> sys.path = noneggs >>> import matplotlib >>> matplotlib.__file__ '/home/titan/sameer/local/lib/python2.4/site-packages/matplotlib/__init__.pyc' Matplotlib comes from Sameer's directory, as it should. In the second session I don't mess with sys.path: % PYTHONPATH=/home/titan/sameer/local/lib/python2.4/site-packages python Python 2.4.2 (#1, Feb 23 2006, 12:48:31) [GCC 3.4.1] on sunos5 Type "help", "copyright", "credits" or "license" for more information. >>> import sys >>> sys.path ['/home/titan/skipm/misc/python/python2', '/home/titan/skipm/misc/python', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/gtk-2.6', '', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/setuptools-0.6c3-py2.4.egg', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/SQLAlchemy-0.3.3-py2.4.egg', '/home/titan/sameer/local/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4', '/opt/app/g++lib6/python-2.4/lib/python2.4/plat-sunos5', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-tk', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-dynload', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/Numeric', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/f2py2e', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/scipy_distutils'] >>> import matplotlib Bad key "lines.markeredgecolor" on line 48 in /opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/matplotlib/mpl-data/matplotlibrc. You probably need to get an updated matplotlibrc file from http://matplotlib.sf.net/matplotlibrc or from the matplotlib source distribution Bad key "lines.markerfacecolor" on line 47 in /opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/matplotlib/mpl-data/matplotlibrc. You probably need to get an updated matplotlibrc file from http://matplotlib.sf.net/matplotlibrc or from the matplotlib source distribution >>> matplotlib.__file__ '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/matplotlib/__init__.pyc' Even though Sameer's directory is ahead of the central installation directory, the centrally installed version is imported. Here's the final session. Rearrange sys.path so all eggs are at the end: % PYTHONPATH=/home/titan/sameer/local/lib/python2.4/site-packages python Python 2.4.2 (#1, Feb 23 2006, 12:48:31) [GCC 3.4.1] on sunos5 Type "help", "copyright", "credits" or "license" for more information. >>> import sys >>> sys.path ['/home/titan/skipm/misc/python/python2', '/home/titan/skipm/misc/python', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/gtk-2.6', '', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/setuptools-0.6c3-py2.4.egg', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/SQLAlchemy-0.3.3-py2.4.egg', '/home/titan/sameer/local/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4', '/opt/app/g++lib6/python-2.4/lib/python2.4/plat-sunos5', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-tk', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-dynload', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/Numeric', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/f2py2e', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/scipy_distutils'] >>> noneggs = [p for p in sys.path if not p.endswith(".egg")] >>> eggs = [p for p in sys.path if p.endswith(".egg")] >>> sys.path = noneggs + eggs >>> sys.path ['/home/titan/skipm/misc/python/python2', '/home/titan/skipm/misc/python', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/gtk-2.6', '', '/home/titan/sameer/local/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4', '/opt/app/g++lib6/python-2.4/lib/python2.4/plat-sunos5', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-tk', '/opt/app/g++lib6/python-2.4/lib/python2.4/lib-dynload', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/Numeric', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/f2py2e', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/3rdParty/scipy_distutils', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/setuptools-0.6c3-py2.4.egg', '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/SQLAlchemy-0.3.3-py2.4.egg'] >>> import matplotlib Bad key "lines.markeredgecolor" on line 48 in /opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/matplotlib/mpl-data/matplotlibrc. You probably need to get an updated matplotlibrc file from http://matplotlib.sf.net/matplotlibrc or from the matplotlib source distribution Bad key "lines.markerfacecolor" on line 47 in /opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/matplotlib/mpl-data/matplotlibrc. You probably need to get an updated matplotlibrc file from http://matplotlib.sf.net/matplotlibrc or from the matplotlib source distribution >>> matplotlib.__file__ '/opt/app/g++lib6/python-2.4/lib/python2.4/site-packages/matplotlib/__init__.pyc' I get the same result if I unset PYTHONSTARTUP. Any idea what's going on? Thx, -- Skip Montanaro - skip(a)pobox.com - http://www.webfast.com/~skip/ "The hippies and the hipsters did some great stuff in the sixties, but the geeks pulled their weight too." -- Billy Bragg

2 2

Setuptools: omit namespace package directories?
by Thomas Lotze Feb. 9, 2007

Feb. 9, 2007

Hi, when using namespace packages, the corresponding package directories and __init__.py files must physically exist in the source tree, even though they can't, by definition of a namespace package, contain anything other than subordinate directories and a fixed stanza of Python code, resp. This gets annoying, especially when using nested namespaces. For example, when writing a buildout recipe, the cleanest thing is to use several namespaces, like zc.recipe.egg does. However, you end up jumping through essentially empty directories all the time while working on the source. There's evidence that this problem is a real one: buildout recipes registered with PyPI tend to omit the "recipe" part at the expense of namespace hygiene and PEP 8 compliance, for example gocept.download or buildout_script. Since there's basically not information in those boilerplate directories and __init__.py files that couldn't be inferred from a keyword parameter to setup(), would it be a sensible feature request that setuptools do without the physical namespace directories in the future? -- Thomas

2 4

setuptools: including shared libraries the Right Way
by Andrew Straw Feb. 9, 2007

Feb. 9, 2007

I'm trying to include shared libraries (built by scons invoked from my setup.py script) into built eggs. I can do this just fine with the package_data command, but then the egg isn't known to be platform dependent. This is somewhat puzzling, because setuptools notices the library and lists it in .egg-info/native_libs.txt. Perhaps this is expected behavior because, in theory, I could include pre-built native libraries of more than one platform, or the native libraries might only be required on one platform. This leads me to the bdist_egg --plat-name option, which doesn't seem to work in this case. "python setup.py bdist_egg --plat-name=abc" doesn't produce an .egg with "abc" in the filename. This is apparently because setuptools thinks the egg doesn't contain C extensions. Perhaps the solution to this issue is to tell setuptools "yes, I did build C extensions". How would I achieve this? Any suggestions? -Andrew

2 1

Re: [Distutils] package_data not used by sdist command
by Phillip J. Eby Feb. 9, 2007

Feb. 9, 2007

At 12:48 PM 2/3/2007 +0100, Arve Knudsen wrote: >Funny, I seem to recall having raised the same issue, but not receiving >much in way of an answer. Glad to see it's being taken care of at least. Um, it's not being "taken care of". As I said, "a patch would go a long way towards getting it in." That means it's probably *not* being taken care of any time soon, unless somebody submits one.

3 2

Re: [Distutils] SetupTools: Forcefully Ignoring Dependencies
by Phillip J. Eby Feb. 7, 2007

Feb. 7, 2007

At 03:31 PM 2/7/2007 -0400, Jorge Vargas wrote: >On 2/6/07, Alexander Michael <lxander.m(a)gmail.com> wrote: > > How can I force easy_install to not worry about (i.e. ignore) > > dependencies? I tried --no-deps, but easy_install (from setuptools > > 0.6c5) still attempts to find dependencies and then errors out. > > >--single-version-externally-managed ? That's an 'install' option, not an easy_install option.

1 0

SetupTools: Forcefully Ignoring Dependencies
by Alexander Michael Feb. 7, 2007

Feb. 7, 2007

How can I force easy_install to not worry about (i.e. ignore) dependencies? I tried --no-deps, but easy_install (from setuptools 0.6c5) still attempts to find dependencies and then errors out. Thanks, Alex

3 2

setuptools-0.6c5-py2.5.egg in cheeseshop seems to be broken
by Jorge Vargas Feb. 7, 2007

Feb. 7, 2007

elpargo@notebook:~$ sh setuptools-0.6c5-py2.5.egg setuptools-0.6c5-py2.5.egg: 8: [[: not found setuptools-0.6c5-py2.5.egg is not the correct name for this egg file. Please rename it back to setuptools-0.6c5-py2.5.egg and try again.

3 3

package_data not used by sdist command
by Jim Fulton Feb. 3, 2007

Feb. 3, 2007

It appears that the sdist command doesn't consult the data passed in the package_data option to setup. I want to name data that isn't under version control for inclusion. Because sdist doesn't pay attention to package_data, the data I'm naming isn't included in the source distribution. It is included if I build an egg directly. This appears to me to be a bug. Jim -- Jim Fulton mailto:jim@zope.com Python Powered! CTO (540) 361-1714 http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org

3 2