Mailman 3 November 2005 - Distutils-SIG

setuptools 0.6a8dev using non-existing shutil._build_cmdtuple function
by David Handy 08 Nov '05

08 Nov '05

I got the following stack trace after installing setuptools 0.6a8dev and running "python setup.py install --home=%HOME%" on my project: Traceback (most recent call last): File "setup.py", line 42, in ? main() File "setup.py", line 37, in main license = "Internal Use Only", File "C:\Python24\lib\distutils\core.py", line 149, in setup dist.run_commands() File "C:\Python24\lib\distutils\dist.py", line 946, in run_commands self.run_command(cmd) File "C:\Python24\lib\distutils\dist.py", line 966, in run_command cmd_obj.run() File "c:\python24\lib\site-packages\setuptools-0.6a8dev_r41396-py2.4.egg\setuptools\command\install.py", line 50, in run cmd.run() File "c:\python24\lib\site-packages\setuptools-0.6a8dev_r41396-py2.4.egg\setuptools\command\easy_install.py", line 230, in run self.easy_install(spec, not self.no_deps) File "c:\python24\lib\site-packages\setuptools-0.6a8dev_r41396-py2.4.egg\setuptools\command\easy_install.py", line 321, in easy_install smart_rmtree(tmpdir) File "c:\python24\lib\site-packages\setuptools-0.6a8dev_r41396-py2.4.egg\setuptools\command\easy_install.py", line 1193, in smart_rmtree shutil._build_cmdtuple(path, cmdtuples) AttributeError: 'module' object has no attribute '_build_cmdtuple' -- David Handy Computer Programming is Fun! Beginning Computer Programming with Python http://www.handysoftware.com/cpif/

2 1

pysqlite egg problem
by Robin Becker 05 Nov '05

05 Nov '05

I'm trying to follow the Turbogears wiki20, but I came across a problem with pysqlite. First off I am a complete newbie to the easy_setup and egg stuff and also have zero knowledge of pysqlite, but assuming that the filename I chose didn't have to exist I found that TG's tg-admin sql create failed. I assumed I needed to get some sort of database set up first so tried this to learn about pyslite C:\Tmp\wiki20>python Python 2.4.2 (#67, Sep 28 2005, 12:41:11) [MSC v.1310 32 bit (Intel)] on win32 Type "help", "copyright", "credits" or "license" for more information. >>> from pysqlite2 import dbapi2 as sqlite Traceback (most recent call last): File "<stdin>", line 1, in ? File "c:\python\lib\site-packages\pysqlite-2.0.6-py2.4-win32.egg\pysqlite2\dbapi2.py", line 32, in ? File "c:\python\lib\site-packages\pysqlite-2.0.6-py2.4-win32.egg\pysqlite2\_sqlite.py", line 7, in ? File "c:\python\lib\site-packages\pysqlite-2.0.6-py2.4-win32.egg\pysqlite2\_sqlite.py", line 6, in __bootstrap__ ImportError: DLL load failed: The specified module could not be found. >>> I checked in the egg and the dll is certainly there as lib/site-packages/pysqlite2/sqlite3.dll I have quite a few non egg packages installed so perhaps I have some wrong version of something on the path. What should I be looking for? -- Robin Becker

2 1

setuptools: .egg-info/ and PKG-INFO
by Ian Bicking 04 Nov '05

04 Nov '05

I'm trying to figure out how I should deal with the .egg-info directory, and PKG-INFO. Right now PKG-INFO is being generated from setup.py. So I don't want to put it in my source control repository, since it is derivative. But I'm maintaining by hand some other files in the .egg-info directory, usually custom package metadata that we consume internally, so I need those files (and .egg-info) in the repository, and hence in the checkout. However, without PKG-INFO lots of things break, as pkg_resources gives a ValueError during some operations (e.g.: ValueError: ("Missing 'Version:' header and/or PKG-INFO file", ProjectName [unknown version] (/usr/home/ianb/co/IscapeLib/tests/appsetup/output/Proj-05))) -- this happens anytime I iterate over entry points, including when setuptools iterates over entry points, which means lots of setup.py commands are broken. They are broken simply because the incomplete .egg-info directory is on the path, even though I don't need direct access to it. I can run setup.py egg_info (creating PKG-INFO) for some reason (that I have not yet determined), but not my own custom setup.py extensions. This includes stuff like "python setup.py egg_info my_custom_command", so I have to write PKG-INFO in a completely separate command. If the .egg-info directory doesn't exist then pkg_resources will be happy, because it won't try to read the package as an egg at all. But it does, and so it's just awkward. Frankly I'd be 100% okay putting PKG-INFO in source control if it was the authoritative source, and I don't particularly care to use setup.py for this data. But that's a cop-out, I should really figure this out as it is. So... what do I do here? Should pkg_resources really just ignore packages without a PKG-INFO file? At least during scan? If I have to live with running setup.py egg_info until 0.6a7, that's fine. BTW, here's the full traceback I get: Traceback (most recent call last): File "setup.py", line 18, in ? package_data={ File "/usr/local/lib/python2.4/distutils/core.py", line 135, in setup ok = dist.parse_command_line() File "/usr/home/ianb/co/setuptools/setuptools/dist.py", line 227, in parse_command_line result = _Distribution.parse_command_line(self) File "/usr/local/lib/python2.4/distutils/dist.py", line 432, in parse_command_line args = self._parse_command_opts(parser, args) File "/usr/home/ianb/co/setuptools/setuptools/dist.py", line 549, in _parse_command_opts nargs = _Distribution._parse_command_opts(self, parser, args) File "/usr/local/lib/python2.4/distutils/dist.py", line 490, in _parse_command_opts cmd_class = self.get_command_class(command) File "/usr/home/ianb/co/setuptools/setuptools/dist.py", line 353, in get_command_class ep.require(installer=self.fetch_build_egg) File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 1637, in require working_set.resolve(self.dist.requires(self.extras),env,installer)) File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 480, in resolve env = Environment(self.entries) File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 558, in __init__ self.scan(search_path) File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 588, in scan self.add(dist) File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 610, in add if dist not in dists: File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 1760, in __cmp__ def __cmp__(self, other): return cmp(self.hashcmp, other) File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 1760, in __cmp__ def __cmp__(self, other): return cmp(self.hashcmp, other) File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 1755, in <lambda> lambda self: ( File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 1782, in parsed_version self._parsed_version = pv = parse_version(self.version) File "/usr/home/ianb/co/setuptools/pkg_resources.py", line 1797, in version raise ValueError( ValueError: ("Missing 'Version:' header and/or PKG-INFO file", ProjectName [unknown version] (/usr/home/ianb/co/IscapeLib/tests/appsetup/output/Proj-05)) -- Ian Bicking / ianb(a)colorstudy.com / http://blog.ianbicking.org

2 5

(no subject)
by Dethe Elza 03 Nov '05

03 Nov '05

Hi folks, Over on the vpython-users mailing list I've been trying to get help with VPython's complicated autoconf-based setup, which turns out to be fairly broken for OS X. They realize that the current setup is too complex and are looking at other options. The following is an exerpt from the ongoing discussion: > On Wed, 2005-10-19 at 21:06 -0700, Dethe Elza wrote: > >> On 19-Oct-05, at 4:57 PM, Jonathan Brandmeyer wrote: >> >>> >>> Are you (or anyone else out there) familiar with Scons? >>> >> >> What is wrong with using distutils[1], the standard method for >> building Python extensions? The new Setuptools[2] package makes it >> even easier, and supports EasyInstall[3] and Python Eggs[4]. >> >> [1] http://docs.python.org/lib/module-distutils.html >> [2] http://peak.telecommunity.com/DevCenter/setuptools >> [3] http://peak.telecommunity.com/DevCenter/EasyInstall >> [4] http://peak.telecommunity.com/DevCenter/PythonEggs >> > > But it doesn't properly support C++, or the use of a compiler other > than > the one that built Python itself. Those features are absolutely > required for VPython. > > -Jonathan I'm not a distutils/setuptools expert (though I'm willing and eager to become one rather than struggle with autoconf any further), but can anyone tell me if Jonathan's statement is even true? I'm willing to create a parallel setuptools-based builder just for OS X use, since the same compiler problem isn't an issue on OS X, but can I use distutils with C++ code? Thanks! --Dethe

3 5

find_package_data in setuptools
by Ian Bicking 03 Nov '05

03 Nov '05

I haven't really used the find_package_data that I emails distutils-sig about before (http://svn.pythonpaste.org/Paste/trunk/paste/util/finddata.py; just haven't gotten around to it, really. But clearly something like that should go in setuptools. And it's harder to maintain separately because you can't import it from another package (though I suppose svn:externals would work). TurboGears has been using the function; has it been working well there? -- Ian Bicking / ianb(a)colorstudy.com / http://blog.ianbicking.org

1 0

Re: [Distutils] New setuptools in subversion
by Phillip J. Eby 03 Nov '05

03 Nov '05

At 09:16 AM 11/3/2005 -0500, Kevin Dangoor wrote: >On 11/2/05, Phillip J. Eby <pje(a)telecommunity.com> wrote: > > Since the Python CVS has been migrated to Subversion, it's now possible to > > get fresh setuptools checkouts using EasyInstall. That is, you can use: > > > > easy_install setuptools==dev > >How do you set this up? I'd like to do something similar for >TurboGears, since the 0.9 release is a bit bigger than the 0.8 >release. Just include an #egg link in your PyPI long_description. Take a look at the setuptools setup.py and setuptools.txt (which is where setup.py reads the long description from). Alternately, you can just put the #egg link on the download page, since in your case the download page is linked from PyPI. EasyInstall scans the home page and download pages of a project for useful links when you request it. Note, by the way, that this means as long as you have links on your download page for all the dependency projects, they should be satisfied from there as well, without a need to explicitly reference the download page.

1 0

-O3 brings the compiler to it's knees
by Simon Burton 03 Nov '05

03 Nov '05

Is there a way to disable -O3 builds ? I have a big (100k+ lines) extension module, and -O3 compile is, at best useless and terribly slow to build, and at worst gobbles up all memory and kills the compile. Simon. -- Simon Burton, B.Sc. Licensed PO Box 8066 ANU Canberra 2601 Australia Ph. 61 02 6249 6940 http://arrowtheory.com

1 1

New setuptools in subversion
by Phillip J. Eby 02 Nov '05

02 Nov '05

Since the Python CVS has been migrated to Subversion, it's now possible to get fresh setuptools checkouts using EasyInstall. That is, you can use: easy_install setuptools==dev to request the development version of setuptools from Subversion. The current in-development version is 0.6a8dev, which means it is an unreleased version of 0.6a8, and will be considered obsolete when the real 0.6a8 is released. Some new "features" of the dev version include: * Bug fixes for all the Subversion-related problems reported recently by John J. Lee * Fix for the version conflict problem reported today by Ian Bicking * Fix for the extension building problem w/Pyrex and Python 2.4 reported by Kevin Dangoor So if you've been experiencing any of the above issues, you might want to give it a try. I still have a long list of to-do's for the official 0.6a8 release, so it probably won't be out before the weekend. In any case, it's always helpful to get some third-party testing before making an official release. Thanks.

1 0

Re: [Distutils] Fwd: [TurboGears] Error installing cElementTree !
by Phillip J. Eby 02 Nov '05

02 Nov '05

At 02:36 PM 11/2/2005 -0500, Kevin Dangoor wrote: >On 11/2/05, Phillip J. Eby <pje(a)telecommunity.com> wrote: > > At 11:20 AM 11/2/2005 -0500, Kevin Dangoor wrote: > > >Has any recent change to setuptools affected a call to "swig_sources"? > > > > > >Kevin > > > > No. If you search the TurboGears archives via Google, someone else > > reported this problem in September, and the issue turned out to be missing > > files in a distribution on turbogears.org. You might check to see if this > > is the same thing. > >It doesn't look like it. The cElementTree tarball that's up there now >has all of the .h files. Okay, after a bunch of Googling for swig_sources, I think the issue is that Pyrex is installed, but not a version that's compatible with Python 2.4. See this patch: https://www.redhat.com/archives/fedora-cvs-commits/2005-September/msg01305.… It looks like the user needs to either uninstall the Pyrex RPM, or install the updated version that contains this patch. See also this URL, that suggests what version might be appropriate: http://people.ubuntulinux.org/~scott/patches/pyrex/pyrex_0.9.3-3ubuntu1.pat… So, basically Pyrex's distutils support is broken for Python 2.4 without the patch to swig_sources. :( Last, but not least, see also: http://bugzilla.ubuntu.com/show_bug.cgi?id=4852 which is probably a good canonical location to point people to. However, now that I know the source of the problem, I can add a monkeypatch to the next version of setuptools to would work around the issue, if detected.

1 0

Re: [Distutils] Fwd: [TurboGears] Error installing cElementTree !
by Phillip J. Eby 02 Nov '05

02 Nov '05

At 11:20 AM 11/2/2005 -0500, Kevin Dangoor wrote: >Has any recent change to setuptools affected a call to "swig_sources"? > >Kevin No. If you search the TurboGears archives via Google, someone else reported this problem in September, and the issue turned out to be missing files in a distribution on turbogears.org. You might check to see if this is the same thing. >---------- Forwarded message ---------- >From: narm <narm(a)go.com.jo> >Date: Nov 1, 2005 6:51 PM >Subject: [TurboGears] Error installing cElementTree ! >To: TurboGears <turbogears(a)googlegroups.com> > > > >Hi all, >I am trying to install on Fedora Core 4 (Python 2.4.1) and I get the >following error (after easy_install -f >http://www.turbogears.org/download/index.html --script-dir >/usr/local/bin TurboGears): > >... >... >Running cElementTree-1.0.2-20050302/setup.py -q bdist_egg --dist-dir >/tmp/easy_install-iN8sd5/cElementTree-1.0.2-20050302/egg-dist-tmp-3C0jrn >Traceback (most recent call last): > File "/usr/local/bin/easy_install", line 7, in ? > sys.exit( >File >"/usr/lib/python2.4/site-packages/setuptools-0.6a6-py2.4.egg/setuptools/command/easy_install.py", >line 1181, in main > setup(script_args = ['-q','easy_install', '-v']+argv, **kw) > File "/usr/lib/python2.4/distutils/core.py", line 149, in setup > dist.run_commands() > >... >... >TypeError: swig_sources() takes exactly 2 arguments (3 given) > > >Any help, Thank you >narm

3 2