Mailman 3 September 2006 - Distutils-SIG

easy_install doesn't recognize valid distutils Windows installers
by Matt Good Sept. 21, 2006

Sept. 21, 2006

On Windows "easy_install trac" fails with the error: "trac-0.10b1.win32.exe is not a valid distutils Windows .exe" http://trac.edgewall.org/ticket/3750 The problem is with easy_install locating the config information embedded in the file. The following patch works with the Trac installer, but I don't know if it will break support for other installers: Index: setuptools/command/easy_install.py =================================================================== --- setuptools/command/easy_install.py (revision 51920) +++ setuptools/command/easy_install.py (working copy) @@ -1249,7 +1249,7 @@ if tag not in (0x1234567A, 0x1234567B): return None # not a valid tag - f.seek(prepended-(12+cfglen+bmlen)) + f.seek(prepended-(12+cfglen)) cfg = ConfigParser.RawConfigParser({'version':'','target_version':''}) try: cfg.readfp(StringIO.StringIO(f.read(cfglen).split(chr(0),1)[0])) -- Matt Good <matt(a)matt-good.net>

2 4

Re: [Distutils] [setuptools] svn 1.4 support
by Phillip J. Eby Sept. 20, 2006

Sept. 20, 2006

At 10:11 AM 9/20/2006 -0700, Bob Ippolito wrote: >On 9/20/06, Phillip J. Eby <pje(a)telecommunity.com> wrote: >>At 05:24 PM 9/20/2006 +0200, Philippe Normand wrote: >> >Hi, >> > >> >It seems that SVN 1.4 doesn't use XML anymore to store metadata >> >in .svn/entries (at least). So setuptools fails to find the repository >> >url for instance: >> > >> > File >> >"/home/test/Elisa/elisa-env/lib/python2.4/setuptools-0.6c2-py2.4.egg/set >> uptools/command/egg_info.py", >> >line 85, in finalize_options >> > self.vtags = self.tags() >> > File >> >"/home/test/Elisa/elisa-env/lib/python2.4/setuptools-0.6c2-py2.4.egg/set >> uptools/command/egg_info.py", >> >line 179, in tags >> > ): version += '-r%s' % self.get_svn_revision() >> > File >> >"/home/test/Elisa/elisa-env/lib/python2.4/setuptools-0.6c2-py2.4.egg/set >> uptools/command/egg_info.py", >> >line 196, in get_svn_revision >> > dirurl = urlre.search(data).group(1) # get repository URL >> >AttributeError: 'NoneType' object has no attribute 'group' >> > >> >I was thinking setuptools was directly using the "svn" command to find >> >revisions and other related informations. But i was wrong ;) >> >>Upgrade to the 0.6c3 version in development using these steps: >> >> easy_install -eb. setuptools==dev06 >> cd setuptools >> python2.4 setup.py install > >It'd probably be a good idea to go ahead and release a version that's >compatible with svn 1.4 and python2.5 before people get a bad taste in >their mouth... Subversion 1.4 was released 10 days ago. As soon as I have a stable solution for the Sourceforge mirror issue. Suggestions welcome. >-bob

2 1

[setuptools] svn 1.4 support
by Philippe Normand Sept. 20, 2006

Sept. 20, 2006

Hi, It seems that SVN 1.4 doesn't use XML anymore to store metadata in .svn/entries (at least). So setuptools fails to find the repository url for instance: File "/home/test/Elisa/elisa-env/lib/python2.4/setuptools-0.6c2-py2.4.egg/setuptools/command/egg_info.py", line 85, in finalize_options self.vtags = self.tags() File "/home/test/Elisa/elisa-env/lib/python2.4/setuptools-0.6c2-py2.4.egg/setuptools/command/egg_info.py", line 179, in tags ): version += '-r%s' % self.get_svn_revision() File "/home/test/Elisa/elisa-env/lib/python2.4/setuptools-0.6c2-py2.4.egg/setuptools/command/egg_info.py", line 196, in get_svn_revision dirurl = urlre.search(data).group(1) # get repository URL AttributeError: 'NoneType' object has no attribute 'group' I was thinking setuptools was directly using the "svn" command to find revisions and other related informations. But i was wrong ;) Philippe

3 2

sftp support
by Jim Fulton Sept. 20, 2006

Sept. 20, 2006

Last week I released a plugin for zc.buildout that adds sftp support: http://www.python.org/pypi/zc.buildoutsftp This is useful when you need to use a private distribution server. I also released a version of buildout that takes advantage of it. This plugin uses the very nice ssh library, paramiko. This plugin should be useful for in other setuptools applications such as easy_install. There isn't really anything buildout specific about it. In fact, it's really more of a setuptools plugin than a buildout plugin. It's implemented as a urllib2 plugin that returns data in a form tailored specifically to setuptools. To use it, just import and call zc.buildoutsftp.buildoutsftp.install(). This installs the sftp handler into urllib2. Then, in your setuptools-based application, you can use sftp urls to name an index server or find links. Jim -- Jim Fulton mailto:jim@zope.com Python Powered! CTO (540) 361-1714 http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org

1 0

should setuptools be an implicit dependency of every egg?
by Martijn Faassen Sept. 20, 2006

Sept. 20, 2006

Hi there, Normally setuptools is installed system-wide. When you install an egg using easy_install, the egg itself can count on setuptools being available, and use for instance its resource management API and namespace package marking facility. It therefore is unnecessary to users to mark setuptools as a dependency to their eggs in setup.py. Since it's unnecessary, it'll just not be done. This works fine in the case of system-wide installation of setuptools, but when installing eggs locally, such as in Buildout, this can lead to problems. Buildout makes sure that only eggs that are dependencies are importable when starting up a script. An egg that is depending on setuptools implicitly will therefore not have access to setuptools facilities. Telling everybody who makes eggs that use setuptools to please take Buildout into account and include setuptools as an explicit dependency in setup.py seems like a hopeless exercise, as things will just plain work for most egg users and developers, at least until the possible eventuality of Buildout reaching critical mass in the community. What would work for Buildout, and as far as I can see does no harm to everybody else, is to make setuptools an implicit dependency of all eggs. It won't affect anyone else (but for a hopefully tiny performance impact) as setuptools is definitely available on the system when installing the egg through easy_install anyway. So, would this be something that could be added to setuptools? Regards, Martijn

4 5

Sourceforge mirrors, again
by Phillip J. Eby Sept. 19, 2006

Sept. 19, 2006

Well, it looks like Sourceforge has found yet another way to mess with easy_install's ability to download from their mirrors. :( Specifically, they are not keeping the dl.sourceforge.net "A" list up-to-date, so easy_install's attempts to just use simple round-robin DNS aren't always working. Several IPs in the round robin "A" list are not responding, and some new mirrors haven't been added to it. At this rate, the current approach will become unusable in a relatively short timeframe. :( It seems as though there is no way to auto-discover the mirrors themselves; I had hoped that perhaps a zone transfer on the dl.sourceforge.net zone might work to obtain a list of the actual mirrors, but I haven't been able to successfully obtain one. What I'm wondering at this point is if perhaps the only sane thing to do is to publish our own mirror list via DNS, so that at least when there's a problem it can still be fixed. The idea would be to replace easy_install's current DNS lookup of 'dl.sourceforge.net' IPs with something like 'dl.sfmirrors.telecommunity.com' (for example). Anybody have any thoughts on this?

3 3

setuptools: egg traceback seems not very informative
by John Machin Sept. 19, 2006

Sept. 19, 2006

Hello all, Example below, with distutils setup of same package under Python 2.5 for comparison. Two problems: (1) Path of source file is part only of the path from the *development* machine and gives no clue as to where the egg is located on the runtime machine nor what Python version nor what package version -- all of which is in the name of the egg!!! (2) The source line is not shown. Can I work around this? Is this recognised as a problem? Are there plans to enhance any of this? Cheers, John | C:\xlrdtest>python | Python 2.4.3 (#69, Mar 29 2006, 17:35:34) [MSC v.1310 32 bit (Intel)] on win32 | Type "help", "copyright", "credits" or "license" for more information. | >>> import xlrd | >>> xlrd.__VERSION__ | '0.6.0a3' | >>> xlrd.__file__ | 'c:\\python24\\lib\\site-packages\\xlrd-0.6.0a3-py2.4.egg\\xlrd\\__init__.pyc' | >>> xlrd.open_workbook('nosuchfile') | Traceback (most recent call last): | File "<stdin>", line 1, in ? | File "build\bdist.win32\egg\xlrd\__init__.py", line 173, in open_workbook | File "build\bdist.win32\egg\xlrd\__init__.py", line 444, in __init__ | IOError: [Errno 2] No such file or directory: 'nosuchfile' | >>> ^Z | | | C:\xlrdtest>\python25\python | Python 2.5c2 (r25c2:51859, Sep 12 2006, 09:33:52) [MSC v.1310 32 bit (Intel)] on | win32 | Type "help", "copyright", "credits" or "license" for more information. | >>> import xlrd | >>> xlrd.__VERSION__ | '0.6.0a3' | >>> xlrd.__file__ | 'C:\\python25\\lib\\site-packages\\xlrd\\__init__.pyc' | >>> xlrd.open_workbook('nosuchfile') | Traceback (most recent call last): | File "<stdin>", line 1, in <module> | File "C:\Python25\Lib\site-packages\xlrd\__init__.py", line 173, in open_workb | ook | encoding_override=encoding_override, | File "C:\Python25\Lib\site-packages\xlrd\__init__.py", line 444, in __init__ | f = open(filename, open_mode) | IOError: [Errno 2] No such file or directory: 'nosuchfile' | >>> |

2 1

compiling C wrappers from distutils
by Eric S. Johansson Sept. 18, 2006

Sept. 18, 2006

I haven't seen any documentation on this or if I have, I didn't recognize it. I need to compile some setgid wrappers which call Python programs. is there a recommended way for compiling then deploying these wrappers as part of a setup.py file? Many thanks for any pointers, ---eric

1 0

Re: [Distutils] AttributeError: 'NoneType' object has no attribute 'group' in get_svn_revision
by Phillip J. Eby Sept. 18, 2006

Sept. 18, 2006

At 04:41 PM 9/18/2006 +0200, Markus Tacker wrote: >Hoi, On 9/18/06, Phillip J. Eby <pje(a)telecommunity.com> wrote: > The >version of setuptools you're using doesn't support Subversion 1.4; you > >need to upgrade to the latest version using either: this gives me similar >errors: Hm. Okay, do this: easy_install -eb. setuptools==dev06 This will create a setuptools subdirectory in the current directory. Then do: cd setuptools python2.4 setup.py install The problem that you're having is that your current version of easy_install is using the setuptools version that doesn't work right with Subversion 1.4. The above approach should work around the problem by only checking out the code, not building it. The second step then builds it using the *new* version of setuptools, which doesn't have the problem. Sorry about that.

1 0

Re: [Distutils] AttributeError: 'NoneType' object has no attribute 'group' in get_svn_revision
by Phillip J. Eby Sept. 18, 2006

Sept. 18, 2006

At 12:50 PM 9/18/2006 +0200, Markus Tacker wrote: >Hoi, while trying to build the webadmin plugin for trac setuptools die >with this error: The version of setuptools you're using doesn't support Subversion 1.4; you need to upgrade to the latest version using either: easy_install setuptools==dev or easy_install setuptools==dev06 Depending on whether you want the 0.7a1 trunk or an early version of 0.6c3. I just added support for Subversion 1.4 this weekend, along with a fix so that future Subversion working copy format changes won't cause errors.

2 1