Mailman 3 May 2007 - Distutils-SIG

Eggs not picking up some files
by David Pratt 25 May '07

25 May '07

I've got sort of a strange issue with eggs for distribution to pypi. I am using the following command to create a egg and send it to pypi and it is omitting my .zcml files from the egg somehow. I export the source from svn and then run: python setup.py register bdist_egg sdist upload I thought maybe there was some sort of issue on my platform. I am on MacOSX 10.4.9 so tried from on of my FreeBSD servers and getting same thing. Probably something simple but hoping someone has an explanation. Many thanks. Regards, David

2 2

mingw and environment variables
by Dobes Vandermeer 22 May '07

22 May '07

It seems to be a problem with distutils currently that g++ isn't used to link at the appropriate time. Ideally you'd split linking into C++ and C variations, and detect whether the C++ compiler was used and use the C++ linker if it was. And, a bug related to this, is that you can't easily override the linker when using mingw; the customize_compiler() function checks for a type of 'unix': def customize_compiler(compiler): """Do any platform-specific customization of a CCompiler instance. Mainly needed on Unix, so we can plug in the information that varies across Unices and is stored in Python's Makefile. """ if compiler.compiler_type == "unix": But the mingw compiler (which is unix compatible) has a compiler_type 'mingw32', not 'unix'. The easiest "band-aid" patch would be to use if compiler.compiler_type in ("unix", "mingw32"): but I wonder whether: if isinstance(compiler, UnixCCompiler): would be more appropriate? The workaround I came up with is: # Force g++ for linking import distutils.sysconfig old_customize_compiler = distutils.sysconfig.customize_compiler def customize_compiler(compiler): old_customize_compiler(compiler) if compiler.compiler_type == 'mingw': compiler.set_executables(linker_so='g++ -mno-cygwin -shared') distutils.sysconfig.customize_compiler = customize_compiler

1 0

setuptools process_url doesn't handle URLErrors gracefullly
by Christian Theune 21 May '07

21 May '07

Hi, I'm fighting against a problem where the DNS name of the homepage of a package that is listed on the cheeseshop isn't accessible any more. In this special case the DNS name for this thing is gone (the package is `rwproperty` the missing DNS entry is z3lab.org). In this case easy_install dies with the following error, although the eggs are listed on the cheeseshop page and the listed homepage is pretty irrelevant: Searching for rwproperty Reading http://cheeseshop.python.org/pypi/rwproperty/ Reading http://www.z3lab.org/sections/blogs/philipp-weitershausen/2006_05_29_pycon-… Traceback (most recent call last): File "/usr/bin/easy_install", line 7, in ? sys.exit( File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/command/easy_install.py", line 1670, in main with_ei_usage(lambda: File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/command/easy_install.py", line 1659, in with_ei_usage return f() File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/command/easy_install.py", line 1674, in <lambda> distclass=DistributionWithoutHelpCommands, **kw File "/usr/lib/python2.4/distutils/core.py", line 149, in setup dist.run_commands() File "/usr/lib/python2.4/distutils/dist.py", line 946, in run_commands self.run_command(cmd) File "/usr/lib/python2.4/distutils/dist.py", line 966, in run_command cmd_obj.run() File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/command/easy_install.py", line 211, in run self.easy_install(spec, not self.no_deps) File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/command/easy_install.py", line 432, in easy_install dist = self.package_index.fetch_distribution( File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/package_index.py", line 462, in fetch_distribution self.find_packages(requirement) File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/package_index.py", line 303, in find_packages self.scan_url(self.index_url + requirement.unsafe_name+'/') File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/package_index.py", line 610, in scan_url self.process_url(url, True) File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/package_index.py", line 201, in process_url page = self.process_index(url, page) File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/package_index.py", line 278, in process_index self.scan_url(new_url) File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/package_index.py", line 610, in scan_url self.process_url(url, True) File "/usr/lib/python2.4/site-packages/setuptools-0.6c5-py2.4.egg/setuptools/package_index.py", line 191, in process_url self.fetched_urls[url] = self.fetched_urls[f.url] = True AttributeError: URLError instance has no attribute 'url' I didn't find any switch to turn to make this go away and I don't know the setuptools code so my few feeble attempts to fix this didn't work out. Some help would be very appreciated. Christian -- gocept gmbh & co. kg - forsterstraße 29 - 06112 halle/saale - germany www.gocept.com - ct(a)gocept.com - phone +49 345 122 9889 7 - fax +49 345 122 9889 1 - zope and plone consulting and development

3 5

Re: [Distutils] Compile Windows64 AMD64
by Mowry, Peter 21 May '07

21 May '07

So I tried ctypes, and it just worked (without any build issues - in fact I didn't have to build anything or write any code). Is there any reason I'd want to write an extend python module (to load my shared library and run exported functions from it) that compiles with distutils, instead of just using ctypes? Thanks ________________________________ From: Mowry, Peter Sent: Friday, May 18, 2007 4:11 PM To: 'distutils-sig(a)python.org' Subject: Compile Windows64 AMD64 I am trying to compile a python extension for Windows64 using distutils from "Python 2.5.1 (r251:54863, Apr 18 2007, 09:02:36) [MSC v.1400 64 bit (AMD64)] on win32". My extension basically is just a simple C code file which does a LoadLibrary (dlopen for unix) of my 64-bit shared library (dll/so) (and then call one function to test it). My python extension compiled and ran on unix, but not windows. Originally it says: File "C:\Python25\lib\distutils\msvccompiler.py", line 616, in get_msvc_paths AttributeError: MSVCCompiler instance has no attribute '_MSVCCompiler__root' Then when I try it after setting env variables DISTUTILS_USE_SDK and MSSdk (both to "1"), it says: error: Don't know how to compile demo.C ditutils doc (dist.pdf) section 11.4 says: Typically, extension modules need to be compiled with the same compiler that was used to compile Python. ... The AMD64 and Itanium binaries are created using the Platform SDK. I am using Visual Studios 8 normally, but I downloaded the Platform SDK 2003 SP1. I opened the start menu "Set Windows XP x64 Build Environment (Retail)", and tried building it from there. This made no difference; I got the same errors. Not fun at all :-(

3 4

Re: [Distutils] Compile Windows64 AMD64
by Phillip J. Eby 20 May '07

20 May '07

At 08:03 AM 5/20/2007 -0400, Alexander Michael wrote: >Unfortunately, ctypes is not available as an egg, so you won't be >able to take advantage of setuptool's easy_install to ensure that >your user has installed all the dependencies. easy_install converts distutils .exe files to eggs just fine, and it compiles the source on other platforms. Windows: $ python2.4 -m easy_install -U ctypes Searching for ctypes Reading http://cheeseshop.python.org/pypi/ctypes/ Reading http://starship.python.net/crew/theller/ctypes/ Reading http://sourceforge.net/project/showfiles.php?group_id=71702 Reading http://cheeseshop.python.org/pypi/ctypes/1.0.2 Best match: ctypes 1.0.2 Downloading http://downloads.sourceforge.net/ctypes/ctypes-1.0.2.win32-py2.4.exe?modtim… Processing ctypes-1.0.2.win32-py2.4.exe ... creating c:\...\lib\site-packages\ctypes-1.0.2-py2.4-win32.egg Extracting ctypes-1.0.2-py2.4-win32.egg to c:\...\lib\site-packages Removing ctypes 0.9.6 from easy-install.pth file Adding ctypes 1.0.2 to easy-install.pth file Installed c:\...\lib\site-packages\ctypes-1.0.2-py2.4-win32.egg Processing dependencies for ctypes Finished processing dependencies for ctypes Linux: [root@sparrow ~]# easy_install-2.3 ctypes Processing ctypes Running setup.py -q bdist_egg --dist-dir /root/ctypes/egg-dist-tmp-OrObNN warning: no files found matching 'NEWS.txt' warning: no files found matching 'ctypes/.CTYPES_DEVEL' Configuring static FFI library: cd build/temp.linux-i686-2.3/libffi && env CFLAGS='' '/root/ctypes/source/libffi/configure' checking build system type... i686-pc-linux-gnu ... zip_safe flag not set; analyzing archive contents... ... Adding ctypes 1.0.1 to easy-install.pth file Installed /usr/lib/python2.3/site-packages/ctypes-1.0.1-py2.3-linux-i686.egg Processing dependencies for ctypes==1.0.1

1 0

Silent install of Python modules.
by Clovis Goldemberg 19 May '07

19 May '07

Suppose I have a bunch of pre-built packages called: XXX1-1.0.0.win32.exe XXX2-1.0.0.win32.exe ... XXXN-1.0.0.win32.exe Is it possible to "automate" the installation, without the need of pressing "Next" so many times? The main idea would be an installation option like "-q" (quiet) ou "-s" (silent). So if I call: XXX1-1.0.0.win32.exe -q XXX2-1.0.0.win32.exe -q ... XXXN-1.0.0.win32.exe -q this would do the job "quietly". The user intervention would be only required if something goes wrong. Thanks for all.

1 0

Compile Windows64 AMD64
by Mowry, Peter 18 May '07

18 May '07

I am trying to compile a python extension for Windows64 using distutils from "Python 2.5.1 (r251:54863, Apr 18 2007, 09:02:36) [MSC v.1400 64 bit (AMD64)] on win32". My extension basically is just a simple C code file which does a LoadLibrary (dlopen for unix) of my 64-bit shared library (dll/so) (and then call one function to test it). My python extension compiled and ran on unix, but not windows. Originally it says: File "C:\Python25\lib\distutils\msvccompiler.py", line 616, in get_msvc_paths AttributeError: MSVCCompiler instance has no attribute '_MSVCCompiler__root' Then when I try it after setting env variables DISTUTILS_USE_SDK and MSSdk (both to "1"), it says: error: Don't know how to compile demo.C ditutils doc (dist.pdf) section 11.4 says: Typically, extension modules need to be compiled with the same compiler that was used to compile Python. ... The AMD64 and Itanium binaries are created using the Platform SDK. I am using Visual Studios 8 normally, but I downloaded the Platform SDK 2003 SP1. I opened the start menu "Set Windows XP x64 Build Environment (Retail)", and tried building it from there. This made no difference; I got the same errors. Not fun at all :-(

2 1

build python2.5 extension on windows64 with MSVC 8 - _MSVCCompiler__root
by Mowry, Peter 18 May '07

18 May '07

C:\Pem\simnow_checkouts\simnow_B\PEM>C:\Python25\python.exe setup.py build --compiler=msvc running build running build_ext building 'demo' extension Traceback (most recent call last): File "setup.py", line 20, in <module> ext_modules = [ext_demo]) File "C:\Python25\lib\distutils\core.py", line 151, in setup dist.run_commands() File "C:\Python25\lib\distutils\dist.py", line 974, in run_commands self.run_command(cmd) File "C:\Python25\lib\distutils\dist.py", line 994, in run_command cmd_obj.run() File "C:\Python25\lib\distutils\command\build.py", line 112, in run self.run_command(cmd_name) File "C:\Python25\lib\distutils\cmd.py", line 333, in run_command self.distribution.run_command(command) File "C:\Python25\lib\distutils\dist.py", line 994, in run_command cmd_obj.run() File "C:\Python25\lib\distutils\command\build_ext.py", line 290, in run self.build_extensions() File "C:\Python25\lib\distutils\command\build_ext.py", line 416, in build_extensions self.build_extension(ext) File "C:\Python25\lib\distutils\command\build_ext.py", line 481, in build_extension depends=ext.depends) File "C:\Python25\lib\distutils\msvccompiler.py", line 354, in compile if not self.initialized: self.initialize() File "C:\Python25\lib\distutils\msvccompiler.py", line 264, in initialize self.__paths = self.get_msvc_paths("path") File "C:\Python25\lib\distutils\msvccompiler.py", line 616, in get_msvc_paths % (self.__root, self.__version)) AttributeError: MSVCCompiler instance has no attribute '_MSVCCompiler__root' I did some web searching and read that I can: os.environ['DISTUTILS_USE_SDK'] = "1" os.environ['MSSdk'] = "1" http://docs.python.org/dist/module-distutils.msvccompiler.html C:\Pem\simnow_checkouts\simnow_B\PEM>C:\Python25\python.exe setup.py build --compiler=msvc running build running build_ext building 'demo' extension error: Don't know how to compile demo.C Unfortunately it sounds like I might need to use the "Platform SDK" to compile even my very basic python extension module (just loads a dll and calls one method) (Windows64, python2.5) :-(

2 1

easy_install and sys.path
by Bryan Lawrence 18 May '07

18 May '07

Hi Folks Can anyone point me to why easy_install forces modules to the front of sys.path? It seems to break long established rules about ordering of path variables, and certainly breaks python in some unexpected contexts e.g: https://bugs.launchpad.net/ubuntu/+source/kubuntu-meta/+bug/113298 Thanks in advance, Bryan

5 8

Overly picky about file URLs
by Jim Fulton 18 May '07

18 May '07

The local_open function in setuptools.package_index is used to open file URLs. A file URL pointing to a directory is treated as non found unless it ends in a "/". This seems overly restrictive to me. Would anyone object if the restriction was relaxed? Jim -- Jim Fulton mailto:jim@zope.com Python Powered! CTO (540) 361-1714 http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org

2 5