Mailman 3 December 2002 - Distutils-SIG

RE: [Distutils] Compiling Python C++ extensions with MingW
by Andrew Gregory Dec. 16, 2002

Dec. 16, 2002

Apologies for troubling you all, the solution is quite simple. You just need to include library stdc++. I'll post something on the newsgroup. The setup.py file looks like: # setup.py - for building _pysimple.pyd # # To use, from command line type: # python setup.py build --compiler=mingw32 # # or python setup.py build --compiler=bcpp # # If sources=['pysimple.i'] then SWIG will be called # but do not yet know how to set SWIG options. # from distutils.core import setup, Extension setup (name = "_pysimple", version = "1.0", maintainer = "Andrew Gregory", maintainer_email = "andrew.gregory(a)npl.co.uk", description = "Sample Python DLL", ext_modules = [Extension('_pysimple', library_dirs=['C:\\mingw\\lib'], libraries=['stdc++'], sources=['pysimple_wrap.cxx'])]) Suggestion: a future release of distutils might do this automatically for mingw when the source extension is .cpp, .cc or .cxx? Andrew Gregory. > -----Original Message----- > From: David Abrahams [mailto:dave@boost-consulting.com] > Sent: 11 December 2002 21:50 > To: M.-A. Lemburg > Cc: Andrew Gregory; 'distutils-sig(a)python.org' > Subject: Re: [Distutils] Compiling Python C++ extensions with MingW > > > "M.-A. Lemburg" <mal(a)lemburg.com> writes: > > > David Abrahams wrote: > >> "M.-A. Lemburg" <mal(a)lemburg.com> writes: > >> > >>>>ap.cxx: undefined reference to `__gxx_personalit > >>>>y_v0' > >>>>dllwrap: gcc exited with status 1 > >>>>error: command 'dllwrap' failed with exit status 1 > >>> > >>>Looks like some lib is missing. Hard to tell which without > >>>a working MinGW installed :-) > >> That's not just "some lib", but a part of the C++ runtime. > It may be > >> as simple as setting LD_LIBRARY_PATH to include the location of the > >> C++ runtimes shipped with mingw when linking. > > > > Patches are welcome. AFAIK, nobody is supporting MinGW for > distutils, > > so you're on your own here. > > > > Could be that g++ needs to be used instead of gcc for compiling > > C++ code... > > Yes, that is definitely the case. > > > at least that's what the CVS log suggests. The MinGW class has gcc > > hard-coded... > > Easy fix, then! > > -- > David Abrahams > dave(a)boost-consulting.com * http://www.boost-consulting.com > Boost support, enhancements, training, and commercial distribution > ------------------------------------------------------------------- This e-mail and any attachments may contain confidential and/or privileged material; it is for the intended addressee(s) only. If you are not a named addressee, you must not use, retain or disclose such information. NPL Management Ltd cannot guarantee that the e-mail or any attachments are free from viruses. NPL Management Ltd. Registered in England and Wales. No: 2937881 Registered Office: Teddington, Middlesex, United Kingdom TW11 0LW. -------------------------------------------------------------------

2 1

lineendings
by Robin Becker Dec. 16, 2002

Dec. 16, 2002

Does distutils know or care about text file line endings? I ask only because I would like to be able to build pure python distros and have them work properly on multiple platforms. -- Robin Becker

5 10

RE: [Distutils] Compiling Python C++ extensions with MingW
by Andrew Gregory Dec. 13, 2002

Dec. 13, 2002

Thanks for the reply. I had not realised that distutils does not support Mingw when compiling C++ I searched for "gxx_personality" in files (using find). It's in libstdc++.a and libsubc++.a which are in the directory C:\MinGW\bin As soon as I've got time I'll have another go, but linking to these files. Andrew Gregory. > -----Original Message----- > From: David Abrahams [mailto:dave@boost-consulting.com] > Sent: 11 December 2002 21:50 > To: M.-A. Lemburg > Cc: Andrew Gregory; 'distutils-sig(a)python.org' > Subject: Re: [Distutils] Compiling Python C++ extensions with MingW > > > "M.-A. Lemburg" <mal(a)lemburg.com> writes: > > > David Abrahams wrote: > >> "M.-A. Lemburg" <mal(a)lemburg.com> writes: > >> > >>>>ap.cxx: undefined reference to `__gxx_personalit > >>>>y_v0' > >>>>dllwrap: gcc exited with status 1 > >>>>error: command 'dllwrap' failed with exit status 1 > >>> > >>>Looks like some lib is missing. Hard to tell which without > >>>a working MinGW installed :-) > >> That's not just "some lib", but a part of the C++ runtime. > It may be > >> as simple as setting LD_LIBRARY_PATH to include the location of the > >> C++ runtimes shipped with mingw when linking. > > > > Patches are welcome. AFAIK, nobody is supporting MinGW for > distutils, > > so you're on your own here. > > > > Could be that g++ needs to be used instead of gcc for compiling > > C++ code... > > Yes, that is definitely the case. > > > at least that's what the CVS log suggests. The MinGW class has gcc > > hard-coded... > > Easy fix, then! > > -- > David Abrahams > dave(a)boost-consulting.com * http://www.boost-consulting.com > Boost support, enhancements, training, and commercial distribution > ------------------------------------------------------------------- This e-mail and any attachments may contain confidential and/or privileged material; it is for the intended addressee(s) only. If you are not a named addressee, you must not use, retain or disclose such information. NPL Management Ltd cannot guarantee that the e-mail or any attachments are free from viruses. NPL Management Ltd. Registered in England and Wales. No: 2937881 Registered Office: Teddington, Middlesex, United Kingdom TW11 0LW. -------------------------------------------------------------------

1 0

overriding build options
by Keith Jackson (DSD staff) Dec. 12, 2002

Dec. 12, 2002

Hi, I've got what might be a simple question, but I haven't found an answer yet. The default python build with gcc uses "-Wall" and "-fstrict-prototypes". I'd like to be able to build extension modules without these flags. SWIG generated code throws a lot of warnings, as does the libraries I'm wrapping, and it makes it very hard for users to see what is actually going on. What is the right way to remove these from the compile command? thanks in advance, --keith ---------------------------------------------------------------- Keith R. Jackson KRJackson(a)lbl.gov Secure Grid Technologies Group (510) 486-4401 Lawrence Berkeley National Laboratory http://www-itg.lbl.gov/~kjackson/

3 3

Re: [Distutils] overriding build options
by Michael Hudson Dec. 12, 2002

Dec. 12, 2002

"Keith Jackson (DSD staff)" <krjackson(a)lbl.gov> writes: > That's what I was afraid of. It sure seems like a simple way to override > the compile options from the python build would be nice. Would be nice, yes, but also a bit of a minefield: generally extension modules have to be built with the same options as Python or all hell can break loose (here I'm thinking particularly of large file options). Obviously, this doesn't apply to warning options, but... brr. There's also x-platform considerations here. Cheers, M. -- Well, yes. I don't think I'd put something like "penchant for anal play" and "able to wield a buttplug" in a CV unless it was relevant to the gig being applied for... -- Matt McLeod, alt.sysadmin.recovery

1 0

Compiling Python C++ extensions with MingW
by Andrew Gregory Dec. 11, 2002

Dec. 11, 2002

I posted details of a problems on the google Python user group - someone emailed to say that I should send this to the distutils-sig. mailing list. It concerns compiling a very simple C++ extension (as a test) on Mingw 2.0.0 for use with MSVC-compiled Python. Using linker option --enable-cxx did not help. http://groups.google.co.uk/groups?dq=&hl=en&lr=&ie=UTF-8&threadm=2830c89 c.0212101559.6ea63560%40posting.google.com&prev=/groups%3Fhl%3Den%26lr%3 D%26ie%3DUTF-8%26group%3Dcomp.lang.python The output is shown below. The SWIG warnings seem to be normal - but it failed at the dllwrap stage. Andrew Gregory. C:\PyFiles\exMingw\MyCPP>python setup.py build --compiler=mingw32 running build running build_ext building '_pysimple' extension creating build creating build\temp.win32-2.2 creating build\temp.win32-2.2\Release C:\MinGW\bin\gcc.exe -mno-cygwin -mdll -O -Wall -IC:\Python22\include -c pysimple_wrap.cxx -o build\temp.win32-2.2\Relea se\pysimple_wrap.o pysimple_wrap.cxx:180: warning: `swig_type_info* SWIG_TypeDynamicCast(swig_type_info*, void**)' defined but not used pysimple_wrap.cxx:192: warning: `swig_type_info* SWIG_TypeQuery(const char*)' defined but not used pysimple_wrap.cxx:374: warning: `void SWIG_addvarlink(PyObject*, char*, PyObject*(*)(), int (*)(PyObject*))' defined but not used pysimple_wrap.cxx:427: warning: `int SWIG_ConvertPtr(PyObject*, void**, swig_type_info*, int)' defined but not used pysimple_wrap.cxx:519: warning: `int SWIG_ConvertPacked(PyObject*, void*, int, swig_type_info*, int)' defined but not used writing build\temp.win32-2.2\Release\_pysimple.def creating build\lib.win32-2.2 C:\MinGW\bin\dllwrap.exe -mno-cygwin -mdll -static --entry _DllMain@12 --output-lib build\temp.win32-2.2\Release\lib_pys imple.a --def build\temp.win32-2.2\Release\_pysimple.def -s build\temp.win32-2.2\Release\pysimple_wrap.o -LC:\Python22\l ibs -lpython22 -o build\lib.win32-2.2\_pysimple.pyd build\temp.win32-2.2\Release\pysimple_wrap.o(.eh_frame+0x11):pysimple_wr ap.cxx: undefined reference to `__gxx_personalit y_v0' dllwrap: gcc exited with status 1 error: command 'dllwrap' failed with exit status 1 ------------------------------------------------------------------- This e-mail and any attachments may contain confidential and/or privileged material; it is for the intended addressee(s) only. If you are not a named addressee, you must not use, retain or disclose such information. NPL Management Ltd cannot guarantee that the e-mail or any attachments are free from viruses. NPL Management Ltd. Registered in England and Wales. No: 2937881 Registered Office: Teddington, Middlesex, United Kingdom TW11 0LW. -------------------------------------------------------------------

4 5

Header dependencies when building extensions
by Nick Patavalis Dec. 11, 2002

Dec. 11, 2002

Is there a way to specify (or even better, have "distutils" automatically deduce) header dependencies when building an extension? If, for example, the "foo" extension is built from "foo.c" which includes "foo.h", how can I make distutils rebuild the extension when "foo.h" changes? Thanks in advance /npat -- A commune is where people join together to share their lack of wealth. -- Richard M. Stallman

2 1

Linking to libs on MacOS X
by Matthew Smith Dec. 10, 2002

Dec. 10, 2002

Hello, I'm having some difficulty extending python with a .cpp file and a library on Mac OS X 10.2.2 (I can't get distutils to find the library). The extention file (vbsecurity.cpp) file contains my the functions I am trying to make available to python, which needs to link to my library: libcryptopp.a (it's in the root of my distribution directory with the headers in a subdirectory - crypto42). The vbsecurity.cpp also makes use of a class (aesphm.cpp, aesphm.h). Now my setup.py file looks like the following: #!/usr/bin/env python from distutils.core import setup, Extension module1 = Extension('vbsecurity', sources = ['vbsecurity.cpp'], include_dirs=['crypto42'], #library_dirs=[''], libraries=['libcryptopp.a']) setup (name = 'vbsecurity', version = '1.0', ext_modules = [module1]) I've tried using library_dirs with an absolute path, placing the lib in a subdirectory and using a relative path, as well as placing the lib in '/usr/lib/'. And I get the following output: mps% python setup.py build running build running build_ext building 'vbsecurity' extension creating build creating build/temp.darwin-6.2-Power Macintosh-2.2 gcc -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -no-cpp-precomp -Icrypto42 -I/usr/include/python2.2 -c vbsecurity.cpp -o build/temp.darwin-6.2-Power Macintosh-2.2/vbsecurity.o [snip - some warnings] creating build/lib.darwin-6.2-Power Macintosh-2.2 gcc -arch i386 -arch ppc -bundle -flat_namespace -undefined suppress build/temp.darwin-6.2-Power Macintosh-2.2/vbsecurity.o -llibcryptopp.a -o build/lib.darwin-6.2-Power Macintosh-2.2/vbsecurity.so ld: for architecture i386 ld: warning /usr/lib/bundle1.o cputype (18, architecture ppc) does not match cputype (7) for specified -arch flag: i386 (file not loaded) ld: warning build/temp.darwin-6.2-Power Macintosh-2.2/vbsecurity.o cputype (18, architecture ppc) does not match cputype (7) for specified -arch flag: i386 (file not loaded) ld: can't locate file for: -llibcryptopp.a error: command 'gcc' failed with exit status 1 No matter what I've tried, I can't get it to find the library. Any help would be great... Cheers Matt

1 1

Distutils for Python itself: compile, install and setup instructions for WIN32
by Henry S. Thompson Dec. 7, 2002

Dec. 7, 2002

I need a tk8.4 Python on a windows box, so I thought I'd install and build Python and compile _tkinter using tcl8.4. Silly me, I assumed if I compiled pythoncore and python, I could then use setup to do the rest. Not so -- various aspects of setup die, as follows: 1) Compile pythoncore and python using Visual C++ 6 and the supplied project files, under c:\Program Files\Python22; 2) Move python.exe and python.dll from c:\Program Files\Python22\PCbuild to c:\Program Files\Python22; 3) Try running python setup.py build in c:\Program Files\Python22 Dies because get_config_var("srcdir") returns [None]. Working around this gets me a bit further, then BINDIR needs a value, then a pervasive failure to locate pyconfig.h causes nothing to happen at great length. Should this work, and if so is there a cookbook description of how to make it work somewhere (I searched quite hard and failed to find it, sorry if it's staring me in the face somewhere). Another way to ask the question -- using configure+make on UN*X systems, distutils takes over early on and manages the rest. How do I achieve a similar installation on WIN32? Thanks in advance, ht -- Henry S. Thompson, HCRC Language Technology Group, University of Edinburgh W3C Fellow 1999--2002, part-time member of W3C Team 2 Buccleuch Place, Edinburgh EH8 9LW, SCOTLAND -- (44) 131 650-4440 Fax: (44) 131 650-4587, e-mail: ht(a)cogsci.ed.ac.uk URL: http://www.ltg.ed.ac.uk/~ht/ [mail really from me _always_ has this .sig -- mail without it is forged spam]

1 0

Bug/patch question, WinNT, Borland C linker, spaces in paths
by Rafal Dowgird Dec. 4, 2002

Dec. 4, 2002

Hello, There is a bug in distutils that breaks Borland C linker. Distutils tries to pass search paths to the linker as "/LD:/Program Files/samplepath" This causes the linker to bail out with an error message suggesting that the path argument is mistreated as an object file. It seems that the linker expects a different quoting scheme that the one used by distutils. I have done some experimenting and it turns out that: /L"D:/Program Files/samplepath" /LD:/Program" "Files/samplepath are both OK. Unfortunately: /L "D:/Program Files/samplepath" does not work - there should be no whitespace between '/L' and the path, so passing '/L' and the path as separate arguments does not work. The piece of code responsible for the quoting is _nt_quote_args function in spawn.py. The following patch 'fixes' the quoting scheme. This is the output from 'cvs diff spawn.py': Index: spawn.py =================================================================== RCS file: /cvsroot/python/distutils/distutils/spawn.py,v retrieving revision 1.16 diff -r1.16 spawn.py 62,63c62 < if string.find(args[i], ' ') != -1: < args[i] = '"%s"' % args[i] --- > args[i] = args[i].replace(' ','" "') Instead of putting the whole space-containing argument into quotes, it only quotes spaces. Unfortunately there is no reason for this not to break other compilers. Due to infelicities in WinApi (child process gets the whole command line, not split into arguments) it's up to the compiler/linker to parse the command line and as far as I know there is no standard way of encoding arguments that contain spaces. Now, the questions: 1. Can anyone test the above patch with other compilers? I only have Borland. 2. I think that one 'standard' argument quoting function might not be sufficient. Perhaps _nt_quote_args should be moved into CCompiler class hierarchy? This way every compiler could override the standard quoting function without the risk of breaking other compilers. 3. I have just started looking at the distutils source code and I am not a Python guru, so perhaps there is another simple way to fix this bug? Regards, Rafal Dowgird

4 4