Mailman 3 November 2000 - Distutils-SIG

Installation questions
by Paul Prescod 23 Nov '00

23 Nov '00

I'm a distutils newbie so I'm just trying to find my way around. I notice that even though (e.g.) numpy is built using distutils, the windows binary zipfile does not come with a setup.py for installation. The setup is pretty brain-dead (just unzip to a particular location) but I'm thinking of a future where Python binaries on a particular platform have a known structure so that they can be installed in a generic way. In other words, I'd like it to be more brain-dead: more like an RPM or MSI where the internal binary distribution structure is well-known. I tried to implement this for a few packages as an experiment (first not using distutils, and then using distutils). I decided that all of the packages would have a top-level "install.py". I was writing small tools to find the Python lib directory, copy the files and so forth but then I realized that I was duplicating some of the work of distutils (which does have an install option, after all). So then I started to use distutils and the "setup.py" convention. The structure of my modules is /foo/__init__.py /foo/bar/__init__.py /foo/bar/something.pyd Installing the ".py"s is easy because of "packages=". But distutils misses the .pyd. Is it doing the right thing? Or should it blindly copy .pyd's as part of a package. Also, is distutil install supposed to do anything with documentation? It would be nice if there were a standard place for Python module documentation. Paul

2 1

Re: [Distutils] distutil or setup problem?
by Berthold Höllmann 21 Nov '00

21 Nov '00

"Thomas Heller" <thomas.heller(a)ion-tof.com> writes: > > Can you post or send the output of 'python setup.py build' ? Here the comes the requested: C:\hoel\solver\python>python C:\hoel\solver\python\setup.py build running build running build_clib building 'mtxobj' library C:\Programme\Microsoft Visual Studio\VC98\BIN\cl.exe /c /nologo /Ox /MD /W3 /GX -I.. -If:/data/fbf/fi/devel/include -If:/data/fbf/fi/devel/include/pthreads -If:/data/fbf/fi/devel/include/spooles /Tc../mtxobj_spooles.c /Fobuild\temp.win32-1.5\../mtxobj_spooles.obj mtxobj_spooles.c C:\Programme\Microsoft Visual Studio\VC98\BIN\cl.exe /c /nologo /Ox /MD /W3 /GX -I.. -If:/data/fbf/fi/devel/include -If:/data/fbf/fi/devel/include/pthreads -If:/data/fbf/fi/devel/include/spooles /Tc../mtxfile_mtxobj.c /Fobuild\temp.win32-1.5\../mtxfile_mtxobj.obj mtxfile_mtxobj.c C:\Programme\Microsoft Visual Studio\VC98\BIN\cl.exe /c /nologo /Ox /MD /W3 /GX -I.. -If:/data/fbf/fi/devel/include -If:/data/fbf/fi/devel/include/pthreads -If:/data/fbf/fi/devel/include/spooles /Tc../mtxPobj_spooles.c /Fobuild\temp.win32-1.5\../mtxPobj_spooles.obj mtxPobj_spooles.c ../mtxPobj_spooles.c(177) : warning C4101: 'ierr' : unreferenced local variable ../mtxPobj_spooles.c(176) : warning C4101: 'max_row' : unreferenced local variable ../mtxPobj_spooles.c(176) : warning C4101: 'min_row' : unreferenced local variable C:\Programme\Microsoft Visual Studio\VC98\BIN\lib.exe build\temp.win32-1.5\../mtxobj_spooles.obj build\temp.win32-1.5\../mtxfile_mtxobj.obj build\temp.win32-1.5\../mtxPobj_spooles.obj /OUT:build\temp.win32-1.5\mtxobj.lib Microsoft (R) Library Manager Version 6.00.8168 Copyright (C) Microsoft Corp 1992-1998. All rights reserved. running build_ext building '_spsolve' extension creating build\temp.win32-1.5\Release C:\Programme\Microsoft Visual Studio\VC98\BIN\cl.exe /c /nologo /Ox /MD /W3 /GX -DVISUAL_CPLUSPLUS -DDebug -If:\data\fbf\fi\devel\include -IG:\bin\Python\include\python1.5/Numeric -Ic:\devl\include -IG:\bin\Python\Include /Tcspsolve.c /Fobuild\temp.win32-1.5\Release\spsolve.obj spsolve.c spsolve.c(232) : warning C4013: 'mtxPobj_symbFacPermute' undefined; assuming extern returning int spsolve.c(259) : warning C4013: 'mtxPobj_numFac' undefined; assuming extern returning int spsolve.c(305) : warning C4018: '!=' : signed/unsigned mismatch spsolve.c(369) : warning C4018: '!=' : signed/unsigned mismatch spsolve.c(392) : warning C4018: '!=' : signed/unsigned mismatch spsolve.c(347) : warning C4101: 'tmp' : unreferenced local variable spsolve.c(468) : warning C4018: '!=' : signed/unsigned mismatch spsolve.c(472) : warning C4018: '!=' : signed/unsigned mismatch spsolve.c(426) : warning C4101: 'Pobj' : unreferenced local variable spsolve.c(427) : warning C4101: 'tmp' : unreferenced local variable spsolve.c(519) : warning C4101: 'd' : unreferenced local variable creating build\lib.win32-1.5 C:\Programme\Microsoft Visual Studio\VC98\BIN\link.exe /DLL /nologo /INCREMENTAL:NO /LIBPATH:c:\devl\bin /LIBPATH:f:\data\fbf\fi\devel\lib /LIBPATH:lib /LIBPATH:G:\bin\Python\libs /LIBPATH:build\temp.win32-1.5 mtxfile.lib spooles.lib cvwmpi.lib mtxobj.lib /EXPORT:init_spsolve build\temp.win32-1.5\Release\spsolve.obj /OUT:build\lib.win32-1.5\_spsolve.pyd /IMPLIB:build\temp.win32-1.5\Release\_spsolve.lib /nodefaultlib:libc spooles.lib(dll.obj) : error LNK2005: _DllMain@12 already defined in MSVCRT.lib(dllmain.obj) spooles.lib(dll.obj) : warning LNK4006: _DllMain@12 already defined in MSVCRT.lib(dllmain.obj); second definition ignored Creating library build\temp.win32-1.5\Release\_spsolve.lib and object build\temp.win32-1.5\Release\_spsolve.exp spsolve.obj : error LNK2001: unresolved external symbol _PyErr_SetFromErrno spsolve.obj : error LNK2001: unresolved external symbol _PyCObject_FromVoidPtr spsolve.obj : error LNK2001: unresolved external symbol _PyArg_ParseTuple spsolve.obj : error LNK2001: unresolved external symbol _PyCObject_AsVoidPtr spsolve.obj : error LNK2001: unresolved external symbol _PyErr_SetString spsolve.obj : error LNK2001: unresolved external symbol __imp__PyExc_TypeError spsolve.obj : error LNK2001: unresolved external symbol __imp__PyCObject_Type spsolve.obj : error LNK2001: unresolved external symbol _Py_BuildValue spsolve.obj : error LNK2001: unresolved external symbol __imp__PyExc_ValueError spsolve.obj : error LNK2001: unresolved external symbol __imp___Py_NoneStruct spsolve.obj : error LNK2001: unresolved external symbol _PyDict_GetItemString spsolve.obj : error LNK2001: unresolved external symbol _PyModule_GetDict spsolve.obj : error LNK2001: unresolved external symbol _PyImport_ImportModule spsolve.obj : error LNK2001: unresolved external symbol _Py_InitModule4 ... <lots of other, surely unrelated unresolved external's from a library used> build\lib.win32-1.5\_spsolve.pyd : fatal error LNK1120: 31 unresolved externals error: command '"C:\Programme\Microsoft Visual Studio\VC98\BIN\link.exe"' failed with exit status 1120 C:\hoel\solver\python> -- email: hoel(a)GermanLloyd.org ) tel. : +49 (40) 3 61 49 - 73 74 ( C[_] These opinions might be mine, but never those of my employer.

1 0

distutil or setup problem?
by Berthold Höllmann 21 Nov '00

21 Nov '00

Hello, Trying to use distutils 1.0.1 to build an extension module and an accompanying library I have some problems. First, when I call > python setup.py build I get cg error (as) : cannot open output file "build/temp.solaris-2.7-sun4u-1.5/../mtxobj_spooles.o" under solaris and a similar message under WIN32. My library files are in the parent directory to the directory where setup.py is. So in the definitions for the library build i use "../mtxobj_spooles.c" which leads distutils not to generate the "build/temp.*" directory. But this is a minor problem compared to my second problem. I can't belive it is a general distutils problem, but have no clue what else can be wrong. After having made "build/temp.win32-1.5" by hand, compiling the windows version fails with "unresolved external symbol" errors like these: spsolve.obj : error LNK2001: unresolved external symbol _PyErr_SetFromErrno spsolve.obj : error LNK2001: unresolved external symbol _PyCObject_FromVoidPtr spsolve.obj : error LNK2001: unresolved external symbol _PyArg_ParseTuple spsolve.obj : error LNK2001: unresolved external symbol _PyCObject_AsVoidPtr spsolve.obj : error LNK2001: unresolved external symbol _PyErr_SetString spsolve.obj : error LNK2001: unresolved external symbol __imp__PyExc_TypeError spsolve.obj : error LNK2001: unresolved external symbol __imp__PyCObject_Type spsolve.obj : error LNK2001: unresolved external symbol _Py_BuildValue spsolve.obj : error LNK2001: unresolved external symbol __imp__PyExc_ValueError spsolve.obj : error LNK2001: unresolved external symbol __imp___Py_NoneStruct spsolve.obj : error LNK2001: unresolved external symbol _PyDict_GetItemString spsolve.obj : error LNK2001: unresolved external symbol _PyModule_GetDict spsolve.obj : error LNK2001: unresolved external symbol _PyImport_ImportModule spsolve.obj : error LNK2001: unresolved external symbol _Py_InitModule4 now that seems strange to me though i thought the distutils take care to link python15.lib to avoid these error messages. Could that be a configuration problem on my side or is this a 1.0.1 bug? Greetings Berthold -- email: hoel(a)GermanLloyd.org ) tel. : +49 (40) 3 61 49 - 73 74 ( C[_] These opinions might be mine, but never those of my employer.

2 1

Mac mods for distutils
by Jack Jansen 20 Nov '00

20 Nov '00

[Hmm, my address for Greg, gward(a)python.net, appears outdated. So I'm sending it here in stead] Greg, here are two diffs and a new file for distutils on the mac. The ccompiler.py diff adds support for the MetroWerks compiler, the dist.py diff moves the Mac argument dialog code to a different place (apparently a few things have changed, it didn't work anymore in the old place). There's also a new file mwerkscompiler.py which is the compiler.py implementation for Metrowerks Codewarrior. Oh yes: the diffs are against the Python CVS tree, not the distutils cvs tree. Let me know if that's a problem and I'll convert them to the other one. -- Jack Jansen | ++++ stop the execution of Mumia Abu-Jamal ++++ Jack.Jansen(a)oratrix.com | ++++ if you agree copy these lines to your sig ++++ www.oratrix.nl/~jack | ++++ see http://www.xs4all.nl/~tank/ ++++

1 0

bdist_rpm and compressed man pages
by Bastian Kleineidam 20 Nov '00

20 Nov '00

Hello, I have a man page in my data files specified. It seems that the compression of man pages confuses the bdist_rpm command. When I am executing python setup.py bdist_rpm the man page is copied and then compressed with the brp-compress script: [...] creating /var/tmp/LinkChecker-buildroot/usr/man creating /var/tmp/LinkChecker-buildroot/usr/man/man1 copying linkchecker.1 -> /var/tmp/LinkChecker-buildroot/usr/man/man1 writing list of installed files to 'INSTALLED_FILES' [...] + /usr/lib/rpm/brp-compress + /usr/lib/rpm/brp-strip + /usr/lib/rpm/brp-strip-comment-note Processing files: LinkChecker-1.2.8-1 File not found: /var/tmp/LinkChecker-buildroot/usr/man/man1/linkchecker.1 Executing(%doc): /bin/sh -e /var/tmp/rpm-tmp.69025 [...] Provides: linkchecker error: command 'rpm' failed with exit status 1 Does anyone know how to fix this? Greetings from Bastian

1 0

Thanks for the help!
by Jack Jansen 19 Nov '00

19 Nov '00

Folks, thanks for the help on distutils-based packages to try. Numeric and PyXML now install flawlessly on the Mac, I'll be mailing the diffs to Greg tomorrow. If someone else wants to play with distutils on the Mac please let me know: I've also had to fix a few bugs in the mkcwproject module, so unless you're using MacPython from the CVS server you'll need to get a newer copy from me. Oh yes: PyOpenGL and Linkchecker, which were also suggested as test cases, were too much work initially. PyOpenGL has "if sys.platform == win32" all over the place and expects that anything that isn't win32 is unix and it expects that a tcl/tk source distribution is available, Linkchecker uses absolute unix pathnames and uses various tricks from the distutils config stuff, which aren't implemented yet (and which may actually be rather difficult to implement). -- Jack Jansen | ++++ stop the execution of Mumia Abu-Jamal ++++ Jack.Jansen(a)oratrix.com | ++++ if you agree copy these lines to your sig ++++ www.oratrix.nl/~jack | ++++ see http://www.xs4all.nl/~tank/ ++++

1 0

Installing package include files
by Jack Jansen 19 Nov '00

19 Nov '00

Something that slightly bothers me with distutils is that if you run Python from source it installs package include files into the Python Include directory. This is a bit of an annoyance for me (as it means I have to clean out the cruft before I create a MacPython source distribution) but I'm really more worried about the elegance of it. Shouldn't there be a site-Include, along the line of the site-packages, so that package include files can't collide with standard Python include files? -- Jack Jansen | ++++ stop the execution of Mumia Abu-Jamal ++++ Jack.Jansen(a)oratrix.com | ++++ if you agree copy these lines to your sig ++++ www.oratrix.nl/~jack | ++++ see http://www.xs4all.nl/~tank/ ++++

1 0

Looking for packages to test on the Mac
by Jack Jansen 17 Nov '00

17 Nov '00

Can someone point me to a disutils-based packages that I can try to install with my new Mac distutils code? I'm now so far that I can install various toy packages and one serious one (Numeric), but I'd like to get a few more test points... -- Jack Jansen | ++++ stop the execution of Mumia Abu-Jamal ++++ Jack.Jansen(a)oratrix.com | ++++ if you agree copy these lines to your sig ++++ www.oratrix.nl/~jack | see http://www.xs4all.nl/~tank/spg-l/sigaction.htm

3 2

RE: [Distutils] Looking for packages to test on the Mac
by Mike Fletcher 17 Nov '00

17 Nov '00

For a likely-to-fail one, PyOpenGL 1.5.6a2 at http://sourceforge.net/project/showfiles.php?group_id=5988 (it's likely to fail since there was an entire branch of code dedicated to the Mac that hasn't been touched since 1.5.5 (Rene ported us to distutils between 1.5.5 and 1.5.6)). Enjoy, Mike -----Original Message----- From: Jack Jansen [mailto:jack@oratrix.nl] Sent: Friday, November 17, 2000 9:03 AM To: distutils-sig(a)python.org Subject: [Distutils] Looking for packages to test on the Mac Can someone point me to a disutils-based packages that I can try to install with my new Mac distutils code? I'm now so far that I can install various toy packages and one serious one (Numeric), but I'd like to get a few more test points... -- Jack Jansen | ++++ stop the execution of Mumia Abu-Jamal ++++ Jack.Jansen(a)oratrix.com | ++++ if you agree copy these lines to your sig ++++ www.oratrix.nl/~jack | see http://www.xs4all.nl/~tank/spg-l/sigaction.htm _______________________________________________ Distutils-SIG maillist - Distutils-SIG(a)python.org http://www.python.org/mailman/listinfo/distutils-sig

1 0

Patch for msvccompiler.py
by Thomas Heller 17 Nov '00

17 Nov '00

The attached patch converts filenames to absolute paths before they are compiled. This make debugging easier, because the debugger is able to find the source files without asking the user. Thomas

1 0