On Mon, Dec 22, 2003 at 08:29:31AM -0800, Guido van Rossum wrote:

John Draper (the famous Capt'n Crunch) reports that on his OpenBSD box, he can't build a debug version of Python 2.3(.3c1, but I doubt that matters) unless he tweaks the configure file to add -O3 to the C flags. That sounds fishy to me, but he insists that's how it is, and he's reproduced it from a clean tarball. Debugging it further doesn't really seem to be within John's power; the -O3 trick was found by his partner Steve who's temporarily unavailable.

The symptom is that without -O3, a "python" binary gets built but its use to run setup.py segfaults. Is there anyone here with access to an OpenBSD box who could try to reproduce this?

OpenBSD 3.3 builds both HEAD and r233c1 fine for me. This is code out of the anoncvs repository btw. -c -- 12:00:00 up 21 days, 1:44, 12 users, load average: 0.01, 0.07, 0.09

Guido van Rossum writes:

If anybody *does* see the bogus behavior and feels like debugging it, I'd appreciate it!

I've been running cvs Python but not previously with debug switched on. I get a core when using OPT=-g. (Note that I'm running Patch 850977 "Modify setup.py to detect Tcl/Tk on BSD", though I wouldn't think it would cause this, and I doubt he's using it.) Investigating. Hints appreciated! -- KBK Script started on Mon Dec 22 13:30:26 2003 hydra /home/kbk/PYTHON/python/dist/src$ uname -a OpenBSD hydra.localdomain 3.3 GENERIC_RAID#0 i386 hydra /home/kbk/PYTHON/python/dist/src$ hydra /home/kbk/PYTHON/python/dist/src$ make clean find . -name '*.o' -exec rm -f {} ';' find . -name '*.s[ol]' -exec rm -f {} ';' find . -name '*.py[co]' -exec rm -f {} ';' hydra /home/kbk/PYTHON/python/dist/src$ make OPT=-g gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Modules/python.o Modules/python.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/acceler.o Parser/acceler.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/grammar1.o Parser/grammar1.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/listnode.o Parser/listnode.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/node.o Parser/node.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/parser.o Parser/parser.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/parsetok.o Parser/parsetok.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/bitset.o Parser/bitset.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/metagrammar.o Parser/metagrammar.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/firstsets.o Parser/firstsets.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/grammar.o Parser/grammar.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/pgen.o Parser/pgen.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/myreadline.o Parser/myreadline.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/tokenizer.o Parser/tokenizer.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/abstract.o Objects/abstract.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/boolobject.o Objects/boolobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/bufferobject.o Objects/bufferobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/cellobject.o Objects/cellobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/classobject.o Objects/classobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/cobject.o Objects/cobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/complexobject.o Objects/complexobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/descrobject.o Objects/descrobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/enumobject.o Objects/enumobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/fileobject.o Objects/fileobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/floatobject.o Objects/floatobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/frameobject.o Objects/frameobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/funcobject.o Objects/funcobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/intobject.o Objects/intobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/iterobject.o Objects/iterobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/listobject.o Objects/listobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/longobject.o Objects/longobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/dictobject.o Objects/dictobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/methodobject.o Objects/methodobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/moduleobject.o Objects/moduleobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/object.o Objects/object.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/obmalloc.o Objects/obmalloc.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/rangeobject.o Objects/rangeobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/setobject.o Objects/setobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/sliceobject.o Objects/sliceobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/stringobject.o Objects/stringobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/structseq.o Objects/structseq.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/tupleobject.o Objects/tupleobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/typeobject.o Objects/typeobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/weakrefobject.o Objects/weakrefobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/unicodeobject.o Objects/unicodeobject.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Objects/unicodectype.o Objects/unicodectype.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/bltinmodule.o Python/bltinmodule.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/exceptions.o Python/exceptions.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/ceval.o Python/ceval.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/mysnprintf.o Python/mysnprintf.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/tokenizer_pgen.o Parser/tokenizer_pgen.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/printgrammar.o Parser/printgrammar.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Parser/pgenmain.o Parser/pgenmain.c gcc -pthread -g Parser/acceler.o Parser/grammar1.o Parser/listnode.o Parser/node.o Parser/parser.o Parser/parsetok.o Parser/bitset.o Parser/metagrammar.o Parser/firstsets.o Parser/grammar.o Parser/pgen.o Objects/obmalloc.o Python/mysnprintf.o Parser/tokenizer_pgen.o Parser/printgrammar.o Parser/pgenmain.o -lpthread -lutil -o Parser/pgen Parser/pgen ./Grammar/Grammar ./Include/graminit.h ./Python/graminit.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/compile.o Python/compile.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/codecs.o Python/codecs.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/errors.o Python/errors.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/frozen.o Python/frozen.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/frozenmain.o Python/frozenmain.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/future.o Python/future.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/getargs.o Python/getargs.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/getcompiler.o Python/getcompiler.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/getcopyright.o Python/getcopyright.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/getmtime.o Python/getmtime.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -DPLATFORM='"openbsd3"' -o Python/getplatform.o ./Python/getplatform.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/getversion.o Python/getversion.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/graminit.o Python/graminit.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/import.o Python/import.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -I. -o Python/importdl.o ./Python/importdl.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/marshal.o Python/marshal.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/modsupport.o Python/modsupport.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/mystrtoul.o Python/mystrtoul.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/pyfpe.o Python/pyfpe.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/pystate.o Python/pystate.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/pythonrun.o Python/pythonrun.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/structmember.o Python/structmember.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/symtable.o Python/symtable.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/sysmodule.o Python/sysmodule.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/traceback.o Python/traceback.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/getopt.o Python/getopt.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/dynload_shlib.o Python/dynload_shlib.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Python/thread.o Python/thread.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Modules/config.o Modules/config.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -DPYTHONPATH='":plat-openbsd3:lib-tk"' -DPREFIX='"/usr/local"' -DEXEC_PREFIX='"/usr/local"' -DVERSION='"2.4"' -DVPATH='""' -o Modules/getpath.o ./Modules/getpath.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Modules/main.o Modules/main.c gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -o Modules/gcmodule.o Modules/gcmodule.c gcc -pthread -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -c ./Modules/threadmodule.c -o Modules/threadmodule.o gcc -pthread -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -c ./Modules/signalmodule.c -o Modules/signalmodule.o gcc -pthread -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -c ./Modules/posixmodule.c -o Modules/posixmodule.o gcc -pthread -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -c ./Modules/errnomodule.c -o Modules/errnomodule.o gcc -pthread -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -c ./Modules/_sre.c -o Modules/_sre.o gcc -pthread -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -c ./Modules/_codecsmodule.c -o Modules/_codecsmodule.o gcc -pthread -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -c ./Modules/zipimport.c -o Modules/zipimport.o gcc -pthread -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -c ./Modules/symtablemodule.c -o Modules/symtablemodule.o gcc -pthread -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -c ./Modules/xxsubtype.c -o Modules/xxsubtype.o if test -f buildno; then expr `cat buildno` + 1 >buildno1; mv -f buildno1 buildno; else echo 1 >buildno; fi gcc -pthread -c -fno-strict-aliasing -g -I. -I./Include -DPy_BUILD_CORE -DBUILD=`cat buildno` -o Modules/getbuildinfo.o ./Modules/getbuildinfo.c rm -f libpython2.4.a ar cr libpython2.4.a Modules/getbuildinfo.o ar cr libpython2.4.a Parser/acceler.o Parser/grammar1.o Parser/listnode.o Parser/node.o Parser/parser.o Parser/parsetok.o Parser/bitset.o Parser/metagrammar.o Parser/firstsets.o Parser/grammar.o Parser/pgen.o Parser/myreadline.o Parser/tokenizer.o ar cr libpython2.4.a Objects/abstract.o Objects/boolobject.o Objects/bufferobject.o Objects/cellobject.o Objects/classobject.o Objects/cobject.o Objects/complexobject.o Objects/descrobject.o Objects/enumobject.o Objects/fileobject.o Objects/floatobject.o Objects/frameobject.o Objects/funcobject.o Objects/intobject.o Objects/iterobject.o Objects/listobject.o Objects/longobject.o Objects/dictobject.o Objects/methodobject.o Objects/moduleobject.o Objects/object.o Objects/obmalloc.o Objects/rangeobject.o Objects/setobject.o Objects/sliceobject.o Objects/stringobject.o Objects/structseq.o Objects/tupleobject.o Objects/typeobject.o Objects/weakrefobject.o Objects/unicodeobject.o Objects/unicodectype.o ar cr libpython2.4.a Python/bltinmodule.o Python/exceptions.o Python/ceval.o Python/compile.o Python/codecs.o Python/errors.o Python/frozen.o Python/frozenmain.o Python/future.o Python/getargs.o Python/getcompiler.o Python/getcopyright.o Python/getmtime.o Python/getplatform.o Python/getversion.o Python/graminit.o Python/import.o Python/importdl.o Python/marshal.o Python/modsupport.o Python/mystrtoul.o Python/mysnprintf.o Python/pyfpe.o Python/pystate.o Python/pythonrun.o Python/structmember.o Python/symtable.o Python/sysmodule.o Python/traceback.o Python/getopt.o Python/dynload_shlib.o Python/thread.o ar cr libpython2.4.a Modules/config.o Modules/getpath.o Modules/main.o Modules/gcmodule.o ar cr libpython2.4.a Modules/threadmodule.o Modules/signalmodule.o Modules/posixmodule.o Modules/errnomodule.o Modules/_sre.o Modules/_codecsmodule.o Modules/zipimport.o Modules/symtablemodule.o Modules/xxsubtype.o ranlib libpython2.4.a gcc -pthread -o python Modules/python.o libpython2.4.a -lpthread -lutil -lm ./Modules/posixmodule.c:5825: warning: tempnam() possibly used unsafely; consider using mkstemp() ./Modules/posixmodule.c:5872: warning: tmpnam() possibly used unsafely; consider using mkstemp() case $MAKEFLAGS in *-s*) CC='gcc -pthread' LDSHARED='ld -Bshareable' OPT='-g' ./python -E ./setup.py -q build;; *) CC='gcc -pthread' LDSHARED='ld -Bshareable' OPT='-g' ./python -E ./setup.py build;; esac Memory fault (core dumped) *** Error code 139 Stop in /home/kbk/PYTHON/python/dist/src (line 335 of Makefile). hydra /home/kbk/PYTHON/python/dist/src$ hydra /home/kbk/PYTHON/python/dist/src$ hydra /home/kbk/PYTHON/python/dist/src$ cvs st configure.in =================================================================== File: configure.in Status: Up-to-date Working revision: 1.442 Repository revision: 1.442 /cvsroot/python/python/dist/src/configure.in,v Sticky Tag: (none) Sticky Date: (none) Sticky Options: (none) hydra /home/kbk/PYTHON/python/dist/src$ Script done on Mon Dec 22 13:31:57 2003 Script started on Mon Dec 22 13:40:31 2003 hydra /home/kbk/PYTHON/python/dist/src$ hydra /home/kbk/PYTHON/python/dist/src$ hydra /home/kbk/PYTHON/python/dist/src$ # [re-build with make clean && make] hydra /home/kbk/PYTHON/python/dist/src$ ./python Python 2.4a0 (#35, Dec 22 2003, 13:38:03) [GCC 2.95.3 20010125 (prerelease, propolice)] on openbsd3 Type "help", "copyright", "credits" or "license" for more information.

...

...

hydra /home/kbk/PYTHON/python/dist/src$ Script done on Mon Dec 22 13:41:26 2003

Interesting... When I do OPT=-g, I get a Memory fault (core dumped) when linking python. Is that when you receive the core dump?

From looking at his output, he gets it just after the linking, when using the freshly linked python executable to run the setup.py script.

Are you saying you didn't try the debug build? --Guido van Rossum (home page: http://www.python.org/~guido/)

Christopher Blunck writes:

On Mon, Dec 22, 2003 at 01:57:18PM -0500, Kurt B. Kaiser wrote:

...

Guido van Rossum writes:

...

If anybody *does* see the bogus behavior and feels like debugging it, I'd appreciate it!

I've been running cvs Python but not previously with debug switched on.

I get a core when using OPT=-g.

(Note that I'm running Patch 850977 "Modify setup.py to detect Tcl/Tk on BSD", though I wouldn't think it would cause this, and I doubt he's using it.)

Investigating. Hints appreciated!

Kurt-

Interesting... When I do OPT=-g, I get a Memory fault (core dumped) when linking python. Is that when you receive the core dump?

What version of gcc? Anthony and I hacked around on HP's compile farm in the 2.3.2 timeframe and saw gcc problems which we hacked around, but nothing like this. Cheers, mwh -- I've even been known to get Marmite *near* my mouth -- but never actually in it yet. Vegamite is right out. UnicodeError: ASCII unpalatable error: vegamite found, ham expected -- Tim Peters, comp.lang.python

On Mon, Dec 22, 2003 at 11:29:40AM -0800, Guido van Rossum wrote:

...

Interesting... When I do OPT=-g, I get a Memory fault (core dumped) when linking python. Is that when you receive the core dump?

...

From looking at his output, he gets it just after the linking, when using the freshly linked python executable to run the setup.py script.

Are you saying you didn't try the debug build?

I received the dump when trying to run setup.py build. -c -- 16:55:00 up 21 days, 6:39, 12 users, load average: 1.30, 0.60, 0.24