[Python-Dev] unit testing bake-off

[Jeremy Hylton]

If anyone is interested in experimenting with a test suite, here is a
summary of the code coverage for the current regression test suite as
run on my Linux box.  Pick a module with low code coverage and your
experiment can also improve the regression test suite.

Jeremy

 67.42%    798  Modules/arraymodule.c
 74.39%    773  Modules/audioop.c
 81.84%    380  Modules/binascii.c
 62.36%    449  Modules/bsddbmodule.c
 78.29%    152  Modules/cmathmodule.c
 67.89%    246  Modules/_codecsmodule.c
 47.41%   2647  Modules/cPickle.c
 87.50%      8  Modules/cryptmodule.c
 64.34%    272  Modules/cStringIO.c
  0.00%   1351  Modules/_cursesmodule.c
  0.00%    202  Modules/_curses_panel.c
 99.28%    139  Modules/errnomodule.c
 30.71%    127  Modules/fcntlmodule.c
 81.90%    315  Modules/gcmodule.c
  0.00%      4  Modules/getbuildinfo.c
 47.29%    277  Modules/getpath.c
 72.22%     54  Modules/grpmodule.c
 79.95%    419  Modules/imageop.c
  0.00%     11  Modules/../Include/cStringIO.h
 13.25%    234  Modules/linuxaudiodev.c
 14.80%    223  Modules/_localemodule.c
 30.66%    137  Modules/main.c
 73.20%     97  Modules/mathmodule.c
 98.39%    124  Modules/md5c.c
 69.70%     66  Modules/md5module.c
 48.62%    362  Modules/mmapmodule.c
 66.22%     74  Modules/newmodule.c
 84.91%     53  Modules/operator.c
 50.57%   1236  Modules/parsermodule.c
  0.00%    350  Modules/pcremodule.c
 28.88%   1077  Modules/posixmodule.c
 82.05%     39  Modules/pwdmodule.c
 77.96%    431  Modules/pyexpat.c
  0.00%   1876  Modules/pypcre.c
 50.00%      2  Modules/python.c
  0.00%    189  Modules/readline.c
 78.35%    425  Modules/regexmodule.c
 72.93%    931  Modules/regexpr.c
  0.00%     81  Modules/resource.c
 76.98%    443  Modules/rgbimgmodule.c
 82.70%    289  Modules/rotormodule.c
 82.47%    291  Modules/selectmodule.c
 85.10%    208  Modules/shamodule.c
 81.52%    276  Modules/signalmodule.c
 51.18%    678  Modules/socketmodule.c
 78.64%   1105  Modules/_sre.c
 69.67%    689  Modules/stropmodule.c
 80.49%    656  Modules/structmodule.c
  4.88%    123  Modules/termios.c
 60.71%    140  Modules/threadmodule.c
 68.78%    205  Modules/timemodule.c
 76.92%     65  Modules/ucnhash.c
 87.50%     16  Modules/unicodedatabase.c
 65.83%    120  Modules/unicodedata.c
 68.81%    420  Modules/zlibmodule.c
 64.68%   1005  Objects/abstract.c
 18.77%    261  Objects/bufferobject.c
 68.77%   1204  Objects/classobject.c
 27.59%     58  Objects/cobject.c
 59.41%    271  Objects/complexobject.c
 78.32%    678  Objects/dictobject.c
 52.14%    723  Objects/fileobject.c
 80.43%    368  Objects/floatobject.c
 84.86%    185  Objects/frameobject.c
 60.40%    149  Objects/funcobject.c
 78.68%    455  Objects/intobject.c
 77.66%    779  Objects/listobject.c
 81.17%   1142  Objects/longobject.c
 50.68%    148  Objects/methodobject.c
 58.82%    136  Objects/moduleobject.c
 76.50%    549  Objects/object.c
 15.24%    105  Objects/rangeobject.c
 41.03%     78  Objects/sliceobject.c
 76.63%   1797  Objects/stringobject.c
 77.00%    287  Objects/tupleobject.c
 22.22%     18  Objects/typeobject.c
 84.26%    108  Objects/unicodectype.c
 66.61%   2743  Objects/unicodeobject.c
 90.79%     76  Parser/acceler.c
  0.00%     28  Parser/bitset.c
  0.00%     67  Parser/firstsets.c
 18.18%     22  Parser/grammar1.c
  0.00%    139  Parser/grammar.c
  0.00%     30  Parser/intrcheck.c
  0.00%     38  Parser/listnode.c
  0.00%      2  Parser/metagrammar.c
  0.00%     63  Parser/myreadline.c
 90.70%     43  Parser/node.c
 82.26%    124  Parser/parser.c
 79.38%     97  Parser/parsetok.c
  0.00%    366  Parser/pgen.c
  0.00%     85  Parser/pgenmain.c
  0.00%     60  Parser/printgrammar.c
 76.70%    588  Parser/tokenizer.c
 62.31%   1231  Python/bltinmodule.c
 76.55%   2021  Python/ceval.c
 64.78%    230  Python/codecs.c
 73.85%   2367  Python/compile.c
 76.67%     30  Python/dynload_shlib.c
 75.75%    301  Python/errors.c
 65.59%    401  Python/exceptions.c
  0.00%     31  Python/frozenmain.c
 56.83%    776  Python/getargs.c
100.00%      2  Python/getcompiler.c
100.00%      2  Python/getcopyright.c
 80.00%      5  Python/getmtime.c
 15.62%     32  Python/getopt.c
100.00%      2  Python/getplatform.c
100.00%      4  Python/getversion.c
 61.78%   1167  Python/import.c
 66.67%     42  Python/importdl.c
 51.35%    483  Python/marshal.c
 60.58%    274  Python/modsupport.c
 88.73%     71  Python/mystrtoul.c
  0.00%      2  Python/pyfpe.c
 91.15%    113  Python/pystate.c
 37.80%    635  Python/pythonrun.c
  0.00%      5  Python/sigcheck.c
 12.67%    150  Python/structmember.c
 53.87%    323  Python/sysmodule.c
100.00%      5  Python/thread.c
 53.47%    144  Python/thread_pthread.h
 21.74%    138  Python/traceback.c
 58.65%  48417  TOTAL