Mailman 3 July 2009 - pytest-dev

[py-dev] py.test : setup / teardown at the directory level
by Philippe Fremy April 16, 2010

April 16, 2010

Hi, I was wondering if there is a possibility to have or emulate setup/teardown method for an entire directory of tests ? I have an expensive setup/teardown method, which I share through about 10 modules, each with about 20 tests. I would save time if I could do the setup/teardown just for that directory. cheers, Philippe

3 9

[py-dev] using docstrings for test descriptions
by Frederik Dohr Sept. 9, 2009

Sept. 9, 2009

Hello all, Holger's presentations at EuroPython last week convinced me that I should finally start migrating to py.test. There's only one thing I'm missing: I'm used to providing fairly detailed descriptions for individual tests ("foo returns bar if baz"). While one could use the assert statement's second argument for this, that seems cumbersome and has some undesired side-effects (e.g. reporting "E AssertionError: <description>" instead of displaying the respective values). Docstrings appear to be the obvious (and pythonic) solution. So I imagine a plugin could add docstring support, which might result in output as described here: http://gist.github.com/141977 (Being new to py.test, it is possible my expectations are misguided - don't hesitate to point out where that's the case.) I'd be willing to look into how this might be implemented; it shouldn't be too hard (e.g. using a decorator), but some pointers on how to get started would be appreciated. Thanks, Fred

2 6

[py-dev] pylib/py.test 1.0.0b9 out
by holger krekel July 31, 2009

July 31, 2009

Hi all, i've just released a 1.0.0b9 to PyPI which should fix all interactions with logging and has generally improved capturing and reporting. Below is the full changelog. If you like to help with some proof-reading, you are welcome to do a mercurial checkout (see http://codespeak.net/py/dist/download.html) go to the doc/ py/test/plugin/pytest_*.py directories and look through the text files and module docstrings from which all of the plugin docs are generated at http://codespeak.net/py/dist/test/plugin/index.html thanks & cheers, holger Changes between 1.0.0b8 and 1.0.0b9 ===================================== * cleanly handle and report final teardown of test setup * fix svn-1.6 compat issue with py.path.svnwc().versioned() (thanks Wouter Vanden Hove) * setup/teardown or collection problems now show as ERRORs or with big "E"'s in the progress lines. they are reported and counted separately. * dist-testing: properly handle test items that get locally collected but cannot be collected on the remote side - often due to platform/dependency reasons * simplified py.test.mark API - see keyword plugin documentation * integrate better with logging: capturing now by default captures test functions and their immediate setup/teardown in a single stream * capsys and capfd funcargs now have a readouterr() and a close() method (underlyingly py.io.StdCapture/FD objects are used which grew a readouterr() method as well to return snapshots of captured out/err) * make assert-reinterpretation work better with comparisons not returning bools (reported with numpy from thanks maciej fijalkowski) * reworked per-test output capturing into the pytest_iocapture.py plugin and thus removed capturing code from config object * item.repr_failure(excinfo) instead of item.repr_failure(excinfo, outerr) Changes between 1.0.0b7 and 1.0.0b8 ===================================== * pytest_unittest-plugin is now enabled by default * introduced pytest_keyboardinterrupt hook and refined pytest_sessionfinish hooked, added tests. * workaround a buggy logging module interaction ("closing already closed files"). Thanks to Sridhar Ratnakumar for triggering. * if plugins use "py.test.importorskip" for importing a dependency only a warning will be issued instead of exiting the testing process. * many improvements to docs: - refined funcargs doc , use the term "factory" instead of "provider" - added a new talk/tutorial doc page - better download page - better plugin docstrings - added new plugins page and automatic doc generation script * fixed teardown problem related to partially failing funcarg setups (thanks MrTopf for reporting), "pytest_runtest_teardown" is now always invoked even if the "pytest_runtest_setup" failed. * tweaked doctest output for docstrings in py modules, thanks Radomir. Changes between 1.0.0b3 and 1.0.0b7 ============================================= * renamed py.test.xfail back to py.test.mark.xfail to avoid two ways to decorate for xfail * re-added py.test.mark decorator for setting keywords on functions (it was actually documented so removing it was not nice) * remove scope-argument from request.addfinalizer() because request.cached_setup has the scope arg. TOOWTDI. * perform setup finalization before reporting failures * apply modified patches from Andreas Kloeckner to allow test functions to have no func_code (#22) and to make "-k" and function keywords work (#20) * apply patch from Daniel Peolzleithner (issue #23) * resolve issue #18, multiprocessing.Manager() and redirection clash * make __name__ == "__channelexec__" for remote_exec code Changes between 1.0.0b1 and 1.0.0b3 ============================================= * plugin classes are removed: one now defines hooks directly in conftest.py or global pytest_*.py files. * added new pytest_namespace(config) hook that allows to inject helpers directly to the py.test.* namespace. * documented and refined many hooks * added new style of generative tests via pytest_generate_tests hook that integrates well with function arguments. Changes between 0.9.2 and 1.0.0b1 ============================================= * introduced new "funcarg" setup method, see doc/test/funcarg.txt * introduced plugin architecuture and many new py.test plugins, see doc/test/plugins.txt * teardown_method is now guaranteed to get called after a test method has run. * new method: py.test.importorskip(mod,minversion) will either import or call py.test.skip() * completely revised internal py.test architecture * new py.process.ForkedFunc object allowing to fork execution of a function to a sub process and getting a result back. XXX lots of things missing here XXX Changes between 0.9.1 and 0.9.2 =============================== * refined installation and metadata, created new setup.py, now based on setuptools/ez_setup (thanks to Ralf Schmitt for his support). * improved the way of making py.* scripts available in windows environments, they are now added to the Scripts directory as ".cmd" files. * py.path.svnwc.status() now is more complete and uses xml output from the 'svn' command if available (Guido Wesdorp) * fix for py.path.svn* to work with svn 1.5 (Chris Lamb) * fix path.relto(otherpath) method on windows to use normcase for checking if a path is relative. * py.test's traceback is better parseable from editors (follows the filenames:LINENO: MSG convention) (thanks to Osmo Salomaa) * fix to javascript-generation, "py.test --runbrowser" should work more reliably now * removed previously accidentally added py.test.broken and py.test.notimplemented helpers. * there now is a py.__version__ attribute Changes between 0.9.0 and 0.9.1 =============================== This is a fairly complete list of changes between 0.9 and 0.9.1, which can serve as a reference for developers. * allowing + signs in py.path.svn urls [39106] * fixed support for Failed exceptions without excinfo in py.test [39340] * added support for killing processes for Windows (as well as platforms that support os.kill) in py.misc.killproc [39655] * added setup/teardown for generative tests to py.test [40702] * added detection of FAILED TO LOAD MODULE to py.test [40703, 40738, 40739] * fixed problem with calling .remove() on wcpaths of non-versioned files in py.path [44248] * fixed some import and inheritance issues in py.test [41480, 44648, 44655] * fail to run greenlet tests when pypy is available, but without stackless [45294] * small fixes in rsession tests [45295] * fixed issue with 2.5 type representations in py.test [45483, 45484] * made that internal reporting issues displaying is done atomically in py.test [45518] * made that non-existing files are igored by the py.lookup script [45519] * improved exception name creation in py.test [45535] * made that less threads are used in execnet [merge in 45539] * removed lock required for atomical reporting issue displaying in py.test [45545] * removed globals from execnet [45541, 45547] * refactored cleanup mechanics, made that setDaemon is set to 1 to make atexit get called in 2.5 (py.execnet) [45548] * fixed bug in joining threads in py.execnet's servemain [45549] * refactored py.test.rsession tests to not rely on exact output format anymore [45646] * using repr() on test outcome [45647] * added 'Reason' classes for py.test.skip() [45648, 45649] * killed some unnecessary sanity check in py.test.collect [45655] * avoid using os.tmpfile() in py.io.fdcapture because on Windows it's only usable by Administrators [45901] * added support for locking and non-recursive commits to py.path.svnwc [45994] * locking files in py.execnet to prevent CPython from segfaulting [46010] * added export() method to py.path.svnurl * fixed -d -x in py.test [47277] * fixed argument concatenation problem in py.path.svnwc [49423] * restore py.test behaviour that it exits with code 1 when there are failures [49974] * don't fail on html files that don't have an accompanying .txt file [50606] * fixed 'utestconvert.py < input' [50645] * small fix for code indentation in py.code.source [50755] * fix _docgen.py documentation building [51285] * improved checks for source representation of code blocks in py.test [51292] * added support for passing authentication to py.path.svn* objects [52000, 52001] * removed sorted() call for py.apigen tests in favour of [].sort() to support Python 2.3 [52481] -- Metaprogramming, Python, Testing: http://tetamap.wordpress.com Python, PyPy, pytest contracting: http://merlinux.eu

1 0

[py-dev] 1.0.0b8 out
by holger krekel July 23, 2009

July 23, 2009

Hi all, i just put a new 1.0.0.b8 release to PyPI, find below a list of changes. Documentation is also updated majorly - there now is an auto-generated list of pages for each plugin, just go to http://pytest.org and look around. And let me know of any issues. have fun, and thanks to all who helped. holger list of changes 1.0.0b7 to 1.0.0b8: * pytest_unittest-plugin is now enabled by default * introduced pytest_keyboardinterrupt hook and refined pytest_sessionfinish hook, added tests. * workaround a buggy logging module interaction ("closing already closed files"). Thanks to Sridhar Ratnakumar for triggering. * if plugins use "py.test.importorskip" for importing a dependency only a warning will be issued instead of exiting the testing process. * many improvements to docs: - refined funcargs doc , use the term "factory" instead of "provider" - added a new talk/tutorial doc page - better download page - better plugin docstrings - added new plugins page and automatic doc generation script * fixed teardown problem related to partially failing funcarg setups (thanks MrTopf for reporting), "pytest_runtest_teardown" is now always invoked even if the "pytest_runtest_setup" failed. * tweaked doctest output for docstrings in py modules, thanks Radomir. -- Metaprogramming, Python, Testing: http://tetamap.wordpress.com Python, PyPy, pytest contracting: http://merlinux.eu

2 4

[py-dev] hook ideas for better use/abuse of txspecs and distribution
by Ronny Pfannschmidt July 22, 2009

July 22, 2009

Hi, i propose 2 new hooks to deal with more intresting aspects of test distribution and txspecs 1. pytest_generate_gateways(config/session) -> list of execnet gateways this hook is supposed to generate the execnet gateways for test execution the default implementation is supposed to just do what py.test currently does howevers users should be free to generate own gateways to custom set up things like virtualenvs on local or remote computers and be able to combine txspecs with own options 2. pytest_select_gateways(test, list of gateways) -> list of gateways this hook is supposed to select the gateways each test is supposed to run on the default implementation should pass a test to all of them or distribute them reasonable the api for this one probably needs a few more idea since i think my initial proposal is not adequate for all uses Regards Ronny

2 4

[py-dev] Problem with py.lib and heapy
by Vineet Jain July 22, 2009

July 22, 2009

I was trying to use heapy (http://guppy-pe.sourceforge.net/)<http://guppy-pe.sourceforge.net/> on my application (which uses py.log and py.test) to try and find some memory leaks. I can't seem to get it to work with py.lib (see exception trace at the end of the email). Can someone please guide me on how to just install py.log (and it's minimum requirements)? I tried downloading the tar and removed all the extra packages in setup.py, however, that failed. Currently I have py.log commented out while I'm debugging my memory leaks. hp = hpy() File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/__init__.py", line 37, in hpy return r.guppy.heapy.Use File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 45, in __getattr__ return self._share.getattr(self, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 195, in getattr d = self.getattr2(inter, cache, owner, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 213, in getattr2 x = self.getattr_package(inter, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 261, in getattr_package x = self.makeModule(x, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 321, in makeModule return Share(module, self, module.__name__, Clamp) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 184, in __init__ getattr(inter, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 45, in __getattr__ return self._share.getattr(self, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 195, in getattr d = self.getattr2(inter, cache, owner, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 215, in getattr2 x = self.getattr3(inter, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 283, in getattr3 pa = getattr(pa, at) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 45, in __getattr__ return self._share.getattr(self, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 195, in getattr d = self.getattr2(inter, cache, owner, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 213, in getattr2 x = self.getattr_package(inter, name) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/etc/Glue.py", line 250, in getattr_package x = __import__(self.makeName(name), globals(), locals()) File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/heapy/View.py", line 555, in <module> prime_builtin_types() File "/usr/lib/python2.5/site-packages/guppy-0.1.9-py2.5-linux-x86_64.egg/guppy/heapy/View.py", line 546, in prime_builtin_types for t in mod.__dict__.values(): File "/usr/lib/python2.5/site-packages/py-0.9.1-py2.5.egg/py/initpkg.py", line 216, in getdict assert not self.__map__, "%r not empty" % self.__map__ AssertionError: {'greenlet': ('./magic/greenlet.py', 'greenlet')} not empty

2 1

[py-dev] py.test and logging issue: ValueError: I/O operation on closed file
by Sridhar Ratnakumar July 22, 2009

July 22, 2009

holger and others, do you have any comments to add to this bug? http://bugs.python.org/issue6333 -srid

3 5

[py-dev] execnet py.test teardown issue
by Gordon Wrigley July 15, 2009

July 15, 2009

Hi Holger I have produced a minimal reproduction for my one remaining issue. To reproduce put the following into a file and run it with py.test import py a = None def test_function(): global a a = py.execnet.SshGateway("localhost").remote_exec("pass") As before the problem only reproduces on my test machine not on my development machine. On my test machine it produces: Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=1 open>> ignored Additionally it only reproduces inside py.test. Now that I know what it is it can be trivially fixed by del'ing the global variable at the end of the test. I am however curious about the difference in behavior on the two machines and I would also like to know if you consider this a problem or if it is just that pushing a channel into the global namespace is a bad idea. It is probably worth noting that in the full system what I pushed into the global namespace wasn't a channel but a utility class that happened to have a reference to a channel, so it wasn't quite as braindead as it looks. Gordon > development machine: > > gordonw@gohma:~$ uname -a > Linux gohma 2.6.28-13-generic #45-Ubuntu SMP Tue Jun 30 19:49:51 UTC > 2009 i686 GNU/Linux > gordonw@gohma:~$ python > Python 2.6.2 (release26-maint, Apr 19 2009, 01:56:41) > [GCC 4.3.3] on linux2 > Type "help", "copyright", "credits" or "license" for more information. >>>> import py >>>> py.version > '1.0.0b7' > test machine: > > lab@okum:~$ uname -a > Linux okum 2.6.28-11-generic #42-Ubuntu SMP Fri Apr 17 01:57:59 UTC > 2009 i686 GNU/Linux > lab@okum:~$ python > Python 2.6.2 (release26-maint, Apr 19 2009, 01:56:41) > [GCC 4.3.3] on linux2 > Type "help", "copyright", "credits" or "license" for more information. >>>> import py >>>> py.version > '1.0.0b1'

1 0

[py-dev] execnet: shutdown issues in a heavily threaded environment
by Gordon Wrigley July 15, 2009

July 15, 2009

> One issue that can pop up is tearing down the whole > machinery cleanly - that can sometimes be more > involved and i believe execnet still might need > some more work there. On that note can you shed any light on this message: Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel._del_ of <Channel id=7 open>> ignored Currently I'm only seeing them on my test machine, but they are occurring very frequently, they drop out at the end of the py.test invocation, I will paste the tail end of the py.test output below. I'm not sure exactly what is causing this, naively it seems to indicate a circular chain of references involving one or more channels. However immediately prior to the conclusion of each test exit gc.garbage is empty and there are none of my objects in gc.get_objects. Also this only started when I reworked our remote invocation system recently, the most notable change in the new system is that it makes more use of threads and particularly it has daemon threads waiting on channel receive calls. lab@okum:~$ uname -a Linux okum 2.6.28-11-generic #42-Ubuntu SMP Fri Apr 17 01:57:59 UTC 2009 i686 GNU/Linux lab@okum:~$ python Python 2.6.2 (release26-maint, Apr 19 2009, 01:56:41) [GCC 4.3.3] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import py >>> py.version '1.0.0b1' ============================================== 35 passed in 231.71 seconds =============================================== Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in Unhandled exception in thread started by <bound method Thread.__bootstrap of <Thread(receiver, stopped daemon 1177635728)>> <bound method Channel.__del__ of <Channel id=7 open>>Error in sys.excepthook: Traceback (most recent call last): File "/usr/lib/python2.6/dist-packages/apport_python_hook.py", line 38, in apport_excepthook from apport.packaging_impl import impl as packaging ImportError: No module named apport.packaging_impl Original exception was: Traceback (most recent call last): File "/usr/lib/python2.6/threading.py", line 497, in __bootstrap self.__bootstrap_inner() File "/usr/lib/python2.6/threading.py", line 538, in __bootstrap_inner (self.name, _format_exc())) TypeError: 'NoneType' object is not callable ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored Exception AttributeError: "'NoneType' object has no attribute 'CHANNEL_CLOSE'" in <bound method Channel.__del__ of <Channel id=7 open>> ignored

2 3

[py-dev] ANN: oejskit 0.8.5 JavaScript in-browser testing and utility kit with py.test plugin
by Samuele Pedroni July 13, 2009

July 13, 2009

jskit contains infrastructure and in particular a py.test plugin to enable running unit tests for JavaScript code inside browsers. The plugin requires py.test 1.0 The approach also enables to write integration tests such that the JavaScript code is tested against server-side Python code mocked as necessary. Any server-side framework that can already be exposed through WSGI can play. More information and downloading at: http://pypi.python.org/pypi/oejskit including documentation and the talk I gave at Europython. jskit was initially developed by Open End AB and is released under the MIT license. In various incarnations it has been in use and useful at Open End for more than a year, we are quite happy to share it. Samuele Pedroni for Open End

1 0