Mailman 3 September 2010 - pytest-dev

[py-dev] py.test api - Running tests in a module object?
by Sridhar Ratnakumar Nov. 29, 2010

Nov. 29, 2010

I am trying to run py.test on a given module object dynamically. mod = __import__('company.foo.somemod') py.test.run(mod) A quick glance in the py.test source doesn't seem like a trivial thing. IPython introspection did not give me any clue either. Is there a way to do this at all? I did try py.test.cmdline.main(['...']), but that accepts only file path, not the Python module object itself. -srid

2 5

[py-dev] do you mind the issue-postings here?
by holger krekel Oct. 12, 2010

Oct. 12, 2010

Hi all, am wondering: do you mind seeing new bitbucket issue creations here on the mailing list? If so i'll create a new mailing list pypy-issue or so and have things rather sent there. Just let me know. Personally i find it a bit unfortuante that the many closed/resolved issues are not notified to this list as well :) cheers, holger

2 1

[py-dev] controlling assertions and difflib
by Floris Bruynooghe Oct. 5, 2010

Oct. 5, 2010

Hi As Holger pointed out the following test hangs py.test in my assertion clone, it triggers a bug in difflib: def test_hang_in_diff(): x = "1\n" * 1000 + "abc" + "2\n" * 1000 y = "1\n" * 1000 + "def" + "2\n" * 1000 assert x == y It seems difflib can not deal with the 1000 identical trailing items. It fails with a TypeError somewhere very deep in a recursion or, when consuming the generator inside a list comprehension, just completely hangs. Also before failing it considers all the 2s as different too. Rather then debugging difflib (there are several possible bugs on bugs.python.org which might relate to this) I've come up with some code that does produce this instead: ______________________________ test_hang_in_diff _______________________________ /tmp/sandbox/test_bugs.py:4: in test_hang_in_diff > assert x == y E assert '1\n1\n1\n1\n...n2\n2\n2\n2\n' == '1\n1\n1\n1\n...n2\n2\n2\n2\n' E Skipping 1990 identical leading characters in diff E Skipping 1991 identical trailing characters in diff E 1 E 1 E 1 E 1 E 1 E - abc2 E + def2 E 2 E 2 E 2 E 2 Another solution is to use context_diff() which does not have this problem, but for some reason also considers all the trailing 2s to be different. Additionally context diff also doesn't provide the nice markers for differences inside a line which might be problematic as there's no guarantee there will be nice line endings in the input. In general I was already thinking of cutting off similar prefixes and suffixes before using ndiff, so this doesn't seem that bad to me. Do others think this is acceptable? This whole issue made me wonder if it should be possible to disable the pytest_assert_binrepr hook. It is probably sufficient to add an option which can be checked right at the start of the builtin pytest_assert_binrepr hook which will just return None or [] right away. But what is the best way to access the config setting from there? Is it fine to use py.test.config or should the setting be piggy-backed on some global again (e.g. change the current py.builtin.builtins.AssertionError._pytesthook into a ._pytestconfig)? Or maybe there's a more elegant solution for this that I'm unaware of? Regards Floris -- Debian GNU/Linux -- The Power of Freedom www.debian.org | www.gnu.org | www.kernel.org

2 4

[py-dev] New issue 124 in py-trunk: disabling capture makes the capfd funcarg break py.test
by issues-noreply＠bitbucket.org Sept. 30, 2010

Sept. 30, 2010

--- you can reply above this line --- New issue 124: disabling capture makes the capfd funcarg break py.test http://bitbucket.org/hpk42/py-trunk/issue/124/disabling-capture-makes-the-c… Ronny Pfannschmidt / RonnyPfannschmidt on Thu, 30 Sep 2010 16:33:58 +0200: Description: the bottom line is getting a invalid fd in the terminalwriter {{{ #!text $ py.test -v testing/ -k test_stdouterrin_setnull inserting into sys.path: /home/ronny/Projects/py ==================================================================== test session starts ==================================================================== platform linux2 -- Python 2.6.5 -- pytest-1.4.0a1 -- /usr/bin/python gateway test setup scope: session execnet: /home/ronny/Projects/execnet/execnet/__init__.pyc -- 1.0.9.dev0 test path 1: testing/ testing/test_basics.py:145: test_stdouterrin_setnull PASSED ==================================================== 324 tests deselected by 'test_stdouterrin_setnull' ===================================================== ========================================================= 1 passed, 324 deselected in 0.27 seconds ========================================================== 16:28:15 | ~/Projects/execnet $ py.test -v testing/ -ks test_stdouterrin_setnull inserting into sys.path: /home/ronny/Projects/py ==================================================================== test session starts ==================================================================== platform linux2 -- Python 2.6.5 -- pytest-1.4.0a1 -- /usr/bin/python gateway test setup scope: session execnet: /home/ronny/Projects/execnet/execnet/__init__.pyc -- 1.0.9.dev0 ERROR: file not found: /home/ronny/Projects/execnet/test_stdouterrin_setnull 16:28:20 | ~/Projects/execnet $ py.test -vs -k test_stdouterrin_setnull inserting into sys.path: /home/ronny/Projects/py ==================================================================== test session starts ==================================================================== platform linux2 -- Python 2.6.5 -- pytest-1.4.0a1 -- /usr/bin/python gateway test setup scope: session execnet: /home/ronny/Projects/execnet/execnet/__init__.pyc -- 1.0.9.dev0 test path 1: /home/ronny/Projects/execnet testing/test_basics.py:145: test_stdouterrin_setnull Traceback (most recent call last): File "/home/ronny/Projects/py/bin/py.test", line 3, in <module> py.cmdline.pytest() File "/home/ronny/Projects/py/py/_cmdline/pytest.py", line 5, in main raise SystemExit(py.test.cmdline.main(args)) File "/home/ronny/Projects/py/py/_test/session.py", line 21, in main exitstatus = config.hook.pytest_cmdline_main(config=config) File "/home/ronny/Projects/py/py/_test/pluginmanager.py", line 352, in __call__ return self.hookrelay._performcall(self.name, mc) File "/home/ronny/Projects/py/py/_test/pluginmanager.py", line 338, in _performcall return multicall.execute() File "/home/ronny/Projects/py/py/_test/pluginmanager.py", line 244, in execute res = method(**kwargs) File "/home/ronny/Projects/py/py/_plugin/pytest_default.py", line 8, in pytest_cmdline_main return Session(config).main() File "/home/ronny/Projects/py/py/_test/session.py", line 77, in main self.config.pluginmanager.notify_exception(excinfo) File "/home/ronny/Projects/py/py/_test/pluginmanager.py", line 166, in notify_exception return self.hook.pytest_internalerror(excrepr=excrepr) File "/home/ronny/Projects/py/py/_test/pluginmanager.py", line 352, in __call__ return self.hookrelay._performcall(self.name, mc) File "/home/ronny/Projects/py/py/_test/pluginmanager.py", line 338, in _performcall return multicall.execute() File "/home/ronny/Projects/py/py/_test/pluginmanager.py", line 244, in execute res = method(**kwargs) File "/home/ronny/Projects/py/py/_plugin/pytest_terminal.py", line 120, in pytest_internalerror self.write_line("INTERNALERROR> " + line) File "/home/ronny/Projects/py/py/_plugin/pytest_terminal.py", line 112, in write_line self._tw.line(line, **markup) File "/home/ronny/Projects/py/py/_io/terminalwriter.py", line 182, in line self.write(s, **kw) File "/home/ronny/Projects/py/py/_io/terminalwriter.py", line 168, in write self._file.flush() IOError: [Errno 9] Bad file descriptor Responsible: hpk42 -- This is an issue notification from bitbucket.org. You are receiving this either because you are the owner of the issue, or you are following the issue.

1 0

[py-dev] New issue 123 in py-trunk: new invocation: "python -m py.test"
by issues-noreply＠bitbucket.org Sept. 29, 2010

Sept. 29, 2010

--- you can reply above this line --- New issue 123: new invocation: "python -m py.test" http://bitbucket.org/hpk42/py-trunk/issue/123/new-invocation-python-m-pytest holger krekel / hpk42 on Wed, 29 Sep 2010 15:52:19 +0200: Description: As with unittest2 and other tools it'd be nice to be able to call py.test without invoking an extra command line tool. For example, on Windows/Jython setuptools/distutils does not even create working command line tool scripts (known issue). Responsible: hpk42 -- This is an issue notification from bitbucket.org. You are receiving this either because you are the owner of the issue, or you are following the issue.

1 0

[py-dev] New issue 122 in py-trunk: store/reuse the state of a last run from a previous session dir
by issues-noreply＠bitbucket.org Sept. 28, 2010

Sept. 28, 2010

--- you can reply above this line --- New issue 122: store/reuse the state of a last run from a previous session dir http://bitbucket.org/hpk42/py-trunk/issue/122/store-reuse-the-state-of-a-la… Ronny Pfannschmidt / RonnyPfannschmidt on Tue, 28 Sep 2010 16:33:23 +0200: Description: taking failures/not yet executed items from the last session dir could help in various cases to prevent tests from rerunning Responsible: hpk42 -- This is an issue notification from bitbucket.org. You are receiving this either because you are the owner of the issue, or you are following the issue.

1 0

[py-dev] New issue 121 in py-trunk: py.test seems gather tests from upper directories
by issues-noreply＠bitbucket.org Sept. 27, 2010

Sept. 27, 2010

--- you can reply above this line --- New issue 121: py.test seems gather tests from upper directories http://bitbucket.org/hpk42/py-trunk/issue/121/pytest-seems-gather-tests-fro… bluebird75 on Mon, 27 Sep 2010 11:35:10 +0200: Description: I don't know what's wrong with my setup, but since I upgraded py.test , it no longer restrict itself to the current directory and subdirectories, it looks up for other directories. {{{ #!bash hilippe@pc-philippe /cygdrive/d/work/elc-dev $ ls -d elc* elc-memory/ elc-py26/ elc-work-fh1/ elc2/ elc-merge-linkchecker/ elc-ref/ elc1/ elc3/ Philippe@pc-philippe /cygdrive/d/work/elc-dev $ cd elc1 Philippe@pc-philippe /cygdrive/d/work/elc-dev/elc1 $ py.test 2010-09-27 11:30:59,592 5404 INFO elc.ElcLogger init_logging_local done C:\Python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_plugin\pytest_default.py:57: DeprecationWarning: <class 'conftest.Directory'> was found in a conftest.py file, use pytest_collect hooks instead. (since version >1.1) Directory = parent.config._getcollectclass('Directory', path) Traceback (most recent call last): File "c:\Python26\Scripts\py.test-script.py", line 8, in <module> load_entry_point('py==1.3.4', 'console_scripts', 'py.test')() File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_cmdline\pytest.py", line 5, in main raise SystemExit(py.test.cmdline.main(args)) File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\cmdline.py", line 16, in main colitems = config.getinitialnodes() File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\config.py", line 158, in getinitialnodes return [self.getnode(arg) for arg in self.args] File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\config.py", line 173, in getnode return self._rootcol.getbynames(names) File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\collect.py", line 388, in getbynames for x in current._memocollect(): File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\collect.py", line 230, in _memocollect return self._memoizedcall('_collected', self.collect) File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\collect.py", line 104, in _memoizedcall res = function() File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\collect.py", line 300, in collect res = self.consider(path) File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\collect.py", line 309, in consider if self.ihook.pytest_ignore_collect(path=path, config=self.config): File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\collect.py", line 21, in call_matching_hooks return hookmethod.pcall(plugins, **kwargs) File "C:\Python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\pluginmanager.py", line 354, in pcall return self.hookrelay._performcall(self.name, mc) File "C:\Python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\pluginmanager.py", line 335, in _performcall return multicall.execute() File "C:\Python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\pluginmanager.py", line 244, in execute res = method(**kwargs) File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_plugin\pytest_default.py", line 32, in pytest_ignore_collect ignore_paths = config.getconftest_pathlist("collect_ignore", path=path) File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\config.py", line 195, in getconftest_pathlist mod, relroots = self._conftest.rget_with_confmod(name, path) File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\conftesthandle.py", line 88, in rget_with_confmod modules = self.getconftestmodules(path) File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\conftesthandle.py", line 72, in getconftestmodules clist.append(self.importconftest(conftestpath)) File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_test\conftesthandle.py", line 108, in importconftest mod = conftestpath.pyimport() File "c:\python26\lib\site-packages\py-1.3.4-py2.6.egg\py\_path\local.py", line 540, in pyimport raise self.ImportMismatchError(modname, modfile, self) py._path.local.ImportMismatchError: ('conftest', 'd:\\work\\elc-dev\\Copy of git-linkchecker\\conftest.py', local('d:\\work\\elc-dev\\elc-memory\\conftest.py')) Philippe@pc-philippe /cygdrive/d/work/elc-dev/elc1 $ }}} The errors reported below belong to other directories than elc1. I have a conftest.py in elc1: {{{ #!python Philippe@pc-philippe /cygdrive/d/work/elc-dev/elc1 $ cat conftest.py # this module is loaded by py.test before running the tests import fix_path import elcloginit import tests.httpd_utils as httpd_utils from tests.setupDbTestEnv import SetupDbTestEnv, envDict collect_ignore = [ 'elc_linkchecker/linkchecker/' ] DB_TEST_ENV = None def pytest_namespace(): global DB_TEST_ENV DB_TEST_ENV = SetupDbTestEnv() envDict[ 'dbTestEnv' ] = DB_TEST_ENV return envDict def pytest_sessionstart( session ): # print 'pytest_sessionstart' DB_TEST_ENV.setup() def pytest_sessionfinish( session, exitstatus ): # print 'pytest_sessionfinish' DB_TEST_ENV.teardown() pass }}} Responsible: hpk42 -- This is an issue notification from bitbucket.org. You are receiving this either because you are the owner of the issue, or you are following the issue.

1 0

[py-dev] Advanced assert equal
by Floris Bruynooghe Sept. 22, 2010

Sept. 22, 2010

Hi Ever since unittest grew it's .assertSequenceEqual() and .assertMultilineEqual() I've been jealous of it. So this weekend I've looked into the py.test code and made an attempt at getting this into my favourite testing tool. The attached patch makes compare equal a special case and checks if the two arguments to it are both a list, text or dict and tries to generate a nicer explanation text for them. The patch is more like a proof of concept then a final implementation, I may have done some very strange or silly things as I'm not familiar with the code. It would be great to get feedback, both on the general concept and the actual implementation (particularly note the way I had to hack _format_explanation() in assertion.py). Some of the rough edges I can think off right now: (i) no idea how comparisons and nested calls work together, (ii) no attempt is made to limit the output from difflib so the screen doesn't get flooded. There's probably many more. I hope this can be useful Floris -- Debian GNU/Linux -- The Power of Freedom www.debian.org | www.gnu.org | www.kernel.org

3 10

[py-dev] pylib/py.test 1.3.4: fixes and new native traceback option
by holger krekel Sept. 14, 2010

Sept. 14, 2010

pylib/py.test 1.3.4 is a minor maintenance release mostly containing bug fixes and a new "--tb=native" traceback option to show "normal" Python standard tracebacks instead of the py.test enhanced tracebacks. See below for more change info and http://pytest.org for more general information on features and configuration of the testing tool. Thanks to the issue reporters and generally to Ronny Pfannschmidt for help. cheers, holger krekel Changes between 1.3.3 and 1.3.4 ================================================== - fix issue111: improve install documentation for windows - fix issue119: fix custom collectability of __init__.py as a module - fix issue116: --doctestmodules work with __init__.py files as well - fix issue115: unify internal exception passthrough/catching/GeneratorExit - fix issue118: new --tb=native for presenting cpython-standard exceptions --

1 0

[py-dev] New issue 120 in py-trunk: Add collect_include option to complement collect_ignore option.
by issues-noreply＠bitbucket.org Sept. 14, 2010

Sept. 14, 2010

--- you can reply above this line --- New issue 120: Add collect_include option to complement collect_ignore option. http://bitbucket.org/hpk42/py-trunk/issue/120/add-collect_include-option-to… sorin on Tue, 14 Sep 2010 15:20:15 +0200: Description: On big/huge project people may want to scan only some directories, and in order to obtain this the current `collect_ignore` list is not enough. Adding tons of directories to `collect_ignore` may not be the best practice instead of just adding the locations you want to be scanned. I would like to propose the addition of `collect_include` option that would allow only the files matching the patterns from it to be scanned. Responsible: hpk42 -- This is an issue notification from bitbucket.org. You are receiving this either because you are the owner of the issue, or you are following the issue.

1 0