[soc2008-general] unit testing the standard library

[Brett Cannon]

On Mon, Mar 24, 2008 at 4:29 AM, Filippo Giunchedi <fgiunchedi at gmail.com> wrote:
> Hello Brett,
>
>
>  On Sun, Mar 23, 2008 at 12:01:27PM -0700, Brett Cannon wrote:
>  > >
>  > >  From the above list and looking at today's trunk it is my understanding that the
>  > >  old style (output-comparison) tests are gone, is that correct?
>  > >
>  >
>  > Yep. They disappeared at PyCon this year.
>
>  Great, I've updated the wiki [0] accordingly.
>
>
>  >
>  > >  Following the same list, what is the status of the other items? Like black/white
>  > >  box testing for other implementations and reorganization of regrtest.py to move
>  > >  more information inside the tests ?
>  > >
>  >
>  > Beyond being ideas in my head I have discussed with some people, they
>  > have not gone anywhere. =)
>
>  Do you think there's enough material for a GSoC proposal? Or perhaps more should
>  be added? If so I'd like to come up with a project and hopefully find a mentor.
>

Possibly. We need:

* A function that imports the module being tested so that if it isn't
imported the test is skipped, but all other import failures are an
error.
* Some way to specify what OSs the test can be run on, both expected
and optionally.
* A way to denote whitebox tests specific for CPython.
* Rewrite regrtest to use all of this new stuff.

That's everything I ever had an idea for. Most of it, though, is not
overly complex (maybe the regrtest rewrite since that file has grown
organically).

-Brett