Mailman 3 June 2013 - Python-Dev

python symbolizition
by Pynix Wang 14 Jun '13

14 Jun '13

1.lambda expression c# a.(x, y) => x == y b.() => SomeMethod() ruby: -> {|msg| puts msg} python can use c# like and remove "lambda" keyword. 2.global variable ruby $glo_var python can use $ or @ or another and remove "global".

4 3

Re: [Python-Dev] cpython: Move test_pep352 over to unittest.main()
by Serhiy Storchaka 14 Jun '13

14 Jun '13

14.06.13 04:18, brett.cannon написав(ла): > http://hg.python.org/cpython/rev/af27c661d4fb > changeset: 84115:af27c661d4fb > user: Brett Cannon <brett(a)python.org> > date: Thu Jun 13 21:18:43 2013 -0400 > summary: > Move test_pep352 over to unittest.main() You forgot about: from test.support import run_unittest

1 0

Re: [Python-Dev] cpython: fixd refleak
by Antoine Pitrou 13 Jun '13

13 Jun '13

On Mon, 10 Jun 2013 10:47:28 +0200 (CEST) christian.heimes <python-checkins(a)python.org> wrote: > http://hg.python.org/cpython/rev/6860263c05b3 > changeset: 84077:6860263c05b3 > user: Christian Heimes <christian(a)cheimes.de> > date: Mon Jun 10 10:47:22 2013 +0200 > summary: > fixd refleak > [...] > - return Py_BuildValue("(OOOO)", ofile_env, ofile, odir_env, odir); > + if ((tup = PyTuple_New(4)) == NULL) { > + goto error; > + } > + PyTuple_SET_ITEM(tup, 0, ofile_env); > + PyTuple_SET_ITEM(tup, 1, ofile); > + PyTuple_SET_ITEM(tup, 2, odir_env); > + PyTuple_SET_ITEM(tup, 3, odir); > + return tup; How about return Py_BuildValue("NNNN", ofile_env, ofile, odir_env, odir); ?

2 2

ssl improvements and testing question
by Christian Heimes 13 Jun '13

13 Jun '13

Hi, I'm working on a couple of improvements for the ssl module: http://bugs.python.org/issue17134 http://bugs.python.org/issue18138 http://bugs.python.org/issue18143 http://bugs.python.org/issue18147 #17134 is going to provide a way to use Window's crypt32.dll to load CA certs from Window's CA cert storage. I have a working proof of concept [1] that uses ctypes to interface crypt32.dll. I'll reimplement the code in C. #18138 implements the bits and pieces for #17134 in order to add DER and PEM certs from memory (ASCII unicode or Py_Buffer). Until now the ssl module can only load files from the file system. #18143 and #18147 are diagnostic and debugging helpers that I would like to add. The SSLContext() object is black box. You stuff in some PEM files and don't know which CA certs have been loaded. The enhancements implement a function to retrieve a list of CA certs (same format as getpeercert()) and list of default CA locations for the platform. I'm also thinking about OCSP support and X509v3 extension support for _decode_certificate(). Both are a PITB ... Python has an easier and better documented C API. Question: What's the minimum version of OpenSSL Python 3.4 is going to support? Do we have an easy way to compile and link Python against a custom installation of OpenSSL or do I have to fiddle around with CPPFLAGS and CFLAGS? Christian [1] https://pypi.python.org/pypi/wincertstore

2 1

Enhancement of Python memory allocators
by Victor Stinner 13 Jun '13

13 Jun '13

Hi, I would like to improve memory allocators of Python. My two use cases are replacing memory allocators with custom allocators in embedded system and hooking allocators to track usage of memory. I wrote a patch for this, I'm going to commit it if nobody complains: http://bugs.python.org/issue3329 Using this patch, detecting memory corruptions (buffer underflow and overflow) can be done without recompilation. We may add an environment variable to enable Python debug functions at runtime, example: PYDEBUGMALLOC=1. There is just a restriction: the environment variable would not be ignored with -E command line option, because command line options are parsed after the first memory allocation. What do you think? ***** The patch adds the following functions: void PyMem_GetAllocators( void **ctx_p, void* (**malloc_p) (void *ctx, size_t size), void* (**realloc_p) (void *ctx, void *ptr, size_t size), void (**free_p) (void *ctx, void *ptr)); void PyMem_SetAllocators( void *ctx, void* (*malloc) (void *ctx, size_t size), void* (*realloc) (void *ctx, void *ptr, size_t size), void (*free) (void *ctx, void *ptr)); It adds 4 similar functions (get/set) for PyObject_Malloc() and allocators of pymalloc arenas. ***** For the "track usage of memory" use case, see the following project which hooks memory allocators using PyMem_SetAllocators() and PyObject_SetAllocators() to get allocated bytes per filename and line number. https://pypi.python.org/pypi/pytracemalloc ***** Another issue proposes to use VirtualAlloc() and VirtualFree() for pymalloc arenas, see: http://bugs.python.org/issue13483 I don't know if it would be interesting, but it would now possible to choose the memory allocator (malloc, mmap, HeapAlloc, VirtualAlloc, ...) at runtime, with an environment variable for example. Victor

2 4

Re: [Python-Dev] [Python-checkins] cpython: Move test___all__ over to unittest.main() and use ModuleNotFoundError
by Brett Cannon 13 Jun '13

13 Jun '13

Obviously the commit message is a little misleading since changes I was about to stage accidentally went in on this change. Sorry about that. Same basic concept of the changes, just to more modules. On Wed, Jun 12, 2013 at 8:12 PM, brett.cannon <python-checkins(a)python.org>wrote: > http://hg.python.org/cpython/rev/c4d7228421df > changeset: 84106:c4d7228421df > user: Brett Cannon <brett(a)python.org> > date: Wed Jun 12 20:12:30 2013 -0400 > summary: > Move test___all__ over to unittest.main() and use ModuleNotFoundError > > files: > Lib/test/regrtest.py | 16 ++++++++-------- > Lib/test/support.py | 14 +++++++------- > Lib/test/test___all__.py | 7 ++----- > Lib/xmlrpc/server.py | 2 +- > Lib/zipfile.py | 6 +++--- > 5 files changed, 21 insertions(+), 24 deletions(-) > > > diff --git a/Lib/test/regrtest.py b/Lib/test/regrtest.py > --- a/Lib/test/regrtest.py > +++ b/Lib/test/regrtest.py > @@ -146,11 +146,11 @@ > > try: > import threading > -except ImportError: > +except ModuleNotFoundError: > threading = None > try: > import multiprocessing.process > -except ImportError: > +except ModuleNotFoundError: > multiprocessing = None > > > @@ -180,7 +180,7 @@ > if sys.platform == 'darwin': > try: > import resource > - except ImportError: > + except ModuleNotFoundError: > pass > else: > soft, hard = resource.getrlimit(resource.RLIMIT_STACK) > @@ -571,7 +571,7 @@ > if findleaks: > try: > import gc > - except ImportError: > + except ModuleNotFoundError: > print('No GC available, disabling findleaks.') > findleaks = False > else: > @@ -692,7 +692,7 @@ > if use_mp: > try: > from threading import Thread > - except ImportError: > + except ModuleNotFoundError: > print("Multiprocess option requires thread support") > sys.exit(2) > from queue import Queue > @@ -1396,7 +1396,7 @@ > pic = sys.path_importer_cache.copy() > try: > import zipimport > - except ImportError: > + except ModuleNotFoundError: > zdc = None # Run unmodified on platforms without zipimport support > else: > zdc = zipimport._zip_directory_cache.copy() > @@ -1473,7 +1473,7 @@ > sys.path_importer_cache.update(pic) > try: > import zipimport > - except ImportError: > + except ModuleNotFoundError: > pass # Run unmodified on platforms without zipimport support > else: > zipimport._zip_directory_cache.clear() > @@ -1510,7 +1510,7 @@ > doctest.master = None > try: > import ctypes > - except ImportError: > + except ModuleNotFoundError: > # Don't worry about resetting the cache if ctypes is not supported > pass > else: > diff --git a/Lib/test/support.py b/Lib/test/support.py > --- a/Lib/test/support.py > +++ b/Lib/test/support.py > @@ -29,27 +29,27 @@ > > try: > import _thread, threading > -except ImportError: > +except ModuleNotFoundError: > _thread = None > threading = None > try: > import multiprocessing.process > -except ImportError: > +except ModuleNotFoundError: > multiprocessing = None > > try: > import zlib > -except ImportError: > +except ModuleNotFoundError: > zlib = None > > try: > import bz2 > -except ImportError: > +except ModuleNotFoundError: > bz2 = None > > try: > import lzma > -except ImportError: > +except ModuleNotFoundError: > lzma = None > > __all__ = [ > @@ -116,7 +116,7 @@ > with _ignore_deprecated_imports(deprecated): > try: > return importlib.import_module(name) > - except ImportError as msg: > + except ModuleNotFoundError as msg: > if sys.platform.startswith(tuple(required_on)): > raise > raise unittest.SkipTest(str(msg)) > @@ -188,7 +188,7 @@ > if not _save_and_block_module(blocked_name, orig_modules): > names_to_remove.append(blocked_name) > fresh_module = importlib.import_module(name) > - except ImportError: > + except ModuleNotFoundError: > fresh_module = None > finally: > for orig_name, module in orig_modules.items(): > diff --git a/Lib/test/test___all__.py b/Lib/test/test___all__.py > --- a/Lib/test/test___all__.py > +++ b/Lib/test/test___all__.py > @@ -75,7 +75,7 @@ > try: > import rlcompleter > import locale > - except ImportError: > + except ModuleNotFoundError: > pass > else: > locale.setlocale(locale.LC_CTYPE, 'C') > @@ -113,8 +113,5 @@ > print('Following modules failed to be imported:', > failed_imports) > > > -def test_main(): > - support.run_unittest(AllTest) > - > if __name__ == "__main__": > - test_main() > + unittest.main() > diff --git a/Lib/xmlrpc/server.py b/Lib/xmlrpc/server.py > --- a/Lib/xmlrpc/server.py > +++ b/Lib/xmlrpc/server.py > @@ -116,7 +116,7 @@ > import traceback > try: > import fcntl > -except ImportError: > +except ModuleNotFoundError: > fcntl = None > > def resolve_dotted_attribute(obj, attr, allow_dotted_names=True): > diff --git a/Lib/zipfile.py b/Lib/zipfile.py > --- a/Lib/zipfile.py > +++ b/Lib/zipfile.py > @@ -18,18 +18,18 @@ > try: > import zlib # We may need its compression method > crc32 = zlib.crc32 > -except ImportError: > +except ModuleNotFoundError: > zlib = None > crc32 = binascii.crc32 > > try: > import bz2 # We may need its compression method > -except ImportError: > +except ModuleNotFoundError: > bz2 = None > > try: > import lzma # We may need its compression method > -except ImportError: > +except ModuleNotFoundError: > lzma = None > > __all__ = ["BadZipFile", "BadZipfile", "error", > > -- > Repository URL: http://hg.python.org/cpython > > _______________________________________________ > Python-checkins mailing list > Python-checkins(a)python.org > http://mail.python.org/mailman/listinfo/python-checkins > >

1 0

Doubly linked lists in Python core?
by Skip Montanaro 11 Jun '13

11 Jun '13

I encountered this disconcerting message yesterday on a Linux system running Python 2.7.2: *** glibc detected *** /opt/local/bin/python: corrupted double-linked list: 0x0000000003b01c90 *** Of course, no core file or other information about where the problem occurred was left behind, just the raw pointer value. Running under valgrind didn't report anything obvious, at least nothing different than a run with slightly different command line parameters which didn't elicit the message. I suspect the problem actually lies in one of our C++ libraries here at work, but before I attempt any debugging gymnastics (ow! my back hurts) I thought I would check to see if Python makes much use of double linked lists in a non-debug build. I don't recall a lot from days of yore, perhaps some in the dict implementation? Thanks, Skip

3 3

new Plan 9 (and family) port of v2.7.5
by Jeff Sickel 11 Jun '13

11 Jun '13

I have a set of patches I've developed based on the 2.7 branch that provides a working port of Python 2.7.5 to Plan 9 386 and amd64 builds (an arm version is mostly working, but will need a few more updates before being hauled off on the wagon). Most of the changes, including mkfiles, are local to a Plan9 subdirectory. There are a few changes to Lib/*.py files specifically site.py and sysconfig.py to make living in a semi-POSIX world tolerable with many current Python modules. Because Plan 9 does not have shared libraries, we must link in all the C modules we want at build time. This means that I've included specific targets to pull in Mercurial sources during the compilation and linking phases. That brings us up to a current version of Mercurial 2.6.2. There is no ssh support for cloning, but we do have a viable version of https: using TLS/SSLv3 that has worked well with bitbucket. That said, I can prepare a patch from my mq work area and submit it upstream in one of various ways for review. Is there a preferred method that does not require an initial `hg clone ssh://hg@hg.python.org/cpython`? acme# pwd /usr/jas/src/cmd/cpython acme# hg sum parent: 83814:75a6bbf41cc8 plan9 qbase qtip update setup base install locations branch: 2.7 commit: 8 unknown (clean) update: 37 new changesets, 2 branch heads (merge) mq: 1 applied ac -jas

2 1

Python 3 metaclasses, doctest, and unittest
by Ethan Furman 10 Jun '13

10 Jun '13

I just wanted to take a minute and say THANK YOU to everyone involved in getting Python 3 to where it is today. It is so much easier to use, especially metaclasses (nearly pulled my hair out trying to get Enum working on Py2!). Also a big thank you to the doctest folks as it was invaluable in getting my Py2 examples correct, and, of course, the unittest folks as I would have been lost without those. Thank you thank you thank you. -- ~Ethan~ P.S. I'll get a backported package on PyPI after the code commit for 3.4.

1 0

Ordering keyword dicts
by Guido van Rossum 10 Jun '13

10 Jun '13

On Sat, May 18, 2013 at 10:27 PM, Raymond Hettinger <raymond.hettinger(a)gmail.com> wrote: > BTW, I'm +1 on the idea for ordering keyword-args. It makes > it easier to debug if the arguments show-up in the order they > were created. AFAICT, no purpose is served by scrambling them > (which is exacerbated by the new randomized hashing security feature). I'm slow at warming up to the idea. My main concern is speed -- since most code doesn't need it and function calls are already slow (and obviously very common :-) it would be a shame if this slowed down function calls that don't need it noticeably. An observation is that it's only necessary to preserve order if the function definition uses **kwds. AFAIK we currently don't know if this is the case when the call is made though, but perhaps the information could be made available to the call site somehow. There are also many special cases to consider; e.g. using **kwds in the call where kwds is an unordered dict, or calls from C, or calls to C. But maybe someone considers this a challenge and comes up with a patch? The benefits to *some* use cases would be obvious. -- --Guido van Rossum (python.org/~guido)

14 15

doctest and pickle
by Ethan Furman 09 Jun '13

09 Jun '13

Is there a doctest mailing list? I couldn't find it. I'm try to use doctest to verify my docs (imagine that!) but I'm having trouble with the one that uses pickle (imagine that!). Any advice on how to make it work? Here's the excerpt: =============================================================================== Pickling -------- Enumerations can be pickled and unpickled:: >>> from enum import Enum >>> class Fruit(Enum): ... tomato = 1 ... banana = 2 ... cherry = 3 ... >>> from pickle import dumps, loads >>> Fruit.tomato is loads(dumps(Fruit.tomato)) True The usual restrictions for pickling apply: picklable enums must be defined in the top level of a module, since unpickling requires them to be importable from that module. =============================================================================== Oh, and I just realized this is probably why the flufl.enum docs import from a preexisting module instead of creating a new class on the spot. Still, it would be nice if this could work. Any ideas? -- ~Ethan~

11 23

Unicode minus sign in numeric conversions
by Łukasz Langa 09 Jun '13

09 Jun '13

Expected behaviour: >>> float('\N{MINUS SIGN}12.34') -12.34 Current behaviour: Traceback (most recent call last): ... ValueError: could not convert string to float: '−12.34' Please note: '\N{MINUS SIGN}' == '\u2212' -- Best regards, Łukasz Langa WWW: http://lukasz.langa.pl/ Twitter: @llanga IRC: ambv on #python-dev

4 3

Obsoleted RFCs
by Serhiy Storchaka 08 Jun '13

08 Jun '13

Here is attached a list of obsoleted RFCs referred in the *.rst, *.txt, *.py, *.c and *.h files. I think it would be worthwhile to update the source code and documentation for more modern RFCs. For example for updating RFC3548 to RFC4648 there is an issue #16995.

6 8

Re: [Python-Dev] [Python-checkins] cpython: Add reference implementation for PEP 443
by Thomas Wouters 08 Jun '13

08 Jun '13

On Wed, Jun 5, 2013 at 3:20 AM, lukasz.langa <python-checkins(a)python.org>wrote: > +from weakref import WeakKeyDictionary > FYI, this change exposes a bug in the atexit module involving subinterpreters, causing the refleaks reported by Antoine's daily report: interpreter startup now always imports weakref, which imports atexit and registers a classmethod. Unfortunately the atexit module doesn't seem to know subinterpreters from subtitles and so doesn't unregister this classmethod when the subinterpreter is terminated. This isn't a new bug, but it's exposed by always importing weakref and atexit during interpreter startup. I'm wondering if that's really necessary :) -- Thomas Wouters <thomas(a)python.org> Hi! I'm an email virus! Think twice before sending your email to help me spread!

4 5

Summary of Python tracker Issues
by Python tracker 07 Jun '13

07 Jun '13

ACTIVITY SUMMARY (2013-05-31 - 2013-06-07) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 4024 (+27) closed 25905 (+21) total 29929 (+48) Open issues with patches: 1793 Issues opened (41) ================== #8902: add datetime.time.now() for consistency http://bugs.python.org/issue8902 reopened by belopolsky #17206: Py_XDECREF() expands its argument multiple times http://bugs.python.org/issue17206 reopened by haypo #17222: py_compile.compile() replaces target files, breaking special f http://bugs.python.org/issue17222 reopened by brett.cannon #18110: Nested set comprehensions in class scope fail http://bugs.python.org/issue18110 opened by Eric.Wieser #18111: Add a default argument to min & max http://bugs.python.org/issue18111 opened by Julian #18112: PEP 442 implementation http://bugs.python.org/issue18112 opened by pitrou #18113: Memory leak in curses.panel http://bugs.python.org/issue18113 opened by ishimoto #18114: Update PyImport_ImportFrozenModuleObject() to use importlib http://bugs.python.org/issue18114 opened by brett.cannon #18115: Use importlib.util.module_to_load in all loaders in importlib http://bugs.python.org/issue18115 opened by brett.cannon #18116: getpass.unix_getpass() always fallback to sys.stdin http://bugs.python.org/issue18116 opened by Nikratio #18117: Missing symlink:Current after Mac OS X 3.3.2 package installat http://bugs.python.org/issue18117 opened by gavan #18119: urllib.FancyURLopener does not treat URL fragments correctly http://bugs.python.org/issue18119 opened by takahashi.shuhei #18121: antigravity leaks subprocess.Popen object http://bugs.python.org/issue18121 opened by christian.heimes #18122: RuntimeError: not holding the import lock http://bugs.python.org/issue18122 opened by arigo #18123: fnmatchicase for case insensitive file search http://bugs.python.org/issue18123 opened by techtonik #18125: Out-of-tree build cannot regenerate Makefile.pre http://bugs.python.org/issue18125 opened by TBBle #18126: Update links to NumPy resources in documentation http://bugs.python.org/issue18126 opened by zaytsev #18128: pygettext: non-standard timestamp format in POT-Creation-Date http://bugs.python.org/issue18128 opened by jwilk #18129: Fatal Python error: Cannot recover from stack overflow. http://bugs.python.org/issue18129 opened by oscarbenjamin #18131: Tkinter Variables require a proper master http://bugs.python.org/issue18131 opened by terry.reedy #18132: buttons in turtledemo disappear on small screens http://bugs.python.org/issue18132 opened by JanKanis #18135: _ssl module: possible integer overflow for very long strings ( http://bugs.python.org/issue18135 opened by haypo #18136: Put local build paths before system build paths in configure.a http://bugs.python.org/issue18136 opened by brett.cannon #18137: format(float, str): integer overflow for huge precision http://bugs.python.org/issue18137 opened by haypo #18138: ssl.SSLContext.add_cert() http://bugs.python.org/issue18138 opened by christian.heimes #18139: email module should have a way to prepend and insert headers http://bugs.python.org/issue18139 opened by kbandla #18140: urlparse.urlsplit confused to fragment when password include # http://bugs.python.org/issue18140 opened by anh.le #18141: tkinter.Image.__del__ can throw an exception if module globals http://bugs.python.org/issue18141 opened by JanKanis #18142: Tests fail on Mageia Linux Cauldron x86-64 with some configure http://bugs.python.org/issue18142 opened by shlomif #18143: ssl.get_default_verify_paths() http://bugs.python.org/issue18143 opened by christian.heimes #18144: FD leak in urllib2 http://bugs.python.org/issue18144 opened by Claudio.Freire #18147: SSL: diagnostic functions to list loaded CA certs http://bugs.python.org/issue18147 opened by christian.heimes #18148: Make of Python 3.2.2 fails on Solaris SPARC http://bugs.python.org/issue18148 opened by eeiddne #18149: filecmp.cmp() - cache invalidation fails when file modificatio http://bugs.python.org/issue18149 opened by fbm #18150: Duplicate test inside TestSingleDispatch http://bugs.python.org/issue18150 opened by vajrasky #18151: Idlelib: update to "with open ... except OSError" (in 2.7, le http://bugs.python.org/issue18151 opened by terry.reedy #18152: Idle: add 2.7 backport script http://bugs.python.org/issue18152 opened by terry.reedy #18153: python imaplib - error 'unexpected repsonse' http://bugs.python.org/issue18153 opened by tahnoon #18154: make install failed on solaris http://bugs.python.org/issue18154 opened by palm.kevin #18155: csv.Sniffer.has_header doesn't escape characters used in regex http://bugs.python.org/issue18155 opened by davechallis #18156: Add an 'attr' attribute to AttributeError http://bugs.python.org/issue18156 opened by brett.cannon Most recent 15 issues with no replies (15) ========================================== #18156: Add an 'attr' attribute to AttributeError http://bugs.python.org/issue18156 #18149: filecmp.cmp() - cache invalidation fails when file modificatio http://bugs.python.org/issue18149 #18148: Make of Python 3.2.2 fails on Solaris SPARC http://bugs.python.org/issue18148 #18147: SSL: diagnostic functions to list loaded CA certs http://bugs.python.org/issue18147 #18144: FD leak in urllib2 http://bugs.python.org/issue18144 #18138: ssl.SSLContext.add_cert() http://bugs.python.org/issue18138 #18137: format(float, str): integer overflow for huge precision http://bugs.python.org/issue18137 #18131: Tkinter Variables require a proper master http://bugs.python.org/issue18131 #18129: Fatal Python error: Cannot recover from stack overflow. http://bugs.python.org/issue18129 #18126: Update links to NumPy resources in documentation http://bugs.python.org/issue18126 #18119: urllib.FancyURLopener does not treat URL fragments correctly http://bugs.python.org/issue18119 #18114: Update PyImport_ImportFrozenModuleObject() to use importlib http://bugs.python.org/issue18114 #18113: Memory leak in curses.panel http://bugs.python.org/issue18113 #18112: PEP 442 implementation http://bugs.python.org/issue18112 #18108: shutil.chown should support dir_fd and follow_symlinks keyword http://bugs.python.org/issue18108 Most recent 15 issues waiting for review (15) ============================================= #18155: csv.Sniffer.has_header doesn't escape characters used in regex http://bugs.python.org/issue18155 #18154: make install failed on solaris http://bugs.python.org/issue18154 #18151: Idlelib: update to "with open ... except OSError" (in 2.7, le http://bugs.python.org/issue18151 #18150: Duplicate test inside TestSingleDispatch http://bugs.python.org/issue18150 #18147: SSL: diagnostic functions to list loaded CA certs http://bugs.python.org/issue18147 #18143: ssl.get_default_verify_paths() http://bugs.python.org/issue18143 #18141: tkinter.Image.__del__ can throw an exception if module globals http://bugs.python.org/issue18141 #18138: ssl.SSLContext.add_cert() http://bugs.python.org/issue18138 #18137: format(float, str): integer overflow for huge precision http://bugs.python.org/issue18137 #18135: _ssl module: possible integer overflow for very long strings ( http://bugs.python.org/issue18135 #18132: buttons in turtledemo disappear on small screens http://bugs.python.org/issue18132 #18126: Update links to NumPy resources in documentation http://bugs.python.org/issue18126 #18116: getpass.unix_getpass() always fallback to sys.stdin http://bugs.python.org/issue18116 #18112: PEP 442 implementation http://bugs.python.org/issue18112 #18111: Add a default argument to min & max http://bugs.python.org/issue18111 Top 10 most discussed issues (10) ================================= #18111: Add a default argument to min & max http://bugs.python.org/issue18111 28 msgs #18116: getpass.unix_getpass() always fallback to sys.stdin http://bugs.python.org/issue18116 17 msgs #18021: Update broken link to Apple Publication Style Guide http://bugs.python.org/issue18021 9 msgs #16427: Faster hash implementation http://bugs.python.org/issue16427 8 msgs #17222: py_compile.compile() replaces target files, breaking special f http://bugs.python.org/issue17222 7 msgs #18078: threading.Condition to allow notify on a specific waiter http://bugs.python.org/issue18078 7 msgs #3329: API for setting the memory allocator used by Python http://bugs.python.org/issue3329 6 msgs #18054: Add more exception related assertions to unittest http://bugs.python.org/issue18054 6 msgs #18122: RuntimeError: not holding the import lock http://bugs.python.org/issue18122 6 msgs #18143: ssl.get_default_verify_paths() http://bugs.python.org/issue18143 6 msgs Issues closed (24) ================== #11959: smtpd cannot be used without affecting global state http://bugs.python.org/issue11959 closed by python-dev #16450: test_missing_localfile masks problems in urlopen http://bugs.python.org/issue16450 closed by orsenthil #17314: Stop using imp.find_module() in multiprocessing http://bugs.python.org/issue17314 closed by brett.cannon #17342: datetime.strptime does not implement %z http://bugs.python.org/issue17342 closed by belopolsky #17486: datetime.timezone returns the wrong tzname() http://bugs.python.org/issue17486 closed by belopolsky #17931: PyLong_FromPid() is not correctly defined on Windows 64-bit http://bugs.python.org/issue17931 closed by python-dev #17932: Win64: possible integer overflow in iterobject.c http://bugs.python.org/issue17932 closed by python-dev #17967: urllib2.open failed to access a url when a perent directory of http://bugs.python.org/issue17967 closed by orsenthil #18065: set __path__ = [] for frozen packages http://bugs.python.org/issue18065 closed by brett.cannon #18066: Remove SGI-specific code from pty.py http://bugs.python.org/issue18066 closed by akuchling #18088: Create importlib.abc.Loader.init_module_attrs() http://bugs.python.org/issue18088 closed by brett.cannon #18089: Create importlib.abc.InspectLoader.load_module() http://bugs.python.org/issue18089 closed by brett.cannon #18094: Skip tests in test_uuid not silently http://bugs.python.org/issue18094 closed by serhiy.storchaka #18109: os.uname() crashes if hostname contains non-ascii characters http://bugs.python.org/issue18109 closed by python-dev #18118: curses utf8 output broken in Python2 http://bugs.python.org/issue18118 closed by haypo #18120: multiprocessing: garbage collector fails to GC Pipe() end when http://bugs.python.org/issue18120 closed by sbt #18124: Broken build on target machine with incorrect hostname (non-as http://bugs.python.org/issue18124 closed by dmi.baranov #18127: Strange behaviour with default list argument http://bugs.python.org/issue18127 closed by eric.smith #18130: idlelib.configSectionNameDialog: fix and add tests and mocks http://bugs.python.org/issue18130 closed by terry.reedy #18133: Modulus not calculating properly? http://bugs.python.org/issue18133 closed by pccreator25 #18134: zipfile extractall accepts wrong password http://bugs.python.org/issue18134 closed by r.david.murray #18145: Strange behavior when importing internal modules in the __init http://bugs.python.org/issue18145 closed by brett.cannon #18146: Document miss, Stats objects has no method called "print_resul http://bugs.python.org/issue18146 closed by hanks #1512124: OSX: debugger hangs IDLE http://bugs.python.org/issue1512124 closed by ned.deily

1 0

Re: [Python-Dev] [Python-checkins] cpython: Issue #17931: Resolve confusion on Windows between pids and process handles.
by Brett Cannon 07 Jun '13

07 Jun '13

I think this CL introduced a memory leak. The daily leak report went from 0 to not 0 between June 4 and June 5 and this is the only CL that touched C code. On Wed, Jun 5, 2013 at 6:31 PM, richard.oudkerk <python-checkins(a)python.org>wrote: > http://hg.python.org/cpython/rev/0410bf251e10 > changeset: 84045:0410bf251e10 > user: Richard Oudkerk <shibturn(a)gmail.com> > date: Wed Jun 05 23:29:30 2013 +0100 > summary: > Issue #17931: Resolve confusion on Windows between pids and process > handles. > > files: > Include/longobject.h | 13 +++++++++++++ > Misc/NEWS | 5 ++--- > Modules/posixmodule.c | 25 +++++++++---------------- > PC/msvcrtmodule.c | 5 +++-- > PC/pyconfig.h | 4 ++-- > 5 files changed, 29 insertions(+), 23 deletions(-) > > > diff --git a/Include/longobject.h b/Include/longobject.h > --- a/Include/longobject.h > +++ b/Include/longobject.h > @@ -52,6 +52,19 @@ > #error "sizeof(pid_t) is neither sizeof(int), sizeof(long) or sizeof(long > long)" > #endif /* SIZEOF_PID_T */ > > +#if SIZEOF_VOID_P == SIZEOF_INT > +# define _Py_PARSE_INTPTR "i" > +# define _Py_PARSE_UINTPTR "I" > +#elif SIZEOF_VOID_P == SIZEOF_LONG > +# define _Py_PARSE_INTPTR "l" > +# define _Py_PARSE_UINTPTR "k" > +#elif defined(SIZEOF_LONG_LONG) && SIZEOF_VOID_P == SIZEOF_LONG_LONG > +# define _Py_PARSE_INTPTR "L" > +# define _Py_PARSE_UINTPTR "K" > +#else > +# error "void* different in size from int, long and long long" > +#endif /* SIZEOF_VOID_P */ > + > /* Used by Python/mystrtoul.c. */ > #ifndef Py_LIMITED_API > PyAPI_DATA(unsigned char) _PyLong_DigitValue[256]; > diff --git a/Misc/NEWS b/Misc/NEWS > --- a/Misc/NEWS > +++ b/Misc/NEWS > @@ -10,9 +10,8 @@ > Core and Builtins > ----------------- > > -- Issue #17931: Fix PyLong_FromPid() on Windows 64-bit: processes are > - identified by their HANDLE which is a pointer (and not a long, which is > - smaller). > +- Issue #17931: Resolve confusion on Windows between pids and process > + handles. > > - Tweak the exception message when the magic number or size value in a > bytecode > file is truncated. > diff --git a/Modules/posixmodule.c b/Modules/posixmodule.c > --- a/Modules/posixmodule.c > +++ b/Modules/posixmodule.c > @@ -5014,11 +5014,7 @@ > if (spawnval == -1) > return posix_error(); > else > -#if SIZEOF_LONG == SIZEOF_VOID_P > - return Py_BuildValue("l", (long) spawnval); > -#else > - return Py_BuildValue("L", (PY_LONG_LONG) spawnval); > -#endif > + return Py_BuildValue(_Py_PARSE_INTPTR, spawnval); > } > > > @@ -5104,11 +5100,7 @@ > if (spawnval == -1) > (void) posix_error(); > else > -#if SIZEOF_LONG == SIZEOF_VOID_P > - res = Py_BuildValue("l", (long) spawnval); > -#else > - res = Py_BuildValue("L", (PY_LONG_LONG) spawnval); > -#endif > + res = Py_BuildValue(_Py_PARSE_INTPTR, spawnval); > > while (--envc >= 0) > PyMem_DEL(envlist[envc]); > @@ -6178,16 +6170,17 @@ > win32_kill(PyObject *self, PyObject *args) > { > PyObject *result; > - DWORD pid, sig, err; > + pid_t pid; > + DWORD sig, err; > HANDLE handle; > > - if (!PyArg_ParseTuple(args, "kk:kill", &pid, &sig)) > + if (!PyArg_ParseTuple(args, _Py_PARSE_PID "k:kill", &pid, &sig)) > return NULL; > > /* Console processes which share a common console can be sent CTRL+C > or > CTRL+BREAK events, provided they handle said events. */ > if (sig == CTRL_C_EVENT || sig == CTRL_BREAK_EVENT) { > - if (GenerateConsoleCtrlEvent(sig, pid) == 0) { > + if (GenerateConsoleCtrlEvent(sig, (DWORD)pid) == 0) { > err = GetLastError(); > PyErr_SetFromWindowsErr(err); > } > @@ -6197,7 +6190,7 @@ > > /* If the signal is outside of what GenerateConsoleCtrlEvent can use, > attempt to open and terminate the process. */ > - handle = OpenProcess(PROCESS_ALL_ACCESS, FALSE, pid); > + handle = OpenProcess(PROCESS_ALL_ACCESS, FALSE, (DWORD)pid); > if (handle == NULL) { > err = GetLastError(); > return PyErr_SetFromWindowsErr(err); > @@ -6603,7 +6596,7 @@ > Py_intptr_t pid; > int status, options; > > - if (!PyArg_ParseTuple(args, _Py_PARSE_PID "i:waitpid", &pid, > &options)) > + if (!PyArg_ParseTuple(args, _Py_PARSE_INTPTR "i:waitpid", &pid, > &options)) > return NULL; > Py_BEGIN_ALLOW_THREADS > pid = _cwait(&status, pid, options); > @@ -6612,7 +6605,7 @@ > return posix_error(); > > /* shift the status left a byte so this is more like the POSIX > waitpid */ > - return Py_BuildValue("Ni", PyLong_FromPid(pid), status << 8); > + return Py_BuildValue(_Py_PARSE_INTPTR "i", pid, status << 8); > } > #endif /* HAVE_WAITPID || HAVE_CWAIT */ > > diff --git a/PC/msvcrtmodule.c b/PC/msvcrtmodule.c > --- a/PC/msvcrtmodule.c > +++ b/PC/msvcrtmodule.c > @@ -113,11 +113,12 @@ > static PyObject * > msvcrt_open_osfhandle(PyObject *self, PyObject *args) > { > - long handle; > + Py_intptr_t handle; > int flags; > int fd; > > - if (!PyArg_ParseTuple(args, "li:open_osfhandle", &handle, &flags)) > + if (!PyArg_ParseTuple(args, _Py_PARSE_INTPTR "i:open_osfhandle", > + &handle, &flags)) > return NULL; > > fd = _open_osfhandle(handle, flags); > diff --git a/PC/pyconfig.h b/PC/pyconfig.h > --- a/PC/pyconfig.h > +++ b/PC/pyconfig.h > @@ -723,8 +723,8 @@ > /* The size of `wchar_t', as computed by sizeof. */ > #define SIZEOF_WCHAR_T 2 > > -/* The size of `pid_t' (HANDLE). */ > -#define SIZEOF_PID_T SIZEOF_VOID_P > +/* The size of `pid_t', as computed by sizeof. */ > +#define SIZEOF_PID_T SIZEOF_INT > > /* Define if you have the dl library (-ldl). */ > /* #undef HAVE_LIBDL */ > > -- > Repository URL: http://hg.python.org/cpython > > _______________________________________________ > Python-checkins mailing list > Python-checkins(a)python.org > http://mail.python.org/mailman/listinfo/python-checkins > >

2 1

html documentation and table-of-contents
by Ethan Furman 07 Jun '13

07 Jun '13

I just used the build system on the 3.4.0 docs, and some of the library modules (haven't checked the others) have the TOC showing up at the bottom of the page instead of the top. Am I doing something wrong? -- ~Ethan~

1 0

Compiling Python with Python
by Jussi Pakkanen 05 Jun '13

05 Jun '13

Hello all I'd like to start this email by saying this is not a proposal to change Python's build system. This is just the results of some experimentation you might be interested it. I have been working on a cross-platform build system called Meson, which is implemented in Python 3. For symmetry I wanted to see if it could be used to build Python itself. After about an evening worth of work, I got the basic C parts (that is, the build targets in the main Makefile such as core Python, pgen etc) built. Main highlights: - pyconfig.h generation in a fully cross-platform way without Autoconf (not tested with Visual Studio but should work as Meson has unit tests for this, tests for functions in header files and some others not done) - builds in a separate build directory, can have arbitrarily many build dirs with different configurations (for gcc/clang/static analysis/debug/release/etc) - configure time 5s, build time 8s on an i5 Macbook running Ubuntu (Autotool-configure takes 37 s but it's not directly comparable because it does a lot more) - the file describing the build is 433 lines, most of which look like this: if cc.has_header('io.h') pyconf.set('HAVE_IO_H', 1) endif - implementation of Meson is 100% Python 3, it does not have a dependency on the shell and in fact already works on Windows If you want to try it yourself, here are the steps (only 64 bit Linux tested thus far): - install python3-ply and Ninja (Ubuntu package ninja-build) - get Meson git head: https://sourceforge.net/p/meson/code/ - get Python3 trunk - download and extract the build files into trunk: https://dl.dropboxusercontent.com/u/37517477/python-meson.tar.gz - cd into Python trunk and do the following commands: mkdir build cd build path/to/meson.py .. ninja And there you have it. You can't do much with it, though (except run pgen to ensure that it actually did something ;) ). If you have any questions that are not directly related to Python, feel free to email me or the Meson mailing list. Enjoy,

3 4

Re: [Python-Dev] HAVE_FSTAT?
by Hossein 05 Jun '13

05 Jun '13

Hi. My 2 cents about this: (well I'm only a noob) I had this problem; I don't know about other people's environment, but my environment's problem was that it was actually not POSIX-compliant: it didn't have other file functions as well, but anyway the `fstat` error is the FIRST error you get when you compile in such environments, so people as unaware as me think the problem is with fstat only. Anyway I think if you are going to remove anything, you should think in terms of POSIX-compliancy of the target system. Removing HAVE_FSTAT might be fine (as user can easily write his own version of the function and have it included into the python's sources), but if you instead provide the user with the ability to use his custom functions when POSIX one's aren't available, it would help make python compile on even more platforms. Sorry if this last one was off-topic. Best regards.

1 0

Re: [Python-Dev] [Python-checkins] cpython: Add reference implementation for PEP 443
by Brett Cannon 05 Jun '13

05 Jun '13

Any chance you could move your definitions for "generic function" and "single dispatch" to the glossary and just link to them here? On Wed, Jun 5, 2013 at 6:20 AM, lukasz.langa <python-checkins(a)python.org>wrote: > http://hg.python.org/cpython/rev/dfcb64f51f7b > changeset: 84039:dfcb64f51f7b > user: Łukasz Langa <lukasz(a)langa.pl> > date: Wed Jun 05 12:20:24 2013 +0200 > summary: > Add reference implementation for PEP 443 > > PEP accepted: > http://mail.python.org/pipermail/python-dev/2013-June/126734.html > > files: > Doc/library/functools.rst | 110 +++++++ > Lib/functools.py | 128 ++++++++- > Lib/pkgutil.py | 52 +--- > Lib/test/test_functools.py | 374 ++++++++++++++++++++++++- > Misc/NEWS | 3 + > Modules/Setup.dist | 2 +- > 6 files changed, 614 insertions(+), 55 deletions(-) > > > diff --git a/Doc/library/functools.rst b/Doc/library/functools.rst > --- a/Doc/library/functools.rst > +++ b/Doc/library/functools.rst > @@ -6,6 +6,7 @@ > .. moduleauthor:: Peter Harris <scav(a)blueyonder.co.uk> > .. moduleauthor:: Raymond Hettinger <python(a)rcn.com> > .. moduleauthor:: Nick Coghlan <ncoghlan(a)gmail.com> > +.. moduleauthor:: Łukasz Langa <lukasz(a)langa.pl> > .. sectionauthor:: Peter Harris <scav(a)blueyonder.co.uk> > > **Source code:** :source:`Lib/functools.py` > @@ -186,6 +187,115 @@ > *sequence* contains only one item, the first item is returned. > > > +.. decorator:: singledispatch(default) > + > + Transforms a function into a single-dispatch generic function. A > **generic > + function** is composed of multiple functions implementing the same > operation > + for different types. Which implementation should be used during a call > is > + determined by the dispatch algorithm. When the implementation is > chosen > + based on the type of a single argument, this is known as **single > + dispatch**. > + > + To define a generic function, decorate it with the ``@singledispatch`` > + decorator. Note that the dispatch happens on the type of the first > argument, > + create your function accordingly:: > + > + >>> from functools import singledispatch > + >>> @singledispatch > + ... def fun(arg, verbose=False): > + ... if verbose: > + ... print("Let me just say,", end=" ") > + ... print(arg) > + > + To add overloaded implementations to the function, use the > :func:`register` > + attribute of the generic function. It is a decorator, taking a type > + parameter and decorating a function implementing the operation for that > + type:: > + > + >>> @fun.register(int) > + ... def _(arg, verbose=False): > + ... if verbose: > + ... print("Strength in numbers, eh?", end=" ") > + ... print(arg) > + ... > + >>> @fun.register(list) > + ... def _(arg, verbose=False): > + ... if verbose: > + ... print("Enumerate this:") > + ... for i, elem in enumerate(arg): > + ... print(i, elem) > + > + To enable registering lambdas and pre-existing functions, the > + :func:`register` attribute can be used in a functional form:: > + > + >>> def nothing(arg, verbose=False): > + ... print("Nothing.") > + ... > + >>> fun.register(type(None), nothing) > + > + The :func:`register` attribute returns the undecorated function which > + enables decorator stacking, pickling, as well as creating unit tests > for > + each variant independently:: > + > + >>> @fun.register(float) > + ... @fun.register(Decimal) > + ... def fun_num(arg, verbose=False): > + ... if verbose: > + ... print("Half of your number:", end=" ") > + ... print(arg / 2) > + ... > + >>> fun_num is fun > + False > + > + When called, the generic function dispatches on the type of the first > + argument:: > + > + >>> fun("Hello, world.") > + Hello, world. > + >>> fun("test.", verbose=True) > + Let me just say, test. > + >>> fun(42, verbose=True) > + Strength in numbers, eh? 42 > + >>> fun(['spam', 'spam', 'eggs', 'spam'], verbose=True) > + Enumerate this: > + 0 spam > + 1 spam > + 2 eggs > + 3 spam > + >>> fun(None) > + Nothing. > + >>> fun(1.23) > + 0.615 > + > + Where there is no registered implementation for a specific type, its > + method resolution order is used to find a more generic implementation. > + The original function decorated with ``@singledispatch`` is registered > + for the base ``object`` type, which means it is used if no better > + implementation is found. > + > + To check which implementation will the generic function choose for > + a given type, use the ``dispatch()`` attribute:: > + > + >>> fun.dispatch(float) > + <function fun_num at 0x1035a2840> > + >>> fun.dispatch(dict) # note: default implementation > + <function fun at 0x103fe0000> > + > + To access all registered implementations, use the read-only > ``registry`` > + attribute:: > + > + >>> fun.registry.keys() > + dict_keys([<class 'NoneType'>, <class 'int'>, <class 'object'>, > + <class 'decimal.Decimal'>, <class 'list'>, > + <class 'float'>]) > + >>> fun.registry[float] > + <function fun_num at 0x1035a2840> > + >>> fun.registry[object] > + <function fun at 0x103fe0000> > + > + .. versionadded:: 3.4 > + > + > .. function:: update_wrapper(wrapper, wrapped, > assigned=WRAPPER_ASSIGNMENTS, updated=WRAPPER_UPDATES) > > Update a *wrapper* function to look like the *wrapped* function. The > optional > diff --git a/Lib/functools.py b/Lib/functools.py > --- a/Lib/functools.py > +++ b/Lib/functools.py > @@ -3,19 +3,24 @@ > # Python module wrapper for _functools C module > # to allow utilities written in Python to be added > # to the functools module. > -# Written by Nick Coghlan <ncoghlan at gmail.com> > -# and Raymond Hettinger <python at rcn.com> > -# Copyright (C) 2006-2010 Python Software Foundation. > +# Written by Nick Coghlan <ncoghlan at gmail.com>, > +# Raymond Hettinger <python at rcn.com>, > +# and Łukasz Langa <lukasz at langa.pl>. > +# Copyright (C) 2006-2013 Python Software Foundation. > # See C source code for _functools credits/copyright > > __all__ = ['update_wrapper', 'wraps', 'WRAPPER_ASSIGNMENTS', > 'WRAPPER_UPDATES', > - 'total_ordering', 'cmp_to_key', 'lru_cache', 'reduce', > 'partial'] > + 'total_ordering', 'cmp_to_key', 'lru_cache', 'reduce', > 'partial', > + 'singledispatch'] > > try: > from _functools import reduce > except ImportError: > pass > +from abc import get_cache_token > from collections import namedtuple > +from types import MappingProxyType > +from weakref import WeakKeyDictionary > try: > from _thread import RLock > except: > @@ -354,3 +359,118 @@ > return update_wrapper(wrapper, user_function) > > return decorating_function > + > + > > +################################################################################ > +### singledispatch() - single-dispatch generic function decorator > > +################################################################################ > + > +def _compose_mro(cls, haystack): > + """Calculates the MRO for a given class `cls`, including relevant > abstract > + base classes from `haystack`. > + > + """ > + bases = set(cls.__mro__) > + mro = list(cls.__mro__) > + for needle in haystack: > + if (needle in bases or not hasattr(needle, '__mro__') > + or not issubclass(cls, needle)): > + continue # either present in the __mro__ already or > unrelated > + for index, base in enumerate(mro): > + if not issubclass(base, needle): > + break > + if base in bases and not issubclass(needle, base): > + # Conflict resolution: put classes present in __mro__ and > their > + # subclasses first. See test_mro_conflicts() in > test_functools.py > + # for examples. > + index += 1 > + mro.insert(index, needle) > + return mro > + > +def _find_impl(cls, registry): > + """Returns the best matching implementation for the given class `cls` > in > + `registry`. Where there is no registered implementation for a specific > + type, its method resolution order is used to find a more generic > + implementation. > + > + Note: if `registry` does not contain an implementation for the base > + `object` type, this function may return None. > + > + """ > + mro = _compose_mro(cls, registry.keys()) > + match = None > + for t in mro: > + if match is not None: > + # If `match` is an ABC but there is another unrelated, equally > + # matching ABC. Refuse the temptation to guess. > + if (t in registry and not issubclass(match, t) > + and match not in cls.__mro__): > + raise RuntimeError("Ambiguous dispatch: {} or {}".format( > + match, t)) > + break > + if t in registry: > + match = t > + return registry.get(match) > + > +def singledispatch(func): > + """Single-dispatch generic function decorator. > + > + Transforms a function into a generic function, which can have > different > + behaviours depending upon the type of its first argument. The > decorated > + function acts as the default implementation, and additional > + implementations can be registered using the 'register()' attribute of > + the generic function. > + > + """ > + registry = {} > + dispatch_cache = WeakKeyDictionary() > + cache_token = None > + > + def dispatch(typ): > + """generic_func.dispatch(type) -> <function implementation> > + > + Runs the dispatch algorithm to return the best available > implementation > + for the given `type` registered on `generic_func`. > + > + """ > + nonlocal cache_token > + if cache_token is not None: > + current_token = get_cache_token() > + if cache_token != current_token: > + dispatch_cache.clear() > + cache_token = current_token > + try: > + impl = dispatch_cache[typ] > + except KeyError: > + try: > + impl = registry[typ] > + except KeyError: > + impl = _find_impl(typ, registry) > + dispatch_cache[typ] = impl > + return impl > + > + def register(typ, func=None): > + """generic_func.register(type, func) -> func > + > + Registers a new implementation for the given `type` on a > `generic_func`. > + > + """ > + nonlocal cache_token > + if func is None: > + return lambda f: register(typ, f) > + registry[typ] = func > + if cache_token is None and hasattr(typ, '__abstractmethods__'): > + cache_token = get_cache_token() > + dispatch_cache.clear() > + return func > + > + def wrapper(*args, **kw): > + return dispatch(args[0].__class__)(*args, **kw) > + > + registry[object] = func > + wrapper.register = register > + wrapper.dispatch = dispatch > + wrapper.registry = MappingProxyType(registry) > + wrapper._clear_cache = dispatch_cache.clear > + update_wrapper(wrapper, func) > + return wrapper > diff --git a/Lib/pkgutil.py b/Lib/pkgutil.py > --- a/Lib/pkgutil.py > +++ b/Lib/pkgutil.py > @@ -1,12 +1,13 @@ > """Utilities to support packages.""" > > +from functools import singledispatch as simplegeneric > +import imp > +import importlib > import os > +import os.path > import sys > -import importlib > -import imp > -import os.path > +from types import ModuleType > from warnings import warn > -from types import ModuleType > > __all__ = [ > 'get_importer', 'iter_importers', 'get_loader', 'find_loader', > @@ -27,46 +28,6 @@ > return marshal.load(stream) > > > -def simplegeneric(func): > - """Make a trivial single-dispatch generic function""" > - registry = {} > - def wrapper(*args, **kw): > - ob = args[0] > - try: > - cls = ob.__class__ > - except AttributeError: > - cls = type(ob) > - try: > - mro = cls.__mro__ > - except AttributeError: > - try: > - class cls(cls, object): > - pass > - mro = cls.__mro__[1:] > - except TypeError: > - mro = object, # must be an ExtensionClass or some such > :( > - for t in mro: > - if t in registry: > - return registry[t](*args, **kw) > - else: > - return func(*args, **kw) > - try: > - wrapper.__name__ = func.__name__ > - except (TypeError, AttributeError): > - pass # Python 2.3 doesn't allow functions to be renamed > - > - def register(typ, func=None): > - if func is None: > - return lambda f: register(typ, f) > - registry[typ] = func > - return func > - > - wrapper.__dict__ = func.__dict__ > - wrapper.__doc__ = func.__doc__ > - wrapper.register = register > - return wrapper > - > - > def walk_packages(path=None, prefix='', onerror=None): > """Yields (module_loader, name, ispkg) for all modules recursively > on path, or, if path is None, all accessible modules. > @@ -148,13 +109,12 @@ > yield i, name, ispkg > > > -#@simplegeneric > +@simplegeneric > def iter_importer_modules(importer, prefix=''): > if not hasattr(importer, 'iter_modules'): > return [] > return importer.iter_modules(prefix) > > -iter_importer_modules = simplegeneric(iter_importer_modules) > > # Implement a file walker for the normal importlib path hook > def _iter_file_finder_modules(importer, prefix=''): > diff --git a/Lib/test/test_functools.py b/Lib/test/test_functools.py > --- a/Lib/test/test_functools.py > +++ b/Lib/test/test_functools.py > @@ -1,24 +1,30 @@ > import collections > -import sys > -import unittest > -from test import support > -from weakref import proxy > +from itertools import permutations > import pickle > from random import choice > +import sys > +from test import support > +import unittest > +from weakref import proxy > > import functools > > py_functools = support.import_fresh_module('functools', > blocked=['_functools']) > c_functools = support.import_fresh_module('functools', > fresh=['_functools']) > > +decimal = support.import_fresh_module('decimal', fresh=['_decimal']) > + > + > def capture(*args, **kw): > """capture all positional and keyword arguments""" > return args, kw > > + > def signature(part): > """ return the signature of a partial object """ > return (part.func, part.args, part.keywords, part.__dict__) > > + > class TestPartial: > > def test_basic_examples(self): > @@ -138,6 +144,7 @@ > join = self.partial(''.join) > self.assertEqual(join(data), '0123456789') > > + > @unittest.skipUnless(c_functools, 'requires the C _functools module') > class TestPartialC(TestPartial, unittest.TestCase): > if c_functools: > @@ -194,18 +201,22 @@ > "new style getargs format but argument is not a tuple", > f.__setstate__, BadSequence()) > > + > class TestPartialPy(TestPartial, unittest.TestCase): > partial = staticmethod(py_functools.partial) > > + > if c_functools: > class PartialSubclass(c_functools.partial): > pass > > + > @unittest.skipUnless(c_functools, 'requires the C _functools module') > class TestPartialCSubclass(TestPartialC): > if c_functools: > partial = PartialSubclass > > + > class TestUpdateWrapper(unittest.TestCase): > > def check_wrapper(self, wrapper, wrapped, > @@ -312,6 +323,7 @@ > self.assertTrue(wrapper.__doc__.startswith('max(')) > self.assertEqual(wrapper.__annotations__, {}) > > + > class TestWraps(TestUpdateWrapper): > > def _default_update(self): > @@ -372,6 +384,7 @@ > self.assertEqual(wrapper.attr, 'This is a different test') > self.assertEqual(wrapper.dict_attr, f.dict_attr) > > + > class TestReduce(unittest.TestCase): > func = functools.reduce > > @@ -452,6 +465,7 @@ > d = {"one": 1, "two": 2, "three": 3} > self.assertEqual(self.func(add, d), "".join(d.keys())) > > + > class TestCmpToKey: > > def test_cmp_to_key(self): > @@ -534,14 +548,17 @@ > self.assertRaises(TypeError, hash, k) > self.assertNotIsInstance(k, collections.Hashable) > > + > @unittest.skipUnless(c_functools, 'requires the C _functools module') > class TestCmpToKeyC(TestCmpToKey, unittest.TestCase): > if c_functools: > cmp_to_key = c_functools.cmp_to_key > > + > class TestCmpToKeyPy(TestCmpToKey, unittest.TestCase): > cmp_to_key = staticmethod(py_functools.cmp_to_key) > > + > class TestTotalOrdering(unittest.TestCase): > > def test_total_ordering_lt(self): > @@ -642,6 +659,7 @@ > with self.assertRaises(TypeError): > TestTO(8) <= () > > + > class TestLRU(unittest.TestCase): > > def test_lru(self): > @@ -834,6 +852,353 @@ > DoubleEq(2)) # Verify the correct > return value > > > +class TestSingleDispatch(unittest.TestCase): > + def test_simple_overloads(self): > + @functools.singledispatch > + def g(obj): > + return "base" > + def g_int(i): > + return "integer" > + g.register(int, g_int) > + self.assertEqual(g("str"), "base") > + self.assertEqual(g(1), "integer") > + self.assertEqual(g([1,2,3]), "base") > + > + def test_mro(self): > + @functools.singledispatch > + def g(obj): > + return "base" > + class C: > + pass > + class D(C): > + pass > + def g_C(c): > + return "C" > + g.register(C, g_C) > + self.assertEqual(g(C()), "C") > + self.assertEqual(g(D()), "C") > + > + def test_classic_classes(self): > + @functools.singledispatch > + def g(obj): > + return "base" > + class C: > + pass > + class D(C): > + pass > + def g_C(c): > + return "C" > + g.register(C, g_C) > + self.assertEqual(g(C()), "C") > + self.assertEqual(g(D()), "C") > + > + def test_register_decorator(self): > + @functools.singledispatch > + def g(obj): > + return "base" > + @g.register(int) > + def g_int(i): > + return "int %s" % (i,) > + self.assertEqual(g(""), "base") > + self.assertEqual(g(12), "int 12") > + self.assertIs(g.dispatch(int), g_int) > + self.assertIs(g.dispatch(object), g.dispatch(str)) > + # Note: in the assert above this is not g. > + # @singledispatch returns the wrapper. > + > + def test_wrapping_attributes(self): > + @functools.singledispatch > + def g(obj): > + "Simple test" > + return "Test" > + self.assertEqual(g.__name__, "g") > + self.assertEqual(g.__doc__, "Simple test") > + > + @unittest.skipUnless(decimal, 'requires _decimal') > + @support.cpython_only > + def test_c_classes(self): > + @functools.singledispatch > + def g(obj): > + return "base" > + @g.register(decimal.DecimalException) > + def _(obj): > + return obj.args > + subn = decimal.Subnormal("Exponent < Emin") > + rnd = decimal.Rounded("Number got rounded") > + self.assertEqual(g(subn), ("Exponent < Emin",)) > + self.assertEqual(g(rnd), ("Number got rounded",)) > + @g.register(decimal.Subnormal) > + def _(obj): > + return "Too small to care." > + self.assertEqual(g(subn), "Too small to care.") > + self.assertEqual(g(rnd), ("Number got rounded",)) > + > + def test_compose_mro(self): > + c = collections > + mro = functools._compose_mro > + bases = [c.Sequence, c.MutableMapping, c.Mapping, c.Set] > + for haystack in permutations(bases): > + m = mro(dict, haystack) > + self.assertEqual(m, [dict, c.MutableMapping, c.Mapping, > object]) > + bases = [c.Container, c.Mapping, c.MutableMapping, c.OrderedDict] > + for haystack in permutations(bases): > + m = mro(c.ChainMap, haystack) > + self.assertEqual(m, [c.ChainMap, c.MutableMapping, c.Mapping, > + c.Sized, c.Iterable, c.Container, > object]) > + # Note: The MRO order below depends on haystack ordering. > + m = mro(c.defaultdict, [c.Sized, c.Container, str]) > + self.assertEqual(m, [c.defaultdict, dict, c.Container, c.Sized, > object]) > + m = mro(c.defaultdict, [c.Container, c.Sized, str]) > + self.assertEqual(m, [c.defaultdict, dict, c.Sized, c.Container, > object]) > + > + def test_register_abc(self): > + c = collections > + d = {"a": "b"} > + l = [1, 2, 3] > + s = {object(), None} > + f = frozenset(s) > + t = (1, 2, 3) > + @functools.singledispatch > + def g(obj): > + return "base" > + self.assertEqual(g(d), "base") > + self.assertEqual(g(l), "base") > + self.assertEqual(g(s), "base") > + self.assertEqual(g(f), "base") > + self.assertEqual(g(t), "base") > + g.register(c.Sized, lambda obj: "sized") > + self.assertEqual(g(d), "sized") > + self.assertEqual(g(l), "sized") > + self.assertEqual(g(s), "sized") > + self.assertEqual(g(f), "sized") > + self.assertEqual(g(t), "sized") > + g.register(c.MutableMapping, lambda obj: "mutablemapping") > + self.assertEqual(g(d), "mutablemapping") > + self.assertEqual(g(l), "sized") > + self.assertEqual(g(s), "sized") > + self.assertEqual(g(f), "sized") > + self.assertEqual(g(t), "sized") > + g.register(c.ChainMap, lambda obj: "chainmap") > + self.assertEqual(g(d), "mutablemapping") # irrelevant ABCs > registered > + self.assertEqual(g(l), "sized") > + self.assertEqual(g(s), "sized") > + self.assertEqual(g(f), "sized") > + self.assertEqual(g(t), "sized") > + g.register(c.MutableSequence, lambda obj: "mutablesequence") > + self.assertEqual(g(d), "mutablemapping") > + self.assertEqual(g(l), "mutablesequence") > + self.assertEqual(g(s), "sized") > + self.assertEqual(g(f), "sized") > + self.assertEqual(g(t), "sized") > + g.register(c.MutableSet, lambda obj: "mutableset") > + self.assertEqual(g(d), "mutablemapping") > + self.assertEqual(g(l), "mutablesequence") > + self.assertEqual(g(s), "mutableset") > + self.assertEqual(g(f), "sized") > + self.assertEqual(g(t), "sized") > + g.register(c.Mapping, lambda obj: "mapping") > + self.assertEqual(g(d), "mutablemapping") # not specific enough > + self.assertEqual(g(l), "mutablesequence") > + self.assertEqual(g(s), "mutableset") > + self.assertEqual(g(f), "sized") > + self.assertEqual(g(t), "sized") > + g.register(c.Sequence, lambda obj: "sequence") > + self.assertEqual(g(d), "mutablemapping") > + self.assertEqual(g(l), "mutablesequence") > + self.assertEqual(g(s), "mutableset") > + self.assertEqual(g(f), "sized") > + self.assertEqual(g(t), "sequence") > + g.register(c.Set, lambda obj: "set") > + self.assertEqual(g(d), "mutablemapping") > + self.assertEqual(g(l), "mutablesequence") > + self.assertEqual(g(s), "mutableset") > + self.assertEqual(g(f), "set") > + self.assertEqual(g(t), "sequence") > + g.register(dict, lambda obj: "dict") > + self.assertEqual(g(d), "dict") > + self.assertEqual(g(l), "mutablesequence") > + self.assertEqual(g(s), "mutableset") > + self.assertEqual(g(f), "set") > + self.assertEqual(g(t), "sequence") > + g.register(list, lambda obj: "list") > + self.assertEqual(g(d), "dict") > + self.assertEqual(g(l), "list") > + self.assertEqual(g(s), "mutableset") > + self.assertEqual(g(f), "set") > + self.assertEqual(g(t), "sequence") > + g.register(set, lambda obj: "concrete-set") > + self.assertEqual(g(d), "dict") > + self.assertEqual(g(l), "list") > + self.assertEqual(g(s), "concrete-set") > + self.assertEqual(g(f), "set") > + self.assertEqual(g(t), "sequence") > + g.register(frozenset, lambda obj: "frozen-set") > + self.assertEqual(g(d), "dict") > + self.assertEqual(g(l), "list") > + self.assertEqual(g(s), "concrete-set") > + self.assertEqual(g(f), "frozen-set") > + self.assertEqual(g(t), "sequence") > + g.register(tuple, lambda obj: "tuple") > + self.assertEqual(g(d), "dict") > + self.assertEqual(g(l), "list") > + self.assertEqual(g(s), "concrete-set") > + self.assertEqual(g(f), "frozen-set") > + self.assertEqual(g(t), "tuple") > + > + def test_mro_conflicts(self): > + c = collections > + > + @functools.singledispatch > + def g(arg): > + return "base" > + > + class O(c.Sized): > + def __len__(self): > + return 0 > + > + o = O() > + self.assertEqual(g(o), "base") > + g.register(c.Iterable, lambda arg: "iterable") > + g.register(c.Container, lambda arg: "container") > + g.register(c.Sized, lambda arg: "sized") > + g.register(c.Set, lambda arg: "set") > + self.assertEqual(g(o), "sized") > + c.Iterable.register(O) > + self.assertEqual(g(o), "sized") # because it's explicitly in > __mro__ > + c.Container.register(O) > + self.assertEqual(g(o), "sized") # see above: Sized is in __mro__ > + > + class P: > + pass > + > + p = P() > + self.assertEqual(g(p), "base") > + c.Iterable.register(P) > + self.assertEqual(g(p), "iterable") > + c.Container.register(P) > + with self.assertRaises(RuntimeError) as re: > + g(p) > + self.assertEqual( > + str(re), > + ("Ambiguous dispatch: <class 'collections.abc.Container'> > " > + "or <class 'collections.abc.Iterable'>"), > + ) > + > + class Q(c.Sized): > + def __len__(self): > + return 0 > + > + q = Q() > + self.assertEqual(g(q), "sized") > + c.Iterable.register(Q) > + self.assertEqual(g(q), "sized") # because it's explicitly in > __mro__ > + c.Set.register(Q) > + self.assertEqual(g(q), "set") # because c.Set is a subclass of > + # c.Sized which is explicitly in > + # __mro__ > + > + def test_cache_invalidation(self): > + from collections import UserDict > + class TracingDict(UserDict): > + def __init__(self, *args, **kwargs): > + super(TracingDict, self).__init__(*args, **kwargs) > + self.set_ops = [] > + self.get_ops = [] > + def __getitem__(self, key): > + result = self.data[key] > + self.get_ops.append(key) > + return result > + def __setitem__(self, key, value): > + self.set_ops.append(key) > + self.data[key] = value > + def clear(self): > + self.data.clear() > + _orig_wkd = functools.WeakKeyDictionary > + td = TracingDict() > + functools.WeakKeyDictionary = lambda: td > + c = collections > + @functools.singledispatch > + def g(arg): > + return "base" > + d = {} > + l = [] > + self.assertEqual(len(td), 0) > + self.assertEqual(g(d), "base") > + self.assertEqual(len(td), 1) > + self.assertEqual(td.get_ops, []) > + self.assertEqual(td.set_ops, [dict]) > + self.assertEqual(td.data[dict], g.registry[object]) > + self.assertEqual(g(l), "base") > + self.assertEqual(len(td), 2) > + self.assertEqual(td.get_ops, []) > + self.assertEqual(td.set_ops, [dict, list]) > + self.assertEqual(td.data[dict], g.registry[object]) > + self.assertEqual(td.data[list], g.registry[object]) > + self.assertEqual(td.data[dict], td.data[list]) > + self.assertEqual(g(l), "base") > + self.assertEqual(g(d), "base") > + self.assertEqual(td.get_ops, [list, dict]) > + self.assertEqual(td.set_ops, [dict, list]) > + g.register(list, lambda arg: "list") > + self.assertEqual(td.get_ops, [list, dict]) > + self.assertEqual(len(td), 0) > + self.assertEqual(g(d), "base") > + self.assertEqual(len(td), 1) > + self.assertEqual(td.get_ops, [list, dict]) > + self.assertEqual(td.set_ops, [dict, list, dict]) > + self.assertEqual(td.data[dict], > + functools._find_impl(dict, g.registry)) > + self.assertEqual(g(l), "list") > + self.assertEqual(len(td), 2) > + self.assertEqual(td.get_ops, [list, dict]) > + self.assertEqual(td.set_ops, [dict, list, dict, list]) > + self.assertEqual(td.data[list], > + functools._find_impl(list, g.registry)) > + class X: > + pass > + c.MutableMapping.register(X) # Will not invalidate the cache, > + # not using ABCs yet. > + self.assertEqual(g(d), "base") > + self.assertEqual(g(l), "list") > + self.assertEqual(td.get_ops, [list, dict, dict, list]) > + self.assertEqual(td.set_ops, [dict, list, dict, list]) > + g.register(c.Sized, lambda arg: "sized") > + self.assertEqual(len(td), 0) > + self.assertEqual(g(d), "sized") > + self.assertEqual(len(td), 1) > + self.assertEqual(td.get_ops, [list, dict, dict, list]) > + self.assertEqual(td.set_ops, [dict, list, dict, list, dict]) > + self.assertEqual(g(l), "list") > + self.assertEqual(len(td), 2) > + self.assertEqual(td.get_ops, [list, dict, dict, list]) > + self.assertEqual(td.set_ops, [dict, list, dict, list, dict, list]) > + self.assertEqual(g(l), "list") > + self.assertEqual(g(d), "sized") > + self.assertEqual(td.get_ops, [list, dict, dict, list, list, dict]) > + self.assertEqual(td.set_ops, [dict, list, dict, list, dict, list]) > + g.dispatch(list) > + g.dispatch(dict) > + self.assertEqual(td.get_ops, [list, dict, dict, list, list, dict, > + list, dict]) > + self.assertEqual(td.set_ops, [dict, list, dict, list, dict, list]) > + c.MutableSet.register(X) # Will invalidate the cache. > + self.assertEqual(len(td), 2) # Stale cache. > + self.assertEqual(g(l), "list") > + self.assertEqual(len(td), 1) > + g.register(c.MutableMapping, lambda arg: "mutablemapping") > + self.assertEqual(len(td), 0) > + self.assertEqual(g(d), "mutablemapping") > + self.assertEqual(len(td), 1) > + self.assertEqual(g(l), "list") > + self.assertEqual(len(td), 2) > + g.register(dict, lambda arg: "dict") > + self.assertEqual(g(d), "dict") > + self.assertEqual(g(l), "list") > + g._clear_cache() > + self.assertEqual(len(td), 0) > + functools.WeakKeyDictionary = _orig_wkd > + > + > def test_main(verbose=None): > test_classes = ( > TestPartialC, > @@ -846,6 +1211,7 @@ > TestWraps, > TestReduce, > TestLRU, > + TestSingleDispatch, > ) > support.run_unittest(*test_classes) > > diff --git a/Misc/NEWS b/Misc/NEWS > --- a/Misc/NEWS > +++ b/Misc/NEWS > @@ -344,6 +344,9 @@ > the default for linking if LDSHARED is not also overriden. This > restores > Distutils behavior introduced in 3.2.3 and inadvertently dropped in > 3.3.0. > > +- Implement PEP 443 "Single-dispatch generic functions". > + > + > Tests > ----- > > diff --git a/Modules/Setup.dist b/Modules/Setup.dist > --- a/Modules/Setup.dist > +++ b/Modules/Setup.dist > @@ -116,6 +116,7 @@ > _operator _operator.c # operator.add() and similar goodies > _collections _collectionsmodule.c # Container types > itertools itertoolsmodule.c # Functions creating iterators for > efficient looping > +atexit atexitmodule.c # Register functions to be run at > interpreter-shutdown > > # access to ISO C locale support > _locale _localemodule.c # -lintl > @@ -170,7 +171,6 @@ > #_weakref _weakref.c # basic weak reference support > #_testcapi _testcapimodule.c # Python C API test module > #_random _randommodule.c # Random number generator > -#atexit atexitmodule.c # Register functions to be run at > interpreter-shutdown > #_elementtree -I$(srcdir)/Modules/expat -DHAVE_EXPAT_CONFIG_H > -DUSE_PYEXPAT_CAPI _elementtree.c # elementtree accelerator > #_pickle _pickle.c # pickle accelerator > #_datetime _datetimemodule.c # datetime accelerator > > -- > Repository URL: http://hg.python.org/cpython > > _______________________________________________ > Python-checkins mailing list > Python-checkins(a)python.org > http://mail.python.org/mailman/listinfo/python-checkins > >

2 1

New FreeBSD 10.0-CURRENT buildbot
by Kubilay Kocak 05 Jun '13

05 Jun '13

Afternoon (UTC+10), I'd like to request a new user/pass for a FreeBSD 10.0-CURRENT VM guest I've just setup as a dedicated buildbot slave to complement my other koobs-freebsd slaves. Also, with this and future additions to the FreeBSD buildslave set in mind, I think it might also be prudent for a rename to take place: koobs-freebsd9-amd64 koobs-freebsd9-amd64-clang (CC=clang) koobs-freebsd10-amd64 (clang is default here) Convention being: koobs-freebsdX[Y]-arch[-config] (Happy for feedback here) If there are any permutations or additions you'd like to specifically see for FreeBSD to increase coverage just let me know (Hint: I have a PandaBoard arm board here i'm getting up and running) I have ZFS & DTrace to work with among other things, and the long term plan is to have FreeBSD buildbots running the full gamut of versions, from -RELEASE through -STABLE to HEAD branches. I'm on #python-dev IRC if someone needs to discuss. -- Regards, Koobs

3 3

PEP 443 Accepted
by Guido van Rossum 05 Jun '13

05 Jun '13

Łukasz, Congratulations! I've accepted PEP 443. I've already marked it as Accepted in the repo. I've also applied some very minor edits in order to make the text flow a little better in a few places. I think this is a great PEP -- it's simple, doesn't overreach, and you've managed the bikeshedding admirably. Thank you for your great contribution to Python! -- --Guido van Rossum (python.org/~guido)

6 5

PyPI upload error
by MRAB 05 Jun '13

05 Jun '13

I've just tried to upload to PyPI using setup.py and got this error: Upload failed (503): backend write error Can anyone tell me what it means?

2 2

Do you consider Python a 4GL? Why (not)?
by Carlos Nepomuceno 05 Jun '13

05 Jun '13

Do you consider Python a 4GL? Why (not)?

3 2

Let's get rid of unbound methods
by 探晴 04 Jun '13

04 Jun '13

2 1