Mailman 3 June 2012 - Python-Dev

Re: [Python-Dev] [Python-checkins] cpython: Issue #14769: test_capi now has SkipitemTest, which cleverly checks
by Terry Reedy 22 Jun '12

22 Jun '12

On 6/22/2012 6:57 AM, larry.hastings wrote: > http://hg.python.org/cpython/rev/ace45d23628a > changeset: 77567:ace45d23628a > user: Larry Hastings <larry(a)hastings.org> > date: Fri Jun 22 03:56:29 2012 -0700 > summary: > Issue #14769: test_capi now has SkipitemTest, which cleverly checks > for "parity" between PyArg_ParseTuple() and the Python/getargs.c static > function skipitem() for all possible "format units". You sensibly only test printable ascii chars, which are in the contiguous range 32 to 127 inclusive. So it makes no sense to claim otherwise and then deny the wrong claim, or to enlarge the range and then shrink it again. > + This function brute-force tests all** ASCII characters (1 to 127 > + inclusive) as format units, checking to see that With a few exceptions**, test all printable ASCII characters (32 to 127 inclusive) as... > + > + ** Okay, it actually skips some ASCII characters. Some characters ** Some characters ... > + have special funny semantics, and it would be difficult to > + accomodate them here. > + for i in range(1, 128): for i in range(32, 128): > + if (not c.isprintable()) or (c in '()e|$'): if c in '()e|$': tjr

3 6

A Desperate Plea For Introspection (aka: BDFAP Needed)
by Larry Hastings 22 Jun '12

22 Jun '12

Here's PEP 362: http://www.python.org/dev/peps/pep-0362/ It adds easy introspection abilities to Python callables. After a whirlwind of activity over the past several weeks we think it's ready. All it needs now is an official pronouncement from some seasoned veteran of the Python community. But that's where it's hit an impasse. Nick Coghlan has recused himself because he was heavily involved in shaping it. And obviously the authors (including myself, in a small way) are ineligible. Nobody else has stepped forward. Yet the feature freeze for 3.3 fast approaches--ominous, unstoppable, like a big round boulder headed straight for Indiana Jones. Time is running out. If you're BDFAP material, why not spend an enjoyable hour today perusing the fine work of these capable folks? Then naturally all you'd need do is haul out your rubber stamp. Mere moments later you'd be on your way, whistling a happy tune, a new spring in your step, knowing in your heart you'd made the world a better place. The reference implementation for CPython trunk is here: https://bitbucket.org/1st1/cpython/changesets/tip/branch(%22pep362%22) <https://bitbucket.org/1st1/cpython/changesets/tip/branch%28%22pep362%22%29> And here's the bug tracker issue: http://bugs.python.org/issue15008 So shines a good deed in a weary world, //arry/

6 21

Feature Freeze
by Ethan Furman 22 Jun '12

22 Jun '12

Does the feature freeze affect documentation enhancements? If it does, can somebody review (and commit! :) issues: http://bugs.python.org/issue14954 http://bugs.python.org/issue14617 Thanks! (And if not necessary before the feature freeze, sorry for the noise.) ~Ethan~

3 2

A reference leak with PyType_FromSpec
by Antoine Pitrou 22 Jun '12

22 Jun '12

Hi, As mentioned in the commit message for 96513d71e650, creating a type using PyType_FromSpec seems to leak references when the type is instantiated. This happens with SSLError: >>> e = ssl.SSLError() >>> sys.getrefcount(ssl.SSLError) 35 >>> e = ssl.SSLError() >>> sys.getrefcount(ssl.SSLError) 36 >>> e = ssl.SSLError() >>> sys.getrefcount(ssl.SSLError) 37 (the SSLError definition is quite simple; it only uses the Py_tp_base, Py_tp_doc and Py_tp_str slots) The SSLError subclasses, e.g. SSLWantReadError, which are created using PyErr_NewExceptionWithDoc, are not affected: >>> e = ssl.SSLWantReadError() >>> sys.getrefcount(ssl.SSLWantReadError) 8 >>> e = ssl.SSLWantReadError() >>> sys.getrefcount(ssl.SSLWantReadError) 8 >>> e = ssl.SSLWantReadError() >>> sys.getrefcount(ssl.SSLWantReadError) 8 Regards Antoine.

1 1

Summary of Python tracker Issues
by Python tracker 22 Jun '12

22 Jun '12

ACTIVITY SUMMARY (2012-06-15 - 2012-06-22) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 3482 (+10) closed 23435 (+51) total 26917 (+61) Open issues with patches: 1460 Issues opened (46) ================== #15079: pickle: Possibly misplaced test http://bugs.python.org/issue15079 opened by mstefanro #15080: Cookie library doesn't parse date properly http://bugs.python.org/issue15080 opened by jgillick #15082: [httplib] httplib.BadStatusLine on any HTTPS connection in cer http://bugs.python.org/issue15082 opened by jtr51 #15083: Rewrite ElementTree tests in a cleaner and safer way http://bugs.python.org/issue15083 opened by eli.bendersky #15088: PyGen_NeedsFinalizing is public, but undocumented http://bugs.python.org/issue15088 opened by ncoghlan #15090: Add etag support to urllib.request.urlretrieve() http://bugs.python.org/issue15090 opened by rhettinger #15091: ImportError when package is symlinked on Unix http://bugs.python.org/issue15091 opened by jason.coombs #15092: Using enum PyUnicode_Kind http://bugs.python.org/issue15092 opened by storchaka #15093: ntpath.isdir returns False for directory symlinks http://bugs.python.org/issue15093 opened by jason.coombs #15094: Incorrectly placed #endif in _tkinter.c. http://bugs.python.org/issue15094 opened by storchaka #15095: test_imaplib problem - intermittent skips and LOGINDISABLED no http://bugs.python.org/issue15095 opened by ncoghlan #15097: Improving wording on the thread-safeness of import http://bugs.python.org/issue15097 opened by valhallasw #15099: exec of function doesn't call __getitem__ or __missing__ on un http://bugs.python.org/issue15099 opened by johnf #15100: Race conditions in shutil.copy, shutil.copy2 and shutil.copyfi http://bugs.python.org/issue15100 opened by radoslaw.zarzynski #15101: multiprocessing pool finalizer can fail if triggered in backgr http://bugs.python.org/issue15101 opened by sbt #15102: Fix 64-bit building for buildbot scripts http://bugs.python.org/issue15102 opened by jkloth #15104: Unclear language in __main__ description http://bugs.python.org/issue15104 opened by techtonik #15105: curses: wrong indentation http://bugs.python.org/issue15105 opened by vjp #15106: Potential Bug in errors.c http://bugs.python.org/issue15106 opened by Ken.Cheung #15108: ERROR: SystemError: ./../Objects/tupleobject.c:118: bad argume http://bugs.python.org/issue15108 opened by pxd #15109: sqlite3.Connection.iterdump() dies with encoding exception http://bugs.python.org/issue15109 opened by ekontsevoy #15110: strange Tracebacks with importlib http://bugs.python.org/issue15110 opened by amaury.forgeotdarc #15111: Wrong ImportError message with importlib http://bugs.python.org/issue15111 opened by amaury.forgeotdarc #15112: argparse: nargs='*' positional argument doesn't accept any ite http://bugs.python.org/issue15112 opened by waltermundt #15114: Deprecate strict mode of HTMLParser http://bugs.python.org/issue15114 opened by ezio.melotti #15115: Duplicated Content-Transfer-Encoding header when applying emai http://bugs.python.org/issue15115 opened by cancel #15116: remove out-of-date Mac application scripting documentation http://bugs.python.org/issue15116 opened by hhas #15117: Please document top-level sqlite3 module variables http://bugs.python.org/issue15117 opened by wchlm #15118: uname and other os functions should return a struct sequence i http://bugs.python.org/issue15118 opened by larry #15119: ctypes mixed-types bitfield layout nonsensical; doesn't match http://bugs.python.org/issue15119 opened by mark.dickinson #15121: devguide doesn't document all bug tracker components http://bugs.python.org/issue15121 opened by petri.lehtinen #15122: Add an option to always rewrite single-file mailboxes in-place http://bugs.python.org/issue15122 opened by petri.lehtinen #15124: _thread.LockType: Optimize lock deletion, acquisition of uncon http://bugs.python.org/issue15124 opened by kristjan.jonsson #15125: argparse: positional arguments containing - in name not handle http://bugs.python.org/issue15125 opened by nstiurca #15127: Supressing warnings with -w "whether gcc supports ParseTuple" http://bugs.python.org/issue15127 opened by samueljohn #15128: inspect raises exception when frames are misleading about sour http://bugs.python.org/issue15128 opened by acapnotic #15130: remove redundant paragraph in socket howto http://bugs.python.org/issue15130 opened by tshepang #15131: Document py/pyw launchers http://bugs.python.org/issue15131 opened by brian.curtin #15132: Let unittest.TestProgram()'s defaultTest argument be a list http://bugs.python.org/issue15132 opened by cjerdonek #15133: tkinter.BooleanVar.get() docstring is wrong http://bugs.python.org/issue15133 opened by mark #15134: urllib.request.thishost() fails on OSX 10.7 http://bugs.python.org/issue15134 opened by ronaldoussoren #15135: HOWTOs doesn't link to "Idioms and Anti-Idioms" article http://bugs.python.org/issue15135 opened by fossilet #15136: Decimal accepting Fraction http://bugs.python.org/issue15136 opened by joncle #15137: Cleaned source of `cmd` module http://bugs.python.org/issue15137 opened by zearin #15138: base64.urlsafe_b64**code are too slow http://bugs.python.org/issue15138 opened by gvanrossum #15139: Speed up threading.Condition wakeup http://bugs.python.org/issue15139 opened by kristjan.jonsson Most recent 15 issues with no replies (15) ========================================== #15135: HOWTOs doesn't link to "Idioms and Anti-Idioms" article http://bugs.python.org/issue15135 #15134: urllib.request.thishost() fails on OSX 10.7 http://bugs.python.org/issue15134 #15133: tkinter.BooleanVar.get() docstring is wrong http://bugs.python.org/issue15133 #15132: Let unittest.TestProgram()'s defaultTest argument be a list http://bugs.python.org/issue15132 #15131: Document py/pyw launchers http://bugs.python.org/issue15131 #15130: remove redundant paragraph in socket howto http://bugs.python.org/issue15130 #15127: Supressing warnings with -w "whether gcc supports ParseTuple" http://bugs.python.org/issue15127 #15117: Please document top-level sqlite3 module variables http://bugs.python.org/issue15117 #15112: argparse: nargs='*' positional argument doesn't accept any ite http://bugs.python.org/issue15112 #15106: Potential Bug in errors.c http://bugs.python.org/issue15106 #15105: curses: wrong indentation http://bugs.python.org/issue15105 #15094: Incorrectly placed #endif in _tkinter.c. http://bugs.python.org/issue15094 #15092: Using enum PyUnicode_Kind http://bugs.python.org/issue15092 #15088: PyGen_NeedsFinalizing is public, but undocumented http://bugs.python.org/issue15088 #15083: Rewrite ElementTree tests in a cleaner and safer way http://bugs.python.org/issue15083 Most recent 15 issues waiting for review (15) ============================================= #15139: Speed up threading.Condition wakeup http://bugs.python.org/issue15139 #15130: remove redundant paragraph in socket howto http://bugs.python.org/issue15130 #15128: inspect raises exception when frames are misleading about sour http://bugs.python.org/issue15128 #15124: _thread.LockType: Optimize lock deletion, acquisition of uncon http://bugs.python.org/issue15124 #15119: ctypes mixed-types bitfield layout nonsensical; doesn't match http://bugs.python.org/issue15119 #15118: uname and other os functions should return a struct sequence i http://bugs.python.org/issue15118 #15114: Deprecate strict mode of HTMLParser http://bugs.python.org/issue15114 #15102: Fix 64-bit building for buildbot scripts http://bugs.python.org/issue15102 #15094: Incorrectly placed #endif in _tkinter.c. http://bugs.python.org/issue15094 #15092: Using enum PyUnicode_Kind http://bugs.python.org/issue15092 #15079: pickle: Possibly misplaced test http://bugs.python.org/issue15079 #15068: fileinput requires two EOF when reading stdin http://bugs.python.org/issue15068 #15063: Source code links for JSON documentation http://bugs.python.org/issue15063 #15061: hmac.secure_compare() leaks information about length of string http://bugs.python.org/issue15061 #15056: Have imp.cache_from_source() raise NotImplementedError when ca http://bugs.python.org/issue15056 Top 10 most discussed issues (10) ================================= #15038: Optimize python Locks on Windows http://bugs.python.org/issue15038 27 msgs #15061: hmac.secure_compare() leaks information about length of string http://bugs.python.org/issue15061 24 msgs #15104: Unclear language in __main__ description http://bugs.python.org/issue15104 9 msgs #14814: Implement PEP 3144 (the ipaddress module) http://bugs.python.org/issue14814 8 msgs #15008: PEP 362 "Signature Objects" reference implementation http://bugs.python.org/issue15008 8 msgs #15109: sqlite3.Connection.iterdump() dies with encoding exception http://bugs.python.org/issue15109 8 msgs #6727: ImportError when package is symlinked on Windows http://bugs.python.org/issue6727 7 msgs #15124: _thread.LockType: Optimize lock deletion, acquisition of uncon http://bugs.python.org/issue15124 7 msgs #13590: extension module builds fail with python.org OS X installers o http://bugs.python.org/issue13590 6 msgs #15052: Outdated comments in build_ssl.py http://bugs.python.org/issue15052 6 msgs Issues closed (46) ================== #7359: mailbox cannot modify mailboxes in system mail spool http://bugs.python.org/issue7359 closed by petri.lehtinen #7584: datetime.rfcformat() for Date and Time on the Internet http://bugs.python.org/issue7584 closed by belopolsky #10053: Don’t close fd when FileIO.__init__ fails http://bugs.python.org/issue10053 closed by hynek #12046: Windows build identification incomplete http://bugs.python.org/issue12046 closed by georg.brandl #13455: Reorganize tracker docs in the devguide http://bugs.python.org/issue13455 closed by ezio.melotti #13783: Clean up PEP 380 C API additions http://bugs.python.org/issue13783 closed by ncoghlan #13825: Datetime failing while reading active directory time attribute http://bugs.python.org/issue13825 closed by belopolsky #14055: Implement __sizeof__ for etree Element http://bugs.python.org/issue14055 closed by loewis #14059: Implement multiprocessing.Barrier http://bugs.python.org/issue14059 closed by sbt #14225: _cursesmodule compile error in OS X 32-bit-only installer buil http://bugs.python.org/issue14225 closed by ned.deily #14653: Improve mktime_tz to use calendar.timegm instead of time.mktim http://bugs.python.org/issue14653 closed by belopolsky #14657: Avoid two importlib copies http://bugs.python.org/issue14657 closed by pitrou #14684: zlib set dictionary support inflateSetDictionary http://bugs.python.org/issue14684 closed by nadeem.vawda #14769: Add test to automatically detect missing format units in skipi http://bugs.python.org/issue14769 closed by larry #14772: Return destination values in some shutil functions http://bugs.python.org/issue14772 closed by brian.curtin #14840: Tutorial: Add a bit on the difference between tuples and lists http://bugs.python.org/issue14840 closed by ezio.melotti #14874: Faster charmap decoding http://bugs.python.org/issue14874 closed by pitrou #14919: what disables one from adding self to the "nosy" list http://bugs.python.org/issue14919 closed by ezio.melotti #14928: Fix importlib bootstrapping issues http://bugs.python.org/issue14928 closed by pitrou #14933: Misleading documentation about weakrefs http://bugs.python.org/issue14933 closed by pitrou #14982: pkgutil.walk_packages seems to not work properly on Python 3.3 http://bugs.python.org/issue14982 closed by brett.cannon #15006: Allow equality comparison between naive and aware datetime obj http://bugs.python.org/issue15006 closed by belopolsky #15026: Faster UTF-16 encoding http://bugs.python.org/issue15026 closed by pitrou #15036: mailbox.mbox fails to pop two items in a row, flushing in betw http://bugs.python.org/issue15036 closed by petri.lehtinen #15043: test_gdb is disallowed by default security settings in Fedora http://bugs.python.org/issue15043 closed by ncoghlan #15054: bytes literals erroneously tokenized http://bugs.python.org/issue15054 closed by meador.inge #15064: Use context manager protocol for more multiprocessing types http://bugs.python.org/issue15064 closed by sbt #15074: Strange behaviour of python cmd module. (Ignores slash) http://bugs.python.org/issue15074 closed by ned.deily #15075: XincludeTest failure in test_xml_etree http://bugs.python.org/issue15075 closed by python-dev #15081: No documentation for PyState_FindModule() http://bugs.python.org/issue15081 closed by christian.heimes #15084: Add option to os.mkdir to not raise an exception for existing http://bugs.python.org/issue15084 closed by loewis #15085: set.union accepts not set iterables for all but the first argu http://bugs.python.org/issue15085 closed by r.david.murray #15086: Ubuntu bot: error while loading shared libraries http://bugs.python.org/issue15086 closed by pitrou #15087: Add gzip function to read gzip'd strings http://bugs.python.org/issue15087 closed by nadeem.vawda #15089: Add gzip support to urllib.request.retrieve() http://bugs.python.org/issue15089 closed by pitrou #15096: Drop support for the "ur" string prefix http://bugs.python.org/issue15096 closed by christian.heimes #15098: "TypeError" can give a misleading message http://bugs.python.org/issue15098 closed by r.david.murray #15103: Solaris compiler chokes on importlib.h http://bugs.python.org/issue15103 closed by pitrou #15107: Potential Bug in mpdecimal.c http://bugs.python.org/issue15107 closed by mark.dickinson #15113: IDLE Shell: delattr(__builtins__,"getattr") causes shell to st http://bugs.python.org/issue15113 closed by r.david.murray #15120: Different behavior of html.parser.HTMLParser http://bugs.python.org/issue15120 closed by hansokumake #15123: float().__format__() disregards given field width http://bugs.python.org/issue15123 closed by luismsgomes #15126: Theading isAlive() missing version note http://bugs.python.org/issue15126 closed by georg.brandl #15129: file.readline() cannot read weird ascii character in file http://bugs.python.org/issue15129 closed by amaury.forgeotdarc #1229239: optionally allow mutable builtin types http://bugs.python.org/issue1229239 closed by terry.reedy #730473: Add Py_AtInit() startup hook for extenders http://bugs.python.org/issue730473 closed by patmiller

1 0

PEP 362 - request for pronouncement
by Yury Selivanov 22 Jun '12

22 Jun '12

Hello, On behalf of Brett, Larry, and myself, I'm requesting for PEP 362 pronouncement. The PEP, has been updated with all feedback from python-dev list discussions. I'm posting the latest version of it with this message. The PEP is also available here: http://www.python.org/dev/peps/pep-0362/ The python issue tracking the patch: http://bugs.python.org/issue15008 The reception of the PEP was very positive, the API is minimalistic and future-proof; the implementation is stable, well tested, reviewed and should be ready to merge. Thank you, Yury PEP: 362 Title: Function Signature Object Version: $Revision$ Last-Modified: $Date$ Author: Brett Cannon <brett(a)python.org>, Jiwon Seo <seojiwon(a)gmail.com>, Yury Selivanov <yselivanov(a)sprymix.com>, Larry Hastings <larry(a)hastings.org> Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 21-Aug-2006 Python-Version: 3.3 Post-History: 04-Jun-2012 Abstract ======== Python has always supported powerful introspection capabilities, including introspecting functions and methods (for the rest of this PEP, "function" refers to both functions and methods). By examining a function object you can fully reconstruct the function's signature. Unfortunately this information is stored in an inconvenient manner, and is spread across a half-dozen deeply nested attributes. This PEP proposes a new representation for function signatures. The new representation contains all necessary information about a function and its parameters, and makes introspection easy and straightforward. However, this object does not replace the existing function metadata, which is used by Python itself to execute those functions. The new metadata object is intended solely to make function introspection easier for Python programmers. Signature Object ================ A Signature object represents the call signature of a function and its return annotation. For each parameter accepted by the function it stores a `Parameter object`_ in its ``parameters`` collection. A Signature object has the following public attributes and methods: * return_annotation : object The "return" annotation for the function. If the function has no "return" annotation, this attribute is not set. * parameters : OrderedDict An ordered mapping of parameters' names to the corresponding Parameter objects. * bind(\*args, \*\*kwargs) -> BoundArguments Creates a mapping from positional and keyword arguments to parameters. Raises a ``TypeError`` if the passed arguments do not match the signature. * bind_partial(\*args, \*\*kwargs) -> BoundArguments Works the same way as ``bind()``, but allows the omission of some required arguments (mimics ``functools.partial`` behavior.) Raises a ``TypeError`` if the passed arguments do not match the signature. * replace(parameters, \*, return_annotation) -> Signature Creates a new Signature instance based on the instance ``replace`` was invoked on. It is possible to pass different ``parameters`` and/or ``return_annotation`` to override the corresponding properties of the base signature. To remove ``return_annotation`` from the copied ``Signature``, pass in ``Signature.empty``. Signature objects are immutable. Use ``Signature.replace()`` to make a modified copy: :: >>> def foo() -> None: ... pass >>> sig = signature(foo) >>> new_sig = sig.replace(return_annotation="new return annotation") >>> new_sig is not sig True >>> new_sig.return_annotation != sig.return_annotation True >>> new_sig.parameters == sig.parameters True >>> new_sig = new_sig.replace(return_annotation=new_sig.empty) >>> hasattr(new_sig, "return_annotation") False There are two ways to instantiate a Signature class: * Signature(parameters, \*, return_annotation) Default Signature constructor. Accepts an optional sequence of ``Parameter`` objects, and an optional ``return_annotation``. Parameters sequence is validated to check that there are no parameters with duplicate names, and that the parameters are in the right order, i.e. positional-only first, then positional-or-keyword, etc. * Signature.from_function(function) Returns a Signature object reflecting the signature of the function passed in. It's possible to test Signatures for equality. Two signatures are equal when their parameters are equal, their positional and positional-only parameters appear in the same order, and they have equal return annotations. Changes to the Signature object, or to any of its data members, do not affect the function itself. Signature also implements ``__str__``: :: >>> str(Signature.from_function((lambda *args: None))) '(*args)' >>> str(Signature()) '()' Parameter Object ================ Python's expressive syntax means functions can accept many different kinds of parameters with many subtle semantic differences. We propose a rich Parameter object designed to represent any possible function parameter. A Parameter object has the following public attributes and methods: * name : str The name of the parameter as a string. Must be a valid python identifier name (with the exception of ``POSITIONAL_ONLY`` parameters, which can have it set to ``None``.) * default : object The default value for the parameter. If the parameter has no default value, this attribute is not set. * annotation : object The annotation for the parameter. If the parameter has no annotation, this attribute is not set. * kind Describes how argument values are bound to the parameter. Possible values: * ``Parameter.POSITIONAL_ONLY`` - value must be supplied as a positional argument. Python has no explicit syntax for defining positional-only parameters, but many built-in and extension module functions (especially those that accept only one or two parameters) accept them. * ``Parameter.POSITIONAL_OR_KEYWORD`` - value may be supplied as either a keyword or positional argument (this is the standard binding behaviour for functions implemented in Python.) * ``Parameter.KEYWORD_ONLY`` - value must be supplied as a keyword argument. Keyword only parameters are those which appear after a "*" or "\*args" entry in a Python function definition. * ``Parameter.VAR_POSITIONAL`` - a tuple of positional arguments that aren't bound to any other parameter. This corresponds to a "\*args" parameter in a Python function definition. * ``Parameter.VAR_KEYWORD`` - a dict of keyword arguments that aren't bound to any other parameter. This corresponds to a "\*\*kwds" parameter in a Python function definition. Always use ``Parameter.*`` constants for setting and checking value of the ``kind`` attribute. * replace(\*, name, kind, default, annotation) -> Parameter Creates a new Parameter instance based on the instance ``replaced`` was invoked on. To override a Parameter attribute, pass the corresponding argument. To remove an attribute from a ``Parameter``, pass ``Parameter.empty``. Parameter constructor: * Parameter(name, kind, \*, annotation, default) Instantiates a Parameter object. ``name`` and ``kind`` are required, while ``annotation`` and ``default`` are optional. Two parameters are equal when they have equal names, kinds, defaults, and annotations. Parameter objects are immutable. Instead of modifying a Parameter object, you can use ``Parameter.replace()`` to create a modified copy like so: :: >>> param = Parameter('foo', Parameter.KEYWORD_ONLY, default=42) >>> str(param) 'foo=42' >>> str(param.replace()) 'foo=42' >>> str(param.replace(default=Parameter.empty, annotation='spam')) "foo:'spam'" BoundArguments Object ===================== Result of a ``Signature.bind`` call. Holds the mapping of arguments to the function's parameters. Has the following public attributes: * arguments : OrderedDict An ordered, mutable mapping of parameters' names to arguments' values. Contains only explicitly bound arguments. Arguments for which ``bind()`` relied on a default value are skipped. * args : tuple Tuple of positional arguments values. Dynamically computed from the 'arguments' attribute. * kwargs : dict Dict of keyword arguments values. Dynamically computed from the 'arguments' attribute. The ``arguments`` attribute should be used in conjunction with ``Signature.parameters`` for any arguments processing purposes. ``args`` and ``kwargs`` properties can be used to invoke functions: :: def test(a, *, b): ... sig = signature(test) ba = sig.bind(10, b=20) test(*ba.args, **ba.kwargs) Arguments which could be passed as part of either ``*args`` or ``**kwargs`` will be included only in the ``BoundArguments.args`` attribute. Consider the following example: :: def test(a=1, b=2, c=3): pass sig = signature(test) ba = sig.bind(a=10, c=13) >>> ba.args (10,) >>> ba.kwargs: {'c': 13} Implementation ============== The implementation adds a new function ``signature()`` to the ``inspect`` module. The function is the preferred way of getting a ``Signature`` for a callable object. The function implements the following algorithm: - If the object is not callable - raise a TypeError - If the object has a ``__signature__`` attribute and if it is not ``None`` - return it - If it has a ``__wrapped__`` attribute, return ``signature(object.__wrapped__)`` - If the object is a an instance of ``FunctionType`` construct and return a new ``Signature`` for it - If the object is a bound method, construct and return a new ``Signature`` object, with its first parameter (usually ``self`` or ``cls``) removed - If the object is an instance of ``functools.partial``, construct a new ``Signature`` from its ``partial.func`` attribute, and account for already bound ``partial.args`` and ``partial.kwargs`` - If the object is a class or metaclass: - If the object's type has a ``__call__`` method defined in its MRO, return a Signature for it - If the object has a ``__new__`` method defined in its MRO, return a Signature object for it - If the object has a ``__init__`` method defined in its MRO, return a Signature object for it - Return ``signature(object.__call__)`` Note that the ``Signature`` object is created in a lazy manner, and is not automatically cached. However, the user can manually cache a Signature by storing it in the ``__signature__`` attribute. An implementation for Python 3.3 can be found at [#impl]_. The python issue tracking the patch is [#issue]_. Design Considerations ===================== No implicit caching of Signature objects ---------------------------------------- The first PEP design had a provision for implicit caching of ``Signature`` objects in the ``inspect.signature()`` function. However, this has the following downsides: * If the ``Signature`` object is cached then any changes to the function it describes will not be reflected in it. However, If the caching is needed, it can be always done manually and explicitly * It is better to reserve the ``__signature__`` attribute for the cases when there is a need to explicitly set to a ``Signature`` object that is different from the actual one Some functions may not be introspectable ---------------------------------------- Some functions may not be introspectable in certain implementations of Python. For example, in CPython, built-in functions defined in C provide no metadata about their arguments. Adding support for them is out of scope for this PEP. Signature and Parameter equivalence ----------------------------------- We assume that parameter names have semantic significance--two signatures are equal only when their corresponding parameters are equal and have the exact same names. Users who want looser equivalence tests, perhaps ignoring names of VAR_KEYWORD or VAR_POSITIONAL parameters, will need to implement those themselves. Examples ======== Visualizing Callable Objects' Signature --------------------------------------- Let's define some classes and functions: :: from inspect import signature from functools import partial, wraps class FooMeta(type): def __new__(mcls, name, bases, dct, *, bar:bool=False): return super().__new__(mcls, name, bases, dct) def __init__(cls, name, bases, dct, **kwargs): return super().__init__(name, bases, dct) class Foo(metaclass=FooMeta): def __init__(self, spam:int=42): self.spam = spam def __call__(self, a, b, *, c) -> tuple: return a, b, c @classmethod def spam(cls, a): return a def shared_vars(*shared_args): """Decorator factory that defines shared variables that are passed to every invocation of the function""" def decorator(f): @wraps(f) def wrapper(*args, **kwds): full_args = shared_args + args return f(*full_args, **kwds) # Override signature sig = signature(f) sig = sig.replace(tuple(sig.parameters.values())[1:]) wrapper.__signature__ = sig return wrapper return decorator @shared_vars({}) def example(_state, a, b, c): return _state, a, b, c def format_signature(obj): return str(signature(obj)) Now, in the python REPL: :: >>> format_signature(FooMeta) '(name, bases, dct, *, bar:bool=False)' >>> format_signature(Foo) '(spam:int=42)' >>> format_signature(Foo.__call__) '(self, a, b, *, c) -> tuple' >>> format_signature(Foo().__call__) '(a, b, *, c) -> tuple' >>> format_signature(Foo.spam) '(a)' >>> format_signature(partial(Foo().__call__, 1, c=3)) '(b, *, c=3) -> tuple' >>> format_signature(partial(partial(Foo().__call__, 1, c=3), 2, c=20)) '(*, c=20) -> tuple' >>> format_signature(example) '(a, b, c)' >>> format_signature(partial(example, 1, 2)) '(c)' >>> format_signature(partial(partial(example, 1, b=2), c=3)) '(b=2, c=3)' Annotation Checker ------------------ :: import inspect import functools def checktypes(func): '''Decorator to verify arguments and return types Example: >>> @checktypes ... def test(a:int, b:str) -> int: ... return int(a * b) >>> test(10, '1') 1111111111 >>> test(10, 1) Traceback (most recent call last): ... ValueError: foo: wrong type of 'b' argument, 'str' expected, got 'int' ''' sig = inspect.signature(func) types = {} for param in sig.parameters.values(): # Iterate through function's parameters and build the list of # arguments types try: type_ = param.annotation except AttributeError: continue else: if not inspect.isclass(type_): # Not a type, skip it continue types[param.name] = type_ # If the argument has a type specified, let's check that its # default value (if present) conforms with the type. try: default = param.default except AttributeError: continue else: if not isinstance(default, type_): raise ValueError("{func}: wrong type of a default value for {arg!r}". \ format(func=func.__qualname__, arg=param.name)) def check_type(sig, arg_name, arg_type, arg_value): # Internal function that encapsulates arguments type checking if not isinstance(arg_value, arg_type): raise ValueError("{func}: wrong type of {arg!r} argument, " \ "{exp!r} expected, got {got!r}". \ format(func=func.__qualname__, arg=arg_name, exp=arg_type.__name__, got=type(arg_value).__name__)) @functools.wraps(func) def wrapper(*args, **kwargs): # Let's bind the arguments ba = sig.bind(*args, **kwargs) for arg_name, arg in ba.arguments.items(): # And iterate through the bound arguments try: type_ = types[arg_name] except KeyError: continue else: # OK, we have a type for the argument, lets get the corresponding # parameter description from the signature object param = sig.parameters[arg_name] if param.kind == param.VAR_POSITIONAL: # If this parameter is a variable-argument parameter, # then we need to check each of its values for value in arg: check_type(sig, arg_name, type_, value) elif param.kind == param.VAR_KEYWORD: # If this parameter is a variable-keyword-argument parameter: for subname, value in arg.items(): check_type(sig, arg_name + ':' + subname, type_, value) else: # And, finally, if this parameter a regular one: check_type(sig, arg_name, type_, arg) result = func(*ba.args, **ba.kwargs) # The last bit - let's check that the result is correct try: return_type = sig.return_annotation except AttributeError: # Looks like we don't have any restriction on the return type pass else: if isinstance(return_type, type) and not isinstance(result, return_type): raise ValueError('{func}: wrong return type, {exp} expected, got {got}'. \ format(func=func.__qualname__, exp=return_type.__name__, got=type(result).__name__)) return result return wrapper References ========== .. [#impl] pep362 branch (https://bitbucket.org/1st1/cpython/overview) .. [#issue] issue 15008 (http://bugs.python.org/issue15008) Copyright ========= This document has been placed in the public domain. .. Local Variables: mode: indented-text indent-tabs-mode: nil sentence-end-double-space: t fill-column: 70 coding: utf-8 End:

2 1

Accepting PEP 397
by Brian Curtin 22 Jun '12

22 Jun '12

As the PEP czar for 397, after Martin's final updates, I hereby pronounce this PEP "accepted"! Thanks to Mark Hammond for kicking it off, Vinay Sajip for writing up the code, Martin von Loewis for recent updates, and everyone in the community who contributed to the discussions. I will begin integration work this evening.

2 2

import too slow on NFS based systems
by Daniel Braniss 21 Jun '12

21 Jun '12

Hi, when lib/python/site-packages/ is accessed via NFS, open/stat/access is very expensive/slow. A simple solution is to use an in memory directory search/hash, so I was wondering if this has been concidered in the past, if not, and I come with a working solution for Unix (at least Linux/Freebsd) will it be concidered. thanks, danny

4 5

Re: [Python-Dev] [Python-checkins] peps: The latest changes from Yury Selivanov. I can almost taste the acceptance!
by Eric Snow 21 Jun '12

21 Jun '12

On Thu, Jun 21, 2012 at 2:44 AM, larry.hastings <python-checkins(a)python.org> wrote: > http://hg.python.org/peps/rev/1edf1cecae7d > changeset: 4472:1edf1cecae7d > user: Larry Hastings <larry(a)hastings.org> > date: Thu Jun 21 01:44:15 2012 -0700 > summary: > The latest changes from Yury Selivanov. I can almost taste the acceptance! > > files: > pep-0362.txt | 159 +++++++++++++++++++++++++++++++------- > 1 files changed, 128 insertions(+), 31 deletions(-) > > > diff --git a/pep-0362.txt b/pep-0362.txt > --- a/pep-0362.txt > +++ b/pep-0362.txt > @@ -42,23 +42,58 @@ > A Signature object has the following public attributes and methods: > > * return_annotation : object > - The annotation for the return type of the function if specified. > - If the function has no annotation for its return type, this > - attribute is not set. > + The "return" annotation for the function. If the function > + has no "return" annotation, this attribute is not set. > + > * parameters : OrderedDict > An ordered mapping of parameters' names to the corresponding > - Parameter objects (keyword-only arguments are in the same order > - as listed in ``code.co_varnames``). > + Parameter objects. > + > * bind(\*args, \*\*kwargs) -> BoundArguments > Creates a mapping from positional and keyword arguments to > parameters. Raises a ``TypeError`` if the passed arguments do > not match the signature. > + > * bind_partial(\*args, \*\*kwargs) -> BoundArguments > Works the same way as ``bind()``, but allows the omission > of some required arguments (mimics ``functools.partial`` > behavior.) Raises a ``TypeError`` if the passed arguments do > not match the signature. > > +* replace(parameters, \*, return_annotation) -> Signature Shouldn't it be something like this: * replace_(*parameters, [return_annotation]) -> Signature Or is parameters supposed to be a dict/OrderedDict of replacements/additions? > + Creates a new Signature instance based on the instance > + ``replace`` was invoked on. It is possible to pass different > + ``parameters`` and/or ``return_annotation`` to override the > + corresponding properties of the base signature. To remove > + ``return_annotation`` from the copied ``Signature``, pass in > + ``Signature.empty``. Can you likewise remove parameters this way? > + > +Signature objects are immutable. Use ``Signature.replace()`` to > +make a modified copy: > +:: > + > + >>> sig = signature(foo) > + >>> new_sig = sig.replace(return_annotation="new return annotation") > + >>> new_sig is not sig > + True > + >>> new_sig.return_annotation == sig.return_annotation > + True Should be False here, right? > + >>> new_sig.parameters == sig.parameters > + True An example of replacing parameters would also be good here. > + > +There are two ways to instantiate a Signature class: > + > +* Signature(parameters, *, return_annotation) Same here as with Signature.replace(). > + Default Signature constructor. Accepts an optional sequence > + of ``Parameter`` objects, and an optional ``return_annotation``. > + Parameters sequence is validated to check that there are no > + parameters with duplicate names, and that the parameters > + are in the right order, i.e. positional-only first, then > + positional-or-keyword, etc. > +* Signature.from_function(function) > + Returns a Signature object reflecting the signature of the > + function passed in. > + > It's possible to test Signatures for equality. Two signatures are > equal when their parameters are equal, their positional and > positional-only parameters appear in the same order, and they > @@ -67,9 +102,14 @@ > Changes to the Signature object, or to any of its data members, > do not affect the function itself. > > -Signature also implements ``__str__`` and ``__copy__`` methods. > -The latter creates a shallow copy of Signature, with all Parameter > -objects copied as well. > +Signature also implements ``__str__``: > +:: > + > + >>> str(Signature.from_function((lambda *args: None))) > + '(*args)' > + > + >>> str(Signature()) > + '()' > > > Parameter Object > @@ -80,20 +120,22 @@ > propose a rich Parameter object designed to represent any possible > function parameter. > > -The structure of the Parameter object is: > +A Parameter object has the following public attributes and methods: > > * name : str > - The name of the parameter as a string. > + The name of the parameter as a string. Must be a valid > + python identifier name (with the exception of ``POSITIONAL_ONLY`` > + parameters, which can have it set to ``None``.) > > * default : object > - The default value for the parameter, if specified. If the > - parameter has no default value, this attribute is not set. > + The default value for the parameter. If the parameter has no > + default value, this attribute is not set. > > * annotation : object > - The annotation for the parameter if specified. If the > - parameter has no annotation, this attribute is not set. > + The annotation for the parameter. If the parameter has no > + annotation, this attribute is not set. > > -* kind : str > +* kind > Describes how argument values are bound to the parameter. > Possible values: > > @@ -101,7 +143,7 @@ > as a positional argument. > > Python has no explicit syntax for defining positional-only > - parameters, but many builtin and extension module functions > + parameters, but many built-in and extension module functions > (especially those that accept only one or two parameters) > accept them. > > @@ -124,9 +166,30 @@ > that aren't bound to any other parameter. This corresponds > to a "\*\*kwds" parameter in a Python function definition. > > +* replace(\*, name, kind, default, annotation) -> Parameter > + Creates a new Parameter instance based on the instance > + ``replaced`` was invoked on. To override a Parameter > + attribute, pass the corresponding argument. To remove > + an attribute from a ``Parameter``, pass ``Parameter.empty``. > + > + > Two parameters are equal when they have equal names, kinds, defaults, > and annotations. > > +Parameter objects are immutable. Instead of modifying a Parameter object, > +you can use ``Parameter.replace()`` to create a modified copy like so: > +:: > + > + >>> param = Parameter('foo', Parameter.KEYWORD_ONLY, default=42) > + >>> str(param) > + 'foo=42' > + > + >>> str(param.replace()) > + 'foo=42' > + > + >>> str(param.replace(default=Parameter.empty, annotation='spam')) > + "foo:'spam'" > + > > BoundArguments Object > ===================== > @@ -138,7 +201,8 @@ > > * arguments : OrderedDict > An ordered, mutable mapping of parameters' names to arguments' values. > - Does not contain arguments' default values. > + Contains only explicitly bound arguments. Arguments for > + which ``bind()`` relied on a default value are skipped. > * args : tuple > Tuple of positional arguments values. Dynamically computed from > the 'arguments' attribute. > @@ -159,6 +223,23 @@ > ba = sig.bind(10, b=20) > test(*ba.args, **ba.kwargs) > > +Arguments which could be passed as part of either ``*args`` or ``**kwargs`` > +will be included only in the ``BoundArguments.args`` attribute. Consider the Why wouldn't the kwargs go into BoundArguments.kwargs? > +following example: > +:: > + > + def test(a=1, b=2, c=3): > + pass > + > + sig = signature(test) > + ba = sig.bind(a=10, c=13) > + > + >>> ba.args > + (10,) > + > + >>> ba.kwargs: > + {'c': 13} > + > > Implementation > ============== > @@ -172,7 +253,7 @@ > - If the object is not callable - raise a TypeError > > - If the object has a ``__signature__`` attribute and if it > - is not ``None`` - return a shallow copy of it > + is not ``None`` - return it > > - If it has a ``__wrapped__`` attribute, return > ``signature(object.__wrapped__)`` > @@ -180,12 +261,9 @@ > - If the object is a an instance of ``FunctionType`` construct s/``FunctionType`` construct/``FunctionType``, construct/ > and return a new ``Signature`` for it > > - - If the object is a method or a classmethod, construct and return > - a new ``Signature`` object, with its first parameter (usually > - ``self`` or ``cls``) removed > - > - - If the object is a staticmethod, construct and return > - a new ``Signature`` object > + - If the object is a method, construct and return a new ``Signature`` > + object, with its first parameter (usually ``self`` or ``cls``) > + removed It may be worth explicitly clarify that it refers to bound methods (and classmethods) here. Also, inspect.getfullargspec() doesn't strip out the self/cls. Would it be okay to store that implicit first argument (self/cls) on the Signature object somehow? Explicit is better than implicit. It's certainly a very special case: the only implicit (and unavoidable) arguments of any kind of callable. If the self were stored on the Signature, I'd also expect that Signature.replace() would leave it out (as would any other copy mechanism). > > - If the object is an instance of ``functools.partial``, construct > a new ``Signature`` from its ``partial.func`` attribute, and > @@ -196,15 +274,15 @@ > - If the object's type has a ``__call__`` method defined in > its MRO, return a Signature for it > > - - If the object has a ``__new__`` method defined in its class, > + - If the object has a ``__new__`` method defined in its MRO, > return a Signature object for it > > - - If the object has a ``__init__`` method defined in its class, > + - If the object has a ``__init__`` method defined in its MRO, > return a Signature object for it > > - Return ``signature(object.__call__)`` > > -Note, that the ``Signature`` object is created in a lazy manner, and > +Note that the ``Signature`` object is created in a lazy manner, and > is not automatically cached. If, however, the Signature object was > explicitly cached by the user, ``signature()`` returns a new shallow copy > of it on each invocation. > @@ -236,11 +314,21 @@ > ---------------------------------------- > > Some functions may not be introspectable in certain implementations of > -Python. For example, in CPython, builtin functions defined in C provide > +Python. For example, in CPython, built-in functions defined in C provide > no metadata about their arguments. Adding support for them is out of > scope for this PEP. > > > +Signature and Parameter equivalence > +----------------------------------- > + > +We assume that parameter names have semantic significance--two > +signatures are equal only when their corresponding parameters have > +the exact same names. Users who want looser equivalence tests, perhaps > +ignoring names of VAR_KEYWORD or VAR_POSITIONAL parameters, will > +need to implement those themselves. > + > + > Examples > ======== > > @@ -270,6 +358,10 @@ > def __call__(self, a, b, *, c) -> tuple: > return a, b, c > > + @classmethod > + def spam(cls, a): > + return a > + > > def shared_vars(*shared_args): > """Decorator factory that defines shared variables that are > @@ -280,10 +372,12 @@ > def wrapper(*args, **kwds): > full_args = shared_args + args > return f(*full_args, **kwds) > + > # Override signature > - sig = wrapper.__signature__ = signature(f) > - for __ in shared_args: > - sig.parameters.popitem(last=False) > + sig = signature(f) > + sig = sig.replace(tuple(sig.parameters.values())[1:]) > + wrapper.__signature__ = sig > + > return wrapper > return decorator > > @@ -313,6 +407,9 @@ > >>> format_signature(Foo().__call__) > '(a, b, *, c) -> tuple' > > + >>> format_signature(Foo.spam) > + '(a)' > + > >>> format_signature(partial(Foo().__call__, 1, c=3)) > '(b, *, c=3) -> tuple' I'm really impressed by the great work on this and how well the PEP process has been working here. This is a great addition to Python! -eric

2 1

PEP 362 6th edition
by Yury Selivanov 21 Jun '12

21 Jun '12

Hello, The new revision of PEP 362 has been posted: http://www.python.org/dev/peps/pep-0362/ Summary: 1. Signature & Parameter objects are now immutable 2. Signature.replace() and Parameter.replace() 3. Signature has a new default constructor, which accepts parameters list and a return_annotation. Parameters list is checked for the correct order (i.e. keyword-only before var-keyword, not vice-versa) The second way to instantiate Signatures is to use 'from_function', which creates a Signature object for the passed function. 4. Parameter.__str__ 5. Positional-only arguments are rendered in '<>' 6. PEP was updated to include new documentation & small examples. The implementation is updated and 100% test covered. Please see the issue: http://bugs.python.org/issue15008 Open questions: Just one - Should we rename 'replace()' to 'new()'? I like 'new()' a bit better - it suggests that we'll get a new object. - Yury PEP: 362 Title: Function Signature Object Version: $Revision$ Last-Modified: $Date$ Author: Brett Cannon <brett(a)python.org>, Jiwon Seo <seojiwon(a)gmail.com>, Yury Selivanov <yselivanov(a)sprymix.com>, Larry Hastings <larry(a)hastings.org> Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 21-Aug-2006 Python-Version: 3.3 Post-History: 04-Jun-2012 Abstract ======== Python has always supported powerful introspection capabilities, including introspecting functions and methods (for the rest of this PEP, "function" refers to both functions and methods). By examining a function object you can fully reconstruct the function's signature. Unfortunately this information is stored in an inconvenient manner, and is spread across a half-dozen deeply nested attributes. This PEP proposes a new representation for function signatures. The new representation contains all necessary information about a function and its parameters, and makes introspection easy and straightforward. However, this object does not replace the existing function metadata, which is used by Python itself to execute those functions. The new metadata object is intended solely to make function introspection easier for Python programmers. Signature Object ================ A Signature object represents the call signature of a function and its return annotation. For each parameter accepted by the function it stores a `Parameter object`_ in its ``parameters`` collection. A Signature object has the following public attributes and methods: * return_annotation : object The "return" annotation for the function. If the function has no "return" annotation, this attribute is not set. * parameters : OrderedDict An ordered mapping of parameters' names to the corresponding Parameter objects. * bind(\*args, \*\*kwargs) -> BoundArguments Creates a mapping from positional and keyword arguments to parameters. Raises a ``TypeError`` if the passed arguments do not match the signature. * bind_partial(\*args, \*\*kwargs) -> BoundArguments Works the same way as ``bind()``, but allows the omission of some required arguments (mimics ``functools.partial`` behavior.) Raises a ``TypeError`` if the passed arguments do not match the signature. * replace(parameters, \*, return_annotation) -> Signature Creates a new Signature instance based on the instance ``replace`` was invoked on. It is possible to pass different ``parameters`` and/or ``return_annotation`` to override the corresponding properties of the base signature. To remove ``return_annotation`` from the copied ``Signature``, pass in ``Signature.empty``. Signature objects are immutable. Use ``Signature.replace()`` to make a modified copy: :: >>> def foo() -> None: ... pass >>> sig = signature(foo) >>> new_sig = sig.replace(return_annotation="new return annotation") >>> new_sig is not sig True >>> new_sig.return_annotation != sig.return_annotation True >>> new_sig.parameters == sig.parameters True >>> new_sig = new_sig.replace(return_annotation=new_sig.empty) >>> hasattr(new_sig, "return_annotation") False There are two ways to instantiate a Signature class: * Signature(parameters, \*, return_annotation) Default Signature constructor. Accepts an optional sequence of ``Parameter`` objects, and an optional ``return_annotation``. Parameters sequence is validated to check that there are no parameters with duplicate names, and that the parameters are in the right order, i.e. positional-only first, then positional-or-keyword, etc. * Signature.from_function(function) Returns a Signature object reflecting the signature of the function passed in. It's possible to test Signatures for equality. Two signatures are equal when their parameters are equal, their positional and positional-only parameters appear in the same order, and they have equal return annotations. Changes to the Signature object, or to any of its data members, do not affect the function itself. Signature also implements ``__str__``: :: >>> str(Signature.from_function((lambda *args: None))) '(*args)' >>> str(Signature()) '()' Parameter Object ================ Python's expressive syntax means functions can accept many different kinds of parameters with many subtle semantic differences. We propose a rich Parameter object designed to represent any possible function parameter. A Parameter object has the following public attributes and methods: * name : str The name of the parameter as a string. Must be a valid python identifier name (with the exception of ``POSITIONAL_ONLY`` parameters, which can have it set to ``None``.) * default : object The default value for the parameter. If the parameter has no default value, this attribute is not set. * annotation : object The annotation for the parameter. If the parameter has no annotation, this attribute is not set. * kind Describes how argument values are bound to the parameter. Possible values: * ``Parameter.POSITIONAL_ONLY`` - value must be supplied as a positional argument. Python has no explicit syntax for defining positional-only parameters, but many built-in and extension module functions (especially those that accept only one or two parameters) accept them. * ``Parameter.POSITIONAL_OR_KEYWORD`` - value may be supplied as either a keyword or positional argument (this is the standard binding behaviour for functions implemented in Python.) * ``Parameter.KEYWORD_ONLY`` - value must be supplied as a keyword argument. Keyword only parameters are those which appear after a "*" or "\*args" entry in a Python function definition. * ``Parameter.VAR_POSITIONAL`` - a tuple of positional arguments that aren't bound to any other parameter. This corresponds to a "\*args" parameter in a Python function definition. * ``Parameter.VAR_KEYWORD`` - a dict of keyword arguments that aren't bound to any other parameter. This corresponds to a "\*\*kwds" parameter in a Python function definition. Always use ``Parameter.*`` constants for setting and checking value of the ``kind`` attribute. * replace(\*, name, kind, default, annotation) -> Parameter Creates a new Parameter instance based on the instance ``replaced`` was invoked on. To override a Parameter attribute, pass the corresponding argument. To remove an attribute from a ``Parameter``, pass ``Parameter.empty``. Parameter constructor: * Parameter(name, kind, \*, annotation, default) Instantiates a Parameter object. ``name`` and ``kind`` are required, while ``annotation`` and ``default`` are optional. Two parameters are equal when they have equal names, kinds, defaults, and annotations. Parameter objects are immutable. Instead of modifying a Parameter object, you can use ``Parameter.replace()`` to create a modified copy like so: :: >>> param = Parameter('foo', Parameter.KEYWORD_ONLY, default=42) >>> str(param) 'foo=42' >>> str(param.replace()) 'foo=42' >>> str(param.replace(default=Parameter.empty, annotation='spam')) "foo:'spam'" BoundArguments Object ===================== Result of a ``Signature.bind`` call. Holds the mapping of arguments to the function's parameters. Has the following public attributes: * arguments : OrderedDict An ordered, mutable mapping of parameters' names to arguments' values. Contains only explicitly bound arguments. Arguments for which ``bind()`` relied on a default value are skipped. * args : tuple Tuple of positional arguments values. Dynamically computed from the 'arguments' attribute. * kwargs : dict Dict of keyword arguments values. Dynamically computed from the 'arguments' attribute. The ``arguments`` attribute should be used in conjunction with ``Signature.parameters`` for any arguments processing purposes. ``args`` and ``kwargs`` properties can be used to invoke functions: :: def test(a, *, b): ... sig = signature(test) ba = sig.bind(10, b=20) test(*ba.args, **ba.kwargs) Arguments which could be passed as part of either ``*args`` or ``**kwargs`` will be included only in the ``BoundArguments.args`` attribute. Consider the following example: :: def test(a=1, b=2, c=3): pass sig = signature(test) ba = sig.bind(a=10, c=13) >>> ba.args (10,) >>> ba.kwargs: {'c': 13} Implementation ============== The implementation adds a new function ``signature()`` to the ``inspect`` module. The function is the preferred way of getting a ``Signature`` for a callable object. The function implements the following algorithm: - If the object is not callable - raise a TypeError - If the object has a ``__signature__`` attribute and if it is not ``None`` - return it - If it has a ``__wrapped__`` attribute, return ``signature(object.__wrapped__)`` - If the object is a an instance of ``FunctionType`` construct and return a new ``Signature`` for it - If the object is a method, construct and return a new ``Signature`` object, with its first parameter (usually ``self`` or ``cls``) removed - If the object is an instance of ``functools.partial``, construct a new ``Signature`` from its ``partial.func`` attribute, and account for already bound ``partial.args`` and ``partial.kwargs`` - If the object is a class or metaclass: - If the object's type has a ``__call__`` method defined in its MRO, return a Signature for it - If the object has a ``__new__`` method defined in its MRO, return a Signature object for it - If the object has a ``__init__`` method defined in its MRO, return a Signature object for it - Return ``signature(object.__call__)`` Note that the ``Signature`` object is created in a lazy manner, and is not automatically cached. However, the user can manually cache a Signature by storing it in the ``__signature__`` attribute. An implementation for Python 3.3 can be found at [#impl]_. The python issue tracking the patch is [#issue]_. Design Considerations ===================== No implicit caching of Signature objects ---------------------------------------- The first PEP design had a provision for implicit caching of ``Signature`` objects in the ``inspect.signature()`` function. However, this has the following downsides: * If the ``Signature`` object is cached then any changes to the function it describes will not be reflected in it. However, If the caching is needed, it can be always done manually and explicitly * It is better to reserve the ``__signature__`` attribute for the cases when there is a need to explicitly set to a ``Signature`` object that is different from the actual one Some functions may not be introspectable ---------------------------------------- Some functions may not be introspectable in certain implementations of Python. For example, in CPython, built-in functions defined in C provide no metadata about their arguments. Adding support for them is out of scope for this PEP. Signature and Parameter equivalence ----------------------------------- We assume that parameter names have semantic significance--two signatures are equal only when their corresponding parameters are equal and have the exact same names. Users who want looser equivalence tests, perhaps ignoring names of VAR_KEYWORD or VAR_POSITIONAL parameters, will need to implement those themselves. Examples ======== Visualizing Callable Objects' Signature --------------------------------------- Let's define some classes and functions: :: from inspect import signature from functools import partial, wraps class FooMeta(type): def __new__(mcls, name, bases, dct, *, bar:bool=False): return super().__new__(mcls, name, bases, dct) def __init__(cls, name, bases, dct, **kwargs): return super().__init__(name, bases, dct) class Foo(metaclass=FooMeta): def __init__(self, spam:int=42): self.spam = spam def __call__(self, a, b, *, c) -> tuple: return a, b, c @classmethod def spam(cls, a): return a def shared_vars(*shared_args): """Decorator factory that defines shared variables that are passed to every invocation of the function""" def decorator(f): @wraps(f) def wrapper(*args, **kwds): full_args = shared_args + args return f(*full_args, **kwds) # Override signature sig = signature(f) sig = sig.replace(tuple(sig.parameters.values())[1:]) wrapper.__signature__ = sig return wrapper return decorator @shared_vars({}) def example(_state, a, b, c): return _state, a, b, c def format_signature(obj): return str(signature(obj)) Now, in the python REPL: :: >>> format_signature(FooMeta) '(name, bases, dct, *, bar:bool=False)' >>> format_signature(Foo) '(spam:int=42)' >>> format_signature(Foo.__call__) '(self, a, b, *, c) -> tuple' >>> format_signature(Foo().__call__) '(a, b, *, c) -> tuple' >>> format_signature(Foo.spam) '(a)' >>> format_signature(partial(Foo().__call__, 1, c=3)) '(b, *, c=3) -> tuple' >>> format_signature(partial(partial(Foo().__call__, 1, c=3), 2, c=20)) '(*, c=20) -> tuple' >>> format_signature(example) '(a, b, c)' >>> format_signature(partial(example, 1, 2)) '(c)' >>> format_signature(partial(partial(example, 1, b=2), c=3)) '(b=2, c=3)' Annotation Checker ------------------ :: import inspect import functools def checktypes(func): '''Decorator to verify arguments and return types Example: >>> @checktypes ... def test(a:int, b:str) -> int: ... return int(a * b) >>> test(10, '1') 1111111111 >>> test(10, 1) Traceback (most recent call last): ... ValueError: foo: wrong type of 'b' argument, 'str' expected, got 'int' ''' sig = inspect.signature(func) types = {} for param in sig.parameters.values(): # Iterate through function's parameters and build the list of # arguments types try: type_ = param.annotation except AttributeError: continue else: if not inspect.isclass(type_): # Not a type, skip it continue types[param.name] = type_ # If the argument has a type specified, let's check that its # default value (if present) conforms with the type. try: default = param.default except AttributeError: continue else: if not isinstance(default, type_): raise ValueError("{func}: wrong type of a default value for {arg!r}". \ format(func=func.__qualname__, arg=param.name)) def check_type(sig, arg_name, arg_type, arg_value): # Internal function that encapsulates arguments type checking if not isinstance(arg_value, arg_type): raise ValueError("{func}: wrong type of {arg!r} argument, " \ "{exp!r} expected, got {got!r}". \ format(func=func.__qualname__, arg=arg_name, exp=arg_type.__name__, got=type(arg_value).__name__)) @functools.wraps(func) def wrapper(*args, **kwargs): # Let's bind the arguments ba = sig.bind(*args, **kwargs) for arg_name, arg in ba.arguments.items(): # And iterate through the bound arguments try: type_ = types[arg_name] except KeyError: continue else: # OK, we have a type for the argument, lets get the corresponding # parameter description from the signature object param = sig.parameters[arg_name] if param.kind == param.VAR_POSITIONAL: # If this parameter is a variable-argument parameter, # then we need to check each of its values for value in arg: check_type(sig, arg_name, type_, value) elif param.kind == param.VAR_KEYWORD: # If this parameter is a variable-keyword-argument parameter: for subname, value in arg.items(): check_type(sig, arg_name + ':' + subname, type_, value) else: # And, finally, if this parameter a regular one: check_type(sig, arg_name, type_, arg) result = func(*ba.args, **ba.kwargs) # The last bit - let's check that the result is correct try: return_type = sig.return_annotation except AttributeError: # Looks like we don't have any restriction on the return type pass else: if isinstance(return_type, type) and not isinstance(result, return_type): raise ValueError('{func}: wrong return type, {exp} expected, got {got}'. \ format(func=func.__qualname__, exp=return_type.__name__, got=type(result).__name__)) return result return wrapper References ========== .. [#impl] pep362 branch (https://bitbucket.org/1st1/cpython/overview) .. [#issue] issue 15008 (http://bugs.python.org/issue15008) Copyright ========= This document has been placed in the public domain. .. Local Variables: mode: indented-text indent-tabs-mode: nil sentence-end-double-space: t fill-column: 70 coding: utf-8 End:

1 0