Mailman 3 August 2012 - Python-Dev

Re: [Python-Dev] [Python-checkins] cpython: Update the What's New details for importlib based on doc/ABC changes.
by Brett Cannon Aug. 2, 2012

Aug. 2, 2012

Sorry about accidentally committing another minor cleanup to importlib in this commit; thought I had already committed it separately. On Thu, Aug 2, 2012 at 5:50 PM, brett.cannon <python-checkins(a)python.org>wrote: > http://hg.python.org/cpython/rev/083534cd7874 > changeset: 78388:083534cd7874 > user: Brett Cannon <brett(a)python.org> > date: Thu Aug 02 17:50:06 2012 -0400 > summary: > Update the What's New details for importlib based on doc/… [View More]ABC changes. > > files: > Doc/library/importlib.rst | 10 ++++++---- > Doc/whatsnew/3.3.rst | 24 +++++++++++++++++++----- > 2 files changed, 25 insertions(+), 9 deletions(-) > > > diff --git a/Doc/library/importlib.rst b/Doc/library/importlib.rst > --- a/Doc/library/importlib.rst > +++ b/Doc/library/importlib.rst > @@ -141,9 +141,10 @@ > longer requires implementation of a ``find_module()`` method. > > > -.. class:: MetaPathFinder(Finder) > +.. class:: MetaPathFinder > > - An abstract base class representing a :term:`meta path finder`. > + An abstract base class representing a :term:`meta path finder` and > + inheriting from :class:`Finder`. > > .. versionadded:: 3.3 > > @@ -156,9 +157,10 @@ > package. If a loader cannot be found, ``None`` is returned. > > > -.. class:: PathEntryFinder(Finder) > +.. class:: PathEntryFinder > > - An abstract base class representing a :term:`path entry finder`. > + An abstract base class representing a :term:`path entry finder` and > + inheriting from :class:`Finder`. > > .. versionadded:: 3.3 > > diff --git a/Doc/whatsnew/3.3.rst b/Doc/whatsnew/3.3.rst > --- a/Doc/whatsnew/3.3.rst > +++ b/Doc/whatsnew/3.3.rst > @@ -519,7 +519,15 @@ > making the import statement work. That means the various importers that > were > once implicit are now fully exposed as part of the :mod:`importlib` > package. > > -In terms of finders, * :class:`importlib.machinery.FileFinder` exposes the > +The abstract base classes defined in :mod:`importlib.abc` have been > expanded > +to properly delineate between :term:`meta path finders <meta path finder>` > +and :term:`path entry finders <path entry finder>` by introducing > +:class:`importlib.abc.MetaPathFinder` and > +:class:`importlib.abc.PathEntryFinder`, respectively. The old ABC of > +:class:`importlib.abc.Finder` is now only provided for > backwards-compatibility > +and does not enforce any method requirements. > + > +In terms of finders, :class:`importlib.machinery.FileFinder` exposes the > mechanism used to search for source and bytecode files of a module. > Previously > this class was an implicit member of :attr:`sys.path_hooks`. > > @@ -547,10 +555,10 @@ > > Beyond the expanse of what :mod:`importlib` now exposes, there are other > visible changes to import. The biggest is that :attr:`sys.meta_path` and > -:attr:`sys.path_hooks` now store all of the finders used by import > explicitly. > -Previously the finders were implicit and hidden within the C code of > import > -instead of being directly exposed. This means that one can now easily > remove or > -change the order of the various finders to fit one's needs. > +:attr:`sys.path_hooks` now store all of the meta path finders and path > entry > +hooks used by import. Previously the finders were implicit and hidden > within > +the C code of import instead of being directly exposed. This means that > one can > +now easily remove or change the order of the various finders to fit one's > needs. > > Another change is that all modules have a ``__loader__`` attribute, > storing the > loader used to create the module. :pep:`302` has been updated to make this > @@ -1733,6 +1741,12 @@ > both the modification time and size of the source file the bytecode > file was > compiled from. > > +* :class:`importlib.abc.Finder` no longer specifies a `find_module()` > abstract > + method that must be implemented. If you were relying on subclasses to > + implement that method, make sure to check for the method's existence > first. > + You will probably want to check for `find_loader()` first, though, in > the > + case of working with :term:`path entry finders <path entry finder>`. > + > * :mod:`pkgutil` has been converted to use :mod:`importlib` internally. > This > eliminates many edge cases where the old behaviour of the PEP 302 import > emulation failed to match the behaviour of the real import system. The > > -- > Repository URL: http://hg.python.org/cpython > > _______________________________________________ > Python-checkins mailing list > Python-checkins(a)python.org > http://mail.python.org/mailman/listinfo/python-checkins > > [View Less]

1 0

PEP 0424: A method for exposing a length hint
by Alex Gaynor Aug. 2, 2012

Aug. 2, 2012

Hi all, I've just submitted a PEP proposing making __length_hint__ a public API for users to define and other VMs to implement: PEP: 424 Title: A method for exposing a length hint Version: $Revision$ Last-Modified: $Date Author: Alex Gaynor <alex.gaynor(a)gmail.com> Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 14-July-2012 Python-Version: 3.4 Abstract ======== CPython currently defines an ``__length_hint__`` method on several types, such as various iterators. … [View More]

22 64

Re: [Python-Dev] [Python-checkins] cpython: Issue #15502: Bring the importlib ABCs into line with the current state of the
by Brett Cannon Aug. 2, 2012

Aug. 2, 2012

Mostly as a note to myself (although if someone else wants to change this, then great), PathEntryFinder.find_loader() specifies self while the other docs don't bother to list it. And I just realized that the other classes defined in the importlib docs don't list their superclasses like MetaPathFinder and PathEntryFinder now do. On Thu, Aug 2, 2012 at 7:26 AM, nick.coghlan <python-checkins(a)python.org>wrote: > http://hg.python.org/cpython/rev/184700df5b6a > changeset: 78379:… [View More]184700df5b6a > parent: 78376:8ace059cdffd > user: Nick Coghlan <ncoghlan(a)gmail.com> > date: Thu Aug 02 21:26:03 2012 +1000 > summary: > Issue #15502: Bring the importlib ABCs into line with the current state > of the import protocols given PEP 420. Original patch by Eric Snow. > > files: > Doc/library/importlib.rst | 77 +++++--- > Lib/importlib/abc.py | 82 ++++++--- > Lib/test/test_importlib/source/test_abc_loader.py | 23 +- > Lib/test/test_importlib/test_abc.py | 7 +- > Misc/NEWS | 3 + > 5 files changed, 127 insertions(+), 65 deletions(-) > > > diff --git a/Doc/library/importlib.rst b/Doc/library/importlib.rst > --- a/Doc/library/importlib.rst > +++ b/Doc/library/importlib.rst > @@ -125,32 +125,49 @@ > > .. class:: Finder > > - An abstract base class representing a :term:`finder`. > - See :pep:`302` for the exact definition for a finder. > - > - .. method:: find_loader(self, fullname): > - > - An abstract method for finding a :term:`loader` for the specified > - module. Returns a 2-tuple of ``(loader, portion)`` where portion > is a > - sequence of file system locations contributing to part of a > namespace > - package. The sequence may be empty. When present, > `find_loader()` is > - preferred over `find_module()`. > - > - .. versionadded: 3.3 > - > - .. method:: find_module(fullname, path=None) > - > - An abstract method for finding a :term:`loader` for the specified > - module. If the :term:`finder` is found on :data:`sys.meta_path` > and the > - module to be searched for is a subpackage or module then *path* > will > - be the value of :attr:`__path__` from the parent package. If a > loader > - cannot be found, ``None`` is returned. > + An abstract base class representing a :term:`finder`. Finder > + implementations should derive from (or register with) the more specific > + :class:`MetaPathFinder` or :class:`PathEntryFinder` ABCs. > > .. method:: invalidate_caches() > > - An optional method which, when called, should invalidate any > internal > - cache used by the finder. Used by :func:`invalidate_caches()` when > - invalidating the caches of all cached finders. > + An optional method which, when called, should invalidate any > internal > + cache used by the finder. Used by :func:`invalidate_caches()` when > + invalidating the caches of all cached finders. > + > + .. versionchanged:: 3.3 > + The API signatures for meta path finders and path entry finders > + were separated by PEP 420. Accordingly, the Finder ABC no > + longer requires implementation of a ``find_module()`` method. > + > + > +.. class:: MetaPathFinder(Finder) > + > + An abstract base class representing a :term:`meta path finder`. > + > + .. versionadded:: 3.3 > + > + .. method:: find_module(fullname, path) > + > + An abstract method for finding a :term:`loader` for the specified > + module. If this is a top-level import, *path* will be ``None``. > + Otheriwse, this is a search for a subpackage or module and *path* > + will be the value of :attr:`__path__` from the parent > + package. If a loader cannot be found, ``None`` is returned. > + > + > +.. class:: PathEntryFinder(Finder) > + > + An abstract base class representing a :term:`path entry finder`. > + > + .. versionadded:: 3.3 > + > + .. method:: find_loader(self, fullname): > + > + An abstract method for finding a :term:`loader` for the specified > + module. Returns a 2-tuple of ``(loader, portion)`` where portion > is a > + sequence of file system locations contributing to part of a > namespace > + package. The sequence may be empty. > > > .. class:: Loader > @@ -569,8 +586,8 @@ > > An :term:`importer` for built-in modules. All known built-in modules > are > listed in :data:`sys.builtin_module_names`. This class implements the > - :class:`importlib.abc.Finder` and :class:`importlib.abc.InspectLoader` > - ABCs. > + :class:`importlib.abc.MetaPathFinder` and > + :class:`importlib.abc.InspectLoader` ABCs. > > Only class methods are defined by this class to alleviate the need for > instantiation. > @@ -579,8 +596,8 @@ > .. class:: FrozenImporter > > An :term:`importer` for frozen modules. This class implements the > - :class:`importlib.abc.Finder` and :class:`importlib.abc.InspectLoader` > - ABCs. > + :class:`importlib.abc.MetaPathFinder` and > + :class:`importlib.abc.InspectLoader` ABCs. > > Only class methods are defined by this class to alleviate the need for > instantiation. > @@ -589,7 +606,7 @@ > .. class:: PathFinder > > :term:`Finder` for :data:`sys.path`. This class implements the > - :class:`importlib.abc.Finder` ABC. > + :class:`importlib.abc.MetaPathFinder` ABC. > > This class does not perfectly mirror the semantics of > :keyword:`import` in > terms of :data:`sys.path`. No implicit path hooks are assumed for > @@ -616,8 +633,8 @@ > > .. class:: FileFinder(path, \*loader_details) > > - A concrete implementation of :class:`importlib.abc.Finder` which caches > - results from the file system. > + A concrete implementation of :class:`importlib.abc.PathEntryFinder` > which > + caches results from the file system. > > The *path* argument is the directory for which the finder is in charge > of > searching. > diff --git a/Lib/importlib/abc.py b/Lib/importlib/abc.py > --- a/Lib/importlib/abc.py > +++ b/Lib/importlib/abc.py > @@ -23,6 +23,61 @@ > abstract_cls.register(frozen_cls) > > > +class Finder(metaclass=abc.ABCMeta): > + > + """Common abstract base class for import finders. > + > + Finder implementations should derive from the more specific > + MetaPathFinder or PathEntryFinder ABCs rather than directly from > Finder. > + """ > + > + def find_module(self, fullname, path=None): > + """An optional legacy method that should find a module. > + The fullname is a str and the optional path is a str or None. > + Returns a Loader object. > + > + The path finder will use this method only if find_loader() does > + not exist. It may optionally be implemented for compatibility > + with legacy third party reimplementations of the import system. > + """ > + raise NotImplementedError > + > + # invalidate_caches() is a completely optional method, so no default > + # implementation is provided. See the docs for details. > + > + > +class MetaPathFinder(Finder): > + > + """Abstract base class for import finders on sys.meta_path.""" > + > + @abc.abstractmethod > + def find_module(self, fullname, path): > + """Abstract method which when implemented should find a module. > + The fullname is a str and the path is a str or None. > + Returns a Loader object. > + """ > + raise NotImplementedError > + > +_register(MetaPathFinder, machinery.BuiltinImporter, > machinery.FrozenImporter, > + machinery.PathFinder) > + > + > +class PathEntryFinder(Finder): > + > + """Abstract base class for path entry finders used by PathFinder.""" > + > + @abc.abstractmethod > + def find_loader(self, fullname): > + """Abstract method which when implemented returns a module loader. > + The fullname is a str. Returns a 2-tuple of (Loader, portion) > where > + portion is a sequence of file system locations contributing to > part of > + a namespace package. The sequence may be empty. > + """ > + raise NotImplementedError > + > +_register(PathEntryFinder, machinery.FileFinder) > + > + > class Loader(metaclass=abc.ABCMeta): > > """Abstract base class for import loaders.""" > @@ -40,33 +95,6 @@ > raise NotImplementedError > > > -class Finder(metaclass=abc.ABCMeta): > - > - """Abstract base class for import finders.""" > - > - @abc.abstractmethod > - def find_loader(self, fullname): > - """Abstract method which when implemented returns a module loader. > - The fullname is a str. Returns a 2-tuple of (Loader, portion) > where > - portion is a sequence of file system locations contributing to > part of > - a namespace package. The sequence may be empty. When present, > - `find_loader()` is preferred over `find_module()`. > - """ > - raise NotImplementedError > - > - @abc.abstractmethod > - def find_module(self, fullname, path=None): > - """Abstract method which when implemented should find a module. > - The fullname is a str and the optional path is a str or None. > - Returns a Loader object. This method is only called if > - `find_loader()` is not present. > - """ > - raise NotImplementedError > - > -_register(Finder, machinery.BuiltinImporter, machinery.FrozenImporter, > - machinery.PathFinder, machinery.FileFinder) > - > - > class ResourceLoader(Loader): > > """Abstract base class for loaders which can return data from their > diff --git a/Lib/test/test_importlib/source/test_abc_loader.py > b/Lib/test/test_importlib/source/test_abc_loader.py > --- a/Lib/test/test_importlib/source/test_abc_loader.py > +++ b/Lib/test/test_importlib/source/test_abc_loader.py > @@ -778,23 +778,32 @@ > expect = io.IncrementalNewlineDecoder(None, True).decode(source) > self.assertEqual(mock.get_source(name), expect) > > + > class AbstractMethodImplTests(unittest.TestCase): > > """Test the concrete abstractmethod implementations.""" > > + class MetaPathFinder(abc.MetaPathFinder): > + def find_module(self, fullname, path): > + super().find_module(fullname, path) > + > + class PathEntryFinder(abc.PathEntryFinder): > + def find_module(self, _): > + super().find_module(_) > + > + def find_loader(self, _): > + super().find_loader(_) > + > + class Finder(abc.Finder): > + def find_module(self, fullname, path): > + super().find_module(fullname, path) > + > class Loader(abc.Loader): > def load_module(self, fullname): > super().load_module(fullname) > def module_repr(self, module): > super().module_repr(module) > > - class Finder(abc.Finder): > - def find_module(self, _): > - super().find_module(_) > - > - def find_loader(self, _): > - super().find_loader(_) > - > class ResourceLoader(Loader, abc.ResourceLoader): > def get_data(self, _): > super().get_data(_) > diff --git a/Lib/test/test_importlib/test_abc.py > b/Lib/test/test_importlib/test_abc.py > --- a/Lib/test/test_importlib/test_abc.py > +++ b/Lib/test/test_importlib/test_abc.py > @@ -30,11 +30,16 @@ > "{0} is not a superclass of {1}".format(superclass, > self.__test)) > > > -class Finder(InheritanceTests, unittest.TestCase): > +class MetaPathFinder(InheritanceTests, unittest.TestCase): > > + superclasses = [abc.Finder] > subclasses = [machinery.BuiltinImporter, machinery.FrozenImporter, > machinery.PathFinder] > > +class PathEntryFinder(InheritanceTests, unittest.TestCase): > + > + superclasses = [abc.Finder] > + subclasses = [machinery.FileFinder] > > class Loader(InheritanceTests, unittest.TestCase): > > diff --git a/Misc/NEWS b/Misc/NEWS > --- a/Misc/NEWS > +++ b/Misc/NEWS > @@ -72,6 +72,9 @@ > Library > ------- > > +- Issue #15502: Bring the importlib ABCs into line with the current state > + of the import protocols given PEP 420. Original patch by Eric Snow. > + > - Issue #15499: Launching a webbrowser in Unix used to sleep for a few > seconds. Original patch by Anton Barkovsky. > > > -- > Repository URL: http://hg.python.org/cpython > > _______________________________________________ > Python-checkins mailing list > Python-checkins(a)python.org > http://mail.python.org/mailman/listinfo/python-checkins > > [View Less]

1 0

Failed issue tracker submission
by Python tracker Aug. 2, 2012

Aug. 2, 2012

There was a problem with the message you sent: This issue can't be closed until issue <a href="http://bugs.python.org/issue15502">15502</a> is closed. Mail Gateway Help ================= Incoming messages are examined for multiple parts: . In a multipart/mixed message or part, each subpart is extracted and examined. The text/plain subparts are assembled to form the textual body of the message, to be stored in the file associated with a "msg" class node. Any parts of … [View More]other types are each stored in separate files and given "file" class nodes that are linked to the "msg" node. . In a multipart/alternative message or part, we look for a text/plain subpart and ignore the other parts. . A message/rfc822 is treated similar tomultipart/mixed (except for special handling of the first text part) if unpack_rfc822 is set in the mailgw config section. Summary ------- The "summary" property on message nodes is taken from the first non-quoting section in the message body. The message body is divided into sections by blank lines. Sections where the second and all subsequent lines begin with a ">" or "|" character are considered "quoting sections". The first line of the first non-quoting section becomes the summary of the message. Addresses --------- All of the addresses in the To: and Cc: headers of the incoming message are looked up among the user nodes, and the corresponding users are placed in the "recipients" property on the new "msg" node. The address in the From: header similarly determines the "author" property of the new "msg" node. The default handling for addresses that don't have corresponding users is to create new users with no passwords and a username equal to the address. (The web interface does not permit logins for users with no passwords.) If we prefer to reject mail from outside sources, we can simply register an auditor on the "user" class that prevents the creation of user nodes with no passwords. Actions ------- The subject line of the incoming message is examined to determine whether the message is an attempt to create a new item or to discuss an existing item. A designator enclosed in square brackets is sought as the first thing on the subject line (after skipping any "Fwd:" or "Re:" prefixes). If an item designator (class name and id number) is found there, the newly created "msg" node is added to the "messages" property for that item, and any new "file" nodes are added to the "files" property for the item. If just an item class name is found there, we attempt to create a new item of that class with its "messages" property initialized to contain the new "msg" node and its "files" property initialized to contain any new "file" nodes. Triggers -------- Both cases may trigger detectors (in the first case we are calling the set() method to add the message to the item's spool; in the second case we are calling the create() method to create a new node). If an auditor raises an exception, the original message is bounced back to the sender with the explanatory message given in the exception. Return-Path: <python-dev(a)python.org> X-Original-To: report(a)bugs.python.org Delivered-To: roundup+tracker(a)psf.upfronthosting.co.za Received: from mail.python.org (mail.python.org [IPv6:2001:888:2000:d::a6]) by psf.upfronthosting.co.za (Postfix) with ESMTPS id 86BB41CD7E for <report(a)bugs.python.org>; Thu, 2 Aug 2012 13:45:35 +0200 (CEST) Received: from albatross.python.org (localhost [127.0.0.1]) by mail.python.org (Postfix) with ESMTP id 3WnqMM2J6szNbw for <report(a)bugs.python.org>; Thu, 2 Aug 2012 13:45:35 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=python.org; s=200901; t=1343907935; bh=gCR6sftsrpIrVDajA2ztlOvXtnpd1hd96n2LwhPSZkk=; h=MIME-Version:Content-Type:Content-Transfer-Encoding:From:To: Subject:Message-Id:Date; b=eGlIBm9r/zVe4tZZOqtKy8ctuyEEfVHryOb98//t3VAYMgz7Th9wKgpUWNd6OEJnQ hWSOrYKAgNROXrwx+ITyPbwGgMbE1CwRfQiCuxe6RMTQJqoM8kS1MebdE/JiBVrD6U 0h/vjTxlMpKY1YjzbOCqvmuHnaSuTRo3LLieIRRc= Received: from localhost (HELO mail.python.org) (127.0.0.1) by albatross.python.org with SMTP; 02 Aug 2012 13:45:35 +0200 Received: from virt-7yvsjn.psf.osuosl.org (virt-7yvsjn.psf.osuosl.org [140.211.10.72]) by mail.python.org (Postfix) with ESMTP for <report(a)bugs.python.org>; Thu, 2 Aug 2012 13:45:34 +0200 (CEST) MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 From: python-dev(a)python.org To: report(a)bugs.python.org Subject: [issue15519] [status=closed; resolution=fixed; stage=committed/rejected] Message-Id: <3WnqMM2J6szNbw(a)mail.python.org> Date: Thu, 2 Aug 2012 13:45:35 +0200 (CEST) TmV3IGNoYW5nZXNldCBhMWFjMWUxM2M1YTAgYnkgTmljayBDb2dobGFuIGluIGJyYW5jaCAnZGVm YXVsdCc6CkNsb3NlICMxNTUxOTogUHJvcGVybHkgZXhwb3NlIFdpbmRvd3NSZWdpc3RyeUZpbmRl ciBpbiBpbXBvcnRsaWIgYW5kIGJyaW5nIHRoZSBuYW1lIGludG8gbGluZSB3aXRoIG5vcm1hbCBp bXBvcnQgdGVybWlub2xvZ3kuIE9yaWdpbmFsIHBhdGNoIGJ5IEVyaWMgU25vdwpodHRwOi8vaGcu cHl0aG9uLm9yZy9jcHl0aG9uL3Jldi9hMWFjMWUxM2M1YTAK [View Less]

1 0

Introduction
by Shanth Kumar Aug. 2, 2012

Aug. 2, 2012

Hi I am Shanthkumar from Bangalore, India, working for a software firm. Good to see the mailing group, as i am new to python curious to ask you people couple of queireis. -- Regards..., Shanthkumara O.D.

2 1

Re: [Python-Dev] cpython: Fix findnocoding.p and pysource.py scripts
by Serhiy Storchaka Aug. 1, 2012

Aug. 1, 2012

On 01.08.12 21:16, victor.stinner wrote: > http://hg.python.org/cpython/rev/67d36e8ddcfc > changeset: 78375:67d36e8ddcfc > user: Victor Stinner <victor.stinner(a)gmail.com> > date: Wed Aug 01 20:12:51 2012 +0200 > summary: > Fix findnocoding.p and pysource.py scripts > > I suppose that these scripts didn't work since Python 3.0. > - line1 = infile.readline() > - line2 = infile.readline() > + with infile: > + line1 = … [View More]

2 1

HTTPS repositories failing when using selfsigned certs
by Jesus Cea Aug. 1, 2012

Aug. 1, 2012

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 My mercurial clone is <https://hg.jcea.es/cpython-2011/>, and today I can't create a patch from it (in the bug tracker). No explanation in the web interface, but checking the sourcecode of the resulting page, I see a SSL certificate failure. So, looks like bugs.python.org is now verifying repository certificates. My certificate is selfsigned and, moreover, it is behind a SNI server, so the certificate python.org is getting is a selfsigned "… [View More]

2 2