Mailman 3 June 2012 - Python-Dev

What should we do with cProfile?
by Alexandre Vassalotti 04 Jun '12

04 Jun '12

Hello, As per PEP 3108, we were supposed to merge profile/cProfile into one unified module. I initially championed the change, but other things got in the way and I have never got to the point of a useful patch. I posted some code and outlined an approach how the merge could be done. However, there still a lot of details to be worked out. So I wondering whether we should abandon the change all together or attempt it for the next release. Personally, I slightly leaning on the former option since the two modules are actually fairly different underneath even though they are used similarly. And also, because it is getting late to make such backward incompatible changes. I am willing to volunteer to push the change though if it is still desired by the community. Cheers! http://bugs.python.org/issue2919

5 4

AUTO: Jon K Peck is out of the office (returning 06/06/2012)
by Jon K Peck 04 Jun '12

04 Jun '12

I am out of the office until 06/06/2012. I will be out of the office Monday and Tuesday, June 4-5. I expect to have some email access but may be delayed in responding. Note: This is an automated response to your message "Python-Dev Digest, Vol 107, Issue 9" sent on 06/04/2012 0:19:23. This is the only notification you will receive while this person is away.

1 0

whither PEP 407 and 413 (release cycle PEPs)?
by Brett Cannon 04 Jun '12

04 Jun '12

Are these dead in the water or are we going to try to change our release cycle? I'm just asking since 3.3 final is due out in about 3 months and deciding on this along with shifting things if we do make a change could end up taking that long and I suspect if we don't do this for 3.3 we are probably never going to do it for Python 3 series as a whole.

6 9

Re: [Python-Dev] PEP 405 (built-in virtualenv) status
by Carl Meyer 04 Jun '12

04 Jun '12

On 03/15/2012 03:02 PM, Lindberg, Van wrote: > FYI, the location of the tcl/tk libraries does not appear to be set in > the virtualenv, even if tkinter is installed and working in the main > Python installation. As a result, tk-based apps will not run from a > virtualenv. Thanks for the report! I've added this to the list of open issues in the PEP and I'll look into it. Carl

6 8

JITted regex engine from pypy
by Maciej Fijalkowski 04 Jun '12

04 Jun '12

Hi I was reading a bit about the regex module and I would like to present some other solution into speeding up the re module for Python. So, as a bit of background - pypy has a re compatible module. It's also JITted and it's also exportable as a C library (that is a library you can call from C with C API, not a python extension module). I wonder if it would be worth to put some work into it to make it a library that CPython can use. On the minus side, the JIT only works on x86 and x86_64, on the plus side, since it's 100% API compatible, it can be used as a _xxx speedup module relatively easy. Do people have opinions? Cheers, fijal

6 8

Python 3.3 on Windows 2000
by "Martin v. Löwis" 04 Jun '12

04 Jun '12

It seems that by moving to VS 2010, we have killed Windows 2000 support, for the same reason VS 2012 would kill XP support: Windows 2000 apparently won't recognize the .exe files as executables anymore. I haven't actually tested this: can somebody please confirm? A year ago, Brian put a statement into PEP 11 that 3.3 would support Windows 2000 still, but with a warning. Under my recent PEP change, Windows 2000 does not need to be supported anymore since 13.07.2010, when Microsoft's extended support expired. So I propose to just remove the claim from the PEP that 3.3 would still be supported, and not go through any notification period. Objections? As a consequence, we could then change some of the deferred-loading stuff for "new" (i.e. XP+) API into proper linking. Regards, Martin

2 2

Python Language Summit, Florence, July 2012
by Larry Hastings 02 Jun '12

02 Jun '12

Like Python? Like Italy? Like meetings? Then I've got a treat for you! I'll be chairing a Python Language Summit this July in historic Florence, Italy. It'll be on July 1st (the day before EuroPython starts) at the Grand Hotel Mediterraneo conference center. Language Summits are when the Python core contributors step away from their computers and get together for a day to argue in person. Email me if you're interested in attending; I can send you the final details and simultaneously get a rough headcount. Volunteers to take notes are greatly appreciated, //arry/

1 1

setprofile and settrace inconsistency
by Alon Horev 01 Jun '12

01 Jun '12

Hi, When setting a trace function with settrace, the trace function when called with a new scope can return another trace function or None, indicating the inner scope should not be traced. I used settrace for some time but calling the trace function for every line of code is a performance killer. So I moved on to setprofile, which calls a trace function every function entry/exit. now here's the problem: the return value from the trace function is ignored (intentionally), denying the possibility to skip tracing of 'hot' or 'not interesting' code. I would like to propose two alternatives: 1. setprofile will not ignore the return value and mimic settrace's behavior. 2. setprofile is just a wrapper around settrace that limits it's functionality, lets make settrace more flexible so setprofile will be redundant. here's how: settrace will recieve an argument called 'events', the trace function will fire only on events contained in that list. for example: setprofile = partial(settrace, events=['call', 'return']) I personally prefer the second. Some context to this issue: I'm building a python tracer - a logger that records each and every function call. In order for it to run in production systems, the overhead should be minimal. I would like to allow the user to say which function/module/classes to trace or skip, for example: the user will skip all math/cpu intensive operations. another example: the user will want to trace his django app code but not the django framework. your thoughts? Thanks, Alon Horev

2 2

a new type for sys.implementation
by Eric Snow 01 Jun '12

01 Jun '12

The implementation for sys.implementation is going to use a new (but "private") type[1]. It's basically equivalent to the following: class namespace: def __init__(self, **kwargs): self.__dict__.update(kwargs) def __repr__(self): keys = (k for k in self.__dict__ if not k.startswith('_')) pairs = ("{}={!r}".format(k, self.__dict__[k]) for k in sorted(keys)) return "{}({})".format(type(self).__name__, ", ".join(pairs)) There were other options for the type, but the new type was the best fit and not hard to do. Neither the type nor its API is directly exposed publicly, but it is still accessible through "type(sys.implementation)". This brings me to a couple of questions: 1. should we make the new type un-instantiable (null out tp_new and tp_init)? 2. would it be feasible to officially add the type (or something like it) in 3.3 or 3.4? I've had quite a bit of positive feedback on the type (otherwise I wouldn't bother bringing it up). But, if we don't add a type like this to Python, I'd rather close the loophole and call it good (i.e. *not* introduce a new type by stealth). My preference is for the type (or equivalent) to be blessed in the language. Regardless of the specific details of such a type, my more immediate concern is with the impact on sys.implementation of python-dev's general sentiment in this space. -eric [1] http://bugs.python.org/issue14673

7 20

Summary of Python tracker Issues
by Python tracker 01 Jun '12

01 Jun '12

ACTIVITY SUMMARY (2012-05-25 - 2012-06-01) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 3450 (+10) closed 23308 (+54) total 26758 (+64) Open issues with patches: 1448 Issues opened (44) ================== #11820: idle3 shell os.system swallows shell command output http://bugs.python.org/issue11820 reopened by ned.deily #12370: Use of super overwrites use of __class__ in class namespace http://bugs.python.org/issue12370 reopened by ncoghlan #12510: IDLE get_the_calltip mishandles raw strings http://bugs.python.org/issue12510 reopened by terry.reedy #12932: dircmp does not allow non-shallow comparisons http://bugs.python.org/issue12932 reopened by terry.reedy #14917: Make os.symlink on Win32 detect if target is directory http://bugs.python.org/issue14917 opened by larry #14918: Incorrect explanation of TypeError exception http://bugs.python.org/issue14918 opened by tsou #14919: what disables one from adding self to the "nosy" list http://bugs.python.org/issue14919 opened by tshepang #14922: mailbox.Maildir.get_message() may fail when Maildir dirname is http://bugs.python.org/issue14922 opened by poliveira #14923: Even faster UTF-8 decoding http://bugs.python.org/issue14923 opened by storchaka #14926: random.seed docstring needs edit of "*a *is" http://bugs.python.org/issue14926 opened by smichr #14927: add "Do not supply int argument" to random.shuffle docstring http://bugs.python.org/issue14927 opened by smichr #14928: Fix importlib bootstrapping issues http://bugs.python.org/issue14928 opened by pitrou #14929: IDLE crashes on *Edit / Find in files ...* command http://bugs.python.org/issue14929 opened by fgracia #14933: Misleading documentation about weakrefs http://bugs.python.org/issue14933 opened by pitrou #14934: generator objects can clear their weakrefs before being resurr http://bugs.python.org/issue14934 opened by pitrou #14935: PEP 384 Refactoring applied to _csv module http://bugs.python.org/issue14935 opened by Robin.Schreiber #14936: PEP 3121, 384 refactoring applied to curses_panel module http://bugs.python.org/issue14936 opened by Robin.Schreiber #14937: IDLE's deficiency in the completion of file names (Python 32, http://bugs.python.org/issue14937 opened by fgracia #14940: Usage documentation for pysetup http://bugs.python.org/issue14940 opened by ncoghlan #14944: Setup & Usage documentation for pydoc, idle & 2to3 http://bugs.python.org/issue14944 opened by ncoghlan #14945: Setup & Usage documentation for selected stdlib modules http://bugs.python.org/issue14945 opened by ncoghlan #14946: packaging’s pysetup script should be named differently than http://bugs.python.org/issue14946 opened by eric.araujo #14949: Documentation should state clearly the differences between "py http://bugs.python.org/issue14949 opened by alexis #14950: Make packaging.install API less confusing and more extensible http://bugs.python.org/issue14950 opened by alexis #14953: Reimplement subset of multiprocessing.sharedctypes using memor http://bugs.python.org/issue14953 opened by sbt #14954: weakref doc clarification http://bugs.python.org/issue14954 opened by stoneleaf #14955: hmac.secure_compare() is not time-independent for unicode stri http://bugs.python.org/issue14955 opened by Jon.Oberheide #14956: custom PYTHONPATH may break apps embedding Python http://bugs.python.org/issue14956 opened by jankratochvil #14957: Improve docs for str.splitlines http://bugs.python.org/issue14957 opened by ncoghlan #14959: ttk.Scrollbar in Notebook widget freezes http://bugs.python.org/issue14959 opened by davidjamesbeck #14963: Use an iterative implementation for contextlib.ExitStack.__exi http://bugs.python.org/issue14963 opened by ncoghlan #14964: distutils2.utils.resolve_name cleanup http://bugs.python.org/issue14964 opened by Ronny.Pfannschmidt #14965: super() and property inheritance behavior http://bugs.python.org/issue14965 opened by 猫.黒 #14966: Fully document subprocess.CalledProcessError http://bugs.python.org/issue14966 opened by ncoghlan #14967: distutils2.utils.resolve_name cannot be implemented to give co http://bugs.python.org/issue14967 opened by Ronny.Pfannschmidt #14968: Section "Inplace Operators" of :mod:`operator` should be a sub http://bugs.python.org/issue14968 opened by larsmans #14971: (unittest) loadTestsFromName does not work on method with a de http://bugs.python.org/issue14971 opened by alex.75 #14973: restore python2 unicode literals in "ur" strings http://bugs.python.org/issue14973 opened by rurpy2 #14974: rename packaging.pypi to packaging.index http://bugs.python.org/issue14974 opened by alexis #14975: import unicodedata, DLL load failed on Python 2.7.3 http://bugs.python.org/issue14975 opened by yfdyh000 #14976: Queue.PriorityQueue() is not interrupt safe http://bugs.python.org/issue14976 opened by JohanAR #14977: mailcap does not respect precedence in the presence of wildcar http://bugs.python.org/issue14977 opened by manu-beffara #14978: distutils Extension fails to be created with unicode package n http://bugs.python.org/issue14978 opened by guyomes #14979: pdb: Link to source http://bugs.python.org/issue14979 opened by techtonik Most recent 15 issues with no replies (15) ========================================== #14979: pdb: Link to source http://bugs.python.org/issue14979 #14978: distutils Extension fails to be created with unicode package n http://bugs.python.org/issue14978 #14966: Fully document subprocess.CalledProcessError http://bugs.python.org/issue14966 #14957: Improve docs for str.splitlines http://bugs.python.org/issue14957 #14954: weakref doc clarification http://bugs.python.org/issue14954 #14953: Reimplement subset of multiprocessing.sharedctypes using memor http://bugs.python.org/issue14953 #14934: generator objects can clear their weakrefs before being resurr http://bugs.python.org/issue14934 #14933: Misleading documentation about weakrefs http://bugs.python.org/issue14933 #14926: random.seed docstring needs edit of "*a *is" http://bugs.python.org/issue14926 #14922: mailbox.Maildir.get_message() may fail when Maildir dirname is http://bugs.python.org/issue14922 #14918: Incorrect explanation of TypeError exception http://bugs.python.org/issue14918 #14917: Make os.symlink on Win32 detect if target is directory http://bugs.python.org/issue14917 #14916: PyRun_InteractiveLoop fails to run interactively when using a http://bugs.python.org/issue14916 #14914: pysetup installed distribute despite dry run option being spec http://bugs.python.org/issue14914 #14913: tokenize the source to manage Pdb breakpoints http://bugs.python.org/issue14913 Most recent 15 issues waiting for review (15) ============================================= #14978: distutils Extension fails to be created with unicode package n http://bugs.python.org/issue14978 #14968: Section "Inplace Operators" of :mod:`operator` should be a sub http://bugs.python.org/issue14968 #14964: distutils2.utils.resolve_name cleanup http://bugs.python.org/issue14964 #14963: Use an iterative implementation for contextlib.ExitStack.__exi http://bugs.python.org/issue14963 #14955: hmac.secure_compare() is not time-independent for unicode stri http://bugs.python.org/issue14955 #14954: weakref doc clarification http://bugs.python.org/issue14954 #14953: Reimplement subset of multiprocessing.sharedctypes using memor http://bugs.python.org/issue14953 #14937: IDLE's deficiency in the completion of file names (Python 32, http://bugs.python.org/issue14937 #14936: PEP 3121, 384 refactoring applied to curses_panel module http://bugs.python.org/issue14936 #14935: PEP 384 Refactoring applied to _csv module http://bugs.python.org/issue14935 #14929: IDLE crashes on *Edit / Find in files ...* command http://bugs.python.org/issue14929 #14923: Even faster UTF-8 decoding http://bugs.python.org/issue14923 #14913: tokenize the source to manage Pdb breakpoints http://bugs.python.org/issue14913 #14910: argparse: disable abbreviation http://bugs.python.org/issue14910 #14900: cProfile does not take its result headers as sort arguments http://bugs.python.org/issue14900 Top 10 most discussed issues (10) ================================= #14814: Implement PEP 3144 (the ipaddress module) http://bugs.python.org/issue14814 13 msgs #6721: Locks in python standard library should be sanitized on fork http://bugs.python.org/issue6721 12 msgs #14956: custom PYTHONPATH may break apps embedding Python http://bugs.python.org/issue14956 12 msgs #14673: add sys.implementation http://bugs.python.org/issue14673 11 msgs #13475: Add '-p'/'--path0' command line option to override sys.path[0] http://bugs.python.org/issue13475 10 msgs #14901: Python Windows FAQ is Very Outdated http://bugs.python.org/issue14901 10 msgs #3177: Add shutil.open http://bugs.python.org/issue3177 9 msgs #14852: json and ElementTree parsers misbehave on streams containing m http://bugs.python.org/issue14852 8 msgs #12510: IDLE get_the_calltip mishandles raw strings http://bugs.python.org/issue12510 7 msgs #14923: Even faster UTF-8 decoding http://bugs.python.org/issue14923 7 msgs Issues closed (55) ================== #8323: buffer objects are picklable but result is not unpicklable http://bugs.python.org/issue8323 closed by sbt #8739: Update to smtpd.py to RFC 5321 http://bugs.python.org/issue8739 closed by r.david.murray #9041: raised exception is misleading http://bugs.python.org/issue9041 closed by meador.inge #9244: multiprocessing.pool: Worker crashes if result can't be encode http://bugs.python.org/issue9244 closed by sbt #9864: email.utils.{parsedate,parsedate_tz} should have better return http://bugs.python.org/issue9864 closed by r.david.murray #10839: email module should not allow some header field repetitions http://bugs.python.org/issue10839 closed by r.david.murray #11050: email.utils.getaddresses behavior contradicts RFC2822 http://bugs.python.org/issue11050 closed by r.david.murray #11685: possible SQL injection into db APIs via table names... sqlite3 http://bugs.python.org/issue11685 closed by petri.lehtinen #11785: email subpackages documentation problems http://bugs.python.org/issue11785 closed by r.david.murray #12091: multiprocessing: simplify ApplyResult and MapResult with threa http://bugs.python.org/issue12091 closed by sbt #12338: multiprocessing.util._eintr_retry doen't recalculate timeouts http://bugs.python.org/issue12338 closed by sbt #12515: email modifies the message structure when the parsed email is http://bugs.python.org/issue12515 closed by r.david.murray #12586: Provisional new email API: new policy implementing custom head http://bugs.python.org/issue12586 closed by r.david.murray #13751: multiprocessing.pool hangs if any worker raises an Exception w http://bugs.python.org/issue13751 closed by sbt #14007: xml.etree.ElementTree - XMLParser and TreeBuilder's doctype() http://bugs.python.org/issue14007 closed by eli.bendersky #14128: _elementtree should expose types and factory functions consist http://bugs.python.org/issue14128 closed by eli.bendersky #14548: garbage collection just after multiprocessing's fork causes ex http://bugs.python.org/issue14548 closed by sbt #14690: Use monotonic time for sched, trace and subprocess modules http://bugs.python.org/issue14690 closed by python-dev #14703: Update PEP metaprocesses to describe PEP czar role http://bugs.python.org/issue14703 closed by ncoghlan #14731: Enhance Policy framework in preparation for adding email6 poli http://bugs.python.org/issue14731 closed by r.david.murray #14744: Use _PyUnicodeWriter API in str.format() internals http://bugs.python.org/issue14744 closed by haypo #14775: Dict untracking can result in quadratic dict build-up http://bugs.python.org/issue14775 closed by pitrou #14796: Calendar module test coverage improved http://bugs.python.org/issue14796 closed by r.david.murray #14818: C implementation of ElementTree: Some functions should support http://bugs.python.org/issue14818 closed by eli.bendersky #14835: plistlib: output empty elements correctly http://bugs.python.org/issue14835 closed by hynek #14857: Direct access to lexically scoped __class__ is broken in 3.3 http://bugs.python.org/issue14857 closed by python-dev #14876: IDLE highlighting theme does not preview with user-selected fo http://bugs.python.org/issue14876 closed by terry.reedy #14881: multiprocessing.dummy craches when self._parent._children does http://bugs.python.org/issue14881 closed by sbt #14909: Fix incorrect use of *Realloc() and *Resize() http://bugs.python.org/issue14909 closed by kristjan.jonsson #14920: help(urllib.parse) fails when LANG=C http://bugs.python.org/issue14920 closed by orsenthil #14921: New trove classifier for simple printers of nested lists http://bugs.python.org/issue14921 closed by dholth #14924: re.finditer() oddity http://bugs.python.org/issue14924 closed by ezio.melotti #14925: email package does not register defect when blank line between http://bugs.python.org/issue14925 closed by r.david.murray #14930: Make memoryview weakrefable http://bugs.python.org/issue14930 closed by sbt #14931: Compattible http://bugs.python.org/issue14931 closed by r.david.murray #14932: Python 3.3.0a3 build fails on MacOS 10.7 with XCode 4.3.2 http://bugs.python.org/issue14932 closed by hynek #14938: 'import my_pkg.__init__' creates duplicate modules http://bugs.python.org/issue14938 closed by brett.cannon #14939: Usage documentation for pyvenv http://bugs.python.org/issue14939 closed by vinay.sajip #14941: "Using Python on Windows" end user docs are out of date http://bugs.python.org/issue14941 closed by brian.curtin #14942: add PyType_New() http://bugs.python.org/issue14942 closed by ncoghlan #14943: winreg OpenKey doesn't work as documented http://bugs.python.org/issue14943 closed by brian.curtin #14947: Missing cross reference in types.new_class documentation http://bugs.python.org/issue14947 closed by python-dev #14948: setup.cfg - rename home_page to homepage http://bugs.python.org/issue14948 closed by eric.araujo #14951: Daikon/KVasir report: Invalid read of size 4 http://bugs.python.org/issue14951 closed by cassou #14952: Cannot run regrtest with amd64/debug on windows http://bugs.python.org/issue14952 closed by kristjan.jonsson #14958: IDLE 3 and PEP414 - highlighting unicode literals http://bugs.python.org/issue14958 closed by ned.deily #14960: about the slowly HTTPServer http://bugs.python.org/issue14960 closed by neologix #14961: map() and filter() methods for iterators http://bugs.python.org/issue14961 closed by ncoghlan #14962: When changing IDLE configuration all text in shell window lose http://bugs.python.org/issue14962 closed by ned.deily #14969: Exception context is not suppressed correctly in contextlib.Ex http://bugs.python.org/issue14969 closed by python-dev #14970: -v command line option is broken http://bugs.python.org/issue14970 closed by brett.cannon #14972: listcomp with nested classes http://bugs.python.org/issue14972 closed by flox #14980: OSX: ranlib: file: libpython2.7.a(pymath.o) has no symbols http://bugs.python.org/issue14980 closed by ronaldoussoren #10997: Duplicate entries in IDLE "Recent Files" menu item on OS X http://bugs.python.org/issue10997 closed by ned.deily #1672568: silent error in email.message.Message.get_payload http://bugs.python.org/issue1672568 closed by r.david.murray

1 0