Python-Dev September 2011

python-dev@python.org

76 participants
56 discussions

bigmemtests for really big memory too slow

by martin＠v.loewis.de

I benchmarked some of the bigmemtests when run with -M 80G. They run really slow, because they try to use all available memory, and then take a lot of time processing it. Here are some runtimes: test_capitalize (test.test_bigmem.StrTest) ... ok (420.490846s) test_center (test.test_bigmem.StrTest) ... ok (149.431523s) test_compare (test.test_bigmem.StrTest) ... ok (200.181986s) test_concat (test.test_bigmem.StrTest) ... ok (154.282903s) test_contains (test.test_bigmem.StrTest) ... ok (173.960073s) test_count (test.test_bigmem.StrTest) ... ok (186.799731s) test_encode (test.test_bigmem.StrTest) ... ok (53.752823s) test_encode_ascii (test.test_bigmem.StrTest) ... ok (8.421414s) test_encode_raw_unicode_escape (test.test_bigmem.StrTest) ... ok (3.752774s) test_encode_utf32 (test.test_bigmem.StrTest) ... ok (9.732829s) test_encode_utf7 (test.test_bigmem.StrTest) ... ok (4.998805s) test_endswith (test.test_bigmem.StrTest) ... ok (208.022452s) test_expandtabs (test.test_bigmem.StrTest) ... ok (614.490436s) test_find (test.test_bigmem.StrTest) ... ok (230.722848s) test_format (test.test_bigmem.StrTest) ... ok (407.471929s) test_hash (test.test_bigmem.StrTest) ... ok (325.906271s) In the test suite, we have the bigmemtest and precisionbigmemtest decorators. I think bigmemtest cases should all be changed to precisionbigmemtest, giving sizes of just above 2**31. With that change, the runtime for test_capitalize would go down to 42s. What do you think? Regards, Martin

9 years, 7 months

Re: [Python-Dev] cpython: Issue #12567: Add curses.unget_wch() function

by Antoine Pitrou

On Tue, 06 Sep 2011 01:53:32 +0200 victor.stinner <python-checkins(a)python.org> wrote: > http://hg.python.org/cpython/rev/b1e03d10391e > changeset: 72297:b1e03d10391e > user: Victor Stinner <victor.stinner(a)haypocalc.com> > date: Tue Sep 06 01:53:03 2011 +0200 > summary: > Issue #12567: Add curses.unget_wch() function > > Push a character so the next get_wch() will return it. Looks like you broke many buildbots. Regards Antoine.

9 years, 7 months

Re: [Python-Dev] [Python-checkins] cpython (3.2): #5301: add image/vnd.microsoft.icon (.ico) MIME type

by Éric Araujo

Hi, However small the commit was, I think it still was a feature request, so I wonder if it was appropriate for the stable versions. Regards

9 years, 7 months

[RELEASED] Python 3.2.2

by Georg Brandl

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On behalf of the Python development team, I'm happy to announce the Python 3.2.2 maintenance release. Python 3.2.2 mainly fixes `a regression <http://bugs.python.org/12576>`_ in the ``urllib.request`` module that prevented opening many HTTP resources correctly with Python 3.2.1. Python 3.2 is a continuation of the efforts to improve and stabilize the Python 3.x line. Since the final release of Python 2.7, the 2.x line will only receive bugfixes, and new features are developed for 3.x only. Since PEP 3003, the Moratorium on Language Changes, is in effect, there are no changes in Python's syntax and built-in types in Python 3.2. Development efforts concentrated on the standard library and support for porting code to Python 3. Highlights are: * numerous improvements to the unittest module * PEP 3147, support for .pyc repository directories * PEP 3149, support for version tagged dynamic libraries * PEP 3148, a new futures library for concurrent programming * PEP 384, a stable ABI for extension modules * PEP 391, dictionary-based logging configuration * an overhauled GIL implementation that reduces contention * an extended email package that handles bytes messages * a much improved ssl module with support for SSL contexts and certificate hostname matching * a sysconfig module to access configuration information * additions to the shutil module, among them archive file support * many enhancements to configparser, among them mapping protocol support * improvements to pdb, the Python debugger * countless fixes regarding bytes/string issues; among them full support for a bytes environment (filenames, environment variables) * many consistency and behavior fixes for numeric operations For a more extensive list of changes in 3.2, see http://docs.python.org/3.2/whatsnew/3.2.html To download Python 3.2 visit: http://www.python.org/download/releases/3.2/ Please consider trying Python 3.2 with your code and reporting any bugs you may notice to: http://bugs.python.org/ Enjoy! - -- Georg Brandl, Release Manager georg at python.org (on behalf of the entire python-dev team and 3.2's contributors) -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (GNU/Linux) iEYEARECAAYFAk5j3d4ACgkQN9GcIYhpnLA2BACeLZ8nSdVOoxlJw4DnbM42neeA fwAAoKTHetXsVxrEfvCWSorUhoJ083kZ =5Wm1 -----END PGP SIGNATURE-----

9 years, 7 months

Python 3 optimizations continued...

by stefan brunthaler

Hi, pretty much a year ago I wrote about the optimizations I did for my PhD thesis that target the Python 3 series interpreters. While I got some replies, the discussion never really picked up and no final explicit conclusion was reached. AFAICT, because of the following two factors, my optimizations were not that interesting for inclusion with the distribution at that time: a) Unladden Swallow was targeting Python 3, too. b) My prototype did not pass the regression tests. As of November 2010 (IIRC), Google is not supporting work on US anymore, and the project is stalled. (If I am wrong and there is still activity and any plans with the corresponding PEP, please let me know.) Which is why I recently spent some time fixing issues so that I can run the regression tests. There is still some work to be done, but by and large it should be possible to complete all regression tests in reasonable time (with the actual infrastructure in place, enabling optimizations later on is not a problem at all, too.) So, the two big issues aside, is there any interest in incorporating these optimizations in Python 3? Have a nice day, --stefan PS: It probably is unusual, but in a part of my home page I have created a link to indicate interest (makes both counting and voting easier, http://www.ics.uci.edu/~sbruntha/) There were also links indicating interest in funding the work; I have disabled these, so as not to upset anybody or make the impression of begging for money...

9 years, 7 months

Summary of Python tracker Issues

by Python tracker

ACTIVITY SUMMARY (2011-08-26 - 2011-09-02) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 2967 ( +4) closed 21701 (+36) total 24668 (+40) Open issues with patches: 1283 Issues opened (32) ================== #12837: Patch for issue #12810 removed a valid check on socket ancilla http://bugs.python.org/issue12837 reopened by brett.cannon #12848: pickle.py treats 32bit lengths as signed, but _pickle.c as uns http://bugs.python.org/issue12848 opened by pitrou #12849: urllib2 headers issue http://bugs.python.org/issue12849 opened by shubhojeet.ghosh #12850: [PATCH] stm.atomic http://bugs.python.org/issue12850 opened by arigo #12851: ctypes: getbuffer() never provides strides http://bugs.python.org/issue12851 opened by skrah #12852: POSIX level issues in posixmodule.c on OpenBSD 5.0 http://bugs.python.org/issue12852 opened by rpointel #12853: global name 'r' is not defined in upload.py http://bugs.python.org/issue12853 opened by reowen #12854: PyOS_Readline usage in tokenizer ignores sys.stdin/sys.stdout http://bugs.python.org/issue12854 opened by Albert.Zeyer #12855: linebreak sequences should be better documented http://bugs.python.org/issue12855 opened by Matthew.Boehm #12856: tempfile PRNG reuse between parent and child process http://bugs.python.org/issue12856 opened by ferringb #12857: Expose called function on frame object http://bugs.python.org/issue12857 opened by eric.snow #12858: crypt.mksalt: use ssl.RAND_pseudo_bytes() if available http://bugs.python.org/issue12858 opened by haypo #12860: http client attempts to send a readable object twice http://bugs.python.org/issue12860 opened by langmartin #12861: PyOS_Readline uses single lock http://bugs.python.org/issue12861 opened by Albert.Zeyer #12862: ConfigParser does not implement "comments need to be preceded http://bugs.python.org/issue12862 opened by DanielFortunov #12863: py32 > Lib > xml.minidom > usage feedback > overrides http://bugs.python.org/issue12863 opened by GPU.Group #12864: 2to3 creates illegal code on import a.b inside a package http://bugs.python.org/issue12864 opened by simohe #12866: Want to submit our Audioop.c patch for 24bit audio http://bugs.python.org/issue12866 opened by Peder.Jørgensen #12869: PyOS_StdioReadline is printing the prompt on stderr http://bugs.python.org/issue12869 opened by Albert.Zeyer #12870: Regex object should have introspection methods http://bugs.python.org/issue12870 opened by mattchaput #12871: Disable sched_get_priority_min/max if Python is compiled witho http://bugs.python.org/issue12871 opened by haypo #12872: --with-tsc crashes on ppc64 http://bugs.python.org/issue12872 opened by dmalcolm #12873: 2to3 incorrectly handles multi-line imports from __future__ http://bugs.python.org/issue12873 opened by Arfrever #12875: backport re.compile flags default value documentation http://bugs.python.org/issue12875 opened by eli.bendersky #12876: Make Test Error : ImportError: No module named _sha256 http://bugs.python.org/issue12876 opened by wah meng #12878: io.StringIO doesn't provide a __dict__ field http://bugs.python.org/issue12878 opened by ericp #12880: ctypes: clearly document how structure bit fields are allocate http://bugs.python.org/issue12880 opened by meadori #12881: ctypes: segfault with large structure field names http://bugs.python.org/issue12881 opened by meadori #12882: mmap crash on Windows http://bugs.python.org/issue12882 opened by itabhijitb #12883: xml.sax.xmlreader.AttributesImpl allows empty string as attrib http://bugs.python.org/issue12883 opened by Michael.Sulyaev #12885: distutils.filelist.findall() fails on broken symlink in Py2.x http://bugs.python.org/issue12885 opened by Alexander.Dutton #12886: datetime.strptime parses input wrong http://bugs.python.org/issue12886 opened by heidar.rafn Most recent 15 issues with no replies (15) ========================================== #12885: distutils.filelist.findall() fails on broken symlink in Py2.x http://bugs.python.org/issue12885 #12883: xml.sax.xmlreader.AttributesImpl allows empty string as attrib http://bugs.python.org/issue12883 #12881: ctypes: segfault with large structure field names http://bugs.python.org/issue12881 #12880: ctypes: clearly document how structure bit fields are allocate http://bugs.python.org/issue12880 #12873: 2to3 incorrectly handles multi-line imports from __future__ http://bugs.python.org/issue12873 #12872: --with-tsc crashes on ppc64 http://bugs.python.org/issue12872 #12869: PyOS_StdioReadline is printing the prompt on stderr http://bugs.python.org/issue12869 #12866: Want to submit our Audioop.c patch for 24bit audio http://bugs.python.org/issue12866 #12864: 2to3 creates illegal code on import a.b inside a package http://bugs.python.org/issue12864 #12863: py32 > Lib > xml.minidom > usage feedback > overrides http://bugs.python.org/issue12863 #12862: ConfigParser does not implement "comments need to be preceded http://bugs.python.org/issue12862 #12860: http client attempts to send a readable object twice http://bugs.python.org/issue12860 #12858: crypt.mksalt: use ssl.RAND_pseudo_bytes() if available http://bugs.python.org/issue12858 #12854: PyOS_Readline usage in tokenizer ignores sys.stdin/sys.stdout http://bugs.python.org/issue12854 #12851: ctypes: getbuffer() never provides strides http://bugs.python.org/issue12851 Most recent 15 issues waiting for review (15) ============================================= #12872: --with-tsc crashes on ppc64 http://bugs.python.org/issue12872 #12857: Expose called function on frame object http://bugs.python.org/issue12857 #12856: tempfile PRNG reuse between parent and child process http://bugs.python.org/issue12856 #12855: linebreak sequences should be better documented http://bugs.python.org/issue12855 #12852: POSIX level issues in posixmodule.c on OpenBSD 5.0 http://bugs.python.org/issue12852 #12850: [PATCH] stm.atomic http://bugs.python.org/issue12850 #12842: Docs: first parameter of tp_richcompare() always has the corre http://bugs.python.org/issue12842 #12841: Incorrect tarfile.py extraction http://bugs.python.org/issue12841 #12837: Patch for issue #12810 removed a valid check on socket ancilla http://bugs.python.org/issue12837 #12832: The documentation for the print function should explain/point http://bugs.python.org/issue12832 #12822: NewGIL should use CLOCK_MONOTONIC if possible. http://bugs.python.org/issue12822 #12820: Tests for Lib/xml/dom/minicompat.py http://bugs.python.org/issue12820 #12819: PEP 393 - Flexible Unicode String Representation http://bugs.python.org/issue12819 #12818: email.utils.formataddr incorrectly quotes parens inside quoted http://bugs.python.org/issue12818 #12817: test_multiprocessing: io.BytesIO() requires bytearray buffers http://bugs.python.org/issue12817 Top 10 most discussed issues (10) ================================= #12852: POSIX level issues in posixmodule.c on OpenBSD 5.0 http://bugs.python.org/issue12852 15 msgs #12736: Request for python casemapping functions to use full not simpl http://bugs.python.org/issue12736 15 msgs #2636: Adding a new regex module (compatible with re) http://bugs.python.org/issue2636 14 msgs #12855: linebreak sequences should be better documented http://bugs.python.org/issue12855 10 msgs #12729: Python lib re cannot handle Unicode properly due to narrow/wid http://bugs.python.org/issue12729 9 msgs #12850: [PATCH] stm.atomic http://bugs.python.org/issue12850 9 msgs #12735: request full Unicode collation support in std python library http://bugs.python.org/issue12735 7 msgs #12837: Patch for issue #12810 removed a valid check on socket ancilla http://bugs.python.org/issue12837 7 msgs #12841: Incorrect tarfile.py extraction http://bugs.python.org/issue12841 6 msgs #12876: Make Test Error : ImportError: No module named _sha256 http://bugs.python.org/issue12876 6 msgs Issues closed (36) ================== #6069: casting error from ctypes array to structure http://bugs.python.org/issue6069 closed by meadori #6980: fix ctypes build failure on armel-linux-gnueabi with -mfloat-a http://bugs.python.org/issue6980 closed by meadori #8296: multiprocessing.Pool hangs when issuing KeyboardInterrupt http://bugs.python.org/issue8296 closed by vinay.sajip #8409: gettext should honor $LOCPATH environment variable http://bugs.python.org/issue8409 closed by barry #9651: ctypes crash when writing zerolength string buffer to file http://bugs.python.org/issue9651 closed by amaury.forgeotdarc #9923: mailcap module may not work on non-POSIX platforms if MAILCAPS http://bugs.python.org/issue9923 closed by ncoghlan #10086: test_sysconfig failure when prefix matches /site http://bugs.python.org/issue10086 closed by eric.araujo #11241: ctypes: subclassing an already subclassed ArrayType generates http://bugs.python.org/issue11241 closed by amaury.forgeotdarc #11564: pickle not 64-bit ready http://bugs.python.org/issue11564 closed by pitrou #11879: TarFile.chown: should use TarInfo.uid if user lookup fails http://bugs.python.org/issue11879 closed by lars.gustaebel #11920: ctypes: Strange bitfield structure sizing issue http://bugs.python.org/issue11920 closed by meadori #12195: Little documentation of annotations http://bugs.python.org/issue12195 closed by rhettinger #12287: ossaudiodev: stack corruption with FD >= FD_SETSIZE http://bugs.python.org/issue12287 closed by neologix #12472: Build failure on IRIX http://bugs.python.org/issue12472 closed by neologix #12494: subprocess: check_output() doesn't close pipes on error http://bugs.python.org/issue12494 closed by haypo #12636: IDLE ignores -*- coding -*- with -r option http://bugs.python.org/issue12636 closed by haypo #12720: Expose linux extended filesystem attributes http://bugs.python.org/issue12720 closed by python-dev #12742: Add support for CESU-8 encoding http://bugs.python.org/issue12742 closed by ezio.melotti #12793: allow filters in os.walk http://bugs.python.org/issue12793 closed by rhettinger #12802: Windows error code 267 should be mapped to ENOTDIR, not EINVAL http://bugs.python.org/issue12802 closed by pitrou #12829: pyexpat segmentation fault caused by multiple calls to Parse() http://bugs.python.org/issue12829 closed by ned.deily #12835: Missing SSLSocket.sendmsg() wrapper allows programs to send un http://bugs.python.org/issue12835 closed by ncoghlan #12839: zlibmodule cannot handle Z_VERSION_ERROR zlib error http://bugs.python.org/issue12839 closed by nadeem.vawda #12843: file object read* methods in append mode overflows http://bugs.python.org/issue12843 closed by amaury.forgeotdarc #12846: unicodedata.normalize turkish letter problem http://bugs.python.org/issue12846 closed by terry.reedy #12847: crash with negative PUT in pickle http://bugs.python.org/issue12847 closed by pitrou #12859: readline implementation doesn't release the GIL http://bugs.python.org/issue12859 closed by Albert.Zeyer #12865: import SimpleHTTPServer http://bugs.python.org/issue12865 closed by amaury.forgeotdarc #12867: linecache.getline() Returning Error http://bugs.python.org/issue12867 closed by ned.deily #12868: test_faulthandler.test_stack_overflow() failed on OpenBSD http://bugs.python.org/issue12868 closed by neologix #12874: Rearrange descriptions of builtin types in the Library referen http://bugs.python.org/issue12874 closed by ezio.melotti #12877: Popen(...).stdout.seek(...) throws "Illegal seek" http://bugs.python.org/issue12877 closed by haypo #12879: "method-wrapper" objects are difficult to inspect http://bugs.python.org/issue12879 closed by benjamin.peterson #12884: Re http://bugs.python.org/issue12884 closed by ezio.melotti #1462440: socket and threading: udp multicast setsockopt fails http://bugs.python.org/issue1462440 closed by neologix #10946: bdist doesn’t pass --skip-build on to subcommands http://bugs.python.org/issue10946 closed by eric.araujo

9 years, 7 months

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

Python-Dev September 2011