Python-Dev October 2012

python-dev@python.org

98 participants
95 discussions

Re: [Python-Dev] cpython (merge 3.2 -> 3.2): null merge

by Georg Brandl

Not very important, but this is not a null merge, as you can see from the diff :) Georg Am 17.10.2012 16:33, schrieb andrew.svetlov: > http://hg.python.org/cpython/rev/16493102f9b1 > changeset: 79798:16493102f9b1 > branch: 3.2 > parent: 79791:98f64cbed2ac > parent: 79795:a8052ad9752b > user: Andrew Svetlov <andrew.svetlov(a)gmail.com> > date: Wed Oct 17 17:20:46 2012 +0300 > summary: > null merge > > files: > Doc/using/cmdline.rst | 6 ++++-- > Misc/ACKS | 1 + > 2 files changed, 5 insertions(+), 2 deletions(-) > > > diff --git a/Doc/using/cmdline.rst b/Doc/using/cmdline.rst > --- a/Doc/using/cmdline.rst > +++ b/Doc/using/cmdline.rst > @@ -379,7 +379,10 @@ > Environment variables > --------------------- > > -These environment variables influence Python's behavior. > +These environment variables influence Python's behavior, they are processed > +before the command-line switches other than -E. It is customary that > +command-line switches override environmental variables where there is a > +conflict. > > .. envvar:: PYTHONHOME > > @@ -570,4 +573,3 @@ > > If set, Python will print memory allocation statistics every time a new > object arena is created, and on shutdown. > - > diff --git a/Misc/ACKS b/Misc/ACKS > --- a/Misc/ACKS > +++ b/Misc/ACKS > @@ -901,6 +901,7 @@ > Saskia van Rossum > Donald Wallace Rouse II > Liam Routt > +Todd Rovito > Craig Rowland > Clinton Roy > Paul Rubin > > > > _______________________________________________ > Python-checkins mailing list > Python-checkins(a)python.org > http://mail.python.org/mailman/listinfo/python-checkins >

8 years, 9 months

Re: [Python-Dev] cpython (3.2): bounds check for bad data (thanks amaury)

by Serhiy Storchaka

On 27.10.12 03:05, philip.jenvey wrote: > http://hg.python.org/cpython/rev/74d65c746f63 > changeset: 79953:74d65c746f63 > branch: 3.2 > parent: 79941:eb999002916c > user: Philip Jenvey <pjenvey(a)underboss.org> > date: Fri Oct 26 17:01:53 2012 -0700 > summary: > bounds check for bad data (thanks amaury) > + if (strlen(p) > 2 && First, it produces compiler warning: Python/codecs.c: In function ‘PyCodec_SurrogatePassErrors’: Python/codecs.c:794: warning: pointer targets in passing argument 1 of ‘strlen’ differ in signedness /usr/include/string.h:397: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ Second, it slowdown the code to 10%: $ ./python-orig -m timeit -s 'b=b"\xed\xa0\xa0"+b"x"*10000' 'b.decode("utf-8", "surrogatepass")' 100000 loops, best of 3: 12.2 usec per loop $ ./python -m timeit -s 'b=b"\xed\xa0\xa0"+b"x"*10000' 'b.decode("utf-8", "surrogatepass")' 100000 loops, best of 3: 13.3 usec per loop I suggest to use the followed code instead: if (PyBytes_GET_SIZE(object) - start >= 3 &&

8 years, 9 months

Anyone have a Universal setter example?

by Robert Steckroth

Hello Gang, I am fresh to this list so, hello PYC gurus! ------------------------------------------------------------------------------ I have been getting into the Python C API over the past few days and found it it to be a wonderful framework with a solid design. There are many questions I would like to pose and answer in this community and look forward to a productive relationship. Here are a few question I have: 1. Is it appropriate to post usage questions regarding the Python C API to this list like the questions below? 2. Is there any examples of a universal setter function for `PyGetSetDef`? The docs mention using the closure pointer from the last element in the `PyGetSetDef` structures. I am finding it hard to get a grasp on how this is implemented. I understand why we use it and what it does and need a more modular setter function for a large object. *From the docs* [http://docs.python.org/extending/newtypes.html] > `The getter function is passed a Noddy object and a “closure”, which is void pointer. In this case, the closure is ignored. (The closure supports an advanced usage in which definition data is passed to the getter and setter. This could, for example, be used to allow a single set of getter and setter functions that decide the attribute to get or set based on data in the closure.)` 3. Is it customary to use header files when building larger Python modules/objects? I was successful in prototyping the source files, but unable to get the module working after running a distutils install. In short, is it encouraged to use header files? -- Bust0ut, Surgemcgee: Systems Engineer --- surgemcgee.com Django_Teamplate3d

8 years, 9 months

Summary of Python tracker Issues

by Python tracker

ACTIVITY SUMMARY (2012-10-19 - 2012-10-26) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 3824 ( +9) closed 24283 (+34) total 28107 (+43) Open issues with patches: 1730 Issues opened (32) ================== #16274: test_asyncore failing on Solaris 10 2.7 (nitrogen/s10) http://bugs.python.org/issue16274 reopened by trent #16288: TextTestResult uses TestCase.__str__() which isn't customisabl http://bugs.python.org/issue16288 opened by rbcollins #16290: PyComplex_AsCComplex should allow __complex__ to return float. http://bugs.python.org/issue16290 opened by mark.dickinson #16291: Enable darwin-host cross compilation. Tested with build=linux, http://bugs.python.org/issue16291 opened by Ray.Donnelly #16292: Cross compilation fixes (general) http://bugs.python.org/issue16292 opened by Ray.Donnelly #16293: curses.ungetch raises OverflowError when given -1 http://bugs.python.org/issue16293 opened by Julian #16296: Patch to fix building on Win32/64 under VS 2010 http://bugs.python.org/issue16296 opened by silverbacknet #16298: httplib.HTTPResponse.read could potentially leave the socket o http://bugs.python.org/issue16298 opened by eranrund #16300: Windows raises ValueError for file:///file/not/exists instead http://bugs.python.org/issue16300 opened by orsenthil #16301: localhost() and thishost() in urllib/request.py http://bugs.python.org/issue16301 opened by orsenthil #16304: re: Match Objects always have a boolean value of True http://bugs.python.org/issue16304 opened by vrutsky #16306: Multiple error line for unknown command line parameter http://bugs.python.org/issue16306 opened by tweksteen #16307: multiprocess.pool.map_async callables not working http://bugs.python.org/issue16307 opened by Bbb #16308: Undocumented (?) behaviour change in argparse from 3.2.3 to 3. http://bugs.python.org/issue16308 opened by telmich #16309: "PYTHONPATH=" different from no PYTHONPATH at all http://bugs.python.org/issue16309 opened by arigo #16310: zipfile: allow surrogates in filenames http://bugs.python.org/issue16310 opened by stefanholek #16311: Use _PyUnicodeWriter API in text decoders http://bugs.python.org/issue16311 opened by haypo #16312: New command line option supported by unittest.main() for runni http://bugs.python.org/issue16312 opened by piotr.dobrogost #16316: Support xz compression in mimetypes module http://bugs.python.org/issue16316 opened by serhiy.storchaka #16317: Mention lzma module in tutorial http://bugs.python.org/issue16317 opened by serhiy.storchaka #16318: FTP_TLS in ftplib not supporting prot_p storlines in FTP7.5 http://bugs.python.org/issue16318 opened by Jeremy.Brock #16320: Establish order in bytes/string dependencies http://bugs.python.org/issue16320 opened by serhiy.storchaka #16321: Move eq.h out of stringlib http://bugs.python.org/issue16321 opened by serhiy.storchaka #16322: time.tzname on Python 3.3.0 for Windows is decoded by wrong en http://bugs.python.org/issue16322 opened by msmhrt #16323: Wrong C API documentation for locale encoding http://bugs.python.org/issue16323 opened by serhiy.storchaka #16324: MIMEText __init__ does not support Charset instance http://bugs.python.org/issue16324 opened by claudep #16325: PEP 8 refers to reference to PEP 8 http://bugs.python.org/issue16325 opened by serhiy.storchaka #16326: distutils build_ext fails to set library_dirs in 2.7.2 on Linu http://bugs.python.org/issue16326 opened by Andy.Salnikov #16327: subprocess.Popen leaks file descriptors on os.fork() failure http://bugs.python.org/issue16327 opened by Mark.Gius #16328: win_add2path.py sets wrong user path http://bugs.python.org/issue16328 opened by Emil.Styrke #16329: mimetypes does not support webm type http://bugs.python.org/issue16329 opened by giampaolo.rodola #16330: Use surrogate-related macros http://bugs.python.org/issue16330 opened by serhiy.storchaka Most recent 15 issues with no replies (15) ========================================== #16330: Use surrogate-related macros http://bugs.python.org/issue16330 #16326: distutils build_ext fails to set library_dirs in 2.7.2 on Linu http://bugs.python.org/issue16326 #16323: Wrong C API documentation for locale encoding http://bugs.python.org/issue16323 #16321: Move eq.h out of stringlib http://bugs.python.org/issue16321 #16320: Establish order in bytes/string dependencies http://bugs.python.org/issue16320 #16317: Mention lzma module in tutorial http://bugs.python.org/issue16317 #16316: Support xz compression in mimetypes module http://bugs.python.org/issue16316 #16312: New command line option supported by unittest.main() for runni http://bugs.python.org/issue16312 #16298: httplib.HTTPResponse.read could potentially leave the socket o http://bugs.python.org/issue16298 #16287: Sporadic test_utime() failures on Solaris http://bugs.python.org/issue16287 #16283: ctypes.util.find_library does not find all DLLs anymore http://bugs.python.org/issue16283 #16281: TODO in tailmatch(): it does not support backward in all cases http://bugs.python.org/issue16281 #16272: C-API documentation clarification for tp_dictoffset http://bugs.python.org/issue16272 #16253: Docs for PyArg_ParseTupleAndKeywords say it doesn't accept nes http://bugs.python.org/issue16253 #16242: Pickle and __getattr__ http://bugs.python.org/issue16242 Most recent 15 issues waiting for review (15) ============================================= #16330: Use surrogate-related macros http://bugs.python.org/issue16330 #16329: mimetypes does not support webm type http://bugs.python.org/issue16329 #16327: subprocess.Popen leaks file descriptors on os.fork() failure http://bugs.python.org/issue16327 #16325: PEP 8 refers to reference to PEP 8 http://bugs.python.org/issue16325 #16324: MIMEText __init__ does not support Charset instance http://bugs.python.org/issue16324 #16320: Establish order in bytes/string dependencies http://bugs.python.org/issue16320 #16317: Mention lzma module in tutorial http://bugs.python.org/issue16317 #16316: Support xz compression in mimetypes module http://bugs.python.org/issue16316 #16311: Use _PyUnicodeWriter API in text decoders http://bugs.python.org/issue16311 #16309: "PYTHONPATH=" different from no PYTHONPATH at all http://bugs.python.org/issue16309 #16307: multiprocess.pool.map_async callables not working http://bugs.python.org/issue16307 #16306: Multiple error line for unknown command line parameter http://bugs.python.org/issue16306 #16296: Patch to fix building on Win32/64 under VS 2010 http://bugs.python.org/issue16296 #16292: Cross compilation fixes (general) http://bugs.python.org/issue16292 #16291: Enable darwin-host cross compilation. Tested with build=linux, http://bugs.python.org/issue16291 Top 10 most discussed issues (10) ================================= #15494: Move test/support.py into a test.support subpackage http://bugs.python.org/issue15494 17 msgs #16327: subprocess.Popen leaks file descriptors on os.fork() failure http://bugs.python.org/issue16327 15 msgs #10527: multiprocessing.Pipe problem: "handle out of range in select() http://bugs.python.org/issue10527 13 msgs #16288: TextTestResult uses TestCase.__str__() which isn't customisabl http://bugs.python.org/issue16288 12 msgs #16308: Undocumented (?) behaviour change in argparse from 3.2.3 to 3. http://bugs.python.org/issue16308 10 msgs #16307: multiprocess.pool.map_async callables not working http://bugs.python.org/issue16307 8 msgs #14621: Hash function is not randomized properly http://bugs.python.org/issue14621 7 msgs #16245: Update html.entities.html5 dictionary and parseentities.py http://bugs.python.org/issue16245 7 msgs #16301: localhost() and thishost() in urllib/request.py http://bugs.python.org/issue16301 7 msgs #16322: time.tzname on Python 3.3.0 for Windows is decoded by wrong en http://bugs.python.org/issue16322 7 msgs Issues closed (33) ================== #4997: xml.sax.saxutils.XMLGenerator should write to io.RawIOBase. http://bugs.python.org/issue4997 closed by serhiy.storchaka #5148: gzip.open breaks with 'U' flag http://bugs.python.org/issue5148 closed by nadeem.vawda #8792: Support Apache extensions to XML-RPC in xmlrpclib http://bugs.python.org/issue8792 closed by bquinlan #10405: IDLE breakpoint facility undocumented http://bugs.python.org/issue10405 closed by ned.deily #11271: concurrent.futures.ProcessPoolExecutor.map() doesn't batch fun http://bugs.python.org/issue11271 closed by bquinlan #12034: check_GetFinalPathNameByHandle() suboptimal http://bugs.python.org/issue12034 closed by pitrou #12692: test_urllib2net is triggering a ResourceWarning http://bugs.python.org/issue12692 closed by nadeem.vawda #12805: Optimizations for bytes.join() et. al http://bugs.python.org/issue12805 closed by pitrou #14394: Add speed improvement note to the decimal docs. http://bugs.python.org/issue14394 closed by skrah #14398: bz2.BZ2DEcompressor.decompress fail on large files http://bugs.python.org/issue14398 closed by nadeem.vawda #15040: stdlib compatibility with pypy: mailbox module http://bugs.python.org/issue15040 closed by petri.lehtinen #15772: Unresolved symbols in Windows 64-bit python http://bugs.python.org/issue15772 closed by loewis #15853: IDLE crashes selecting Preferences menu with OS X ActiveState http://bugs.python.org/issue15853 closed by ned.deily #16013: small csv reader bug http://bugs.python.org/issue16013 closed by serhiy.storchaka #16116: Can not install C extension modules to inside a venv on Python http://bugs.python.org/issue16116 closed by python-dev #16210: combine the two type() definitions in built-in function docs http://bugs.python.org/issue16210 closed by ezio.melotti #16220: wsgiref does not call close() on iterable response http://bugs.python.org/issue16220 closed by pitrou #16241: "-X faulthandler" is not documented in -X option docs http://bugs.python.org/issue16241 closed by asvetlov #16262: srcdir != builddir builds fail, if hg is not installed http://bugs.python.org/issue16262 closed by doko #16264: test_logging failure on Windows 7 buildbot http://bugs.python.org/issue16264 closed by pitrou #16289: Update devguide for 3.4 http://bugs.python.org/issue16289 closed by ned.deily #16294: 8 space indent in tutorial http://bugs.python.org/issue16294 closed by python-dev #16295: With VS2010 the select extension links against wsock32 instead http://bugs.python.org/issue16295 closed by sbt #16297: make csv.DictReader.__init__ use self.fieldnames http://bugs.python.org/issue16297 closed by r.david.murray #16299: __build__ as a temp build directory for setup.py http://bugs.python.org/issue16299 closed by r.david.murray #16302: Fix ResourceWarning in Lib/test/test_urllib.py http://bugs.python.org/issue16302 closed by orsenthil #16303: typo in error message in pstats.py http://bugs.python.org/issue16303 closed by ezio.melotti #16305: possible segfault in math.factorial http://bugs.python.org/issue16305 closed by mark.dickinson #16313: Support xz compression in shutil module http://bugs.python.org/issue16313 closed by serhiy.storchaka #16314: Support xz compression in distutils http://bugs.python.org/issue16314 closed by serhiy.storchaka #16315: Support xz compression in Mac build script http://bugs.python.org/issue16315 closed by ned.deily #16319: optional comma inside function argument list triggers syntax e http://bugs.python.org/issue16319 closed by chris.jerdonek #1248658: dir should accept dirproxies for __dict__ http://bugs.python.org/issue1248658 closed by ronaldoussoren

8 years, 9 months

Python Bug Day in October

by Éric Araujo

Hi all, The Montreal-Python user group would like to host a bug day on October 27 (to be confirmed) at a partner university in Montreal. It would be cool to do a bug day on IRC like we used to (and in other physical locations if people want to!) to get new contributors and close bugs. What do you think? Cheers

8 years, 9 months

Split unicodeobject.c into subfiles

by Victor Stinner

Hi, I forked CPython repository to work on my "split unicodeobject.c" project: http://hg.python.org/sandbox/split-unicodeobject.c The result is 10 files (included the existing unicodeobject.c): 1176 Objects/unicodecharmap.c 1678 Objects/unicodecodecs.c 1362 Objects/unicodeformat.c 253 Objects/unicodeimpl.h 733 Objects/unicodelegacy.c 1836 Objects/unicodenew.c 2777 Objects/unicodeobject.c 2421 Objects/unicodeoperators.c 1235 Objects/unicodeoscodecs.c 1288 Objects/unicodeutfcodecs.c 14759 total This is just a proposition (and work in progress). Everything can be changed :-) "unicodenew.c" is not a good name. Content of this file may be moved somewhere else. Some files may be merged again if the separation is not justified. I don't like the "unicode" prefix for filenames, I would prefer a new directory. -- Shorter files are easier to review and maintain. The compilation is faster if only one file is modified. The MBCS codec requires windows.h. The whole unicodeobject.c includes it just for this codec. With the split, only unicodeoscodecs.c includes this file. The MBCS codec needs also a "winver" variable. This variable is defined between the BLOOM filter and the unicode_result_unchanged() function. How can you explain how these things are sorted? Where should I add a new function or variable? With the split, the variable is now defined very close to where is it used. You don't have to scroll 7000 lines to see where it is used. If you would like to work on a specific function, you don't have to use the search function of your editor to skip thousands to lines. For example, the 18 functions and 2 types related to the charmap codec are now grouped into one unique and short C file. It was already possible to extend and maintain unicodeobject.c (some people proved it!), but it should now be much simpler with shorter files. Note: unicodeobject.c is also composed by the huge stringlib library (4000 lines), which is shared with the bytes type. -- * Objects/unicodeimpl.h Private macros and prototype of private functions. Many unicode_xxx() functions has been renamed to _PyUnicode_xxx() to be able to reuse them in different files. * Objects/unicodenew.c Functions to create a new Unicode string (PyUnicode_New), convert from/to UCS4 and wchar_t*, resize a string. The ugly part of the PEP 393. * Objects/unicodeoperators.c find, replace, compare, split, fill, etc. * Objects/unicodeobject.c "str" type with all methods, _string module and unicodeiter type. * Objects/unicodeformat.c PyUnicode_FromFormat() and PyUnicode_Format() * Objects/unicodecodecs.c Text codecs for Python Unicode strings: - PyUnicode_Decode() - PyUnicode_AsEncodedObject() - PyUnicode_DecodeUnicodeEscape() - PyUnicode_DecodeRawUnicodeEscape(), PyUnicode_AsRawUnicodeEscapeString() - _PyUnicode_DecodeUnicodeInternal() - PyUnicode_DecodeLatin1(), PyUnicode_AsLatin1String() - PyUnicode_AsASCIIString() - PyUnicode_EncodeDecimal() - many helpers for other codecs - ... * Objects/unicodecharmap.c Character Mapping Codec: - PyUnicode_BuildEncodingMap() - PyUnicode_DecodeCharmap() - PyUnicode_AsCharmapString() - PyUnicode_Translate() * Objects/unicodeoscodecs.c Operating system codecs: MBCS codec, locale (FS) codec => FS encode/decode. * Objects/unicodeutfcodecs.c UTF-7/8/16/32 codecs and ASCII decoder. * Objects/unicodelegacy.c Legacy and deprecated Unicode API: Py_UNICODE type. Victor

8 years, 9 months

Who I am

by Jose Figueroa

Hello pythoners! I am Jose Figueroa from Mexico. I work usually with C/C++, Ruby and PHP (yeah I know =( ) but I will start again with python because I got some free time after finishing a project. I gonna use python for my Master Degree in Computer Sciences. Thanks Jose Figueroa

8 years, 9 months

Fwd: Python 3.3 can't sort memoryviews as they're unorderable

by Mark Lawrence

-------- Original Message -------- Subject: Python 3.3 can't sort memoryviews as they're unorderable Date: Sun, 21 Oct 2012 12:24:32 +0100 From: Mark Lawrence <breamoreboy(a)yahoo.co.uk> To: python-list(a)python.org Newsgroups: gmane.comp.python.general http://docs.python.org/dev/whatsnew/3.3.html states "memoryview comparisons now use the logical structure of the operands and compare all array elements by value". So I'd have thought that you should be able to compare them and hence sort them, but this is the state of play. Python 3.3.0 (v3.3.0:bd8afb90ebf2, Sep 29 2012, 10:55:48) [MSC v.1600 32 bit (Intel)] on win32 Type "help", "copyright", "credits" or "license" for more information. >>> memoryview(bytearray(range(5))) == memoryview(bytearray(range(5))) True >>> memoryview(bytearray(range(5))) != memoryview(bytearray(range(5))) False >>> memoryview(bytearray(range(5))) < memoryview(bytearray(range(5))) Traceback (most recent call last): File "<stdin>", line 1, in <module> TypeError: unorderable types: memoryview() < memoryview() Okay then, let's subclass memoryview to provide the functionality. >>> class Test(memoryview): ... pass ... Traceback (most recent call last): File "<stdin>", line 1, in <module> TypeError: type 'memoryview' is not an acceptable base type Oh dear. http://docs.python.org/py3k/library/stdtypes.html#typememoryview only gives examples of equality comparisons and there was nothing that I could see in PEP3118 to explain the rationale behind the lack of other comparisons. What have I missed? Nobody on the main Python ml could answer this so can someone please explain the background to how memoryviews work in this instance as I'm confused, thanks. Mark Lawrence.

8 years, 9 months

Some joker is trying to unsubscribe me

by Guido van Rossum

I've received three messages in the past hour from mailman at python.org notifying me of various attempts to receive a password reminder or to remove me from python-dev. I hope they don't succeed. -- --Guido van Rossum (python.org/~guido)

8 years, 9 months

PEP 427: data directory

by Antoine Pitrou

Hello, The FAQ has this weird statement: “This specification does not have an opinion on how you should organize your code. The .data directory is just a place for any files that are not normally installed inside site-packages or on the PYTHONPATH.” But, say, if I want to install some init script to /etc/init.d by using distutils' data_files argument: setup.py(..., data_files=[('/etc/init.d', ['my-init-script'])] ) How is it stored and represented by the wheel format? Regards Antoine.

8 years, 9 months

← Newer
1
2
3
4
5
6
7
8
9
10
Older →

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

Python-Dev October 2012