Mailman 3 October 2014 - Python-Dev

Sad status of Python 3.x buildbots
by Victor Stinner Oct. 10, 2014

Oct. 10, 2014

Hi, I'm using Python buildbots to ensure that my changes don't fail on some platform. It's important for changes close to the operation system. The problem is that many buildbots are ill. Before, only a few buildbots had sporadic failures. Now most buildbots are always fail (are red). Here is an incomplete list of failures seen on buildbots. Before I opened an issue for each bug, but usually nobody takes care of them. So today I'm trying the mailing list. How can we fix all these issues to have more "green" buildbots? Can anyone help on this task? AMD64 OpenIndiana 3.x: a lot of tests fail with OSError(12, "Not enough space") or MemoryError. It's probably on issue on the host. AMD64 Snow Leop 3.x: many tests are not reliable (stable) on this platform. For example, test_logging.test_race() sometimes fail with PermissionError(1, "Operation not permitted: '/tmp/test_logging-3-bjulw8iz.log'"). Another example, test_asyncio.test_stdin_broken_pipe() sometimes fail with an assertion error because BrokenPipeError was not raised. Do we still support this old version of Mac OS X? Released in 2009, it is 5 years old. Is upgrading to Maverick (10.9) free and possible on old Mac computers? I don't have access to this old OS. x86 RHEL 6 3.x: TestReadline.test_init() fails, issue #19884. I don't have to this platform, I don't know how to fix it. x86 Windows Server 2003 [SB] 3.x: test_build_ext() of test_distutils hangs during 1 hang before being killed, it hangs something in the C compiler. x86 Windows7 3.x: test_nntplib fails with OSError("cannot read from timed out object"). x86 XP-4 3.x: test_distutils fails because Visual Studio linker (link.exe) fails with the error 1181 (cannot open input file). test_capi.test_forced_io_encoding() fails with an assertion error because sys.__stdin__ is None. AMD64 Solaris 11 [SB] 3.x: sometimes, tests fail with MemoryError. test_uuid.test_uuid4() fails with an assertion error. ctypes has issue with the sign of integer numbers (bug in libffi?). ARMv7 3.x: "Read-only file system", Mercurial fails... x86 FreeBSD 7.2 3.x: test_io.test_interrupted_write_text() hangs. x86 FreeBSD 6.4 3.x: test_urllib2net.test_urlwithfrag() fails with urllib.error.URLError: <urlopen error unknown url type: https>. test_tcl has many issues. test_multiprocessing_spawn fails whereas the test should be skipped. x86 OpenBSD 5.5 3.x: many failing tests. x86 OpenIndiana 3.x: MemoryError. TestReadline.test_init() also fails. x86 Tiger 3.x: test_nntplib fails with OSError("cannot read from timed out object". I skipped "SPARC Solaris 10 OpenCSW 3.x" and "PPC64 AIX 3.x" in my list, I'm not really interested by these platforms. Victor

16 35

Summary of Python tracker Issues
by Python tracker Oct. 10, 2014

Oct. 10, 2014

ACTIVITY SUMMARY (2014-10-03 - 2014-10-10) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 4598 (-33) closed 29769 (+90) total 34367 (+57) Open issues with patches: 2152 Issues opened (34) ================== #7830: Flatten nested functools.partial http://bugs.python.org/issue7830 reopened by belopolsky #22526: file iteration SystemError for huge lines (2GiB+) http://bugs.python.org/issue22526 reopened by doko #22542: Use arc4random under OpenBSD for os.urandom() if /dev/urandom http://bugs.python.org/issue22542 reopened by 700eb415 #22552: ctypes.CDLL returns singleton objects, resulting in usage conf http://bugs.python.org/issue22552 opened by Ivan.Pozdeev #22554: Idle: optionally auto-pop-up completion window for names http://bugs.python.org/issue22554 opened by terry.reedy #22555: Tracking issue for adjustments to binary/text boundary handlin http://bugs.python.org/issue22555 opened by ncoghlan #22557: Local import is too slow http://bugs.python.org/issue22557 opened by serhiy.storchaka #22558: Missing hint to source code - complete http://bugs.python.org/issue22558 opened by Friedrich.Spee.von.Langenfeld #22559: [backport] ssl.MemoryBIO http://bugs.python.org/issue22559 opened by alex #22560: Add loop-agnostic SSL implementation to asyncio http://bugs.python.org/issue22560 opened by pitrou #22568: Use of "utime" as variable name in Modules/posixmodule.c cause http://bugs.python.org/issue22568 opened by Jeffrey.Armstrong #22570: Better stdlib support for Path objects http://bugs.python.org/issue22570 opened by barry #22571: Remove import * recommendations and examples in doc? http://bugs.python.org/issue22571 opened by terry.reedy #22575: bytearray documentation confuses string for unicode objects http://bugs.python.org/issue22575 opened by mjpieters #22577: local variable changes lost after pdb jump command http://bugs.python.org/issue22577 opened by xdegaye #22578: Add additional attributes to re.error http://bugs.python.org/issue22578 opened by serhiy.storchaka #22581: Other mentions of the buffer protocol http://bugs.python.org/issue22581 opened by serhiy.storchaka #22583: C stack overflow in the Python 2.7 compiler http://bugs.python.org/issue22583 opened by Kevin.Dyer #22585: os.urandom() should use getentropy() of OpenBSD 5.6 http://bugs.python.org/issue22585 opened by haypo #22586: urljoin allow_fragments doesn't work http://bugs.python.org/issue22586 opened by ColonelThirtyTwo #22587: os.path.abspath(None) behavior is inconsistent between platfor http://bugs.python.org/issue22587 opened by KevKeating #22589: mimetypes uses image/x-ms-bmp as the type for bmp files http://bugs.python.org/issue22589 opened by brma #22590: math.copysign buggy with nan under Windows http://bugs.python.org/issue22590 opened by pitrou #22592: Drop support of Borland C compiler http://bugs.python.org/issue22592 opened by haypo #22593: Automate update of doc references to UCD version when it chang http://bugs.python.org/issue22593 opened by r.david.murray #22594: Add a link to the regex module in re documentation http://bugs.python.org/issue22594 opened by serhiy.storchaka #22596: support.transient_internet() doesn't catch connection refused http://bugs.python.org/issue22596 opened by berker.peksag #22598: Add mUTF-7 codec (UTF-7 modified for IMAP) http://bugs.python.org/issue22598 opened by jcea #22599: traceback: errors in the linecache module at exit http://bugs.python.org/issue22599 opened by haypo #22600: In Multiprocessing Queue() doesn't work with list : __.put(lis http://bugs.python.org/issue22600 opened by AlainCALMET #22601: asyncio: loop.run_forever() should consume exception of the te http://bugs.python.org/issue22601 opened by haypo #22602: UTF-7 codec decodes ill-formed sequences starting with "+" http://bugs.python.org/issue22602 opened by jwilk #22603: Fix a typo in the contextlib docs http://bugs.python.org/issue22603 opened by Francisco.Fernández.Castaño #22604: assertion error in complex division http://bugs.python.org/issue22604 opened by pitrou Most recent 15 issues with no replies (15) ========================================== #22604: assertion error in complex division http://bugs.python.org/issue22604 #22603: Fix a typo in the contextlib docs http://bugs.python.org/issue22603 #22602: UTF-7 codec decodes ill-formed sequences starting with "+" http://bugs.python.org/issue22602 #22601: asyncio: loop.run_forever() should consume exception of the te http://bugs.python.org/issue22601 #22600: In Multiprocessing Queue() doesn't work with list : __.put(lis http://bugs.python.org/issue22600 #22596: support.transient_internet() doesn't catch connection refused http://bugs.python.org/issue22596 #22594: Add a link to the regex module in re documentation http://bugs.python.org/issue22594 #22593: Automate update of doc references to UCD version when it chang http://bugs.python.org/issue22593 #22589: mimetypes uses image/x-ms-bmp as the type for bmp files http://bugs.python.org/issue22589 #22585: os.urandom() should use getentropy() of OpenBSD 5.6 http://bugs.python.org/issue22585 #22581: Other mentions of the buffer protocol http://bugs.python.org/issue22581 #22577: local variable changes lost after pdb jump command http://bugs.python.org/issue22577 #22575: bytearray documentation confuses string for unicode objects http://bugs.python.org/issue22575 #22539: Table formatting errors in pydoc http://bugs.python.org/issue22539 #22538: turtledemo two_canvases reversion http://bugs.python.org/issue22538 Most recent 15 issues waiting for review (15) ============================================= #22603: Fix a typo in the contextlib docs http://bugs.python.org/issue22603 #22601: asyncio: loop.run_forever() should consume exception of the te http://bugs.python.org/issue22601 #22599: traceback: errors in the linecache module at exit http://bugs.python.org/issue22599 #22596: support.transient_internet() doesn't catch connection refused http://bugs.python.org/issue22596 #22592: Drop support of Borland C compiler http://bugs.python.org/issue22592 #22578: Add additional attributes to re.error http://bugs.python.org/issue22578 #22568: Use of "utime" as variable name in Modules/posixmodule.c cause http://bugs.python.org/issue22568 #22560: Add loop-agnostic SSL implementation to asyncio http://bugs.python.org/issue22560 #22559: [backport] ssl.MemoryBIO http://bugs.python.org/issue22559 #22557: Local import is too slow http://bugs.python.org/issue22557 #22552: ctypes.CDLL returns singleton objects, resulting in usage conf http://bugs.python.org/issue22552 #22526: file iteration SystemError for huge lines (2GiB+) http://bugs.python.org/issue22526 #22525: ast.literal_eval() doesn't do what the documentation says http://bugs.python.org/issue22525 #22524: PEP 471 implementation: os.scandir() directory scanning functi http://bugs.python.org/issue22524 #22522: sys.excepthook doesn't receive the traceback when called from http://bugs.python.org/issue22522 Top 10 most discussed issues (10) ================================= #22515: Implement partial order on Counter http://bugs.python.org/issue22515 21 msgs #22568: Use of "utime" as variable name in Modules/posixmodule.c cause http://bugs.python.org/issue22568 17 msgs #22524: PEP 471 implementation: os.scandir() directory scanning functi http://bugs.python.org/issue22524 16 msgs #20167: Exception on IDLE closing http://bugs.python.org/issue20167 12 msgs #22181: os.urandom() should use Linux 3.17 getrandom() syscall http://bugs.python.org/issue22181 11 msgs #22486: Add math.gcd() http://bugs.python.org/issue22486 10 msgs #22526: file iteration SystemError for huge lines (2GiB+) http://bugs.python.org/issue22526 10 msgs #22547: Implement an informative `BoundArguments.__repr__` http://bugs.python.org/issue22547 10 msgs #17636: Modify IMPORT_FROM to fallback on sys.modules http://bugs.python.org/issue17636 8 msgs #22559: [backport] ssl.MemoryBIO http://bugs.python.org/issue22559 8 msgs Issues closed (85) ================== #4832: IDLE does not supply a default ext of .py on Windows or OS X f http://bugs.python.org/issue4832 closed by terry.reedy #6359: pyexpat.c calls trace function incorrectly for exceptions http://bugs.python.org/issue6359 closed by georg.brandl #6653: Potential memory leak in multiprocessing http://bugs.python.org/issue6653 closed by pitrou #8065: Memory leak in readline.get_current_history_length http://bugs.python.org/issue8065 closed by terry.reedy #9417: Declaring a class creates circular references http://bugs.python.org/issue9417 closed by georg.brandl #10031: Withdraw anti-recommendation of relative imports from document http://bugs.python.org/issue10031 closed by python-dev #10583: Encoding issue with chm help in 2.7.1 http://bugs.python.org/issue10583 closed by georg.brandl #10712: 2to3 fixer for deprecated unittest method names http://bugs.python.org/issue10712 closed by r.david.murray #11491: dbm.open(..., flag="n") raises dbm.error if file exists and is http://bugs.python.org/issue11491 closed by r.david.murray #11693: memory leak in email.generator.Generator().flatten() method http://bugs.python.org/issue11693 closed by terry.reedy #11866: race condition in threading._newname() http://bugs.python.org/issue11866 closed by r.david.murray #12148: Clarify "or-ing together" doctest option flags http://bugs.python.org/issue12148 closed by python-dev #13101: Module Doc viewer closes when browser window closes on Windows http://bugs.python.org/issue13101 closed by georg.brandl #14056: Misc doc changes for tarfile http://bugs.python.org/issue14056 closed by r.david.murray #14201: Documented caching for shared library's __getattr__ and __geti http://bugs.python.org/issue14201 closed by r.david.murray #14303: Incorrect documentation for socket.py on linux http://bugs.python.org/issue14303 closed by python-dev #15855: memoryview methods and data members are missing docstrings http://bugs.python.org/issue15855 closed by r.david.murray #16155: Some minor doc fixes in Doc/faq http://bugs.python.org/issue16155 closed by python-dev #16177: Typing left parenthesis in IDLE causes intermittent Cocoa Tk c http://bugs.python.org/issue16177 closed by ned.deily #16518: add "buffer protocol" to glossary http://bugs.python.org/issue16518 closed by r.david.murray #17057: Data model documentation grammar http://bugs.python.org/issue17057 closed by python-dev #17078: string.Template.safe_substitute hard-wires "braces" as {} http://bugs.python.org/issue17078 closed by georg.brandl #17444: multiprocessing.cpu_count() should use hw.availcpu on Mac OS X http://bugs.python.org/issue17444 closed by pitrou #18043: No mention of `match.regs` in `re` documentation http://bugs.python.org/issue18043 closed by georg.brandl #18176: Builtins documentation refers to old version of UCD. http://bugs.python.org/issue18176 closed by r.david.murray #18348: Additional code pages for EBCDIC http://bugs.python.org/issue18348 closed by haypo #18494: PyType_GenericSet/GetDict functions misnamed in docs? http://bugs.python.org/issue18494 closed by python-dev #18615: sndhdr.whathdr could return a namedtuple http://bugs.python.org/issue18615 closed by r.david.murray #19071: Documentation on what self is for module-level functions is mi http://bugs.python.org/issue19071 closed by python-dev #19380: Optimize parsing of regular expressions http://bugs.python.org/issue19380 closed by serhiy.storchaka #19472: inspect.getsource() raises a wrong exception type http://bugs.python.org/issue19472 closed by yselivanov #19477: document tp_print() as being dead in Py3 http://bugs.python.org/issue19477 closed by python-dev #21052: Consider dropping ImportWarning for empty sys.path_hooks and s http://bugs.python.org/issue21052 closed by brett.cannon #21072: Python docs and downloads not available for Egypt http://bugs.python.org/issue21072 closed by georg.brandl #21173: WeakKeyDictionary.__len__ fragile w/ _IterationGuards http://bugs.python.org/issue21173 closed by python-dev #21428: Python suddenly cares about EOLs formats on windows http://bugs.python.org/issue21428 closed by georg.brandl #21456: skip 2 tests in test_urllib2net.py if _ssl module not present http://bugs.python.org/issue21456 closed by berker.peksag #21480: A build now requires... http://bugs.python.org/issue21480 closed by python-dev #21715: Chaining exceptions at C level http://bugs.python.org/issue21715 closed by serhiy.storchaka #21782: hashable documentation error: shouldn't mention id http://bugs.python.org/issue21782 closed by python-dev #21883: relpath: Provide better errors when mixing bytes and strings http://bugs.python.org/issue21883 closed by serhiy.storchaka #21905: RuntimeError in pickle.whichmodule when sys.modules if mutate http://bugs.python.org/issue21905 closed by pitrou #21965: Add support for Memory BIO to _ssl http://bugs.python.org/issue21965 closed by pitrou #22219: python -mzipfile fails to add empty folders to created zip http://bugs.python.org/issue22219 closed by serhiy.storchaka #22222: dtoa.c: remove custom memory allocator http://bugs.python.org/issue22222 closed by haypo #22247: More incomplete module.__all__ lists http://bugs.python.org/issue22247 closed by benjamin.peterson #22290: "AMD64 OpenIndiana 3.x" buildbot: assertion failed in PyObject http://bugs.python.org/issue22290 closed by haypo #22292: pickle whichmodule RuntimeError http://bugs.python.org/issue22292 closed by attilio.dinisio #22331: test_io.test_interrupted_write_text() hangs on the buildbot Fr http://bugs.python.org/issue22331 closed by haypo #22332: test_multiprocessing_main_handling fail on buildbot "x86 FreeB http://bugs.python.org/issue22332 closed by haypo #22423: Errors in printing exceptions raised in a thread http://bugs.python.org/issue22423 closed by serhiy.storchaka #22449: SSLContext.load_verify_locations behavior on Windows and OSX http://bugs.python.org/issue22449 closed by python-dev #22462: Modules/pyexpat.c violates PEP 384 http://bugs.python.org/issue22462 closed by pitrou #22470: Possible integer overflow in error handlers http://bugs.python.org/issue22470 closed by serhiy.storchaka #22482: logging: fileConfig doesn't support formatter styles http://bugs.python.org/issue22482 closed by vinay.sajip #22507: PyType_IsSubtype doesn't call __subclasscheck__ http://bugs.python.org/issue22507 closed by georg.brandl #22508: Remove __version__ string from email http://bugs.python.org/issue22508 closed by r.david.murray #22546: Wrong default precision in documentation for format http://bugs.python.org/issue22546 closed by terry.reedy #22548: Bogus parsing of negative zeros in complex literals http://bugs.python.org/issue22548 closed by mark.dickinson #22549: bug in accessing bytes, inconsistent with normal strings and p http://bugs.python.org/issue22549 closed by r.david.murray #22550: issubclass can fail after module reloading http://bugs.python.org/issue22550 closed by serhiy.storchaka #22551: Anything results in a SyntaxError after -u on 2.7.8 on Windows http://bugs.python.org/issue22551 closed by Taylor.Marks #22553: Diagram issue http://bugs.python.org/issue22553 closed by georg.brandl #22556: datetime comparison with 'None' returning a TypeError http://bugs.python.org/issue22556 closed by eric.smith #22561: PyUnicode_InternInPlace crashes http://bugs.python.org/issue22561 closed by ned.deily #22562: Singleton pattern for namedtuple http://bugs.python.org/issue22562 closed by r.david.murray #22563: namedtuple: raise an exception when the given class name would http://bugs.python.org/issue22563 closed by mark.dickinson #22564: ssl: post-commit review of the new memory BIO API http://bugs.python.org/issue22564 closed by haypo #22565: missing const in declaration of PyErr_WarnEx in C-API docs http://bugs.python.org/issue22565 closed by python-dev #22566: International keyboard makes IDLE crash on OSX http://bugs.python.org/issue22566 closed by ned.deily #22567: doctest handle ignored execption http://bugs.python.org/issue22567 closed by r.david.murray #22569: Add support for weakrefs to _socket.socket http://bugs.python.org/issue22569 closed by python-dev #22572: NoneType object is not iterable error when asyncio Server.clos http://bugs.python.org/issue22572 closed by r.david.murray #22573: AttributeErrors in statements split up into multiple linse wit http://bugs.python.org/issue22573 closed by r.david.murray #22574: super() and del in the same method leads to UnboundLocalError http://bugs.python.org/issue22574 closed by Miaou #22576: ftplib documentation gives a wrong argument name for storbinar http://bugs.python.org/issue22576 closed by berker.peksag #22579: Posix module init function name should not be compiler-depende http://bugs.python.org/issue22579 closed by haypo #22580: PyUnicode_Tailmatch documentation does not match signature http://bugs.python.org/issue22580 closed by python-dev #22582: RuntimeError with string concatenation http://bugs.python.org/issue22582 closed by Kevin.Dyer #22584: Get rid of SRE character tables http://bugs.python.org/issue22584 closed by serhiy.storchaka #22588: memory corrupted in test_capi refleaks test http://bugs.python.org/issue22588 closed by haypo #22591: Drop support of MS-DOS (DJGPP compiler) http://bugs.python.org/issue22591 closed by haypo #22595: F5 shortcut key not working in IDLE for OSX http://bugs.python.org/issue22595 closed by mc128k #22597: printf-style formatting allows mixing keyed and keyless specif http://bugs.python.org/issue22597 closed by eric.smith #1519638: Unmatched Group issue - workaround http://bugs.python.org/issue1519638 closed by serhiy.storchaka

1 0

mUTF-7 support?
by Jesus Cea Oct. 10, 2014

Oct. 10, 2014

I miss mUTF-7 support (as used to encode IMAP4 mailbox names) in Python, in the codecs module. As an european with a language with 27 different letters (instead of english 26), tildes, opening question marks, etc., I find it very inconvenient. This encoding is used basically only in IMAP4, I know. But IMAP4 is an important protocol and all projects related to it needs mUTF-7 support if they care about non-english alphabets. Everybody has already an implementation, waste of effort. We already support quite amusing encodings in <https://docs.python.org/3.5/library/codecs.html#standard-encodings>. What do you think?. Could be considered for Python 3.5?. I volunteer for the job, of course. PS: Do you think a Python implementation would be good enough?. I don't think this need to be C-fast. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

10 22

shebang policy, and pip
by Christian Tismer Oct. 8, 2014

Oct. 8, 2014

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Howdy, this question is a bit about general policy which is not yet covered in the python recommendations: I see projects which do check-ins like "get rid of shebang lines" and they remove those lines from non-script sources. It is not always clear to me what to do, so I tend to leave those lines in per default, in order not to waste time thinking about it, but well, today I was confronted with that. Digging a bit deeper shows the following: python docs: No mention of shebang, but for Windows. https://docs.python.org/3/search.html?q=shebang&check_keywords=yes&area=def… https://docs.python.org/3/using/windows.html?highlight=shebang Google's python style guide also says when a shebang is needed, but does not forbid it. Pep 394 explains how to use shebang, but still nothing about not using it. http://legacy.python.org/dev/peps/pep-0394/ So is there anything officially preferred, and should that go into pep 8? Special case with pip - ------------------ I was looking through my installed packages and wondered quite much about pip: Pip has a shebang in the __init__ file, but no shebang in the __main__ file. I guess this is wrong and should be in the executable file, which is __main__ . cheers - Chris - -- Christian Tismer :^) tismer(a)stackless.com Software Consulting : http://www.stackless.com/ Karl-Liebknecht-Str. 121 : http://www.pydica.net/ 14482 Potsdam : GPG key -> 0xFB7BEE0E phone +49 173 24 18 776 fax +49 (30) 700143-0023 -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.22 (Darwin) Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJUNQ8FAAoJEOcwEVD7e+4Of5MH/13YyXRzPVXfsLDbfe/CRkFF ORVAPkRB90OaEmbLTvBXPhFlAgEwcQnpdO+tmqigvlORd0cSXQKIxoPOiqq601gs XV56aREqBCT26XMaKTuoPdu4DaW+TkwyWSn70eq4U/P7YjF3ZlNt8IkA5mteM7an ycRYMnknEaIvP/xpZdGp+v4pq5LA42LWAY1awnBk4eMP04uDowSmcuLELpZrmSCr iMkw6wPUdZxGVtQNwSses0mh3DuaQuwrubhHMnLoOKn/lqRjckG2Ii2BIHlWy9lQ 5X3y8IdWPh7awio8xaibNqsWaP+0DT97g2H7QZf8YIG7/DkHL/iacSr7NAPBXXQ= =IODc -----END PGP SIGNATURE-----

4 5

[RELEASE] Python 3.4.2 is now available
by Larry Hastings Oct. 8, 2014

Oct. 8, 2014

On behalf of the Python development community and the Python 3.4 release team, I'm pleased to announce the availability of Python 3.4.2. Python 3.4.2 has many bugfixes and other small improvements over 3.4.1. One new feature for Mac OS X users: the OS X installers are now distributed as signed installer package files compatible with the OS X Gatekeeper security feature. You can download it here: https://www.python.org/download/releases/3.4.2 May the road rise up to meet you, //arry/

6 6

performance delta with .py presence v.s. only pyc on python 2.7.x?
by John Smith Oct. 7, 2014

Oct. 7, 2014

My team has a python app that appears to perform 10+% better when the python source is present v.s. when only the pyc's are distributed. This is contradictory to my understanding of how python leverages pyc's. Scenario 1. pyc-only install sees mediocre performance. (pyc's are built using compileall.py, then source .py's removed before packaging) 2. adding the .py files to the installed filesystem results in 10+% performance improvement 3. verified no difference in mod times, no new .pyc's generated 4. remove the .py's and again see drop in performance Env info: centos 6.5, x86_64, however python used is 32bit from the i686 repos (this is how we deal with some 32bit only c libraries that the app must use) Has anyone got an idea of what I might be running into? The app itself is a black box to me. I was not able to isolate this using a simple piece of python code that worked on a math problem for a discernible amount of time, so it could be something to do with how the app is using python. The app was originally written for python 2.4... Any suggestions on what I can try is appreciated.

3 2

Interactive Grid for Sorting, Filtering DataFrames in IPython Notebook
by tshawver Oct. 7, 2014

Oct. 7, 2014

As part of the work on our research environment at Quantopian <https://www.quantopian.com/research> , I've been building an extension which renders pandas DataFrames as interactive grids in the IPython notebook. The extension uses a Javascript library called SlickGrid to render the grids, and the current state of the project can be found here on GitHub: https://github.com/quantopian/qgrid The extension is also viewable in nbviewer: http://nbviewer.ipython.org/github/quantopian/qgrid/blob/master/qgrid_demo.… The GitHub repository contains some explanation of why I chose to implement the grid as a Python package rather than a standard IPython notebook extension, which might be interesting for other people who are looking to add functionality to the notebook in a similar way. -Tim -- View this message in context: http://python.6.x6.nabble.com/Interactive-Grid-for-Sorting-Filtering-DataFr… Sent from the Python - python-dev mailing list archive at Nabble.com.

2 1

3.4.2 is slipping by a day
by Larry Hastings Oct. 7, 2014

Oct. 7, 2014

We don't have Windows installers yet. If we can't get 'em in the next 24 hours or so, I'll release without them. But for now... we wait. Twiddling my thumbs, //arry/

1 0

bytes-like objects
by R. David Murray Oct. 7, 2014

Oct. 7, 2014

Over the past while we've been cleaning up the docs in the area of "how do we refer to bytes, bytearray, memoryview, etc, etc?" in the APIs that deal with bytes. As you may or may not remember, we settled on the term 'bytes-like object', and have changed the docs to (we hope) consistently use this term, which has a glossary entry most of the references to it link to. I just committed (to 3.5) the final changes for issue 16518, the change to consistently using the term 'bytes-like object' for things that support the buffer interface. This means that messages that previously read: 'sometype' does not support the buffer interface now read a bytes-like object is required, not 'sometype' The 'buffer interface' messages were rather confusing, since you have to dig to find out what the 'buffer interface' is. It isn't any sort of python object, nor is there any object in python3 that has a name related to it. 'bytes-like object', on the other hand, is fairly intuitive[*], and if you look it up in the glossary it links to the explanation of the buffer interface. We felt it was worth explicitly mentioning this patch on python-dev to point out to everyone that the docs and error messages now use a consistent terminology, instead of the mis-mash we had before, which should make it easier to help people with issues where this comes up. If there are objections to this change to the messages it is easy enough to back out, but personally I find the new error messages *much* clearer, and I'm an experienced dev. (This work was done by Ezio Melotti, but I committed the final patch as part of my quest to clear the 'commit review' queue in the tracker.) --David [*] the more esoteric cases are not often encountered in regular (as opposed to NumPy) code, and when they are, the extension to "something that can be interpreted as a sequence of bytes" is pretty straightforward conceptually.

9 13

Fixing 2.7.x
by Ethan Furman Oct. 6, 2014

Oct. 6, 2014

With the incredibly long life span of 2.7, which bugs should we *not* fix? For example, in http://bugs.python.org/issue22297 I mentioned one reason to not fix that bug was that the fix was not in 3.1-3.3, but 2.7 will outlive all those plus a couple more. So, what are the current guidelines on what to fix? Is it still security only, with the rest being carrots for switching? -- ~Ethan~

11 13