Mailman 3 November 2007 - Python-Dev

Python tickets summary
by Facundo Batista 14 Dec '07

14 Dec '07

People: I modified my tool, whichs makes a summary of all the Python tickets (I moved the source where the info is taken from SF to our Roundup). In result, the summary is now, again, updated daily: http://www.taniquetil.com.ar/facundo/py_tickets.html Enjoy it. Regards, -- . Facundo Blog: http://www.taniquetil.com.ar/plog/ PyAr: http://www.python.org/ar/

3 17

[poll] New name for __builtins__
by Christian Heimes 04 Dec '07

04 Dec '07

I'm sending this mail to Python-dev in the hope to reach more developers. GvR likes to rename the __builtin__ to reduce confusing between __builtin__ and __builtins__. He wanted to start a poll on the new name but apparently he forgot. >From http://bugs.python.org/issue1498 --- In http://bugs.python.org/issue1774369 I mentioned that I wanted to rename __builtins__ to __rootns__. Though right now I think something longer and less cryptic might be better. The reason is to avoid for once and for all the confusion between __builtin__, which is a module, and __builtins__, a feature mainly used by sandboxing to pass the set of builtins to be used via the global namespace. This lay at the heart of the referenced bug. I'm still in favor of this but haven't had the time to investigate how much work it would be. [...] OK, then we need to agree on a new name. I find __root__ too short, __rootns__ too cryptic, and __root_namespace__ too long. :-) What else have we got? --- What name do you prefer? I'm +1 with Raymond on __root__ but I'm still open for better suggestions. Christian

32 78

Decimal news: speedup and stabilization
by Facundo Batista 02 Dec '07

02 Dec '07

Hi people! Two news. A big speed up, and now we reached some stable state. Mark Dickinson found out that a lot of time was lost internally in decimal.py when dealing with the Decimal mantissas. He changed the way that mantissa was stored, from a tuple of ints, to a plain string (each character a digit). This achieved a speedup of around a 40%!!! Three notes: - The speedup was measured using two tools I created [*], one basically tries a lot of use cases, the other use the specification test cases. Both generate a .py which actually measures the times. - No API was changed, and this a good thing, :) - The change is somewhat big. But as the speedup is important, and the API es untouched, I considered it was something that worths it. After several months with a lot of work here, no more big changes are planned to this module, so I will backport it to 2.5.3 (when the trunk gets unfrozen). Note that the module complies with the latest specification and with the latest test cases (that are from one month ago!). Thanks Mark for all your effort here! [*] http://tools.assembla.com/svn/homedevel/decimal/ Regards, -- . Facundo Blog: http://www.taniquetil.com.ar/plog/ PyAr: http://www.python.org/ar/

2 3

Update to PEP 366 (Relative imports from the main module)
by Nick Coghlan 02 Dec '07

02 Dec '07

I've updated PEP 366 with a proposed implementation, as well as a few changes to the proposed semantics to make the implementation feasible (the old proposal called for imp.new_module to calculate a value when it didn't have access to all of the relevant information). The updated text is below, and should turn up on python.org before too long. Regards, Nick. -------------------------------------------- PEP: 366 Title: Main module explicit relative imports Version: $Revision$ Last-Modified: $Date$ Author: Nick Coghlan <ncoghlan(a)gmail.com> Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 1-May-2007 Python-Version: 2.6, 3.0 Post-History: 1-May-2007, 4-Jul-2007, 7-Jul-2007, 23-Nov-2007 Abstract ======== This PEP proposes a backwards compatible mechanism that permits the use of explicit relative imports from executable modules within packages. Such imports currently fail due to an awkward interaction between PEP 328 and PEP 338. By adding a new module level attribute, this PEP allows relative imports to work automatically if the module is executed using the ``-m`` switch. A small amount of boilerplate in the module itself will allow the relative imports to work when the file is executed by name. Proposed Change =============== The major proposed change is the introduction of a new module level attribute, ``__package__``. When it is present, relative imports will be based on this attribute rather than the module ``__name__`` attribute. As with the current ``__name__`` attribute, setting ``__package__`` will be the responsibility of the PEP 302 loader used to import a module. Loaders which use ``imp.new_module()`` to create the module object will have the new attribute set automatically to ``None``. When the import system encounters an explicit relative import in a module without ``__package__`` set (or with it set to ``None``), it will calculate and store the correct value (``__name__.rpartition('.')[0]`` for normal modules and ``__name__`` for package initialisation modules). If ``__package__`` has already been set then the import system will use it in preference to recalculating the package name from the ``__name__`` and ``__path__`` attributes. The ``runpy`` module will explicitly set the new attribute, basing it off the name used to locate the module to be executed rather than the name used to set the module's ``__name__`` attribute. This will allow relative imports to work correctly from main modules executed with the ``-m`` switch. When the main module is specified by its filename, then the ``__package__`` attribute will be set to ``None``. To allow relative imports when the module is executed directly, boilerplate similar to the following would be needed before the first relative import statement:: if __name__ == "__main__" and __package__ is None: __package__ = "expected.package.name" Note that this boilerplate is sufficient only if the top level package is already accessible via ``sys.path``. Additional code that manipulates ``sys.path`` would be needed in order for direct execution to work without the top level package already being importable. This approach also has the same disadvantage as the use of absolute imports of sibling modules - if the script is moved to a different package or subpackage, the boilerplate will need to be updated manually. It has the advantage that this change need only be made once per file, regardless of the number of relative imports. Rationale for Change ==================== The current inability to use explicit relative imports from the main module is the subject of at least one open SF bug report (#1510172) [1]_, and has most likely been a factor in at least a few queries on comp.lang.python (such as Alan Isaac's question in [2]_). This PEP is intended to provide a solution which permits explicit relative imports from main modules, without incurring any significant costs during interpreter startup or normal module import. The section in PEP 338 on relative imports and the main module provides further details and background on this problem. Reference Implementation ======================== Rev 47142 in SVN implemented an early variant of this proposal which stored the main module's real module name in the ``__module_name__`` attribute. It was reverted due to the fact that 2.5 was already in beta by that time. Patch 1487 [4] is the proposed implementation for this PEP. Alternative Proposals ===================== PEP 3122 proposed addressing this problem by changing the way the main module is identified. That's a significant compatibility cost to incur to fix something that is a pretty minor bug in the overall scheme of things, and the PEP was rejected [3]_. The advantage of the proposal in this PEP is that its only impact on normal code is the small amount of time needed to set the extra attribute when importing a module. Relative imports themselves should be sped up fractionally, as the package name is cached in the module globals, rather than having to be worked out again for each relative import. References ========== .. [1] Absolute/relative import not working? (http://www.python.org/sf/1510172) .. [2] c.l.p. question about modules and relative imports (http://groups.google.com/group/comp.lang.python/browse_thread/thread/c44c76…) .. [3] Guido's rejection of PEP 3122 (http://mail.python.org/pipermail/python-3000/2007-April/006793.html) .. [4] PEP 366 implementation patch (http://bugs.python.org/issue1487) Copyright ========= This document has been placed in the public domain.

2 2

-O2 faster than -O3?
by Neil Toronto 01 Dec '07

01 Dec '07

On both of my systems, using -O2 reduces execution time in pystone by 9% and in pybench by 8%. It's function inlining: "-O3 -fno-inline-functions" works just as well as "-O2". Removing "-g" has little effect on the result. Systems: - AMD Athlon 64 X2 Dual Core 4600+, 512 KB cache (desktop) - Intel T2300 Dual Core 1.66GHz, 512 KB cache (laptop) Both are Ubuntu 7.04, GCC 4.1.2. Does anybody else see this? It may be GCC being stupid (which has happened before) or not enough cache on my systems (definitely possible). If it's not one of those, I'd say it's because CPython core functions are already very large, and almost everything that ought to be inlined is already a macro. Pybench comparison for the Athlon: http://spreadsheets.google.com/ccc?key=pHIJrYc_pnIXCwJvDvU9gfQ&hl=en_US Neil

4 4

msvcr90 support was added to mingw
by Christian Heimes 30 Nov '07

30 Nov '07

Paul Moore got some Cygwin developers persuaded to implement support for msvcr90 [1]. The coded was added a few days ago [2]. This means that users are still able to use MinGW to compile extensions when we switch to VS 2008 as default compiler on Windows. I'm not sure how many people are interested in the topic but some may be glad to hear that MinGW is still supported. Christian [1] http://article.gmane.org/gmane.comp.gnu.mingw.user/24686 [2] http://cygwin.com/cgi-bin/cvsweb.cgi/src/winsup/mingw/msvcrt.def.in?rev=1.8…

2 1

Summary of Tracker Issues
by Tracker 30 Nov '07

30 Nov '07

ACTIVITY SUMMARY (11/23/07 - 11/30/07) Tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 1323 open (+24) / 11687 closed (+11) / 13010 total (+35) Open issues with patches: 418 Average duration of open issues: 699 days. Median duration of open issues: 844 days. Open Issues Breakdown open 1315 (+23) pending 8 ( +1) Issues Created Or Reopened (36) _______________________________ Warning required when calling register() on an ABCMeta subclass 11/30/07 CLOSED http://bugs.python.org/issue1109 reopened gvanrossum py3k, patch Patch to remove unbound methods 11/24/07 CLOSED http://bugs.python.org/issue1493 created tiran py3k, patch DOM-Documentation should mention that appendChild() removes the 11/24/07 CLOSED http://bugs.python.org/issue1494 created dennda Unicode in a comment. 11/24/07 CLOSED http://bugs.python.org/issue1495 created wiscados add str.maketrans() 11/25/07 CLOSED http://bugs.python.org/issue1496 created georg.brandl py3k, patch Patch to remove API to create new unbound methods 11/25/07 http://bugs.python.org/issue1497 created tiran py3k, patch Rename __builtins__ to __root_namespace__? 11/26/07 http://bugs.python.org/issue1498 created gvanrossum py3k failure behaviour of compile() is missing 11/26/07 http://bugs.python.org/issue1499 created AchimGaedke Example using range doesn't give claimed results 11/26/07 CLOSED http://bugs.python.org/issue1500 created basingwerk 0 ** 0 documentation 11/26/07 http://bugs.python.org/issue1501 created jimjjewett itertools should grow chunkify 11/26/07 CLOSED http://bugs.python.org/issue1502 created arkanes test_xmlrpc is still flakey 11/27/07 http://bugs.python.org/issue1503 created gvanrossum Add 2to3 fixer for (un)bound methods 11/27/07 http://bugs.python.org/issue1504 reopened tiran py3k Changes to PyMethod_New breaks ctypes on Windows 11/27/07 CLOSED http://bugs.python.org/issue1505 created tiran py3k func alloca inside ctypes lib needs #include <alloca.h> on solar 11/27/07 http://bugs.python.org/issue1506 created mthibaut complex constructor loses signs of zeros 11/27/07 http://bugs.python.org/issue1507 created marketdickinson Removal of stale code in _csv.c / pyexpat.c 11/27/07 CLOSED http://bugs.python.org/issue1508 created JosephArmbruster py3k Documentation lacking for the sqlite3 module. 11/28/07 http://bugs.python.org/issue1509 created pmawhorter help for file/open should state which is prefered. 11/28/07 http://bugs.python.org/issue1510 created carlfk csv input converts \r\n to \n but csv output does not when a fie 11/28/07 http://bugs.python.org/issue1511 created fenner Removal of stale code in pyconfig.h 11/28/07 http://bugs.python.org/issue1512 created JosephArmbruster object.c do_compare comparison ordering error 11/28/07 CLOSED http://bugs.python.org/issue1513 created JosephArmbruster missing constants in socket module 11/28/07 http://bugs.python.org/issue1514 created dbinger py3k, patch deepcopy doesn't copy instance methods 11/29/07 http://bugs.python.org/issue1515 created mlvanbie make _ctypes work with non-gcc compilers 11/29/07 http://bugs.python.org/issue1516 created gregcouch lookdict should INCREF/DECREF startkey around PyObject_RichCompa 11/29/07 CLOSED http://bugs.python.org/issue1517 created rhamphoryncus patch Fast globals/builtins access (patch) 11/29/07 http://bugs.python.org/issue1518 created ntoronto patch async_chat.__init__() parameters 11/29/07 http://bugs.python.org/issue1519 created nvawda 'without make' documentation build anomaly 11/29/07 http://bugs.python.org/issue1520 created JosephArmbruster string.decode() fails on long strings 11/29/07 http://bugs.python.org/issue1521 created eisele pyvm module patch 11/29/07 http://bugs.python.org/issue1522 created tiran py3k, patch xdrlib fails to detect overflow (struct bug?) 11/29/07 http://bugs.python.org/issue1523 created lloyd os.system() fails for commands with multiple quoted file names 11/29/07 http://bugs.python.org/issue1524 created Quigon Executing Python script using subprocess.Popen twice interactive 11/30/07 CLOSED http://bugs.python.org/issue1525 created canhuth DeprecationWarning in zipfile.py while zipping 113000 files 11/30/07 http://bugs.python.org/issue1526 created bialix Problem with static libs on Windows 11/30/07 http://bugs.python.org/issue1527 created tiran py3k, patch Issues Now Closed (34) ______________________ Warning required when calling register() on an ABCMeta subclass 0 days http://bugs.python.org/issue1109 tiran py3k, patch Fixer needed for __future__ imports 82 days http://bugs.python.org/issue1138 tiran py3k popen3 website documentation inconsistency 55 days http://bugs.python.org/issue1220 georg.brandl email module example email-unpack.py error 43 days http://bugs.python.org/issue1273 georg.brandl Bug in pstats.print_callers 32 days http://bugs.python.org/issue1315 georg.brandl subprocess.communication doc could use clarification 28 days http://bugs.python.org/issue1344 georg.brandl xml.dom refers to PyXML, which is no longer maintained 26 days http://bugs.python.org/issue1355 georg.brandl Interpreter cleanup: order of _PyGILState_Fini and PyInterpreter 22 days http://bugs.python.org/issue1402 amaury.forgeotdarc new keyword-only function parameters interact badly with nested 15 days http://bugs.python.org/issue1409 amaury.forgeotdarc py3k test_subprocess fails on SuSE 10 16 days http://bugs.python.org/issue1412 tiran SystemError accessing uninitialised cell contents 9 days http://bugs.python.org/issue1445 amaury.forgeotdarc error in TestResult.addError and TestResult.addFailure 5 days http://bugs.python.org/issue1467 georg.brandl MSI installer does not include SSL test .pem files 6 days http://bugs.python.org/issue1468 loewis csv module is leaking references 4 days http://bugs.python.org/issue1479 georg.brandl py3k sqlite module is leaking lots of references 4 days http://bugs.python.org/issue1480 georg.brandl py3k Patch to remove unbound methods 2 days http://bugs.python.org/issue1493 gvanrossum py3k, patch DOM-Documentation should mention that appendChild() removes the 0 days http://bugs.python.org/issue1494 loewis Unicode in a comment. 0 days http://bugs.python.org/issue1495 facundobatista add str.maketrans() 3 days http://bugs.python.org/issue1496 georg.brandl py3k, patch Example using range doesn't give claimed results 0 days http://bugs.python.org/issue1500 gvanrossum itertools should grow chunkify 0 days http://bugs.python.org/issue1502 rhettinger Changes to PyMethod_New breaks ctypes on Windows 1 days http://bugs.python.org/issue1505 tiran py3k Removal of stale code in _csv.c / pyexpat.c 0 days http://bugs.python.org/issue1508 tiran py3k object.c do_compare comparison ordering error 0 days http://bugs.python.org/issue1513 georg.brandl lookdict should INCREF/DECREF startkey around PyObject_RichCompa 1 days http://bugs.python.org/issue1517 gvanrossum patch Executing Python script using subprocess.Popen twice interactive 0 days http://bugs.python.org/issue1525 canhuth inspect, class instances and __getattr__ 1692 days http://bugs.python.org/issue718532 gvanrossum Subclassing from Modules 1607 days http://bugs.python.org/issue765228 gvanrossum profiler: Bad return and Bad call errors with exceptions 1022 days http://bugs.python.org/issue1117670 georg.brandl cannot change cursor color in IDLE 221 days http://bugs.python.org/issue1705362 georg.brandl sqlite3 causes memory read error 169 days http://bugs.python.org/issue1734164 ghaering Add O_NOATIME to os module 165 days http://bugs.python.org/issue1735632 georg.brandl Decimal.__int__ overflows for large values 107 days http://bugs.python.org/issue1770416 facundobatista Unify __builtins__ -> __builtin__ 107 days http://bugs.python.org/issue1774369 georg.brandl py3k, patch Top Issues Most Discussed (10) ______________________________ 12 pyvm module patch 1 days open http://bugs.python.org/issue1522 11 string.decode() fails on long strings 1 days open http://bugs.python.org/issue1521 9 Patch to remove unbound methods 2 days closed http://bugs.python.org/issue1493 8 Add 2to3 fixer for (un)bound methods 3 days open http://bugs.python.org/issue1504 6 func alloca inside ctypes lib needs #include <alloca.h> on sola 3 days open http://bugs.python.org/issue1506 6 Patch to remove API to create new unbound methods 5 days pending http://bugs.python.org/issue1497 6 Interpreter cleanup: order of _PyGILState_Fini and PyInterprete 22 days closed http://bugs.python.org/issue1402 5 lookdict should INCREF/DECREF startkey around PyObject_RichComp 1 days closed http://bugs.python.org/issue1517 5 object.c do_compare comparison ordering error 0 days closed http://bugs.python.org/issue1513 5 Rename __builtins__ to __root_namespace__? 4 days open http://bugs.python.org/issue1498

1 0

[poll] New name for __builtins__
by Facundo Batista 29 Nov '07

29 Nov '07

2007/11/29, Greg Ewing <greg.ewing(a)canterbury.ac.nz>: > > __ubiquitous__ > Uh! Great! +1 -- . Facundo Blog: http://www.taniquetil.com.ar/plog/ PyAr: http://www.python.org/ar/

1 0

Re: [Python-Dev] removing the new and types modules
by henning.vonbargen＠arcor.de 29 Nov '07

29 Nov '07

Sorry if this is a dumb question, but are there actually good reasons to remove "types"? IMHO the types module helps keeping code readable. For example "if type(obj) == FloatType" is just more readable than "if type(obj) == type(1.0)". Luckily Python does not distinguish float and double like other languages - otherwise it wouldn't be clear for the average programmer if 1.0 is a float or a double constant. Henning

5 4

ssl module integration with asyncore
by Giampaolo Rodola' 29 Nov '07

29 Nov '07

Hi there, since ssl module is still in development I thought it would have been better asking such question here instead of on comp.lang.python. I'm interested in using the ssl module with asyncore but since there's no real documentation about it yet I've been not able to write something useful with it. Currently I'm trying to add the SSL support to an asyncore-based FTP server I wrote. I tried to write some code by watching the ssl-related test-suite scripts with no luck since there are no available tests for asyncore available. I tried to play with the wrap_socket() function a little bit but different type of errors are raised every time. I'm sure this happens because I'm not doing things in the right way. Could someone please show me an example code about how the ssl module could be integrated with asyncore?

2 11