Mailman 3 October 2008 - Python-Dev

Transformation with ``parser`` ast
by Malthe Borch Oct. 13, 2008

Oct. 13, 2008

The ``compiler.ast`` module makes parsing Python source-code and AST manipulation relatively painless and it's straight-forward to implement a transformer class. However, I find that the ``compiler.pycodegen`` module imposes a hard limit on the length of functions since it calculates jump points in a recursion. I'm using this module to compile an XML dynamic template into Python code (akin to "Mako") and functions may grow to a rather large size. Now it seems that the ``parser`` module, which parses source code into ``parser.st`` trees does not have the same limitations, however, I could not find a transformer class compatible with its tree structure. What's the recommended way of working with the AST tree from the ``parser`` module? \malthe

2 1

Possible summits at PyCon (and question about sprinting implications)
by Brett Cannon Oct. 13, 2008

Oct. 13, 2008

Over in PyConLand, there has been talk about trying to set up a language summit the day before PyCon starts (the second day of tutorials). The idea is to give the core developers and Python VM implementers a day to sit around and talk about stuff without having to eat into the sprints (I am not leading the organizing of it, so I don't have any exact details beyond various ideas that have leaked over to the program committee mailing list). The idea was then floated about inviting the VM implementers of the big three JavaScript VMs. But then this got re-targeted as possibly a separate summit on Wednesday (first day of tutorials) where the various dynamic language VM implementers could get together and talk. PyCon would essentially act as the hosting site for this and as motivation to maybe get some other VM folks to look at the language and since no business or university would necessarily be interested enough to make this happen. But there is a worry that if people attended one or both of the summits it would cut into people's sprint time. And if any sprint group would be adversely affected by this, the core sprint would be hit the hardest since the attendees of the sprint are the most likely to attend either summit. And so I have been tasked with asking people whether attending the summits would put a crimp in their attendance of the sprints. Please let me know if attending the summits (especially the VM one on Wednesday) would cause you to skip out on the sprints in any way. -Brett

1 0

Re: [Python-Dev] [Python-checkins] r66863 - python/trunk/Modules/posixmodule.c
by "Martin v. Löwis" Oct. 12, 2008

Oct. 12, 2008

[switching to python-dev] Georg Brandl wrote: > Martin v. Löwis schrieb: >> Raymond Hettinger wrote: >>>> Merges should be handled by the original committer. >>> Respectfully disagree. Some people here having been taking >>> responsibility for keeping the branches in-sync >> Which people specifically? > > Specifically, Christian, Benjamin and myself have done larger merges > to the 3k branch in the past, and if svnmerge is used, I suspect will > do the same for 2.6. That's different, though. Does any of you has actually taken *responsibility* to do so, either unlimited, or with some limitation? (e.g. for a year, or until 2.7 is released, or for all changes but bsddb and Windows). I would be (somewhat) happy to hear that, but I wouldn't really expect it - we are all volunteers, and we typically consider taking responsibility (e.g. as a release manager) very carefully. Please don't get me wrong: I very much appreciate that you volunteer, but I don't want to discharge any committer from merging on the assumption that someone has formally taken responsibility. I would be skeptical relying on such a commitment, knowing that RL can get in the way too easily. E.g. Christian disappeared for some time, and I completely sympathize with that - but it also tells me that I can't trust on somebody doing something unless that someone has explicitly said that he will do that, hoping that he will tell me when the commitment is no longer valid (the same happened, e.g., in the Python job board, and happens all the time in other projects - it took me about a year before I stepped back as the PyXML maintainer). I can *also* sympathize with committers that say "we don't want to backport, because we either don't have the time, or the expertise (say, to install and run svnmerge on Windows)". I just accept that not all patches that deserve backporting actually do get backported (just as not all patches that deserve acceptance do get accepted, in the first place). Regards, Martin

7 13

for __future__ import planning
by Benjamin Peterson Oct. 12, 2008

Oct. 12, 2008

So now that we've released 2.6 and are working hard on shepherding 3.0 out the door, it's time to worry about the next set of releases. :) I propose that we dramatically shorten our release cycle for 2.7/3.1 to roughly a year and put a strong focus stabilizing all the new goodies we included in the last release(s). In the 3.x branch, we should continue to solidify the new code and features that were introduced. One 2.7's main objectives should be binding 3.x and 2.x ever closer. -- Cheers, Benjamin Peterson "There's nothing quite as beautiful as an oboe... except a chicken stuck in a vacuum cleaner."

16 31

2 modifications in robotparser.py
by Taskinoor Hasan Oct. 12, 2008

Oct. 12, 2008

im a novice python programmer. i have made two changes to robotparser.py. i apologize if this is the wrong list to post this mail. 1. some sites /* specially wikipedia */ returns 403 when default User-Agent is used. so i have changed the code to use urllib2 and added a set_user_agent method. this is simple. 2. this problem is slight complicated. please check the robots.txt file from mathworld. http://mathworld.wolfram.com/robots.txt it contains 2 User-Agent: * lines. from http://www.robotstxt.org/norobots-rfc.txt These name tokens are used in User-agent lines in /robots.txt to identify to which specific robots the record applies. The robot must obey the first record in /robots.txt that contains a User- Agent line whose value contains the name token of the robot as a substring. The name comparisons are case-insensitive. If no such record exists, it should obey the first record with a User-agent line with a "*" value, if present. If no record satisfied either condition, or no records are present at all, access is unlimited. but it seems that our robotparser is obeying the 2nd one. the problem occures because robotparser assumes that no robots.txt will contain two * user-agent. it should not have two two such line, but in reality many site may have two. so i have changed the code as follow: def _add_entry(self, entry): if "*" in entry.useragents: # the default entry is considered last if self.default_entry == None: self.default_entry = entry else: self.entries.append(entry) and at the end of parse(self, lines) method if state==2: # self.entries.append(entry) self._add_entry(entry) red marked lines are added by me. as im a very novice python programmer, i really want some experts comment about this matter. i apologize again if im wasting ur times. thanks in advance Taskinoor Hasan Sajid

2 2

Distutils/packaging sprint this weekend
by A.M. Kuchling Oct. 11, 2008

Oct. 11, 2008

Tarek Zidae' is organizing a sprint on general distutils/setuptools/packaging this weekend. Physically it's in Arlington VA, but participants will be hanging out in #distutils on freenode's IRC. More information at <http://www.openplans.org/projects/plone-conference-2008-dc/distribute>. --am"If you're in Fairfax County and need a lift, let me know"k

2 1

syntax change justification
by Jim Jewett Oct. 11, 2008

Oct. 11, 2008

Nick Coghlan's explanation of what justifies a syntax change (most of message http://mail.python.org/pipermail/python-dev/2008-October/082831.html ) should probably be added to the standard docs/FAQs somewhere. At the moment, I'm not sure exactly where, though. At the moment, the Developer FAQ (http://www.python.org/dev/faq/) is mostly about using specific tools (rather than design philosophy), and Nick's explanation may be too detailed for the current Explanations section of www.python.org/dev/ Possibly as a Meta-PEP? -jJ

4 3

backporting tests [was: [Python-checkins] r66863 - python/trunk/Modules/posixmodule.c]
by Jim Jewett Oct. 10, 2008

Oct. 10, 2008

In http://mail.python.org/pipermail/python-dev/2008-October/082994.html Martin v. Löwis wrote: > So 2.6.0 will contain a lot of tests that have never been tested in > a wide variety of systems. Some are incorrect, and get fixed in 2.6.1, > and stay fixed afterwards. This is completely different from somebody > introducing a new test in 2.6.4. It means that there are more failures > in a maintenance release, not less as in the first case. If 2.6.1 has some (possibly accidental, but exposed to the users) behavior that is not a clear bug, it should be kept through 2.6.x. You may well want to change it in 2.7, but not in 2.6.4. Adding a test to 2.6.2 ensures that the behavior will not silently disappear because of an unrelated bugfix in 2.6.3. -jJ

1 0

Summary of Python tracker Issues
by Python tracker Oct. 10, 2008

Oct. 10, 2008

ACTIVITY SUMMARY (10/03/08 - 10/10/08) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 2105 open (+49) / 13818 closed (+21) / 15923 total (+70) Open issues with patches: 690 Average duration of open issues: 707 days. Median duration of open issues: 1884 days. Open Issues Breakdown open 2089 (+49) pending 16 ( +0) Issues Created Or Reopened (73) _______________________________ zlib.crc32() and adler32() return value 10/06/08 http://bugs.python.org/issue1202 reopened facundobatista 64bit, easy Fix test_cProfile 10/06/08 http://bugs.python.org/issue2744 reopened benjamin.peterson "make check" suggest a testing target under GNU coding standards 10/03/08 CLOSED http://bugs.python.org/issue3758 reopened brett.cannon patch 08 value popups an stdin error, no date handle allowed 10/03/08 CLOSED http://bugs.python.org/issue4031 created pgimelli disutils cannot recognize ".dll.a" as library on cygwin 10/03/08 http://bugs.python.org/issue4032 created ocean-city python search path - .pth recursion 10/03/08 http://bugs.python.org/issue4033 created jolleyjoe traceback attribute error 10/03/08 http://bugs.python.org/issue4034 created ghazel patch, needs review Support bytes for os.exec*() 10/03/08 http://bugs.python.org/issue4035 created haypo patch, patch Support bytes for subprocess.Popen() 10/03/08 http://bugs.python.org/issue4036 created haypo patch, patch doctest.py should include method descriptors when looking inside 10/04/08 http://bugs.python.org/issue4037 created daaku py3k error in distutils file_copy exception handlers 10/04/08 CLOSED http://bugs.python.org/issue4038 created mhammond patch, patch Add __enter__ and __exit__ methods to StringIO/cStringIO classes 10/04/08 CLOSED http://bugs.python.org/issue4039 created peppergrower ignored exceptions in generators (regression?) 10/04/08 http://bugs.python.org/issue4040 created benjamin.peterson reference to rexec in __import__ 10/04/08 CLOSED http://bugs.python.org/issue4041 created wplappert IDLE won't start in 2.6 final. A known fix was overlooked? 10/04/08 CLOSED http://bugs.python.org/issue4042 created rbtyod Warnings in IDLE raise TypeError (such as attempting to import d 10/04/08 http://bugs.python.org/issue4043 created craigh test_output_textcalendar fails on non-englisch locale 10/05/08 http://bugs.python.org/issue4044 created oefe test_mboxmmdf_to_maildir fails on non-englisch locale 10/05/08 http://bugs.python.org/issue4045 created oefe test_formatdate_usegmt fails on non-englisch locale 10/05/08 http://bugs.python.org/issue4046 created oefe test_run_abort triggers CrashReporter on MacOS X 10/05/08 http://bugs.python.org/issue4047 created oefe parsermodule won't validate relative imports 10/05/08 http://bugs.python.org/issue4048 created dbinger patch IDLE does not open at all 10/06/08 http://bugs.python.org/issue4049 created Chris_L inspect.findsource() returns binary data for shared library modu 10/06/08 http://bugs.python.org/issue4050 created brodierao patch use of TCHAR under win32 10/06/08 http://bugs.python.org/issue4051 created eckhardt patch Build on 2.6 on AIX 5.3 fails (syntax error / undeclared identif 10/06/08 CLOSED http://bugs.python.org/issue4052 created gerard str.split unintentionally strips char 'I' from the string 10/06/08 CLOSED http://bugs.python.org/issue4053 created Govind str.split unintentionally strips char 'I' from the string 10/06/08 CLOSED http://bugs.python.org/issue4054 created Govind Documentation on website is missing section numbers 10/06/08 CLOSED http://bugs.python.org/issue4055 created ivazquez :Class: causes exception 10/06/08 CLOSED http://bugs.python.org/issue4056 created ianb Popen(..., cwd=...) does not set PWD environment variable 10/06/08 http://bugs.python.org/issue4057 created tebeka markup in What's New in 2.6 10/06/08 CLOSED http://bugs.python.org/issue4058 created lehmannro patch sqlite3 docs incomplete 10/06/08 CLOSED http://bugs.python.org/issue4059 created lehmannro patch PyUnicode_DecodeUTF16(..., byteorder=0) gets it wrong on Mac OS 10/06/08 http://bugs.python.org/issue4060 created trentm patch summing two numbers-strange answer 10/06/08 CLOSED http://bugs.python.org/issue4061 created mhmtyozcu001 Reference to non-existent __version__ in ast module 10/06/08 http://bugs.python.org/issue4062 created orestis sphinx: make all-pdf does not exist. 10/07/08 CLOSED http://bugs.python.org/issue4063 created guettli distutils.util.get_platform() is wrong for universal builds on m 10/07/08 http://bugs.python.org/issue4064 created ronaldoussoren patch, needs review _multiprocessing doesn't build on macosx 10.3 10/07/08 http://bugs.python.org/issue4065 created ronaldoussoren smtplib SMTP_SSL._get_socket doesn't return a value 10/07/08 http://bugs.python.org/issue4066 created marcin.bachry patch ast.fix_missing_locations() breaks if node doesn't have "_attrib 10/07/08 http://bugs.python.org/issue4067 created marcin.bachry patch Backport fix for issue 3312 10/07/08 CLOSED http://bugs.python.org/issue4068 created ghaering patch, patch set.remove raises confusing KeyError 10/07/08 CLOSED http://bugs.python.org/issue4069 created cfbolz patch python tests failure if builddir <> sourcedir 10/07/08 http://bugs.python.org/issue4070 created rpetrov patch ntpath.abspath fails for long str paths 10/08/08 http://bugs.python.org/issue4071 created JDay patch build_py support for lib2to3 is stale 10/08/08 http://bugs.python.org/issue4072 created mhammond patch distutils build_scripts and install_data commands need 2to3 supp 10/08/08 http://bugs.python.org/issue4073 created mhammond Building a list of tuples has non-linear performance 10/08/08 http://bugs.python.org/issue4074 created gregory.p.smith Use WCHAR variant of OutputDebugString 10/08/08 http://bugs.python.org/issue4075 created eckhardt patch Cannot build non-framework tkinter Python on Mac OS X.5 10/08/08 CLOSED http://bugs.python.org/issue4076 created indiedan Py_FatalError cleanup patch 10/08/08 http://bugs.python.org/issue4077 created eckhardt patch, easy asyncore fixes are not backwards compatible 10/08/08 http://bugs.python.org/issue4078 created sidnei new urllib2.Request 'timeout' attribute needs to have a default 10/08/08 http://bugs.python.org/issue4079 created sidnei pyunit - display time of each test case - patch 10/08/08 http://bugs.python.org/issue4080 created pprokop patch Error copying directory to _static in Sphinx 10/08/08 http://bugs.python.org/issue4081 created tcdelaney python2.6 -m site doesn't run site._script() any more 10/08/08 http://bugs.python.org/issue4082 created christian.heimes try statement in language reference not updated for v2.6 10/09/08 http://bugs.python.org/issue4083 created davipo Decimal.max(NaN, x) gives incorrect results when x is finite and 10/09/08 http://bugs.python.org/issue4084 created marketdickinson patch 2.5.2 whatsnew document corrupts names, by having broken HTML, a 10/09/08 CLOSED http://bugs.python.org/issue4085 created drj support %z format in time.strftime and _strptime? 10/09/08 http://bugs.python.org/issue4086 created skip.montanaro Document the effects of NotImplemented on == and != 10/09/08 http://bugs.python.org/issue4087 created marketdickinson Patch to implement a real poplib test suite 10/09/08 http://bugs.python.org/issue4088 created giampaolo.rodola patch linking python2.6.dll crash on windows xp 10/09/08 http://bugs.python.org/issue4089 created Manuel Documenting set comparisons and operations 10/09/08 http://bugs.python.org/issue4090 created tjreedy python dll not installed in windows system directory 10/09/08 http://bugs.python.org/issue4091 created theller inspect.getargvalues return type not ArgInfo 10/09/08 http://bugs.python.org/issue4092 created castironpi add gc/memory management tests to pybench 10/09/08 http://bugs.python.org/issue4093 created pitrou "Future statements" Doc from 2.6 refers to 2.5 10/09/08 CLOSED http://bugs.python.org/issue4094 created martin.marcher Delivery Status 10/10/08 CLOSED http://bugs.python.org/issue4095 created nobody Lib/lib2to3/*.pickle are shipped / modified in the build 10/10/08 http://bugs.python.org/issue4096 created doko Traceback doesn't run back all the way 10/10/08 http://bugs.python.org/issue4097 created pinkisntwell surprised by default list parameter 10/10/08 CLOSED http://bugs.python.org/issue4098 created trott dir on a compiled re does not show pattern as a part of the list 10/10/08 http://bugs.python.org/issue4099 created bartoszr xml.etree.ElementTree does not read xml-text over page bonderies 10/10/08 http://bugs.python.org/issue4100 created roland Issues Now Closed (44) ______________________ test_socket.py fails 297 days http://bugs.python.org/issue1610 Tinctorius PythonLauncher not working correctly on OS X 10.5/Leopad 261 days http://bugs.python.org/issue1905 thelawnmowerman [Py3k] line number is wrong after encoding declaration 206 days http://bugs.python.org/issue2384 amaury.forgeotdarc patch file that breaks 2to3 (despite being correct python) 185 days http://bugs.python.org/issue2532 collinwinter os.listdir can return byte strings 105 days http://bugs.python.org/issue3187 loewis patch [proposal] alternative for re.sub 93 days http://bugs.python.org/issue3255 ocean-city float.as_integer_ratio method is not documented 95 days http://bugs.python.org/issue3288 georg.brandl patch 2to3 Iterative Wildcard Matching 81 days http://bugs.python.org/issue3358 collinwinter patch Fraction and Decimal in the Tutorial 79 days http://bugs.python.org/issue3412 rhettinger PEP 3121 --- module state is not nul-initalized as claimed in th 38 days http://bugs.python.org/issue3740 loewis patch "make check" suggest a testing target under GNU coding standards 3 days http://bugs.python.org/issue3758 brett.cannon patch _lsprof issue 19 days http://bugs.python.org/issue3895 benjamin.peterson Building PDF documentation from tex files 19 days http://bugs.python.org/issue3909 georg.brandl bisect insort C implementation ignores methods on list subclasse 16 days http://bugs.python.org/issue3935 georg.brandl patch PyTraceBack_Print() doesn't respect # coding: xxx header 13 days http://bugs.python.org/issue3975 amaury.forgeotdarc patch Additional 2to3 documentation updates 5 days http://bugs.python.org/issue4000 georg.brandl 2to3 does relative import for modules not in a package. 3 days http://bugs.python.org/issue4001 benjamin.peterson patch missing newline in "Could not convert argument %s to string" err 7 days http://bugs.python.org/issue4004 amaury.forgeotdarc patch Python-2.6-py2.6.egg-info contains Alpha reference 4 days http://bugs.python.org/issue4014 loewis convert os.getcwdu() to os.getcwd(), and getcwdu() to getcwd() 1 days http://bugs.python.org/issue4023 benjamin.peterson patch Documentation displays incorrectly in iexplore. 4 days http://bugs.python.org/issue4029 LambertDW 08 value popups an stdin error, no date handle allowed 0 days http://bugs.python.org/issue4031 amaury.forgeotdarc py3k error in distutils file_copy exception handlers 1 days http://bugs.python.org/issue4038 mhammond patch, patch Add __enter__ and __exit__ methods to StringIO/cStringIO classes 0 days http://bugs.python.org/issue4039 benjamin.peterson reference to rexec in __import__ 0 days http://bugs.python.org/issue4041 georg.brandl IDLE won't start in 2.6 final. A known fix was overlooked? 1 days http://bugs.python.org/issue4042 loewis Build on 2.6 on AIX 5.3 fails (syntax error / undeclared identif 0 days http://bugs.python.org/issue4052 loewis str.split unintentionally strips char 'I' from the string 0 days http://bugs.python.org/issue4053 haypo str.split unintentionally strips char 'I' from the string 0 days http://bugs.python.org/issue4054 haypo Documentation on website is missing section numbers 2 days http://bugs.python.org/issue4055 georg.brandl :Class: causes exception 2 days http://bugs.python.org/issue4056 georg.brandl markup in What's New in 2.6 2 days http://bugs.python.org/issue4058 georg.brandl patch sqlite3 docs incomplete 2 days http://bugs.python.org/issue4059 georg.brandl patch summing two numbers-strange answer 0 days http://bugs.python.org/issue4061 benjamin.peterson sphinx: make all-pdf does not exist. 1 days http://bugs.python.org/issue4063 georg.brandl Backport fix for issue 3312 1 days http://bugs.python.org/issue4068 ghaering patch, patch set.remove raises confusing KeyError 0 days http://bugs.python.org/issue4069 amaury.forgeotdarc patch Cannot build non-framework tkinter Python on Mac OS X.5 1 days http://bugs.python.org/issue4076 amaury.forgeotdarc 2.5.2 whatsnew document corrupts names, by having broken HTML, a 0 days http://bugs.python.org/issue4085 georg.brandl "Future statements" Doc from 2.6 refers to 2.5 0 days http://bugs.python.org/issue4094 benjamin.peterson Delivery Status 0 days http://bugs.python.org/issue4095 loewis surprised by default list parameter 0 days http://bugs.python.org/issue4098 amaury.forgeotdarc optparse enable_interspersed_args disable_interspersed_args 982 days http://bugs.python.org/issue1415508 akuchling patch Failed to build Python 2.5.1 with sqlite3 528 days http://bugs.python.org/issue1706863 ocean-city patch Top Issues Most Discussed (10) ______________________________ 15 os.listdir can return byte strings 105 days closed http://bugs.python.org/issue3187 14 python2.6 -m site doesn't run site._script() any more 2 days open http://bugs.python.org/issue4082 14 PyUnicode_DecodeUTF16(..., byteorder=0) gets it wrong on Mac OS 4 days open http://bugs.python.org/issue4060 13 Cross compiling patches for MINGW 694 days open http://bugs.python.org/issue1597850 12 PyTraceBack_Print() doesn't respect # coding: xxx header 13 days closed http://bugs.python.org/issue3975 12 compile() cannot decode Latin-1 source encodings 55 days open http://bugs.python.org/issue3574 10 ntpath.abspath fails for long str paths 3 days open http://bugs.python.org/issue4071 9 Use WCHAR variant of OutputDebugString 2 days open http://bugs.python.org/issue4075 7 importing from UNC roots doesn't work 46 days open http://bugs.python.org/issue3677 6 Document the effects of NotImplemented on == and != 1 days open http://bugs.python.org/issue4087

1 0

www.python.org/doc and docs.python.org hotfixed
by Jim Jewett Oct. 10, 2008

Oct. 10, 2008

> For the search engine issue, is there any way we can tell robots to > ignore the rewrite rules so they see the broken links? (although even > that may not be ideal, since what we really want is to tell the robot > the link is broken, and provide the new alternative) I may be missing something obvious, but isn't this the exact intent of HTTP response code 301 Moved Permanently http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.3.2 -jJ

1 0