Mailman 3 February 2008 - Python-Dev

Can't decode \x876F character encoded in Shift JIS charset ?
by Nicolas Dumazet 07 Feb '08

07 Feb '08

>>> unicode('\x87\x6F', "shift jis") Traceback (most recent call last): File "<stdin>", line 1, in <module> UnicodeDecodeError: 'shift_jis' codec can't decode bytes in position 0-1: illegal multibyte sequence Still, \x87\x6F is a valid Shift-JIS character : http://demo.icu-project.org/icu-bin/convexp?conv=ibm-943_P15A-2003&b=87&s=M…, it is "㎜"... Thanks, -- Nicolas Dumazet — NicDumZ Deuxième année ENSIMAG.

3 2

Buildbot failures
by Raymond Hettinger 07 Feb '08

07 Feb '08

Some of bsddb tests are failing. In Py3.0 I switched the bsddb modules from UserDict.DictMixin to collections.MutableMapping. But, the failures are also happened in the Py2.6 branch so something else must be the cause. The db.InvalidArgError suggests that one of the defined constants is broken. There is also a recurring failure in SocketServer.py returning "ValueError: list.remove(x): x not in list" during attempts to remove a PID from the list of active_children. Any ideas about what is causing this? The freelists optimization has been causing periodic failure in test_sys., "test_compact_freelists self.assert_(r[0][2] > 100, r[0][2])". Also, test_docxmlrpc hasn't been happy. One of the tests isn't getting the exact response string it expected. Any ideas what is causing this? Raymond

3 2

bugs.pythong.org bug?
by Joseph Armbruster 06 Feb '08

06 Feb '08

All, I attempted to search for all issues created by me today so I could catch up since i've been out of the loop for a bit. I performed the following steps: - went to bugs.python.org - clicked search (on the lhs of the page) - typed in josepharmbruster as creator - clicked search I will create an issue if deemed necessary. Joseph Armbruster *exceptions.KeyError*: Debugging information follows 1. While evaluating the standard:'request/batch' expression on line 23 Current variables: *templates*<roundup.cgi.templating.Templatesinstance at 0x2ab2b64c5fc8> *repeat*<roundup.cgi.PageTemplates.TALES.SafeMapping instance at 0x2ab2b75ad9e0> *false*0 *context*<HTMLClass(0x2ab2b75ad908) issue> * utils*<roundup.cgi.templating.TemplatingUtils instance at 0x2ab2b75ad950> *db*<roundup.cgi.templating.HTMLDatabase instance at 0x2ab2b75ad6c8> *nothing*None *i18n*< roundup.cgi.TranslationService.TranslationService instance at 0x2ab2b759e200> *true*1 *default*< roundup.cgi.PageTemplates.TALES.Default instance at 0x2ab2b6353b90> * request*<HTMLRequest {'_context': None, 'startwith': 0, 'show': < roundup.support.TruthDict instance at 0x2ab2b75ad830>, 'classname': 'issue', 'special_char': '@', 'dispname': None, 'group': [('+', 'priority')], '_client': <roundup.cgi.client.Client instance at 0x2ab2b759e128>, 'template': 'index', 'input': <function input_xhtml at 0x2ab2b635b758>, 'columns': ['title', 'id', 'activity', 'status'], 'sort': [('+', 'activity')], 'env': {'HTTP_AUTHORIZATION': None, 'SERVER_PORT': '8080', 'SERVER_NAME': 'localhost', 'HTTP_ACCEPT_LANGUAGE': 'en-us,en;q= 0.5', 'SCRIPT_NAME': '', 'REQUEST_METHOD': 'GET', 'HTTP_HOST': 'localhost:8080', 'PATH_INFO': 'issue', 'CONTENT_TYPE': 'text/plain', 'QUERY_STRING': '%40search_text=&title=&%40columns=title&id=&%40columns=id&creation=&creator=josepharmbruster&activity=&%40columns=activity&%40sort=activity&actor=&nosy=&type=&components=&versions=&severity=&dependencies=&assignee=&keywords=&priority=&%40group=priority&status=1&%40columns=status&resolution=&%40pagesize=50&%40startwith=0&%40action=search', 'TRACKER_NAME': 'tracker'}, 'form': FieldStorage(None, None, [MiniFieldStorage('@columns', 'title'), MiniFieldStorage('@columns', 'id'), MiniFieldStorage('creator', 'josepharmbruster'), MiniFieldStorage('@columns', 'activity'), MiniFieldStorage('@sort', 'activity'), MiniFieldStorage('@group', 'priority'), MiniFieldStorage('status', '1'), MiniFieldStorage('@columns', 'status'), MiniFieldStorage('@pagesize', '50'), MiniFieldStorage('@startwith', '0'), MiniFieldStorage('@action', 'search'), MiniFieldStorage('@filter', 'creator'), MiniFieldStorage('@filter', 'status')]), 'nodeid': None, 'base': 'http://bugs.python.org/', 'user': <HTMLItem(0x2ab2b75ad7e8) user 2>, 'search_text': None, 'pagesize': 50, 'filterspec': {'status': ['1'], 'creator': []}, 'filter': ['creator', 'status'], 'client': < roundup.cgi.client.Client instance at 0x2ab2b759e128>}> *tracker*< roundup.instance.Tracker instance at 0x2ab2b64bccf8> *template*<Roundup PageTemplate 'issue.index.html'> *config*< roundup.configuration.CoreConfig instance at 0x2ab2b64bcd40> *options*{'ok_message': [], 'error_message': []} *loop*< roundup.cgi.PageTemplates.TALES.SafeMapping instance at 0x2ab2b75ad9e0> *status_notresolved*'-1,1,3' *columns_showall* 'id,activity,title,creator,assignee,status' *kw_create*0 *attrs*{'tal:define': 'batch request/batch', 'tal:condition': 'context/is_view_ok'} *columns *'id,activity,title,creator,status' 2. A problem occurred in your template "issue.index.html". Full traceback: Traceback (most recent call last): File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/client.py", line 770, in renderContext result = pt.render(self, None, None, **args) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/templating.py", line 323, in render getEngine().getContext(c), output, tal=1, strictinsert=0)() File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 192, in __call__ self.interpret(self.program) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 236, in interpret handlers[opcode](self, args) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 666, in do_useMacro self.interpret(macro) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 236, in interpret handlers[opcode](self, args) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 411, in do_optTag_tal self.do_optTag(stuff) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 396, in do_optTag return self.no_tag(start, program) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 391, in no_tag self.interpret(program) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 236, in interpret handlers[opcode](self, args) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 689, in do_defineSlot self.interpret(slot) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 236, in interpret handlers[opcode](self, args) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 411, in do_optTag_tal self.do_optTag(stuff) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 396, in do_optTag return self.no_tag(start, program) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 391, in no_tag self.interpret(program) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 236, in interpret handlers[opcode](self, args) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/TAL/TALInterpreter.py", line 462, in do_setLocal_tal self.engine.setLocal(name, self.engine.evaluateValue(expr)) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/PageTemplates/TALES.py", line 227, in evaluate return expression(self) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/PageTemplates/Expressions.py", line 194, in __call__ return self._eval(econtext) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/PageTemplates/Expressions.py", line 189, in _eval return render(ob, econtext.vars) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/PageTemplates/Expressions.py", line 95, in render ob = ob() File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/cgi/templating.py", line 2463, in batch l = [id for id in klass.filter(matches, filterspec, sort, group) File "/home/roundup/roundup-production//lib/python2.4/site-packages/roundup/backends/rdbms_common.py", line 2178, in filter del d[None] KeyError

3 2

XXX - in funcobject.c
by Kristján Valur Jónsson 06 Feb '08

06 Feb '08

Hello there. in function_call() in funcobject.c, we have this comment: /* XXX This is broken if the caller deletes dict items! */ Now, I wonder what specifically is meant here? are we really talking about the 'callee' here? In PyEval_EvalCodeEx() it looks as though all keywords are always INCREFed, so the callee never gets a borrowed reference to something from the keyword dict. Maybe this comment is out of date, or can someone demonstrate how to break the code accordingly? The reason I ask is that I am debugging a really tricky crash case on our live servers and I am currently led to believe that the temporary array for the keyword dict is being overwritten somehow. Cheers, Kristján, CCP games.

3 7

Limit free list of method and builtin function objects (was: [Python-checkins] r60614 - in python/trunk: Misc/NEWS Objects/classobject.c Objects/methodobject.c)
by M.-A. Lemburg 06 Feb '08

06 Feb '08

Hi Christian, could you explain how you came up with the 256 entry limit ? It appears to be rather low and somehow arbitrary. I understand that some limit is required, but since these objects get created a lot (e.g. for bound methods), setting the limit too low will significantly slow down the interpreter. BTW: What does pybench have to say to this patch ? To get an idea of how many objects are typically part of the free list, I'd suggest running an application such as Zope for a while and then check the maximum numfree value. Thanks, -- Marc-Andre Lemburg eGenix.com Professional Python Services directly from the Source (#1, Feb 06 2008) >>> Python/Zope Consulting and Support ... http://www.egenix.com/ >>> mxODBC.Zope.Database.Adapter ... http://zope.egenix.com/ >>> mxODBC, mxDateTime, mxTextTools ... http://python.egenix.com/ ________________________________________________________________________ :::: Try mxODBC.Zope.DA for Windows,Linux,Solaris,MacOSX for free ! :::: eGenix.com Software, Skills and Services GmbH Pastor-Loeh-Str.48 D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg Registered at Amtsgericht Duesseldorf: HRB 46611 On 2008-02-06 13:44, christian.heimes wrote: > Author: christian.heimes > Date: Wed Feb 6 13:44:34 2008 > New Revision: 60614 > > Modified: > python/trunk/Misc/NEWS > python/trunk/Objects/classobject.c > python/trunk/Objects/methodobject.c > Log: > Limit free list of method and builtin function objects to 256 entries each. > > Modified: python/trunk/Misc/NEWS > ============================================================================== > --- python/trunk/Misc/NEWS (original) > +++ python/trunk/Misc/NEWS Wed Feb 6 13:44:34 2008 > @@ -12,6 +12,9 @@ > Core and builtins > ----------------- > > +- Limit free list of method and builtin function objects to 256 entries > + each. > + > - Patch #1953: Added ``sys._compact_freelists()`` and the C API functions > ``PyInt_CompactFreeList`` and ``PyFloat_CompactFreeList`` > to compact the internal free lists of pre-allocted ints and floats. > > Modified: python/trunk/Objects/classobject.c > ============================================================================== > --- python/trunk/Objects/classobject.c (original) > +++ python/trunk/Objects/classobject.c Wed Feb 6 13:44:34 2008 > @@ -4,10 +4,16 @@ > #include "Python.h" > #include "structmember.h" > > +/* Free list for method objects to safe malloc/free overhead > + * The im_self element is used to chain the elements. > + */ > +static PyMethodObject *free_list; > +static int numfree = 0; > +#define MAXFREELIST 256 > + > #define TP_DESCR_GET(t) \ > (PyType_HasFeature(t, Py_TPFLAGS_HAVE_CLASS) ? (t)->tp_descr_get : NULL) > > - > /* Forward */ > static PyObject *class_lookup(PyClassObject *, PyObject *, > PyClassObject **); > @@ -2193,8 +2199,6 @@ > In case (b), im_self is NULL > */ > > -static PyMethodObject *free_list; > - > PyObject * > PyMethod_New(PyObject *func, PyObject *self, PyObject *klass) > { > @@ -2207,6 +2211,7 @@ > if (im != NULL) { > free_list = (PyMethodObject *)(im->im_self); > PyObject_INIT(im, &PyMethod_Type); > + numfree--; > } > else { > im = PyObject_GC_New(PyMethodObject, &PyMethod_Type); > @@ -2332,8 +2337,14 @@ > Py_DECREF(im->im_func); > Py_XDECREF(im->im_self); > Py_XDECREF(im->im_class); > - im->im_self = (PyObject *)free_list; > - free_list = im; > + if (numfree < MAXFREELIST) { > + im->im_self = (PyObject *)free_list; > + free_list = im; > + numfree++; > + } > + else { > + PyObject_GC_Del(im); > + } > } > > static int > @@ -2620,5 +2631,7 @@ > PyMethodObject *im = free_list; > free_list = (PyMethodObject *)(im->im_self); > PyObject_GC_Del(im); > + numfree--; > } > + assert(numfree == 0); > } > > Modified: python/trunk/Objects/methodobject.c > ============================================================================== > --- python/trunk/Objects/methodobject.c (original) > +++ python/trunk/Objects/methodobject.c Wed Feb 6 13:44:34 2008 > @@ -4,7 +4,12 @@ > #include "Python.h" > #include "structmember.h" > > +/* Free list for method objects to safe malloc/free overhead > + * The m_self element is used to chain the objects. > + */ > static PyCFunctionObject *free_list = NULL; > +static int numfree = 0; > +#define MAXFREELIST 256 > > PyObject * > PyCFunction_NewEx(PyMethodDef *ml, PyObject *self, PyObject *module) > @@ -14,6 +19,7 @@ > if (op != NULL) { > free_list = (PyCFunctionObject *)(op->m_self); > PyObject_INIT(op, &PyCFunction_Type); > + numfree--; > } > else { > op = PyObject_GC_New(PyCFunctionObject, &PyCFunction_Type); > @@ -125,8 +131,14 @@ > _PyObject_GC_UNTRACK(m); > Py_XDECREF(m->m_self); > Py_XDECREF(m->m_module); > - m->m_self = (PyObject *)free_list; > - free_list = m; > + if (numfree < MAXFREELIST) { > + m->m_self = (PyObject *)free_list; > + free_list = m; > + numfree++; > + } > + else { > + PyObject_GC_Del(m); > + } > } > > static PyObject * > @@ -346,14 +358,16 @@ > PyCFunctionObject *v = free_list; > free_list = (PyCFunctionObject *)(v->m_self); > PyObject_GC_Del(v); > + numfree--; > } > + assert(numfree == 0); > } > > /* PyCFunction_New() is now just a macro that calls PyCFunction_NewEx(), > but it's part of the API so we need to keep a function around that > existing C extensions can call. > */ > - > + > #undef PyCFunction_New > PyAPI_FUNC(PyObject *) PyCFunction_New(PyMethodDef *, PyObject *); > > _______________________________________________ > Python-checkins mailing list > Python-checkins(a)python.org > http://mail.python.org/mailman/listinfo/python-checkins

1 0

Re: [Python-Dev] Any tips to tell sprinter at PyCon about developing on Windows?
by Trent Nelson 05 Feb '08

05 Feb '08

Feb 2, 2008 7:34 PM, Christian Heimes <lists(a)cheimes.de> wrote: > > Brett Cannon wrote: > > It would be really cool if you can recruit some experienced Windows > > developers. :] > That's the point in all of this. =) > -Brett I'll be around for the sprints -- didn't really have a plan as to what I'd like to sprint on but if there's some interest in farming Windows developers, I'll raise my hand. Anything in particular you can point myself or others in the Windows camp at such that we're a bit better prepared come sprint time (i.e. open issues)? (Also, I'm looking to acquire a new reasonably well-spec'd Windows box for work. If it's available in time for PyCon, I should be able to set up a couple of virtual 64-bit Vista/Server 2008 images with VS 2008 dev environments that non-Windows developers could use, if that would be desirable.) Trent.

1 0

Any Emacs tips for core developers?
by Brett Cannon 05 Feb '08

05 Feb '08

I noticed on the download page that http://www.python.org/emacs is listed as the place to get your modes for Python development (which seemed to lack any mention of Vim and the support in svn; a slight bias =). Is this true for core development as well? Basically if someone can tell me the best place to download stuff and a bullet point or three for core dev new developers who use Emacs will thank you. And if you use something other than Vim or TextMate you can make suggestions as well. But it should be a fairly popular editor for me to bother to toss a slide into the tutorial. -Brett

12 25

Backporting PEP 3115
by Thomas Wouters 04 Feb '08

04 Feb '08

Is anyone interested in seeing PEP 3115 (Metaclasses in Python 3000, ) backported to 2.6? Actually, I guess I am interested, so perhaps I should ask 'does anyone see any objection to it being backported'? Of course there should be full backward compatibility in 2.6, but I don't see any issue preventing that, right now. (I was actually working on backporting the new super() (incorrectly described in PEP 3135) which builds on top of PEP 3115; I can backport without PEP 3115 but it would be a waste if we then backported 3115 after all.) -- Thomas Wouters <thomas(a)python.org> Hi! I'm a .signature virus! copy me into your .signature file to help me spread!

1 0

Any tips to tell sprinter at PyCon about developing on Windows?
by Brett Cannon 03 Feb '08

03 Feb '08

This year at PyCon, sprint coaches are giving tutorials up to three hours long the night before sprinting starts. Being the sprint coach on the core means that I get to be that person for the core. Here is to hoping people wait for me for dinner that night. Anyway, to make the tutorial as useful as possible I need to worry about Windows users. But being an OS X/UNIX user, I don't know how to help these people. =) As or right now I am going to point them to the readme.txt file in PCbuild for build instructions. But I don't know if there is any tips or tricks I should be pointing out to them in terms of developing on Python. I mean I assume they can use the build executable from their svn checkout and have it pick up changes they make to code in the checkout, right? I honestly don't know how different it is to develop on Windows than on UNIX. So any info that people can give me to cover would be helpful. -Brett

5 13

Fix of urgent exception pickling issue in Python 2.5.2, help needed
by Jaroslav Pachola 03 Feb '08

03 Feb '08

As you may know, I recently posted a message about the following issue: http://bugs.python.org/issue1692335 . The issue has been reviewed by Guido van Rossum yesterday and as it seems there are some serious concerns about breaking the pickle protocol functionality and that's why I please the mailing list subscribers for help. Review of the attached patches by someone who has a deep insight into the pickle protocol would be really appreciated. Let me briefly explain the situation: Before version 2.5, it was perfectly possible to pickle and unpickle subclasses of Exception class with custom initializer parameters. In 2.5 it does not work any more and I think the issue is related to new-style class exceptions introduced in Python 2.5. The bug tracker contains patch that fixes the issue and adds some useful test cases. The patch seems to be relatively clean and simple, but still it seems necessary that another experienced developer reviews the patch so the issue can be resolved and closed. The issue prevents some existing projects to move to Python 2.5, please help. Regards, Jaroslav Pachola

1 0