Mailman 3 September 2007 - Python-Dev

Pygtk app and hangs.
by jd Sept. 19, 2007

Sept. 19, 2007

Hi I have a non-trivial pygtk running in to hangs/freezes. Over all here is how program looks like. gobject.threads_init() gtk.main within threads_enter/threads_leave All UI operaions in main threads. Some call backs create UIWorker threads, UI worker thread does some work.. and then do gobkect.idle_add to call a function that updates the UI. I have a timer uses gobject.timeout_add. the idle callbacks and timeout call backs are in threads_enter/threads_leave. I use some lib, that creates its own threads and does socket operations. Q. Anything I missed, or any suggestions. Is there a comprehensive list/scheme on how to write a MT pygtk app? Q. I tried to setup debug version 2.5 but it fails with import gtk File "/usr/lib/python2.5/site-packages/gtk-2.0/gtk/__init__.py", line 38, in <module> import gobject as _gobject File "/usr/lib/python2.5/site-packages/gtk-2.0/gobject/__init__.py", line 30, in <module> from _gobject import * ImportError: /usr/lib/python2.5/site-packages/gtk-2.0/gobject/_gobject.so: undefined symbol: PyUnicodeUCS4_FromObject What special switch do I need to give to the configure while building python ? Q. I have attached thread dumps. Any input on what might be going ? Q. Modal dialogboxes event processing happens in the main thread ? Sorry for sending it to both the list. But the app is pygtk while stack *seems* fairly clean (other than main thread). Thanks a ton, in advance. /Jd ____________________________________________________________________________________ Pinpoint customers who are looking for what you sell. http://searchmarketing.yahoo.com/

2 1

Re: [Python-Dev] SSL certs
by Thomas Wouters Sept. 19, 2007

Sept. 19, 2007

On 9/13/07, Bill Janssen <janssen(a)parc.com> wrote: > > > However, there is an alternative to using multiple IP addresses: > > one could also use multiple "subject alternative names", and create > > a certificate that lists them all. > > Unfortunately, much of the client code that does the hostname > verification is wrapped up in gullible Web browsers or Java HTTPS > libraries that swallowed RFC 2818 whole, and not easily accessible by > applications. Does any of it recognize and accept "subject > alternative name"? For what it's worth, when I last looked at this (a year or so ago), only a few fringe browsers on mobile phones had issues with accepting our wildcard certificate, and some of those only because they didn't trust the root authority. -- Thomas Wouters <thomas(a)python.org> Hi! I'm a .signature virus! copy me into your .signature file to help me spread!

2 1

IPv6 hostname resolution using socket.getaddrinfo()
by O.R.Senthil Kumaran Sept. 19, 2007

Sept. 19, 2007

To get the hostname, I can use socket.gethostbyname() but that has an inherent limitation wherein does it not support IPv6 name resolution, and getaddrinfo() should be used instead. Looking up the socket.getaddrinfo() documentation, I come to know that The getaddrinfo() function returns a list of 5-tuples with the following structure: (family, socktype, proto, canonname, sockaddr) family, socktype, proto are all integer and are meant to be passed to the socket() function. canonname is a string representing the canonical name of the host. It can be a numeric IPv4/v6 address when AI_CANONNAME is specified for a numeric host. With this information, if I try something like this: >>> for res in socket.getaddrinfo('goofy.goofy.com', None, socket.AI_CANONNAME): print res (2, 1, 6, '', ('10.98.1.6', 0)) (2, 2, 17, '', ('10.98.1.6', 0)) (2, 3, 0, '', ('10.98.1.6', 0)) In the output, I see the cannoname to be always blank ''. I am not getting the IPv4 or IPv6 address as a result of using getaddrinfo(). Am I making any mistake? What i am trying is a replacement function for socket.gethostbyname(hostname) which will work for both IPv4 and IPv6 (and make changes in urllib2 to support that) # return hostbyname for either IPv4 or IPv6 address. Common function. def ipv6_gethostbyname(hostname): for res in socket.getaddrinfo(hostname,None, socket.AI_CANONNAME): fa, socktype, proto, canonname, sa = res return cannoname The above function does not seem to work. It returns blank value only. Any help/ pointers? -- O.R.Senthil Kumaran http://uthcode.sarovar.org

4 4

Extending Python 3000
by Rob Crowther Sept. 18, 2007

Sept. 18, 2007

I'm attempting to wrap the GNU MP mpf_t type and related functions, as I need the extra precision and speed for a package I'm writing. The available wrappers are either unmaintained or undocumented and incompatible with Python 3000. Following the docs in the Python 3000 section of the website, I've started off with this: *mpfmodule.c* #include <Python.h> #include <stdio.h> #include <gmp.h> typedef struct { PyObject_HEAD mpf_t ob_val; } MPFObject; static PyTypeObject MPFType = { PyObject_HEAD_INIT(NULL) 0, /*ob_size*/ "mpf.MPF", /*tp_name*/ sizeof(MPFObject), /*tp_basicsize*/ 0, /*tp_itemsize*/ 0, /*tp_dealloc*/ 0, /*tp_print*/ 0, /*tp_getattr*/ 0, /*tp_setattr*/ 0, /*tp_compare*/ 0, /*tp_repr*/ 0, /*tp_as_number*/ 0, /*tp_as_sequence*/ 0, /*tp_as_mapping*/ 0, /*tp_hash */ 0, /*tp_call*/ 0, /*tp_str*/ 0, /*tp_getattro*/ 0, /*tp_setattro*/ 0, /*tp_as_buffer*/ Py_TPFLAGS_DEFAULT, /*tp_flags*/ "GNU MP mpf_t objects", /* tp_doc */ }; static PyMethodDef mpf_methods[] = { {NULL} }; #ifndef PyMODINIT_FUNC #define PyMODINIT_FUNC void #endif PyMODINIT_FUNC initmpf(void) { PyObject* m; MPFType.tp_new = PyType_GenericNew; if (PyType_Ready(&MPFType) < 0) return; m = Py_InitModule3("mpf", mpf_methods, "Wrapper around GNU MP mpf_t and related methods"); Py_INCREF(&MPFType); PyModule_AddObject(m, "MPF", (PyObject *) &MPFType); } Upon running my setup.py script, it gives me numerous warnings. These do not occur if I attempt to use Python 2.5. It also works fine under Python 2.5. weilawei@archeron:~/Code/mpf$ python setup.py build running build running build_ext building 'mpf' extension gcc -pthread -fno-strict-aliasing -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -fPIC -DMAJOR_VERSION=1 -DMINOR_VERSION=0 -I/usr/local/include -I/usr/local/include/python3.0 -c mpfmodule.c -o build/temp.linux-i686-3.0 /mpfmodule.o *mpfmodule.c:11: warning: missing braces around initializer mpfmodule.c:11: warning: (near initialization for ‘MPFType.ob_base.ob_base’) mpfmodule.c:13: warning: initialization makes integer from pointer without a cast mpfmodule.c:32: warning: initialization from incompatible pointer type* gcc -pthread -shared build/temp.linux-i686-3.0/mpfmodule.o -L/usr/local/lib -lgmp -o build/lib.linux-i686-3.0/mpf.so Inside the Python interpreter: weilawei@archeron:~/Code/mpf/build/lib.linux-i686-3.0$ python Python 3.0a1 (py3k, Sep 15 2007, 00:33:44) [GCC 4.1.3 20070831 (prerelease) (Ubuntu 4.1.2-16ubuntu1)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import mpf >>> test = mpf.MPF() Traceback (most recent call last): File "<stdin>", line 1, in <module> *MemoryError* >>> mpf.MPF *Segmentation fault* Pointers as to what has changed and what I need to do to compile an extension for Py3k would be very much appreciated. Thank you all in advance for your time. - Rob

2 1

Daily Windows Installers
by "Martin v. Löwis" Sept. 17, 2007

Sept. 17, 2007

Together with David Bolen, I set up a series of buildbot slaves that create an MSI installer from the 2.5, 2.6, and 3.0 branches every day. The result files are available from http://www.python.org/dev/daily-msi/ The buildbot pages themselves are at http://www.python.org/dev/buildbot/msi/ There are still some glitches with that installation (in particular, the Microsoft help compiler seems to crash occasionally). If you find any problems with the MSI files themselves, please report them to this list, or to the bug tracker. Regards, Martin

5 8

Hash to longs, and Decimal
by Facundo Batista Sept. 17, 2007

Sept. 17, 2007

Hi everybody! In the Tracker Issue... http://bugs.python.org/issue1772851 ... Mark Dickinson came with a patch that alters in a very corner case how the hash is calculated to a long integer. This allows changes in Decimal that lead to a better hashing behaviour for big, big, really big numbers. The patch applies cleanly, all the tests pass ok (Mark also provided more tests for the hash function). I won't commit this right now; I'll delay the change for a couple of days in case somebody wants to take a look at it. Thanks! -- . Facundo Blog: http://www.taniquetil.com.ar/plog/ PyAr: http://www.python.org/ar/

3 2

'text' mode rears its ugly head again
by Bill Janssen Sept. 17, 2007

Sept. 17, 2007

I've checked in the asyncore SSL patch, and the Windows buildbots are failing on the HTTPS test. I believe it's due to this insane differentiation between between text files and binary files, a bad idea introduced by Windows and perpetuated (apparently) by Python. I can't believe this wasn't eliminated in py3k! Anyway, I think what's going on is that the two data blobs the test compares, one read from a file opened with "open(filename, 'r')", and the other a data stream read from an HTTP response "file" returned from urllib.urlopen(), have different line-endings. Of course, this only matters on Windows; on UNIX, the faux differentiation doesn't exist. Bill

2 3

Eric Raymond account on bug tracker locked
by Paul Dubois Sept. 16, 2007

Sept. 16, 2007

Eric Raymond (esr)'s account on bugs.python.org has been misused. Since this may mean that his password on sf.net is also compromised, I cannot trust that address to notify him. I have changed the password to prevent further mischief. If someone knows a bona-fide way to contact him let me know it and I'll inform him, if he doesn't see this himself.

2 1

How to pickle class derived from c++ extension
by Martin Drautzburg Sept. 15, 2007

Sept. 15, 2007

I understand that I can picke an extension class written in C/C++ by providing a __reduce__() method along with __getstate__()/__setstate__(). While I still havent gotten this to work, my main question is: How could I possibly pickle an object of a python class which is derived from the C++ extension? It seems that I can define >>> class Bar(list): ... pass and add more attributes >>> l=Bar() >>> l.x=11 and __reduce__() will show the "x" attribute >>> l.__reduce__() (<function _reconstructor at 0xb7e2cf0c>, (<class '__main__.Bar'>, <type 'list'>, []), {'x': 11}) But this does not seem to work with my extension class Foo. I defined a __getstate__() method and __reduce__() indeed shows me some state. But if I create a derived class Bar on the Python side and an object bar as an instance of that class, and add an "x" attribute to that bar object, then __reduce__ing that object shows nothing about the "x" attribute. This is in a way undestandable, as __reduce__() eventually just calls __getstate__() and the only implementation it can find is in my Foo extension class, which knows nothing abpout the Bar derived class let alone its "x" attribute. I would like to have __reduce__() do it the pyhon way as far as it cat get, and then call some magic method of my C++ class to pickle the "C++ part" of an object. Is there a way to achieve this? The "list" class seems to have something that my Foo class does not have. What is this? Or of course if there is a better way, to picke objects of classes which are derived from C++ extensions I'd be happy to hear about it.

2 1

Re: [Python-Dev] Removing the GIL (Me, not you!)
by Phillip J. Eby Sept. 15, 2007

Sept. 15, 2007

At 10:07 AM 9/11/2007 -0500, Justin Tulloss wrote: >On 9/11/07, "Martin v. Löwis" ><<mailto:martin@v.loewis.de>martin(a)v.loewis.de> wrote: > > 1. Some global interpreter state/modules are protected (where are these > > globals at?) > >It's the interpreter and thread state itself (pystate.h), for the thread >state, also _PyThreadState_Current. Then there is the GC state, in >particular "generations". There are various caches and counters also. > > >Caches seem like they definitely might be a problem. Would you mind >expanding on this a little? What gets cached and why? It's not just caches and counters. It's also every built-in type structure, builtin module, builtin function... any Python object that's a built-in, period. That includes things like None, True, and False. Caches would include such things as the pre-created integers -100 through 255, the 1-byte character strings for chr(0)-chr(255), and the interned strings cache, to name a few. Most of these things I've mentioned are truly global, and not specific to an individual interpreter.

17 44