[ python-Bugs-1041645 ] Thread management corrupts heap

[SourceForge.net]

Bugs item #1041645, was opened at 2004-10-06 14:15
Message generated for change (Comment added) made by benson_basis
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1041645&group_id=5470

Category: None
Group: None
Status: Open
Resolution: None
Priority: 7
Submitted By: benson margulies (benson_basis)
Assigned to: Nobody/Anonymous (nobody)
Summary: Thread management corrupts heap

Initial Comment:
The PyGILState_Ensure mechanism appears to have a 
built-in heap-corrupting race condition.

If a new thread calls PyGILState_Ensure, then the code 
allocates a new 'tstate' for it on the heap. This 
allocation is not protected by any lock. So, multiple 
racing threads can hit the heap at the same time, and 
corrupt it.

I have observed this with both 2.3 and with 2.4a3.

I will attach a sample application. The application is 
Win32, but should be easy enough to adapt to Unix if 
someone cares to.

Since the stated purpose of this mechanism, in PEP311, 
is to allow any-old-thread to call into Python, I believe 
that the usage model here is legitimate.

To watch this explode, run the attached with arguments 
like, oh, 1 100 40 against the debug python build.




----------------------------------------------------------------------

>Comment By: benson margulies (benson_basis)
Date: 2004-10-06 19:49

Message:
Logged In: YES 
user_id=876734

The documentation very specifically states that the order 
doesn't matter. Further, I've read the code, and the problem 
is unprotected data structures in the python debug heap, 
which won't be any more protected in the other order.

I'll switch them and report back, just in case.


----------------------------------------------------------------------

Comment By: Nick Coghlan (ncoghlan)
Date: 2004-10-06 19:32

Message:
Logged In: YES 
user_id=1038590

I haven't checked if that would fix the problem, since I'm
currently on Linux.

----------------------------------------------------------------------

Comment By: Nick Coghlan (ncoghlan)
Date: 2004-10-06 19:31

Message:
Logged In: YES 
user_id=1038590

The attached program calls PyEval_InitThreads and
Py_Initialize in the wrong order.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1041645&group_id=5470