Mailman 3 January 2006 - Twisted

Re: [Twisted-Python] Up to date Debian packages
by Brendan Simon Jan. 9, 2006

Jan. 9, 2006

twisted-python-request(a)twistedmatrix.com wrote: > Brendan Simon wrote: > >> Is there an easy way to get precompiled versions of Twisted for Debian >> Sarge? >> > > Hi, Brendan, > sorry, but this question is cute somehow - twisted is python - there's > nothing to compile - if you need *.deb sooo much, the latest version in > unstable is 2.0.1-something, but it just can't be easier than > downloading the latest 2.1 tarball and just setting the … [View More]

3 2

[Twisted-Python] Switch to tempfile.mkstemp?
by Itamar Shtull-Trauring Jan. 9, 2006

Jan. 9, 2006

On Sun, 2006-01-08 at 21:58 -0700, James Knight wrote: > Author: foom > Date: Sun Jan 8 21:58:32 2006 > New Revision: 15544 > > Modified: > trunk/twisted/web2/static.py > Log: > Use tempfile.mktemp instead of custom filename making. > Fixes issue1391. Now that we're using 2.3, can we switch to the more secure mkstemp?

2 1

[Twisted-Python] Triggering callbacks on raw file descriptors
by Brian Granger Jan. 9, 2006

Jan. 9, 2006

Hi, I am trying to integrate an external networking library that is asynchronous into a Twisted app (Apple's Bonjour for those interested). The library is setup for use in a select loop. The library is responsible for all the actual network things (like creating the connection, reading and writing to it. The only thing I need to do is register the socket's file descriptor with the twisted reactor and have some callback triggered when it is _ready_ for reading/writing. Digging … [View More]

4 6

[Twisted-Python] TwistedSumo-2005-11-06 on Debian Sarge
by Brendan Simon Jan. 9, 2006

Jan. 9, 2006

twisted-python-request(a)twistedmatrix.com wrote: >> Is there an easy way to get precompiled versions of Twisted for Debian >> Sarge? >> > Hi, Brendan, > sorry, but this question is cute somehow - twisted is python - there's > nothing to compile - if you need *.deb sooo much, the latest version in > unstable is 2.0.1-something, but it just can't be easier than > downloading the latest 2.1 tarball and just setting the > PYTHONPATH=/path/to/twisted, i … [View More]

2 1

[Twisted-Python] Up to date Debian packages
by Brendan Simon Jan. 8, 2006

Jan. 8, 2006

I'm running Debian Sarge (ie. stable release). The default installation of python-twisted is 1.3.0-8. I would like the latest version, preferable 2.1.0. From the twisted web pages, I was lead to believe that the following site has the latest Debian snapshots, release-candidates and releases, but the latest version I could find there was 1.2.0+1.3.0-1 (whatever that means). http://twisted.sourceforge.net/debian I've also checked http://backports.org/ but nobody has backported the … [View More]

6 7

[Twisted-Python] SSL client authentication example
by dkarbott＠comcast.net Jan. 8, 2006

Jan. 8, 2006

I modified the echoserv_ssl.py / echoclient_ssl.py examples to do client authtentication while I was trying to learn about using SSL with twisted. My code is in the attached .tgz. It uses self-signed certificates so it doesn't depend on (or require) a CA. I hope that someone else might find it useful. The documentation that I was able to google seems kind of sparse. I'm admittedly neither a crypto expert nor very experienced with OpenSSL, so if you find bugs let me know. -- Darrell

2 1

[Twisted-Python] conch sshsimpleclient example and password
by Brendan Simon Jan. 8, 2006

Jan. 8, 2006

I'm new to Twisted and I am using 1.3.0-8 on Debian Sarge. I'm playing with the sshsimpleclient in the example directory. I changed USER to 'brendan' and HOST to 'localhost'. The script continually asks me for the password even though I have entered it correctly. I changed the script to use id_rsa instead of id_dsa, and put my id_rsa.pub in my ~/.ssh/autorhized_keys file. Now when I run the script I get the expected result of : got data from cat: 'hello conch\n' If I comment out … [View More]

1 0

[Twisted-Python] Securing a custom protocol
by Brian Granger Jan. 7, 2006

Jan. 7, 2006

Hi, I have written a custom line based protocol using twisted. I need to add authentication and encryption to my protocol and I am wondering what the best route is. Here are some options that I see: 1. Use SSL for encryption and cred for user authentication 2. Use SSH through conch As I understand it, both of these approaches can do authentication and encryption of any protocol. What are the advantages and disadvantages or each? Which is more robust and supported in twisted? … [View More]

2 2

[Twisted-Python] Re: [Twisted-commits] r15537 - PROPFIND works now
by Jean-Paul Calderone Jan. 6, 2006

Jan. 6, 2006

On Fri, 06 Jan 2006 11:59:00 -0700, Wilfredo Sanchez <wsanchez(a)wolfwood.twistedmatrix.com> wrote: >Author: wsanchez >Date: Fri Jan 6 11:59:00 2006 >New Revision: 15537 > >Modified: > trunk/twisted/web2/dav/test/test_prop.py >Log: >PROPFIND works now The test for it fails consistently on the OS X slave, though. I've set this test as todo again. Here's the current failure: Failure: twisted.trial.unittest.FailTest: Incorrect content-type for PROPFIND … [View More]

1 0

[Twisted-Python] help with refcounts and memleaks
by Andrea Arcangeli Jan. 6, 2006

Jan. 6, 2006

Hello, I was just shoked today when I noticed this: ------------------- import sys class A(object): y = None def x(self): pass def __del__(self): print 'deleted' a = A() print sys.getrefcount(a) if 1: a.y = a.x print sys.getrefcount(a) del a ------------------- I understood the cross references memleaks well, like "x.y = y; y.x= x; del x,y", but I didn't imagine that "a.y = a.x" would be enough to generate a memleak. "a.y = a.x" isn't referencing another structure, it's … [View More]referencing itself only. Infact if I do this the memleak goes away!! ------------------- import sys class A(object): def x(self): pass y = x def __del__(self): print 'deleted' a = A() print sys.getrefcount(a) a.x() a.y() print a.x, a.y del a ------------------- Now the fact a static field doesn't generate a reference but a dynamic one does is quite confusing to me and it also opened a can of worms in my code. I can handle that now that I know about it, but I wonder what people recommends to solve memleaks of this kind. I'd also like to know how other languages like ruby and java behave in terms of self-references of objects. Can't the language understand it's a self reference, and in turn it's the same as an integer or a string, like it already does when the member is initialized statically? Infact can't the language be smart enough to even understand when two cross referenced objects lost visibility from all points of view, and drop both objects even if they hold a reference on each other? I understand this is a lot more complicated but wouldn't it be possible in theory? What does the garbage collection of other languages like ruby and java, the same as python or more advanced? So far my python programs never really cared to released memory (so my not full understanding of python refcounts wasn't a problem), but now since I'm dealing with a server I must make sure that the "proto" is released after a loseConnection invocation. So I must cleanup all cross and self! references in loseConnection and use weakrefs where needed. Now those structures that I'm leaking (like the protocol object) are so tiny that there's no chance that I could ever notice the memleak in real life, so I had to add debugging code to trap memleaks. You can imagine my server code like this: class cpushare_protocol(Int32StringReceiver): def connectionMade(self): [..] self.hard_handlers = { PROTO_SECCOMP : self.seccomp_handler, PROTO_LOG : self.log_handler, } [..] def log_handler(self, string): [..] def seccomp_handler(self, string): [..] def __del__(self): print 'protocol deleted' def connectionLost(self, reason): [..] # memleaks del self.hard_handlers print 'protocol refcount:', sys.getrefcount(self) #assert sys.getrefcount(self) == 4 For things like hard_handlers (that are self-referencing callbacks) I can't even use the weakref.WeakValueDictionary, because it wouldn't hold itself, the object gets released immediately. So the only chance I have to release the memory of the protocol object when the connection is dropped, is to do an explicit del self.hard_handlers in loseConnection. I wonder what other twisted developers do to avoid those troubles. Perhaps I shouldn't use self referencing callbacks to hold the state machine, and do like the smpt protocol that does this: def lookupMethod(self, command): return getattr(self, 'do_' + command.upper(), None) basically working with strings instead of pointers. Or I can simply make sure to cleanup all structures when I stop using them (like with the del self.hard_handlers above), but then I'll lose part of the automatic garbage collection features of python. I really want garbage collection or I could have written this in C++ if I'm forced to cleanup by hand. Help is appreciated, thanks! PS. Merry Christmas and Happy New 2006! [View Less]

8 17

[Twisted-Python] Weekly Bug Summary
by James Y Knight Jan. 4, 2006

Jan. 4, 2006

Bug summary ______________________ Since 2005-12-28 06:00:02.200000: Bugs opened: 20 Bugs closed: 8 Total open bugs: 518 (+12) Urgent: 8 (+7) Bug: 244 (+3) Feature: 181 (+1) Wish: 85 (+1) New / Reopened Bugs ______________________ ==== Urgent ==== [CORE, TRIAL] trial -u fills working directory with old _trial_temp directories (2 days ago) http://twistedmatrix.com/bugs/issue1393 opened by exarkun [TESTS, WEB2] Intermitent failure in web2 unit tests (2 … [View More]

1 0

[Twisted-Python] Re: r15451 - Fix test failures under windows by changing the eventual-send operation to
by Brian Warner Jan. 2, 2006

Jan. 2, 2006

>> Yes it does: order of method call. Ah. That's useful to know: I would prefer to use a non-threading-related call to achieve this eventual-send functionality. I'll add a TODO test to check that this promise is being met. > It should be fixable by storing the last time of an element added to the > queue, and adding epsilon if current time is the same. Wouldn't you have to guarantee that epsilon is smaller than the resolution of your time.time() return value? What if you sorted … [View More]on a tuple of (time, counter) instead? (the down side is that you'd have to search for all existing timers with the same time value to figure out what counter value you ought to use. ick.). We should clarify what guarantees are made by callLater. I think there may be several separate ones here: 1: callLater(0, A); callLater(0, B) will result in A being invoked before B will result in both A and B being invoked before any other DelayedCalls 2: callLater(N, A); callLater(N, B) will result in A being invoked before B 3: callLater(N, A); callLater(N+M, C); callLater(N, B) will result in A being invoked before B (think of this as a unit test for the adding-epsilon concern above) The second and third ones are not so important to me, just in terms of what I need to use it as a plan-coordination tool. I only intend to use this with N=0. To that end, using a separate queue for timers that are ready to go "now" (i.e. ones that will be fired before calling select() or the like) might be useful, basically making N=0 a special case. This would avoid the overhead of inserting the DelayedCall into an arbitrary place and maintaining the ordering guarantees of #2 and #3, and would avoid an extra select() spin between the time an N=0 timer was inserted and the time it was fired. The existing threadCallQueue happens to behave exactly this way, although I'd want to write some additional tests to make sure it gets serviced as many times as it's supposed to be (specifically, when threads are unavailable and therefore wakeUp() is not used, does a call inserted from within an N=0 callback get serviced before the reactor sleeps again?). The problem is both the word "thread" in the name, and the fact that we might not be making the same guarantees about the behavior of callFromThread as we are about that of callLater. Hmm. Most reactors split off a list of timers that are ready to go "now" on each spin, right? And/or there's that _pendingTimedCalls list I see in t.i.base .. maybe we could take advantage of one of those, just appending the call to those lists and making sure they'll be serviced again, rather than adding the overhead of maintaining ordering guarantees #2 and #3. hmm-ingly, -Brian [View Less]

4 4

[Twisted-Python] ssh manhole
by Phil Christensen Jan. 2, 2006

Jan. 2, 2006

folks- so, i've read over a number of threads in the archives, and the docs on tm.com, and i think i'm missing a few pieces of info, so i'd appreciate any help. for the moment i have a multiservice application that i've added a telnet manhole interface to. however, due to the deprecation of the twisted.manhole.telnet module, and my disinterest in sending passwords in plaintext, i'd like to update this to use ssl. this much i know how to do, but then i would assume the only way to … [View More]

2 4

[Twisted-Python] Depreciation of trial.unittest functions?
by Paul Swartz Jan. 1, 2006

Jan. 1, 2006

I'm not sure if Conch is the only project that did this, but it used the trial.unittest.* functions instead of methods on TestCases. I used them to avoid having to pass TestCase instances around all over the places, or using a global variable. To avoid the depreciation warnings, I've starting using the unittest._inst global variable, but I doubt that this is the appropriate way to change my code. Is this just not a supported way of using Trial, or is there something else I should be doing? -… [View More]

3 3

[Twisted-Python] Twisted windows hackers - help the tests to pass!
by glyph＠divmod.com Dec. 31, 2005

Dec. 31, 2005

Twisted fails scads of tests on Windows. You can see that here: http://twistedmatrix.com/buildbot/ I know that there are at least a few people on this list that use Twisted on Windows. Doesn't it bother you that it's broken? If you're a windows developer, help out and fix some tests! A few Twisted hackers, Justin J. in particular, are hard at work to make it scale and perform well on Windows, but in addition to the rocket-science of IOCP there is quite a bit of grunt work to do, especially … [View More]

6 20