Mailman 3 December 2006 - Twisted

[Twisted-Python] Thread
by Gabriel 06 Dec '06

06 Dec '06

Hi!! I'm new in Twisted, and I'm having problems with Thread. I was looking for it at documentation, and saw that it's not safe (!?), but it's possible to run using twisted.python.threadable, I haven't understood the thread examples using simple TCP and ServerFactoryl, there is anything like reactor.run() using it or can I only use threads as client? Can anyone give me a basic example? Thanks! from Brazil... Gabriel www.garimpar.com

2 1

[Twisted-Python] twisted dohop
by Atli Þorbjörnsson 05 Dec '06

05 Dec '06

We would like to be added to the ProjectsUsingTwisted page. dohop.com is a flight planner and twisted runs what we call our "priceserver". The priceserver is under a substantial amount of load and twisted handles the job handsomely. Try it out at http://www.dohop.com The backend of the site runs otherwise almost wholly on Python with bits and pieces in C. We do a lot of django under mod_python with a mysql db. Hope you see us fit for a mention and thank you for the amazing framework that is twisted. Atli Thorbjornsson dohop.com

2 1

[Twisted-Python] Passing information from SSL postconnection check to application
by Henrik Thostrup Jensen 05 Dec '06

05 Dec '06

Hi I have an application which uses M2Crypto authentication. I use the wrapper supplied by M2Crypto, and can do postConnection check just fine. I need to pass along some of the information from the client credentials, but I cannot figure out how to do this. The code looks something like this: from twisted.application import service, internet from twisted.protocols import policies from M2Crypto import SSL from M2Crypto.SSL.TwistedProtocolWrapper import TLSProtocolWrapper def protocol_factory(factory, wrapped_protocol): wrapper = TLSProtocolWrapper(factory, wrapped_protocol, startPassThrough=0, client=0, contextFactory=ServerContextFactory(), postConnectionCheck=MyChecker()) return wrapper factory = ... wrapper = policies.WrappingFactory(factory) wrapper.protocol = protocol_factory wrapper.protocol.TLS = True factory.startTLS = True factory.sslChecker = SSL.Checker.Checker() factory = wrapper application = service.Application('foo') service = internet.TCPServer(8443, factory) service.setServiceParent(application) Currently the original factory is the factory from twisted.web2, but I would like to be able to do this, on a general level, e.g., from AMP as well. Setting the information into some global value is sure to fail, but I cannot see how else to propagate information. -- - Henrik

1 0

[Twisted-Python] Posible error in documentation
by Nicolas D. Cesar 04 Dec '06

04 Dec '06

taken from http://twistedmatrix.com/projects/core/documentation/howto/producers.html: "Pull Producers The pull producer API is defined by the IPushProducer interface. Pull producers are useful .." shouldn't be the "IPullProducer interface" ..? Should I add a bug in TRAC? Greetings, -- Nicolás D. César <ncesar(a)lunix.com.ar> Lunix S.R.L. -[ http://www.lunix.com.ar ]- GnuPG Public Key: gpg --keyserver wwwkeys.pgp.net --recv-key 0x3606F3E6

2 1

Re: [Twisted-Python] Need Exception that will stop ther reactor within twistd
by glyph＠divmod.com 04 Dec '06

04 Dec '06

On 30 Nov, 08:00 pm, ncesar(a)lunix.com.ar wrote: >my apologies for the delayed answer, i've been very busy latelly. No problem, aren't we all. >El Martes, 28 de Noviembre de 2006 06:07, glyph(a)divmod.com escribi�: >> Should the webserver stop simply because your protocol is not working? > >Well, yes I agree with you: not a webserver. So, I'll shortly describe my >application. My point is that you are artificially combining your application with your infrastructure. The reactor is always potentially in use by multiple applications, so it is not the thing that should be stopped. >I have multiple LSTP (Linux Terminal Server Project) servers. All servers are >(almost) the same, and any of them can serve any client. There are arround >8-12 servers and 150+ clients. I'm developing a twisted application that >balances clients requests (by filtering DHCP discover/requests packets. (I >attached an image, my application is called multiltsp). I'm using ip_queue >for this. OK. So somewhere, there should be a MultiLTSPService which is the thing that gets stopped by these exceptions, I think. >There is a LDAP somewhere that has all client MACs that are in the group (eg. >the 150 clients) and from time to time, multiltsp re-reads this list. (I'm >simplifying much of these details). I'll call this list "ALL-MACS"... >... all multiltsp daemons MUST have the ALL-MACS list identical, in case there >is a out of sync[1] problem the (incorrect) server must quit and the others >must handle the clients. Shouldn't it just get informed that it is in an invalid state, and re-start itself, rather than shutting down entirely? I understand that this is a "panic" state that should "never happen", but you can flush that one bit of state without tanking the entire process. >There are serveral services involved in this application (the multicast UDP >protocol, a shell, the ip_queue reader and others), but a major problem as >stated above MUST get the application down with some special clean up. So there needs to be an object that represents the "whole application", which has references to all these services. The reactor should not be serving that purpose. >Glyph, I hope you understand my rustic English in the explanation above. Any >advice or suggestion please respond this email. It's not too bad :)

2 1

[Twisted-Python] robust listenUDP with N clients?
by marc bohlen 04 Dec '06

04 Dec '06

hi folks I am new to twisted and new to server programming. Nonetheless, I would like to build a robust client-server looping mechanism in which a server would listen for input from N clients, say 10, and react immediately when it receives data from them. I have a sample (see below) that appears to run well, but am not sure if it will scale under real network load and larger N. (I am parsing the input data received from the clients and using it to calculate a fibonnaci series, just for testing. The reactor can be stopped with keyboard input (I am on a win32 platform)). If you see any problems with this approach, please let me know ! Thanks, marc CODE: import os, sys, time, msvcrt from twisted.internet import reactor, defer, task from twisted.internet.protocol import DatagramProtocol ports = [1007, 2007, 3007, 4007, 5007, 6007, 7007, 8007, 9007] #---------------------------- def check_keyboard(result): try: if(msvcrt.kbhit()): result = "hit" except: pass return result #--------------------------- def mstop(result): if(result == "hit"): print "got hit - closing task and reactor" mtask.stop() reactor.stop() #--------------------------- def print_time(result): print time.asctime(time.localtime()) #--------------------------- def fibonnaci(limit): first, new, second = 0,0,1 for i in xrange(limit - 1): new = first + second first = second second = new return new #--------------------------- def mrun(): d = defer.Deferred() d.addCallback(check_keyboard) d.addCallback(mstop) d.addCallback(print_time) d.callback("blabla") #--------------------------- class server(DatagramProtocol): def datagramReceived(self, data, (host, port)): print "server received: %r from %s:%d" % (data, host, port) self.transport.write(data, (host, port)) limit = int(data.split(": ")[1]) num = fibonnaci(limit) print num #--------------------------- if __name__ == '__main__': print "listening on 9 ports - hit key to quit" mrun() mtask = task.LoopingCall(mrun) mtask.start(1.0) for i in range (0,(len(ports))): reactor.listenUDP(ports[i], server()) reactor.run() #--------------------------

2 4

[Twisted-Python] peer 2 peer, udp, stdio -> very confused
by varname 04 Dec '06

04 Dec '06

hi all, first: I have been reading the topics on this list regarding apps that need to be client/server at the same time, use udp, need to be able to react to user input while the reactor is running with much interest, but I'm very confused now as to how I should proceed with my own problem. In short: I'm trying to create a peer 2 peer application that has a text-based gui (commandline), driven by user input and communicates with other peers over udp (and occasionally over tcp, to transfer files). I'm just really confused over some basic concepts. Am I correct that I can just create a simple class extending protocol.DatagramProtocol to facilitate the raw udp sending / receiving? Then use that in a Factory class (MyClientFactory) to 'layer' the p2p protocol functionality on? Where do I put my stdio implementation then? And am I right that the only thing needed for udp to work is to do a reactor.listenUDP(portnum, MyClientFactory()) or do I need to use two factory classes, one for the client 'bit' and one for the server? I realise that's a lot of questions, but the sheer size of twisted has overwhelmed me a bit and I'd appreciate any help you can give.

2 1

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 03 Dec '06

03 Dec '06

Bug summary ______________________ Summary for 2006-11-26 through 2006-12-03 Bugs opened: 10 Bugs closed: 9 Total open bugs: 784 (+1) |== Type Changes |== Priority Changes |== Component Changes |Defect: +1 |Highest: -2 |Core: +2 |Enhancement: +0 |Normal: +3 |Mail: +0 |Task: +0 |Low: -1 |Names: +1 |Lowest: +1 |Pydoctor: -3 |Trial: +1 |Web2: +1 |Words: -1 New / Reopened Bugs ______________________ ===== Highest ===== [#2248] Do error reporting in twisted.names.client.Resolver (opened by exarkun) task names http://twistedmatrix.com/trac/ticket/2248 ===== Normal ===== [#2246] Wrong signature for addCallbacks in the Deferred Reference (opened by zseil) (CLOSED, duplicate) defect core http://twistedmatrix.com/trac/ticket/2246 [#2247] Wrong signature for addCallbacks in the Deferred Reference (opened by zseil) defect core http://twistedmatrix.com/trac/ticket/2247 [#2249] Trial hangs if callLater is replaced (opened by jml) defect trial http://twistedmatrix.com/trac/ticket/2249 [#2250] twisted.mail.pop3.__all__ lacks a comma (opened by mwh) enhancement mail http://twistedmatrix.com/trac/ticket/2250 [#2251] twisted.mail.pop3.__all__ is mis-defined (opened by exarkun) (CLOSED, duplicate) enhancement mail http://twistedmatrix.com/trac/ticket/2251 [#2252] web2 shouldn't use socket.gethostbyaddr (opened by dreid) enhancement web2 http://twistedmatrix.com/trac/ticket/2252 [#2253] trial reporter dies with IOError (opened by acapnotic) defect trial http://twistedmatrix.com/trac/ticket/2253 [#2255] sqlalchemy support for twisted.enterprise (opened by synapsis) (CLOSED, invalid) enhancement core http://twistedmatrix.com/trac/ticket/2255 ===== Lowest ===== [#2254] open connection for injecting code into long-running twistd process at run-time by default (opened by glyph) enhancement core http://twistedmatrix.com/trac/ticket/2254 Closed Bugs ______________________ ===== Highest ===== [#2177] Collect Jabber interfaces in one file (opened by ralphm, closed by ralphm, fixed) task words http://twistedmatrix.com/trac/ticket/2177 [#2147] Give TestCase a default testMethod (opened by jml, closed by jml, fixed) enhancement trial http://twistedmatrix.com/trac/ticket/2147 [#2072] Document newline convention required by twisted.mail.pop3.IMailbox.getMessage (opened by exarkun, closed by exarkun, fixed) enhancement mail http://twistedmatrix.com/trac/ticket/2072 ===== Normal ===== [#2246] Wrong signature for addCallbacks in the Deferred Reference (opened by zseil, closed by zseil, duplicate) defect core http://twistedmatrix.com/trac/ticket/2246 [#2209] pydoctor has problems with moresystems' using an absolute url prefix (opened by mwh, closed by mwh, fixed) defect pydoctor http://twistedmatrix.com/trac/ticket/2209 [#2210] pydoctor system pickles that use moresystems can't be loaded (opened by mwh, closed by mwh, fixed) defect pydoctor http://twistedmatrix.com/trac/ticket/2210 [#2251] twisted.mail.pop3.__all__ is mis-defined (opened by exarkun, closed by exarkun, duplicate) enhancement mail http://twistedmatrix.com/trac/ticket/2251 [#2255] sqlalchemy support for twisted.enterprise (opened by synapsis, closed by glyph, invalid) enhancement core http://twistedmatrix.com/trac/ticket/2255 ===== Low ===== [#1644] pydoctor's nevowhtml is probably easy to speed up (opened by mwh, closed by mwh, fixed) enhancement pydoctor http://twistedmatrix.com/trac/ticket/1644

1 0

Re: [Twisted-Python] trac's reliability
by glyph＠divmod.com 01 Dec '06

01 Dec '06

On 27 Nov, 07:04 pm, foom(a)fuhm.net wrote: >The other option is to upgrade wolfwood to debian stable ("sarge") and then >just install svn 1.4 from testing. That might be a good idea anyhow, since >oldstable is, well, old. And unsupported. It would be good to know, for the purposes of such discussions, who the official admin of these hosts is. If I knew, I'd ask that person to please upgrade everything to Dapper, thanks to its long updates support cycle and my relatively stable experience with it. Without knowing who it was and how long it's going to take though, it's hard to make suggestions.

5 6