Mailman 3 May 2004 - Twisted

[Twisted-Python] Writing a Jabber client
by E.A.M. Huijbers 24 May '04

24 May '04

Hi all, I'm having trouble writing a Jabber client with Twisted. I came across a simple sample[0], and tried to build out from it, but for some reason it's barely working. When I run the application in the attached script, the logon goes fine, and I can receive messages sent to the account, but it never seems to receive subscription requests. When I ran it on an account that already had some items on the contact list, I did receive <presence> messages to indcate that a user changed status, but I don't receive <presence type="subscribe"> messages... Ultimately, I tacked a "/*" handler on to the code to see if I was receiving any packets at all, but the only thing that seems to trigger anything are messages. This is very frustrating for me. Is it a problem with the code, or am I missing something in the Jabber protocol? Any help would be greatly appreciated. - Rico P.S: Please don't mind the code, I know it's a bit (a lot) hackish right now, but my first step is to get it running. I'll make it beautiful afterwards ;) . [0] http://randomthoughts.vandorp.ca/WK/blog/706?t=item ##### code starts here ##### from twisted.protocols.jabber import client, jid from twisted.protocols import xmlstream from twisted.xish import domish from twisted.internet import reactor name = 'Foo' server='bar.com' resource = 'PythonBot' password = 'foobar' me = '%s@%s/%s' % (name, server, resource) thexmlstream = None tryandregister = 1 def initOnline(xmlstream): global factory print 'Initializing...' xmlstream.addObserver('/message', gotMessage) xmlstream.addObserver('/presence', gotPresence) xmlstream.addObserver('/iq', gotIq) xmlstream.addObserver('/*', gotSomething) def authd(xmlstream): thexmlstream = xmlstream print "we've authd!" print repr(xmlstream) #need to send presence so clients know we're #actually online presence = domish.Element(('jabber:client', 'presence')) presence.addElement('status').addContent('Online') xmlstream.send(presence) initOnline(xmlstream) def gotMessage(el): print 'Got message: %s' % str(el.attributes) def gotSomething(el): print 'Got something: %s -> %s' % (el.name, str(el.attributes)) def gotIq(el): print 'Got IQ: %s' % str(el.attributes) def gotPresence(el): print 'We got a presence message!' print repr(el.attributes) try: t = el.attributes['type'] if t == 'subscribe': # Grant every subscription request xmlstream.send(domish.Element(('jabber:client', 'presence'), attribs={ 'from': me, 'to':el.attributes['from'], 'type':'subscribed' })) except KeyError: # Big fat ignore pass def invaliduserEvent(xmlstream): print 'Invalid user!' global tryandregister if tryandregister: tryandregister = 0 print 'Attempting to register...' global factory factory.authenticator.registerAccount(name, password) else: global reactor reactor.stop() def authfailedEvent(xmlstream): global reactor print 'Auth failed!' reactor.stop() def registerfailedEvent(xmlstream): global reactor print 'Register failed!' reactor.stop() myJid = jid.JID(me) secret = password factory = client.basicClientFactory(myJid,secret) # Register authentication callbacks factory.addBootstrap(xmlstream.STREAM_AUTHD_EVENT, authd) factory.addBootstrap(client.BasicAuthenticator.INVALID_USER_EVENT, invaliduserEvent) factory.addBootstrap(client.BasicAuthenticator.AUTH_FAILED_EVENT, authfailedEvent) factory.addBootstrap(client.BasicAuthenticator.REGISTER_FAILED_EVENT, registerfailedEvent) # Go! reactor.connectTCP(server, 5222, factory) reactor.run()

2 3

[Twisted-Python] Can I benefit from multi-processor hardware?
by June Jae-jun Kang 24 May '04

24 May '04

Our current Windows server, written thoroughly in C++, is spawning a few threads in order to benefit from multi-processor hardware. Coz our app logic is not so flexible, now we consider moving to Twisted. Can we still benefit from multi-processor hardware with Twisted's basic event-driven architecture?

4 3

[Twisted-Python] How do you get clients ip addys with xmlrpc
by Daniel Newton 23 May '04

23 May '04

Some gave me this snippet of code: /class Example(xmlrpc.XMLRPC): // """An example object to be published."""// / def xmlrpc_whatIsMyAddress(self): return self.transport.getPeer().host / // if __name__ == '__main__': // from twisted.internet import reactor // r = Example() // reactor.listenTCP(7080, server.Site(r)) // reactor.run()/ but it doesnt work ("Example instance has no attribute 'transport'") the transport attribute is not there.. so where is it???

1 0

[Twisted-Python] pb.Copyable, round trip objects, and untrusted clients
by David Ripton 22 May '04

22 May '04

I'm working on a client-server game, with hidden information, using PB. I don't want to trust the clients. Because there is hidden information, it's important not to send anything to the client that it's player shouldn't see. Doing that with PB is pretty straightforward. If a class's data is always secret, don't make it Copyable. If parts of a class are secret, censor them in getStateToCopy. Obviously, the client should only be able to change the server's game state via a well-defined error-checked interface. Also fairly straightforward, though error-prone since you need to forsee and test against every way to cheat. There's a third hole to plug, which is passing an object from the server to the client as an argument of a client-side remote_* method, and later getting it back as an argument to a server-side perspective_* method. (e.g. the server passes the client a list of games in progress, and later the client passes back the game it wants to join.) If the client changes the object before passing it back, it might trick the server into doing the wrong thing with it. Anyway, it seems easy enough to avoid this problem, by just rewinding any changes the client has made to such objects. At some point before sending an object to the client side, add it to a dict, keyed by its id. When an object comes back from the client as an argument in a perspective_* call, use its id to lookup the server's copy of the object in the dict, and then reassign the current name to the good version of the object, losing any changes the client may have made. In other words, the client is treated as if it only passed the object's id back, not its __dict__. But the interface is simpler. e.g.: in Server def __init__: self._paranoia = {} # Maybe a weak dict instead #.... def paranoid_add(self, obj): self._paranoia[id(obj)] = obj def paranoid_get(self, obj): return self._paranoia[id(obj)] def form_game(self, whatever): game = Game.Game(args) self.paranoia_add(game) Then in User (a pb.Avatar): def perspective_join_game(self, game): game = self.server.paranoid_get(game) self.server.join_game(self.name, game) This is simple and works, but it's annoyingly repetitive. And plumbing code is infecting the application level. And I know there are other object vs. id caches inside PB, so this feels redundant. What's the right way to do this with Copyable? Thanks. -- David Ripton dripton(a)ripton.net

4 20

[Twisted-Python] Need cacheable help
by Sorin C. 22 May '04

22 May '04

Hi all, I plan to use heavily Cacheables in my client-server application and I bumped into a problem. On the server side I have a Cacheable object which internally uses a database module and on the client side an equivalent RemoteCache which uses wxPython. But in order to obtain a remote reference I have to call setUnjellyableForClass on this two classes which in turn requires that when this call is made the classes have to be imported and the modules that they use also imported. This basically means that now I have to make available wxPython for server distribution and the database module for client distribution though I don't use them. One solution would be build another layer on top of these classes and this layer should deal with wxPython and database module but would it be another possibilty to overcome this problem? Any sugestion is appreciated. Thanks, Sorin __________________________________ Do you Yahoo!? Yahoo! Domains � Claim yours for only $14.70/year http://smallbusiness.promotions.yahoo.com/offer

1 0

[Twisted-Python] service takedown (one newbie to other newbies, methinks)
by Bill la Forge 22 May '04

22 May '04

If a service starts successfully, once initialization completes successfully, it's stopService will be called for proper cleanup. However, if another service fails to successfully initialize, and it is kind enough to call reactor.stop() rather than throw an exception, then the first service can, at the end of its initialization, call reactor.addSystemEventTrigger('before','shutdown',self.failedStartup), then failedStartup() will be called and there is STILL a chance to cleanup. Here's the code, the script, and the twistd output: from twisted.application import service from twisted.internet import reactor class SimpleService(service.Service): def startService(self): service.Service.startService(self) reactor.addSystemEventTrigger('before','shutdown',self.failedStartup) print '>>>start' def stopService(self): print '>>>stop' service.Service.stopService(self) def failedStartup(self): print 'Oh!!!!!!!!!!!!!!!!!!!!!' class FailService(service.Service): def startService(self): reactor.stop() from twisted.application import service from twisted.internet import reactor import simpleService application = service.Application('testServer') serviceCollection=service.IServiceCollection(application) ss=simpleService.SimpleService() ss.setServiceParent(serviceCollection) fs=simpleService.FailService() fs.setServiceParent(serviceCollection) C:\other\Bill\compstrm\compstrm\twbsd>twistd -noy testService.py 2004/05/21 21:39 India Standard Time [-] Log opened. 2004/05/21 21:39 India Standard Time [-] twistd 1.2.0 (C:\Python23\python.exe 2. 3.3) starting up 2004/05/21 21:39 India Standard Time [-] reactor class: twisted.internet.default .SelectReactor 2004/05/21 21:39 India Standard Time [-] >>>start 2004/05/21 21:39 India Standard Time [-] Oh!!!!!!!!!!!!!!!!!!!!! 2004/05/21 21:39 India Standard Time [-] Main loop terminated. 2004/05/21 21:39 India Standard Time [-] Server Shut Down. C:\other\Bill\compstrm\compstrm\twbsd> Bill la Forge http://www.geocities.com/laforge49/ Yahoo! India Matrimony: Find your partner online.

4 8

[Twisted-Python] delay 0 patch for 1.3 base.py
by Bill la Forge 21 May '04

21 May '04

Here's the patch for callLater with delay of 0, but now for 1.3. (Nice to see the windows installer is now available!) Again, I've tested it, but Twisted regression tests remain to be done. Again, I consign copyrights to Glyph. Again, I'll update http://compstrm.sourceforge.net as soon as I hear word that the regression tests have succeeded. (I STILL have my fingers crossed!) ===== Bill la Forge http://www.geocities.com/laforge49/ ________________________________________________________________________ Yahoo! India Matrimony: Find your partner online. http://yahoo.shaadi.com/india-matrimony/ --- base.1.3.py 2004-05-21 08:08:58.000000000 +0530 +++ base.py 2004-05-22 10:50:10.015124800 +0530 @@ -368,10 +368,16 @@ assert callable(_f), "%s is not callable" % _f assert sys.maxint >= _seconds >= 0, \ "%s is not greater than or equal to 0 seconds" % (_seconds,) - tple = DelayedCall(seconds() + _seconds, _f, args, kw, - self._pendingTimedCalls.remove, - self._resetCallLater) - insort(self._pendingTimedCalls, tple) + if _seconds != 0: + tple = DelayedCall(_seconds + seconds(), _f, args, kw, + self._pendingTimedCalls.remove, + self._resetCallLater) + insort(self._pendingTimedCalls, tple) + else: + tple = DelayedCall(0, _f, args, kw, + self._pendingTimedCalls.remove, + self._resetCallLater) + self._pendingTimedCalls.append(tple) return tple def _resetCallLater(self, tple): @@ -415,9 +421,13 @@ log.err() count += 1 del self.threadCallQueue[:count] + if not self._pendingTimedCalls: + return now = seconds() + do=[] while self._pendingTimedCalls and (self._pendingTimedCalls[-1].time <= now): - call = self._pendingTimedCalls.pop() + do.append(self._pendingTimedCalls.pop()) + for call in do: try: call.called = 1 call.func(*call.args, **call.kw)

1 0

[Twisted-Python] Win32 files uploaded
by Cory Dodt 21 May '04

21 May '04

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On http://twistedmatrix.com/products/download Please note that these files have a version string that is inconsistent with the tarballs on the same page. The win32 files will report version "1.3.0" (which is correct). Some of the other files will say "1.3.0rc1" (which is not). A new release is coming shortly to fix this discrepancy. Thanks for your patience. C -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3-nr1 (Windows 2000) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFArh8L3A5SrXAiHQcRAt53AKCGbzsMCL2EJ0CMrPIF9LkoZtpKWwCgkm12 AhtrvUwzb1tCJTBMSSpIII4= =yQyw -----END PGP SIGNATURE-----

1 0

[Twisted-Python] still no stop!
by Bill la Forge 21 May '04

21 May '04

I've uninstalled twisted and re-installed. Still no 'stop'! Here's my latest (true) test: from twisted.application import service from twisted.internet import reactor class SimpleService(service.Service): def startService(self): service.Service.startService(self) print '>>>start' def stopService(self): print '>>>stop' service.Service.stopService(self) from twisted.application import service from twisted.internet import reactor import simpleService application = service.Application('testServer') serviceCollection=service.IServiceCollection(application) ss=simpleService.SimpleService() ss.setServiceParent(serviceCollection) reactor.stop() C:\other\Bill\compstrm\compstrm\twbsd>twistd -noy testService.py 2004/05/21 19:45 India Standard Time [-] Log opened. 2004/05/21 19:45 India Standard Time [-] twistd 1.2.0 (C:\Python23\python.exe 2. 3.3) starting up 2004/05/21 19:45 India Standard Time [-] reactor class: twisted.internet.default .SelectReactor 2004/05/21 19:45 India Standard Time [-] >>>start 2004/05/21 19:45 India Standard Time [-] Main loop terminated. 2004/05/21 19:45 India Standard Time [-] Server Shut Down. C:\other\Bill\compstrm\compstrm\twbsd> Is this an NT200 problem??? ;-( Bill la Forge http://www.geocities.com/laforge49/ Yahoo! India Matrimony: Find your partner online.

3 4

[Twisted-Python] Service.stopService
by Bill la Forge 21 May '04

21 May '04

I have a very simple application--I'm testing service start and stop. Woops--stopService is never called. Why? Here's my simpleService.py: from twisted.application import service class SimpleService(service.Service): def startService(self): service.Service.startService(self) print '***start' def stopService(self): service.Service.stopService(self) print '***stop' And here's my twistd script: from twisted.application import service import simpleService application = service.Application('testService', uid=1, gid=1) serviceCollection=service.IServiceCollection(application) w = simpleService.SimpleService() s.setServiceParent(serviceCollection) It logs ***start, just fine. But never ***stop! Is something broken? Or should I be using addSystemEventTrigger??? Bill la Forge http://www.geocities.com/laforge49/ Yahoo! India Matrimony: Find your partner online.

3 3

Twisted May 2004