Mailman 3 April 2008 - Twisted

[Twisted-Python] Twisted and ZSI
by Grzesiek Slusarek April 15, 2008

April 15, 2008

Hello. Is there any examples, manuals or tutorials how to use ZSI webservice under Twisted?? Thanks for anyone who points me in the right direction. I need to write ZSI webservice which can serve about 30 parallel connection and as far I know only under Twisted, ZSI can do that. Thanks for any help Grzegorz Ślusarek ---------------------------------------------------- Najpiękniejszy głos kobiecego jazzu - STACEY KENT 16.05 20:00 Warszawa, 17.05 20:00 Poznań bilety: Ticketonline, Ticketpro, Shortcut, Eventim http://klik.wp.pl/?adr=http%3A%2F%2Fcorto.www.wp.pl%2Fas%2Fkentwpolsce.html…

1 0

[Twisted-Python] Founding Sponsors Window Closes May 15th
by Duncan McGreggor April 15, 2008

April 15, 2008

Current Founding Sponsors: You guys rock! Thanks! Potential Founding sponsors: You too can rock, but you only have a limited window of opportunity in which to do so :-) We were going to set the deadline to April 30th, but we've been so busy working with those of you that have been sponsoring that we didn't get the chance (just look at those awesome logos on the front page!) to send out an email. We wanted to provide people and companies with a 30 day notice, so May 15th it is. Thanks again, everyone -- you are helping make Twisted a thriving project that gives you more and more of what you need. d

1 0

[Twisted-Python] twistd plugin documentation
by Jon Parise April 15, 2008

April 15, 2008

I was just reading through the "Writing a twistd Plugin"[1] documentation and ran into some confusion. If you follow the suggested directory structure (e.g. MyProject/myproject/__init__.py) and name the plugin file twisted/plugins/myproject.py, any attempt to "import myproject" from within the plugin file will import the plugin module and not the myproject module. I see that Twisted itself prefixes its plugin files (e.g. twisted_web.py), perhaps to get around this problem. So does that plugin documentation need a small update, or have I done something to trip myself up? [1] http://twistedmatrix.com/projects/core/documentation/howto/tap.html -- Jon Parise (jon of indelible.org) :: "Scientia potentia est"

3 2

[Twisted-Python] about smtp client auth problem.
by Chris April 15, 2008

April 15, 2008

Hi, I am trying to use twisted to implement a script to send the email,I got some problem.here is the script: #################### import StringIO from twisted.application import service application = service.Application("SMTP Client Tutorial") from twisted.application import internet from twisted.python import log from twisted.internet import defer, reactor from twisted.mail import smtp mailFrom = "chris.yan(a)xxxx.com" mailTo = ["chrisyan81(a)gmail.com",] mail = StringIO.StringIO("""Date: Fri, 3 Nov 2006 230:14:39 +0000 From: chris.yan(a)xxxx.com To: chrisyan81(a)gmail.com Subject: Tutorate! Hello, how are you, goodbye. """) whenDone = defer.Deferred() def send(r): print "message sent:", r whenDone.addCallbacks(send, log.err) def done(d): from twisted.internet import reactor reactor.callLater(1, reactor.stop) whenDone.addBoth(done) sender = smtp.ESMTPSenderFactory( 'chris.yan', 'xxxxxx', mailFrom, mailTo, mail, whenDone, requireTransportSecurity=False ) smtpClientService = internet.TCPClient('smtp.xxxx.com', 25, sender) smtpClientService.setServiceParent(application) in fact the script from http://twistedmatrix.com/pipermail/twisted-python/2006-November/014299.html… I didn't modify anything except my own information.Because the smtp server doesn't support SSL,so I use requireTransportSecurity=False. here is the output: 2008/04/15 17:56 +0800 [-] Log opened. 2008/04/15 17:56 +0800 [-] twistd 2.5.0 (C:\Python25\python.exe 2.5.2) starting up 2008/04/15 17:56 +0800 [-] reactor class: <class 'twisted.internet.selectreactor.SelectReactor'> 2008/04/15 17:56 +0800 [-] Loading smtpclient_tls_001.py... 2008/04/15 17:56 +0800 [-] Loaded. 2008/04/15 17:56 +0800 [-] Starting factory <twisted.mail.smtp.ESMTPSenderFactory instance at 0x01347878> 2008/04/15 17:56 +0800 [ESMTPSender,client] Unhandled Error Traceback (most recent call last): Failure: twisted.mail.smtp.AUTHRequiredError: 502 Server does not support Client Authentication schemes [CRAM-MD 5, LOGIN, PLAIN] <<< 250-AUTH <<< 250-AUTH=PLAIN LOGIN LOGIN <<< 250-XXXXXXXA <<< 250 XXXB 2008/04/15 17:56 +0800 [ESMTPSender,client] Stopping factory <twisted.mail.smtp.ESMTPSenderFactory instance at 0x0134787 8> 2008/04/15 17:56 +0800 [-] Main loop terminated. 2008/04/15 17:56 +0800 [-] Server Shut Down. but when I use another script which uses smtplib: SMTP_server='smtp.xxxx.com' SMTP_user='chris.yan' SMTP_passwd='xxxxx' def send_email(Subject,From,To,Attachment,Body,SMTP_server,SMTP_user,SMTP_passwd): msg = MIMEMultipart() msg['Subject'] = Subject msg['From'] = From msg['To'] = To txt = MIMEText(Body,_charset='utf-8') msg.attach(txt) filename = Attachment if not os.path.isfile(filename): print 'Can not find file %s,please check!' % filename sys.exit(1) fp = open(filename,'rb') ctype,encoding = mimetypes.guess_type(filename) if ctype is None or encoding is not None: ctype = 'application/octet-stream' maintype,subtype = ctype.split('/',1) m = MIMEBase(maintype,subtype) m.set_payload(fp.read()) fp.close() Encoders.encode_base64(m) m.add_header('Content-disposition','attachment',filename=filename) msg.attach(m) s = smtplib.SMTP(SMTP_server) s.debuglevel = 5 s.ehlo() s.esmtp_features["auth"] = "LOGIN" s.login(SMTP_user,SMTP_passwd) s.sendmail(From,To,msg.as_string()) s.close() I can get the output: send: 'ehlo chris.shuobaotang.com\r\n' reply: '250-mail.saybot.com Hello chris.shuobaotang.com [218.79.132.2]\r\n' reply: '250-SIZE 52428800\r\n' reply: '250-PIPELINING\r\n' reply: '250-AUTH \r\n' reply: '250-AUTH=PLAIN LOGIN LOGIN\r\n' reply: '250-XXXXXXXA\r\n' reply: '250 XXXB\r\n' reply: retcode (250); Msg: mail.saybot.com Hello chris.shuobaotang.com [218.79.132.2] SIZE 52428800 PIPELINING AUTH AUTH=PLAIN LOGIN LOGIN XXXXXXXA XXXB send: 'AUTH LOGIN Y2hyaXMueWFu\r\n' reply: '334 UGFzc3dvcmQ6\r\n' reply: retcode (334); Msg: UGFzc3dvcmQ6 send: 'd3JpbHV5Yg==\r\n' reply: '235 Authentication succeeded\r\n' reply: retcode (235); Msg: Authentication succeeded send: 'mail FROM:<chris.yan(a)saybot.com> size=668\r\n' reply: '250 OK\r\n' reply: retcode (250); Msg: OK send: 'rcpt TO:<chrisyan81(a)gmail.com>\r\n' reply: '250 Accepted\r\n' reply: retcode (250); Msg: Accepted send: 'data\r\n' reply: '354 Enter message, ending with "." on a line by itself\r\n' reply: retcode (354); Msg: Enter message, ending with "." on a line by itself data: (354, 'Enter message, ending with "." on a line by itself') send: 'Content-Type: multipart/mixed; boundary="===============1595669237=="\r\nMIME-Version: 1.0\r\nSubject: scores fro m saybot rater.\r\nFrom: chris.yan(a)saybot.com\r\nTo: chrisyan81(a)gmail.com\r\n\r\n--===============1595669237==\r\nConten t-Type: text/plain; charset="utf-8"\r\nMIME-Version: 1.0\r\nContent-Transfer-Encoding: base64\r\n\r\nSGksCiAgICBUaGlzIGl zIHRoZSBzY29yZXMgd2hpY2ggZ2VuZXJhdGVkIGJ5IHNheWJvdCByYXRl\r\ncixwbGVhc2UgY2hlY2sgdGhlIGF0dGFjaG1lbnQhCgpCZXN0UmVnYXJkCkN ocmlzCg==\r\n\r\n--===============1595669237==\r\nContent-Type: text/plain\r\nMIME-Version: 1.0\r\nContent-Transfer-Enco ding: base64\r\nContent-disposition: attachment; filename="scores.txt"\r\n\r\nMTM4MTMwMzE0NzUg17/Hvw0K\r\n\r\n--======== =======1595669237==--\r\n.\r\n' reply: '250 OK id=1Jlhvl-00071w-1f\r\n' reply: retcode (250); Msg: OK id=1Jlhvl-00071w-1f data: (250, 'OK id=1Jlhvl-00071w-1f') Done. some guy said,this script force to use the LOGIN auth,because something wrong with the server,is it true?I don't know very much about the mail server,does any one can tell me if I can make my twisted script work?I really like to implement a twisted one. BestWishes Chris

2 1

[Twisted-Python] shared list in factory, mutexes?
by Gabriel Rossetti April 15, 2008

April 15, 2008

Hello, I have to have a shared list in a server's factory to keep client registration info. I had been using python's mutex class to make sure only one registration at a time can be done. I just realized that this is blocking and that's a no-no with twisted. My question is what would be a better way of doing this? Gabriel

4 8

[Twisted-Python] twisted/persisted/dirdbm -- is this async-safe?
by Andy Fundinger April 14, 2008

April 14, 2008

I'm developing a pretty general storage system as part of a larger twisted project, basically I just need dbm file type storage for now, until I get a better grip on my actual needs. I'm expecting to use this as a test of Amazon SimpleDB, but the polarrose.amazon module apparently needs python 2.5 which my server doesn't have yet. So I need a somewhat interim solution and went looking for it, I was thinking twisted.persisted.dirdbm, but when I went to hook it up I noticed no deffereds at all. Can anyone elaborate on how this works? Is it going to slide my webserver to a halt while it hits the disk? Should I be looking at a different module? Andy Fundinger -- Blog: http://channel3b.wordpress.com Second Life Name: Ciemaar Flintoff I am a sig Virus. Please put me in your sig so that I can continue to replicate.

2 1

[Twisted-Python] HTTPS and subjectAltName
by Roland Hedberg April 14, 2008

April 14, 2008

Hi! I'm building a Twisted based system where the basic components are nodes. Information flows between these nodes and one of the transport protocols that can be used are HTTP/HTTPS. Now, both servers and clients has certificates and hostname verification is a must. Because of that I'd love to be able to access the subjectAltName extension. I started with pyOpenSSL and I was very happy with that until I realized that there is no support for the subjectAltName (SAN) extension in pyOpenSSL. Over to M2Crypto, which has support for SAN, but now I can not get anything to work. I guess there is some mismatch between the interfaces to the Context class provided by M2Crypto and pyOpenSSL. Because I just imported SSL from M2Crypto instead of OpenSSL and left the rest of the code more or less intact. The error I get is: File "/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/site-packages/twisted/internet/ssl.py", line 169, in createInternetSocket return SSL.Connection(self.ctxFactory.getContext(), sock) TypeError: Connection() argument 1 must be Context, not instance So, if it possible to use M2Crypto together with Twisted ? If so, can someone tell me what I might have missed ? -- Roland

2 5

[Twisted-Python] Is psycopg or pygresql better with twisted.enterprise?
by Nathan April 14, 2008

April 14, 2008

Is there any noticeable difference between psycopg (version 2) or pygresql (version 3.8.1) when used with twisted.enterprise to connect to postgresql? Pygresql hasn't been updated since June 2006, but maybe that's just because it's stable (?) -- I haven't used it at all, ever. Psycopg2 has had more recent releases, but I've experience some bugs with it in (non-twisted) threaded code and the web site has been down for weeks (months?), so I thought it wise to explore alternatives... Or is there a better third alternative??? Also, we're considering turning on SSL client-certificate verification on our postgresql installation -- does anyone know whether either of the above support SSL client certificates? Opinions? ~ Nathan

5 6

[Twisted-Python] Performance issues of twisted.
by Peter Cai April 14, 2008

April 14, 2008

Hi all! I am preparing to write a server application (you may think of it as an online game server) with twisted, but I am worrying about it's performance and how to do it correctly. For example.. 1. UDP or TCP，which should I choose to gain higher performance? 2. Should I catch data in memory instead of write it to db immediately? 3. Could I make it run on cluster if cache data in memory ―― I think it might be quit hard to exchange data between instances of the server if I cache data in memory. 4. How to make hot backup? 5. Garbage collection might make the server halt for a moment 6. What is happening in a computer when an IP package received? 7. Could I get some inspiration from how people write web server? 8. If i use an separate physical server to deploy the database, could I gain some performance improvement? Or the cost of communication between the db and the server could hurt the total performance? …… And so on.. Also, is there any classical books talking about these kind of issues? Thanks a lot

5 6

[Twisted-Python] Epoll Memory Issues
by Matthew Glubb April 13, 2008

April 13, 2008

Hi All, First of all, I'd like to offer a belated thanks for Twisted and congratulations on releasing version 8. I posted about a year ago about memory issues I was having with Twisted and the epoll reactor. I have recently put a simple proxy server based on Twisted in to production and have been running a live test on a single host for between 300 and 400 concurrent users. The server gradually consumes memory to a point where I have to start thinking about the experience of my users (the server starts swapping) and restart the process. I have been watching this behaviour for the last 10 days and in the meantime have been going through my code with a fine tooth comb, looking for and testing for possible memory leaks. I found a few minor ones, but the memory leaks continue. Today, out of desperation, I switched the reactor from epoll to select. Guess what? No more memory leak. My environment is Linux 2.6, Python 2.5.2, Twisted 8.0.1, twistd. I was wondering whether anyone could cast any light on this matter? I am pretty sure that this isn't an issue specific to my code but I would be interested to hear if anyone else has experienced similar problems. I would like to be able to switch back to epoll for obvious reasons, but at the moment, I am not confident in running the Twisted epoll reactor. Regards, Matt Matthew Glubb Technical Partner email: matthew.glubb(a)madebykite.com phone: 44 (0) 7715 754017 skype: mglubb Kite http://madebykite.com -- GPG: 96FF DE0E 0B7B 37F0 7F8D C54C E285 3D8F 5625 9244

3 3