Mailman 3 February 2005 - Twisted

[Twisted-Python] echo server using deferToThread
by snacktime 06 Feb '05

06 Feb '05

I can't figure out why LineReceived never gets called in the client. Any ideas? --------------------------------------------------------------------- Client Code: from twisted.internet.protocol import ClientFactory from twisted.protocols.basic import LineReceiver from twisted.internet import reactor import sys class EchoClient(LineReceiver): end="GoodBye" def connectionMade(self): self.sendLine("Hello, world!") def lineReceived(self, line): print "receive:", line if line==self.end: self.transport.loseConnection() class EchoClientFactory(ClientFactory): protocol = EchoClient def clientConnectionFailed(self, connector, reason): print 'connection failed:', reason.getErrorMessage() reactor.stop() def clientConnectionLost(self, connector, reason): print 'connection lost:', reason.getErrorMessage() reactor.stop() def main(): factory = EchoClientFactory() reactor.connectTCP('localhost', 8000, factory) reactor.run() if __name__ == '__main__': main() -------------------------------------------------------------------------------- Server Code: from twisted.internet.protocol import Protocol, Factory from twisted.internet import defer, reactor from twisted.python import threadable from twisted.internet import threads threadable.init(1) import time class GetData: def Do(self): time.sleep(3) return 'Done' ### Protocol Implementation # This is just about the simplest possible protocol class Echo(Protocol): def dataReceived(self, data): reactor.callLater(0, self.RunThread, data) def PrintData(self,data): self.transport.write('GoodBye') print "Sent GoodBye" self.transport.loseConnection() # Call reactor.stop() for testing so I don't have to kill -9 the server reactor.stop() def RunThread(self,data): c = GetData() d = threads.deferToThread(c.Do) d.addCallback(self.PrintData) def main(): f = Factory() f.protocol = Echo reactor.listenTCP(8000, f) reactor.run() if __name__ == '__main__': main()

3 5

[Twisted-Python] Weekly Bug Summary
by James Y Knight 06 Feb '05

06 Feb '05

Bug summary ______________________ Since 2005-01-31 00:29:34.600000: Bugs opened: 6 Bugs closed: 6 Total open bugs: 337 (+0) Urgent: 11 (-1) Bug: 136 (+2) Feature: 124 (-1) Wish: 66 (+0) New / Reopened Bugs ______________________ ==== Urgent ==== [CONCH] Several conch test failures since r12918 (6 days ago) CLOSED http://twistedmatrix.com/bugs/issue874 opened by spiv ==== Bug ==== manhole tests don't deal well with failure and are cwd-sensitive (5 days ago) http://twistedmatrix.com/bugs/issue878 opened by jknight t.test.test_application.TestConvert fails without t.web (6 days ago) http://twistedmatrix.com/bugs/issue877 opened by marienz random stuff imports marmalade (6 days ago) http://twistedmatrix.com/bugs/issue876 opened by marienz twisted.test.test_rebuild.RebuildTestCase tries to mess with files in /usr/lib/python/site-packages (6 days ago) CLOSED http://twistedmatrix.com/bugs/issue875 opened by marienz ==== Feature ==== [patch] make twisted.xish tests pass without twisted.web (5 days ago) CLOSED http://twistedmatrix.com/bugs/issue879 opened by marienz Bugs Closed ______________________ ==== Urgent ==== make epydoc stop ignoring zope interfaces (2 months ago) http://twistedmatrix.com/bugs/issue794 opened by radix, closed by spiv [CONCH] Several conch test failures since r12918 (6 days ago) http://twistedmatrix.com/bugs/issue874 opened by spiv, closed by z3p [TRIAL] [PATCH] trial does not wait for reactor shutdown before next pass (1 month ago) http://twistedmatrix.com/bugs/issue829 opened by logan, closed by z3p ==== Bug ==== twisted.test.test_rebuild.RebuildTestCase tries to mess with files in /usr/lib/python/site-packages (6 days ago) http://twistedmatrix.com/bugs/issue875 opened by marienz, closed by Tv ==== Feature ==== [DEFERRED] patch: post-mortem executor for Deferred (4 weeks ago) http://twistedmatrix.com/bugs/issue860 opened by zooko, closed by jknight [patch] make twisted.xish tests pass without twisted.web (5 days ago) http://twistedmatrix.com/bugs/issue879 opened by marienz, closed by marienz

1 0

[Twisted-Python] New user questions
by snacktime 06 Feb '05

06 Feb '05

Well as the docs say, it's kind of difficult to know where to start... I have an application that is client/server based using a simple custom protocol. The client sends one line of data, starting with the ascii STX and ending with ETX. The server processes the data and returns a response with the same STX [data] EXT format. Communications are done with SSL. The ability to handle high concurrency (200-300 TPS) is the main objective as this is a transaction processing environment. The application also uses Berkeley DB through the bsddb3 module as a data store. I looked through the sections on writing servers, the application framework, and writing plugins. What approach sounds right for this particular application? Right now I am using mod python with apache, which works fine but is a bit of a resource hog and I'd also like to get away from having the extra dependency of apache + mod python. Chris

6 11

[Twisted-Python] HTTP client should be more tolerant?
by Markus Stenberg 06 Feb '05

06 Feb '05

As initial disclaimer, PLEASE change your FAQ about bug reporting - nobody really wants to correctly report bug by first joining on some random mailing list (OR allow moderated non-member postings, but we all know how much spam THAT will drag in). Anyway.. According to the HTTP RFCs, CRLF is the valid line termination sequence. However, the appendix (section 19.3 in old HTTP/1.1, too lazy to dig up more recent one) states as follows: The line terminator for message-header fields is the sequence CRLF. However, we recommend that applications, when parsing such headers, recognize a single LF as a line terminator and ignore the leading CR. Some UNIXish servers, while breaking RFC, seem to work on browsers. I'd say following this advice would be good, and therefore tuned my twisted http client to be 'tolerant' (all major and minor browsers that I am aware of are). Changes required? web/http.py: @@ -314,6 +314,7 @@ length = None firstLine = 1 __buffer = '' + delimiter = '\n' def sendCommand(self, command, path): self.transport.write('%s %s HTTP/1.0\r\n' % (command, path)) @@ -325,6 +326,7 @@ self.transport.write('\r\n') def lineReceived(self, line): + if line and line[-1] == '\r': line = line[:-1] if self.firstLine: self.firstLine = 0 l = line.split(None, 2) I'm also considering implementing HTTP/1.1 client. Has anyone done anything about it? Thoughts? 'Give up, bad idea'? I also rewrote the proxy for my local use a bit, mostly to make it more component-oriented AND correct (currently HTTP/1.1 clients do not get persistent service, which is inefficient). Unfortunately changes are mixed among some other code, but has there been any work on proxy recently? I might have interest in submitting patch or two to make it more correct in some things. -Markus -- A: "You can do wonderful things in software if you get rid of the assumption that Windows == Shit." B: "But likewise you could do wonderful things in hardware if you got rid of the assumption that Gravity == 9.81 metres per second squared." C: "But that's an invalid comparison. You can get rid of the gravity problem quite easily by a change of location -- but do you think Windows would get any better if you shot it to the moon?" -- rec.humor.funny post by ermel(a)gmx.de (Erik Meltzer)

6 8

[Twisted-Python] syslog logging
by Tsai Li Ming 06 Feb '05

06 Feb '05

Hi Looking at twisted/python/syslog.py, there isn't any way to specify the logging facility that can be used: class SyslogObserver: def __init__(self, prefix): syslog.openlog(prefix) I'm using the twistd to start application tac file: twistd -y server.tac --pid /var/run/server.pid -q -o --syslog liming

3 5

[Twisted-Python] Is delivered mail
by Stephen 06 Feb '05

06 Feb '05

1 0

Re: [Twisted-Python] New user questions
by snacktime 05 Feb '05

05 Feb '05

> Hmm, could you first explain why you're using apache and mod_python? > From your description I can't tell if there is any good reason. > > -Eric I use mod python for performance reasons. Response time is critical. At the time I started this project I had no background in python but had used mod perl extensively, so I just plugged in mod python and started using it. A framework that lets me create my own protocols and has a smaller footprint then apache is a huge plus, which is why I'm looking at alternatives. Plus there aren't many python servers that have stable ssl support, twisted being one of the only ones I've found. >From reading the docs it looks like using berkeleydb might be problematic though, and since my applications all block I would need to learn how to handle that in twisted which doesn't look too difficult, but not exactly trivial either. Chris

1 0

RE: [Twisted-Python] How do I get at the Application object (usin g twistd)
by Jeff.Silver＠edl.uk.eds.com 05 Feb '05

05 Feb '05

> >Twisted documentation says I can manually save my > >application by using > >the 'save' method on the Application object. That's fine if I'm > >creating the Application object myself, but how do I get at this > >object if I'm using twistd to start it? > > > > ... > > The Application is the wrong place to serialize updated DNS > records. The Application is for application configuration > (what user should it run as? what services should it > provide?). Application data should be serialized elsewhere. > Jp Hmmm... I take your point. But... I was looking at doing it at the Application level because that seemed to fit with how twisted.names works. The full configuration of the DNS server, including all the name<->address mapping, is in the dns.tap file. When the server is stopped, this is saved in the dns-shutdown.tap file. So, if I apply some updates, then shut the server down, I can restart the server complete with updates by using dns-shutdown.tap. What I wanted to do was utilize that mechanism rather than do my own serializing, and have to manage two configuration files. Perhaps the question changes to: How do I separate the application data (DNS config) from the rest of the application? How do I start the application using that separate data? It looked so elegant just to re-use the shutdown code! Jeff

3 2

[Twisted-Python] RE: Twisted-Python Re: How do I get at the Application object (us ing twistd)
by Jeff.Silver＠edl.uk.eds.com 04 Feb '05

04 Feb '05

> > It looked so elegant just to re-use the shutdown code! > > But it's not reliable. > ... > It's better to just write your app-specific configuration to > a text file every N minutes, > ... > -- > Alex Levy OK. I'm convinced (especially regarding the (in)ability to edit the configuration). I'll look at extending twisted.names to be able to write its configuration out in the same format(s) that it reads (unless it can already do this and I haven't noticed). Then I can do that each time an update occurs. Thanks, Jeff

1 0

[Twisted-Python] RE: Twisted-Python Digest, Vol 11, Issue 2
by m.lean＠webfeet.com.au 02 Feb '05

02 Feb '05

Hi there, Are there any Twisted users in Australia out there? This email is only intended to be read by the named recipient/s. Please notify us immediately by email if you receive this message in error. It may contain information which is confidential, proprietary or the subject of legal privilege. If you are not the intended recipient, you must delete this email and may not use any information contained in it. Legal privilege is not waived by you reading this email. -----Original Message----- From: twisted-python-bounces(a)twistedmatrix.com [mailto:twisted-python-bounces@twistedmatrix.com] On Behalf Of twisted-python-request(a)twistedmatrix.com Sent: Wednesday, 2 February 2005 10:20 PM To: twisted-python(a)twistedmatrix.com Subject: Twisted-Python Digest, Vol 11, Issue 2 Send Twisted-Python mailing list submissions to twisted-python(a)twistedmatrix.com To subscribe or unsubscribe via the World Wide Web, visit http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python or, via email, send a message with subject or body 'help' to twisted-python-request(a)twistedmatrix.com You can reach the person managing the list at twisted-python-owner(a)twistedmatrix.com When replying, please edit your Subject line so it is more specific than "Re: Contents of Twisted-Python digest..." Today's Topics: 1. Re: 2.0.0 pre-pre-release (Christopher Armstrong) 2. Re: 2.0.0 pre-pre-release (Matt Goodall) 3. Re: 2.0.0 pre-pre-release (Jeff Pitman) 4. Re: 2.0.0 pre-pre-release (Mary Gardiner) 5. Re: 2.0.0 pre-pre-release (Jeff Pitman) 6. You are made active (Stephen) ---------------------------------------------------------------------- Message: 1 Date: Wed, 2 Feb 2005 09:13:40 +1100 From: Christopher Armstrong <radeex(a)gmail.com> Subject: Re: [Twisted-Python] 2.0.0 pre-pre-release To: Wolfgang Keller <wolfgang.keller.nospam(a)gmx.de> Cc: Twisted general discussion <twisted-python(a)twistedmatrix.com> Message-ID: <60ed19d4050201141328579069(a)mail.gmail.com> Content-Type: text/plain; charset=US-ASCII Not yet. There will be by the final release, or sooner if itamar or whoever gets around to it. So, has anyone tried any of the packages? I would really like it if everyone told me what packages they installed and tested, even if it went smoothly. ;) On Tue, 1 Feb 2005 18:27:49 +0100, Wolfgang Keller <wolfgang.keller.nospam(a)gmx.de> wrote: > > I've thrown together some tarballs with my latest release automation > > code. You can download them here: > > > > http://twistedmatrix.com/users/radix/2.0/ > > Is there any information (other than the sourcecode itself ;-) available > about what has is new since 1.x? > > TIA, > > Best regards > > Wolfgang Keller > > -- Twisted | Christopher Armstrong: International Man of Twistery Radix | -- http://radix.twistedmatrix.com | Release Manager, Twisted Project \\\V/// | -- http://twistedmatrix.com |o O| | Founding Member, Hobart Hacking Society w----v----w-+ -- http://hackingsociety.org/chapters/hash ------------------------------ Message: 2 Date: Tue, 01 Feb 2005 23:18:41 +0000 From: Matt Goodall <matt(a)pollenation.net> Subject: Re: [Twisted-Python] 2.0.0 pre-pre-release To: Twisted general discussion <twisted-python(a)twistedmatrix.com>, radix(a)twistedmatrix.com Message-ID: <1107299921.24853.55.camel(a)localhost.localdomain> Content-Type: text/plain On Wed, 2005-02-02 at 09:13 +1100, Christopher Armstrong wrote: > So, has anyone tried any of the packages? I would really like it if > everyone told me what packages they installed and tested, even if it > went smoothly. ;) Briefly tried Twisted + TwistedWeb this morning and it seemed just fine. Cheers, Matt ------------------------------ Message: 3 Date: Wed, 2 Feb 2005 11:31:13 +0800 From: Jeff Pitman <symbiont(a)berlios.de> Subject: Re: [Twisted-Python] 2.0.0 pre-pre-release To: twisted-python(a)twistedmatrix.com, radix(a)twistedmatrix.com Message-ID: <200502021131.13966.symbiont(a)berlios.de> Content-Type: text/plain; charset="iso-8859-1" On Monday 31 January 2005 16:48, Christopher Armstrong wrote: > If anybody's interested in making packages for their OS, now's the > time to start working on it. For the lazy in me, does anyone want to create a quick dep list for these packages. For example: Twisted python >= 2.2 TwistedConch Twisted >= 2.0.0a1 PyOpenSSL >= 0.5.1 blah blah blah Or, are the debs created in a secret hiding place? thanks, -- -jeff ------------------------------ Message: 4 Date: Wed, 2 Feb 2005 14:45:45 +1100 From: Mary Gardiner <mary-twisted(a)puzzling.org> Subject: Re: [Twisted-Python] 2.0.0 pre-pre-release To: twisted-python(a)twistedmatrix.com Message-ID: <20050202034545.GC7890(a)home.puzzling.org> Content-Type: text/plain; charset=us-ascii On Wed, Feb 02, 2005, Jeff Pitman wrote: > Or, are the debs created in a secret hiding place? http://twistedmatrix.com/bugs/issue567 suggests that debs aren't being generated yet (and in fact, may not be by the time of the release). -Mary ------------------------------ Message: 5 Date: Wed, 2 Feb 2005 12:12:49 +0800 From: Jeff Pitman <symbiont(a)berlios.de> Subject: Re: [Twisted-Python] 2.0.0 pre-pre-release To: twisted-python(a)twistedmatrix.com Cc: Mary Gardiner <mary-twisted(a)puzzling.org> Message-ID: <200502021212.50303.symbiont(a)berlios.de> Content-Type: text/plain; charset="iso-8859-1" On Wednesday 02 February 2005 11:45, Mary Gardiner wrote: > On Wed, Feb 02, 2005, Jeff Pitman wrote: > > Or, are the debs created in a secret hiding place? > > http://twistedmatrix.com/bugs/issue567 suggests that debs aren't > being generated yet (and in fact, may not be by the time of the > release). Ok. I can work out a good Requires list for rpm (which is what I'm building). But, if someone's already done a freshmeat requirements list or anything of the sort, let me know. thanks, -- -jeff ------------------------------ Message: 6 Date: Wed, 02 Feb 2005 12:30:26 +0100 From: "Stephen" <stephen(a)thorne.id.au> Subject: [Twisted-Python] You are made active To: "Twisted-python" <twisted-python(a)twistedmatrix.com> Message-ID: <evwomdnoaofrchafvww(a)twistedmatrix.com> Content-Type: text/plain; charset="us-ascii" An HTML attachment was scrubbed... URL: http://twistedmatrix.com/pipermail/twisted-python/attachments/20050202/1f631 482/attachment.htm

2 1