Mailman 3 March 2010 - Twisted

[Twisted-Python] stdio.StandardIO blocks?
by Willy Lai March 24, 2010

March 24, 2010

Hi all I'm new to twisted and also have not a lot of Python experience. My problem boils down to following situation: I have a server and a client over TCP, once the client is connected to the server, the server periodically pings the client in order to check if it is still alive. The client sends a response/pong back to each ping. These messages are printed to stdout. The two consoles would then look like: [connected] ping pong ...2 seconds ... ping pong ...2 seconds ... ping pong ... Now the user should be able to write commands in the command line, which get's sent to the server, without interrupting the pings. But in my case, while writing on the console the output stops. The server will send a ping, but the client does not seem to receive the ping, since I don't get a pong on the server. What happens at the moment I type something in the command line? What I want, is writing stuff in the console, without interrupting the ping mechanism. (The pings and pongs in my case should continue to be sent while typing stuff in the console) That's how I use StandardIO: class CommandLine(protocol.Protocol): def __init__(self, protocol): self.protocol = protocol def dataReceived(self, data): print('INPUT: %s' % (data) class Client(protocol.DatagramProtocol): def __init__(self): # initialize command line connector commandLine = CommandLine(self) # connect member to command line output self.output = stdio.StandardIO(commandLine) Cheers

2 1

[Twisted-Python] Error: filedescriptor out of range in select
by Don Schoeman March 23, 2010

March 23, 2010

3 4

[Twisted-Python] python-daemon PID file
by null null March 23, 2010

March 23, 2010

Hi all, Im trying to get a daemon up and running but i cant get python-daemon to create a PID file. versions: Python 2.5.2 python-daemon-1.5.5 Debian Linux 2.6.26-2-686 <code> import daemon import lockfile daemon.DaemonContext(pidfile=lockfile.FileLock('/var/run/mydaemon.pid'),) daemon.__enter__() main() daemon.__exit__() </code> The above doesnt create a pid file, ive tried different permissions for the daemon and manualy making the pid file in the main() but no luck. In summary: I cant get a PID file created or populated with a PID by python-daemon. Anyone see something that im doing wrong? ive been sitting on this way too long. I looked at the python-daemon source and i cant see where the pid is inserted into the pid file, only where it __enter__'s the lockfile so is this functionality missing? Thanks!

2 1

[Twisted-Python] sara bai wants to chat
by sara bai March 21, 2010

March 21, 2010

I've been using Google Talk and thought you might like to try it out. We can use it to call each other for free over the internet. Here's an invitation to download Google Talk. Give it a try! ----------------------------------------------------------------------- sara bai wants to stay in better touch using some of Google's coolest new products. If you already have Gmail or Google Talk, visit: http://mail.google.com/mail/b-9f11c59641-70c58d7828-5e0dfd9bfa94a78a You'll need to click this link to be able to chat with sara bai. To get Gmail - a free email account from Google with over 2,800 megabytes of storage - and chat with sara bai, visit: http://mail.google.com/mail/a-9f11c59641-70c58d7828-5e0dfd9bfa94a78a Gmail offers: - Instant messaging right inside Gmail - Powerful spam protection - Built-in search for finding your messages and a helpful way of organizing emails into "conversations" - No pop-up ads or untargeted banners - just text ads and related information that are relevant to the content of your messages All this, and its yours for free. But wait, there's more! By opening a Gmail account, you also get access to Google Talk, Google's instant messaging service: http://www.google.com/talk/ Google Talk offers: - Web-based chat that you can use anywhere, without a download - A contact list that's synchronized with your Gmail account - Free, high quality PC-to-PC voice calls when you download the Google Talk client We're working hard to add new features and make improvements, so we might also ask for your comments and suggestions periodically. We appreciate your help in making our products even better! Thanks, The Google Team To learn more about Gmail and Google Talk, visit: http://mail.google.com/mail/help/about.html http://www.google.com/talk/about.html (If clicking the URLs in this message does not work, copy and paste them into the address bar of your browser).

1 0

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com March 21, 2010

March 21, 2010

1 0

[Twisted-Python] Twisted Sprint this Sunday
by exarkun＠twistedmatrix.com March 19, 2010

March 19, 2010

Hi all, Flumotion is going to be hosting a sprint this Sunday (Mid-morning to evening, Spanish time). I'll be introducing a lot of developers to the Twisted development process and trying to find them good first-time- contributor tickets to work on. Even if you're not on the Iberian peninsula this weekend, you can still participate virtually. :) If anyone wants to help out with reviews or suggest tickets that might be productive to work on, meet up with us in #twisted on Freenode. Jean-Paul

2 1

[Twisted-Python] FTP Client - questions
by Renan Mathias Fernandes March 18, 2010

March 18, 2010

Hello, I am trying to learn/implement a FTP Client, but I am facing a problem: How can I check if the retrieveFile method has finished downloading a file? As far as I can see, there is no easy way to do this, am I incorrect? Below is an example of what I am doing to retrieve a file: class FileReceiver(Protocol): """ Protocol subclass that writes received data to a local file. """ def __init__(self, filename): self.file = open(filename, 'wb') def dataReceived(self, data): self.file.write(data) def connectionMade(ftpClient): test = FileReceiver('./testRetrieve.txt') try: ftpClient.retrieveFile('testFile.txt',test) except: print "Exception -", sys.exc_value reactor.stop() Can anyone shed a light? Thanks in advance, Renan Mathias Fernandes

2 1

[Twisted-Python] Is it possible to turn off transactions for adbapi?
by markscottwright＠gmail.com March 18, 2010

March 18, 2010

I'm trying to get SQL Server 2005 to CREATE DATABASE using twisted. However, SQL Server won't allow you to run CREATE DATABASE within a transaction (apparently, it's not something sql server can roll back, which seems sensible). Which means that the following code results in an error. Is there a way to turn transactions off for a query? @defer.inlineCallbacks def test_simple_create(): try: password = "xxx" connection_string = "Driver={SQL Native Client}; Server=(local); UID=sa; PWD=%s;" % password db = adbapi.ConnectionPool("pyodbc", connection_string, cp_noisy=True) cmd = """CREATE DATABASE atest ON (NAME=atest, FILENAME='c:\temp\atest', SIZE=64MB) LOG ON (NAME=atestlog, FILENAME='c:\temp\atestlog', SIZE=64MB)""" yield db.runOperation(cmd) except Exception, e: print e finally: db.close() reactor.stop() if __name__ == "__main__": from twisted.python import log import sys test_simple_create() log.startLogging(sys.stdout) reactor.run() === 2010-03-18 09:28:45-0500 [-] Log opened. 2010-03-18 09:28:45-0500 [-] adbapi connecting: pyodbc ('Driver={SQL Native Client}; Server=(local); UID=sa; PWD=xxx;',) 2010-03-18 09:28:45-0500 [-] ('42000', '[42000] [Microsoft][SQL Native Client][SQL Server]CREATE DATABASE statement not allowed within multi-statement transaction. (226) (SQLExecDirectW)') 2010-03-18 09:28:45-0500 [-] adbapi closing: pyodbc 2010-03-18 09:28:45-0500 [-] Main loop terminated. 2010-03-18 09:28:45-0500 [-]

3 2

[Twisted-Python] Twisted and python threading
by (*)·´`·.¸.»ÐëÄdMäñ·´`·.¸.»(*) March 18, 2010

March 18, 2010

Hi, I'm trying to spawn a threading.Thread from a Twisted application, but the thread won't start unless I schedule the the code with reactor.callLater(), any Ideas ?

3 3

[Twisted-Python] Log Rotation Blocks w/ Large Number of Log Files
by Jason J. W. Williams March 17, 2010

March 17, 2010

Hello, Twistd blocks for a long period of time when the number of log files built up is large, thereby causing connections to freeze and (depending on the length of the rotation) time out. Given I've only used Twisted in the past and not contributed to it, I was curious if someone could take a look at my changes to twisted.python.logfile.LogFile's rotate() method and see if there's any reason the changes would be a bad idea. What I've attempted to do is defer the rotation of the old log files to a thread, and only rotate the current log file in the foreground. Original twisted.python.logfile.LogFile.rotate(): http://gist.github.com/334538 My version with deferral of old log rotation: http://gist.github.com/334545 (Changes are against Twisted 10.0). Thank you in advance. -J

3 4

[Twisted-Python] Twisted easy bugs, and other thoughts about getting people involved in Twisted
by Asheesh Laroia March 17, 2010

March 17, 2010

I ran into David Reid at PyCon a few weeks ago, and I showed him an index of "easy" and "bitesize" bugs I'm putting on the web at https://openhatch.org/search/. He told me that the Twisted team tags bugs as "easy" in Trac. So all you might like to see https://openhatch.org/search/?q=Twisted&toughness=bitesize -- it's the result of search for bugs whose full text or project matches "Twisted", constrained to only include the bugs that are "easy". This is the same query as http://twistedmatrix.com/trac/query?status=new&status=assigned&status=reope… -- the same 18 tickets -- but cached in our index. The OpenHatch website aims to show helpful, friendly things to potential new contributors. A list of bugs isn't always adequate, so I'm really happy jesstess wrote some tips on the OpenHatch project page regarding getting involved in Twisted: https://openhatch.org/+projects/Twisted The "Relatedly" sidebox on that project page has other helpful links: potential mentors, namely people who have signed into OpenHatch and said they can mentor in Python or Twisted. So that's a quick tour of some of relevant things to you guys. I have a few questions for you guys, if you're game: * Of these things, what are the most interesting or useful? the least? * Are there other tickets from the Twisted Trac that would be good to pull in? * Would you like me to ping the list if we come up with anything else I think you might find interesting? * Do any of you want to re-use some of this data -- can we make that easier? We're pretty interested in helping projects convert users to contributors (in code, testing, documentation, whatever!) across free software. I wonder if there is a website widget that we could make for you to put on twistedmatrix.com -- a big box talking about how "You TOO can contribute to Twisted -- there are mentors, easy bugs, and everything!" This email has gotten fairly long, so I'll stop here for now. I don't mean to barge in; let me know if I'm unwelcome, and I'll wander off. I find myself in a maze of Twisted developers, none of whom are alike. Thanks! I'll be hanging out on #twisted as myself, paulproteus. -- Asheesh. P.S. If you think this is interesting, stay in touch with us: IRC (freenode): #openhatch Twitter/Identi.ca: @openhatchery blog: https://openhatch.org/blog/ email and more: https://openhatch.org/contact/ P.S. The OpenHatch website has its source in git and shared under a free license -- https://openhatch.org/source-code-etc/ -- "World conquerors sometimes become fools, but fools never become world conquerors." -- "The Outer Limits: The Invisibles"

4 5

[Twisted-Python] http://twistedmatrix.com/ trac installation updated
by exarkun＠twistedmatrix.com March 16, 2010

March 16, 2010

Hi all, Thomas and I have finished upgrading the trac installation on http://twistedmatrix.com/ to 0.11.6. We expect that this will resolve a number of the issues the site has had. If you notice anything broken about the website now, please point it out. Jean-Paul

10 18

[Twisted-Python] My twisted application could not start after reboot be cause of "twistd.pid"
by Peter Cai March 16, 2010

March 16, 2010

Someone turn off the server by cutting power of the server. When the machine is power on, I found my twisted application could not start and emit the following error. Another twistd server is running, PID 3398 This could either be a previously started instance of your application or a different application entirely. To start a new one, either run it in some other directory, or use the --pidfile and --logfile parameters to avoid clashes. After I deleted twistd.pid, it could start normally. I checked if there is process with PID 3398, but there wasn't. What might cause this problem? How to avoid it? -- look to the things around you,the immediate world around you, if you are alive,it will mean something to you ——Paul Strand

6 7

[Twisted-Python] Application mode: Killing a peer connection from the server in a thread. Is this correct?
by Jonathan Sawyer March 14, 2010

March 14, 2010

Hi everyone, I am running a server in application context via: # code: server.tac factory = Factory() factory.protocol = MyProtocol application = service.Application("MyServer") service = internet.TCPServer(5555, factory) service.setServiceParent(application) # end code ran with $ twistd -ny server.tac Here is some of my Protocol code: # code: myprotocol.py def checkIdle(transport): while 1: now = time.time() if now - transport.activityFlag > 30.0: transport.loseConnection() time.sleep(1) break return time.sleep(8) return class MyProtocol(Protocol): def connectionMade(self): self.transport.activityFlag = time.time() thread.start_new_thread(checkIdle, (self.transport,)) # ... the rest of the methods... not important for this question # end code Now here's my problem: I want to kill connections from the server that have been idle for, say, 30 seconds. An idle connection is one in which is a _valid_ connection (i.e., it hasn't disconnected from the server) but hasn't sent any data for 30 seconds. The way I have initially set it up was in a thread. I simply check the last time it had activity from that particular transport. The really real problem I am having is when the connection is closed, the client doesn't know about it. It is simply closed on the server and the client is left hanging. If I test this in telnet with: $ telnet localhost 5555 telnet never quits with a message: Connection closed by foreign host. (which is indeed exactly what I want) The only way I get this response is if I try to send data to the server while the connection has been "lost". Can anyone direct me on the proper way to kill a connection from the server end in a clean manner? (By the way, I'm very new to twisted, not so new to Python). Thanks for any help! -- Jonathan Sawyer Geographic Information Network of Alaska (GINA) University of Alaska Fairbanks (907) 474-5689

2 1

Re: [Twisted-Python] [Twisted] #4331: SIGCHLD causes "Interrupted system call" errors on Python 2.4, in a fresh SVN checkout (was: SIGCHILD causes "Interrupted system call" errors on Python 2.4, in a fresh SVN checkout)
by Glyph Lefkowitz March 14, 2010

March 14, 2010

Also regarding Trac issues; I'm not sure if this one is new, but I received this message from the ticket notifier and I noticed that since the only thing that changed is the ticket subject, there appears to be no indication of who changed it or what changed, unless you look at the 'subject' line of the email. On Mar 14, 2010, at 3:29 AM, Twisted wrote: > #4331: SIGCHLD causes "Interrupted system call" errors on Python 2.4, in a fresh > SVN checkout > --------------------------+------------------------------------------------- > Reporter: TimAllen | Owner: glyph > Type: defect | Status: new > Priority: normal | Milestone: > Component: core | Keywords: > Branch: | Branch_author: > Launchpad_bug: | > --------------------------+------------------------------------------------- > > -- > Ticket URL: <http://twistedmatrix.com/trac/ticket/4331#comment:4> > Twisted <http://twistedmatrix.com/trac/> > Engine of your Internet

1 0

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com March 14, 2010

March 14, 2010

1 0

[Twisted-Python] Twisted 10.0.0 released
by Jonathan Lange March 11, 2010

March 11, 2010

On behalf of Twisted Matrix Laboratories, I am honored to announce the release of Twisted 10.0. Highlights include: * Improved documentation, including "Twisted Web in 60 seconds" * Faster Perspective Broker applications * A new Windows installer that ships without zope.interface * Twisted no longer supports Python 2.3 * Over one hundred closed tickets For more information, see the NEWS file. It's stable, backwards compatible, well tested and in every way an improvement. Download it now from: http://tmrc.mit.edu/mirror/twisted/Twisted/10.0/Twisted-10.0.0.tar.bz2 or http://tmrc.mit.edu/mirror/twisted/Twisted/10.0/Twisted-10.0.0.win32-py2.5.… Many thanks to Jean-Paul Calderone and Chris Armstrong, whose work on release automation tools and answers to numerous questions made this possible. Thanks also to the supporters of the Twisted Software Foundation and to the many contributors for this release. jml

4 5

[Twisted-Python] how to send message in msn bot
by code prophecy March 11, 2010

March 11, 2010

Hi, I've been playing with twisted msn implementation but failed to figure out how to send/recv message to another msn user ? I understand that i need to use msn.SwitchboardClient but am confused as to how and where to connect it ? what factory to use etc. any hint/example shall be appreciated. Thanks

1 0

[Twisted-Python] sniffing multicast traffic
by Ben Barker March 10, 2010

March 10, 2010

Hello - I wonder if someone can help: We have some status info being sent by various machines using multicast addressed udp packets. I have been attempting to use twisted to write a python script that will passively monitor on the relevant port for any udp packets with the specified multicast address, which I can then parse the payloads of as required. I have been looking at the examples here: http://code.activestate.com/recipes/425975-simple-udp-multicast-client-serv… But I seem to have trouble getting them to receive anything at all. I have managed to use tshark to display the packets : tshark -i eth0 -x -l -f udp so I know the data is there (coming isn on address 224.0.0.4, port 901) Any suggestions? B

4 10

[Twisted-Python] web2 -> web ToDo List
by ssteinerX＠gmail.com March 9, 2010

March 9, 2010

While I see tickets in the tracker for web2 and others for web, I couldn't find a 'cherry pick' list of things to be moved from web2 back into web. Is there one? Thanks, S

5 6

[Twisted-Python] Get Twisted 10.0 in to Ubuntu 10.04 LTS
by Jonathan Lange March 9, 2010

March 9, 2010

Hello all, Ubuntu's "Lucid Lynx" is now in feature freeze, meaning that it won't automatically take new versions of packages (see https://wiki.ubuntu.com/FeatureFreeze). Since we've just released Twisted 10.0.0 and since the release is awesome, stable, low-risk and a great thing to have in the next long-term support version of Ubuntu, I think we should strive to get a "Feature Freeze expection" (aka an "FFe"). I've followed the https://wiki.ubuntu.com/FreezeExceptionProcess and have filed a bug at https://bugs.edge.launchpad.net/ubuntu/+source/twisted/+bug/531977. But I need help. The FFe process requires a packaged version of the new release, along with build files and what not. I lack the expertise to do this, so I'd very much appreciate it if someone here who knows Debian/Ubuntu packaging could please package the new 10.0.0 release and attach the relevant files to the bug. Thanks, jml

4 10

[Twisted-Python] How to use time-base event in reactor?
by sleepd March 8, 2010

March 8, 2010

I am developing a online RTS game server, some event a base by time, example: a buff grant Max HP for 30 seconds, spawn army ever 30 seconds... I plan to use a timer to manage it, but Twisted are event-driven, how to put this timer in reactor's loop?

4 6

[Twisted-Python] Synchronous byte streaming
by Darren Govoni March 7, 2010

March 7, 2010

Hi, I received some great advice in the past about using Int32StringReceiver to be able to send a reliable message of bytes from the client to the server without hassling with unordered or partial messages. Seems to work. But I have one problem. My client iterates over a file sending 7MB byte messages to transport.sendString() to a server. What i see is that the client seems to buffer or wait to send those. After a few hundred sendStrings() still the server has not received one message. The result is my client gets throttled bad in terms of disk and memory. After all my sendString writes, then eventually the server receives the first message. But my computer is 100% max'd out. highly undesirable. What I want is for each on-the-wire send to complete, before sendString returns so resources can be managed properly. Is there _any_ way in Twisted to do this? thanks for any tips!! Darren

2 2

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com March 7, 2010

March 7, 2010

1 0

[Twisted-Python] 10.0.0 post-release actions
by Jonathan Lange March 6, 2010

March 6, 2010

Hello all, 10.0.0 is well-and-truly released. Jean-Paul has just updated the website documentation and I've made notes on what he did and stored it at http://twistedmatrix.com/trac/wiki/ReleaseProcess. My plan now is this: * Roll out a 10.0.1 release * Give ReleaseProcess a lot of love, turning it into a readable, useful document rather than a bunch of raw data * Make sure tickets are filed on all of the hard bits of the process * Schedule a 10.1 release * Fix the tickets that made the process hard * Do the 10.1 release * Find someone willing to be release manager for 10.2 and 10.3 Regarding the 10.0.1 release. The milestone[1] has two open tickets, one of which has a patch sans tests, and the other is mostly minor defects. I will try to roll out a 10.0.1 release soon that fixes both of these issues. There is also an open ticket which *might* be a regression: http://twistedmatrix.com/trac/ticket/4351. What you can do to help: * Investigate #4351 and decide whether or not it's a regression * Land a patch for http://twistedmatrix.com/trac/ticket/4210 * Fix tickets on the regular-releases milestone[2] cheers, jml [1] http://twistedmatrix.com/trac/query?status=new&status=assigned&status=reope… [2] http://twistedmatrix.com/trac/query?status=new&status=assigned&status=reope…

1 0