Mailman 3 December 2003 - Twisted

[Twisted-Python] ANN: TwistedJava 0.6.1
by Itamar Shtull-Trauring Dec. 3, 2003

Dec. 3, 2003

TwistedJava is an implementation of Perspective Broker for java. This release is basically identical to 0.6, except it adds a login() method which supports logging to new style Twisted 1.1 PB servers. http://itamarst.org/software/twistedjava/ -- Itamar Shtull-Trauring http://itamarst.org/ Available for Python & Twisted consulting

3 2

[Twisted-Python] how to best limit a given protocol to one instance (socket connection)?
by John Benson Dec. 3, 2003

Dec. 3, 2003

Hi, I'd like to ensure that only one client can get into my instance of Protocol. I'm thinking of setting an "instances" attribute on the Factory and losing the connection if it has already been incremented to 1, but I'm wondering if there is something more forceful that says "server rejected connection" that might be a twisted Factory or Protocol configuration option. Thanks in advance for any help.

2 1

Re: [Twisted-Python] Contributing to Twisted
by Brian Warner Dec. 2, 2003

Dec. 2, 2003

Michal Pasternak <michal(a)pasternak.w.lub.pl> writes: > I'd like to setup buildbot on my machine and help Twisted building and > testing packages - as my contribution to Twisted project. I can install it > on a 700 MHz / 256 RAM / NetBSD-stable machine. Excellent! I'll set up a netbsd builder and mail you the setup information. I need a little time to get the next buildbot release out the door.. otherwise I think you'll need to run the CVS version of the buildslave. I'll see … [View More]

2 1

[Twisted-Python] TwistedJava
by Phil Christensen Dec. 2, 2003

Dec. 2, 2003

I was just wondering if anyone ( **cough**itamar**cough** ;-) ) has had a chance to hack out TwistedJava for the new cred framework. I know it's not a high-demand product, but I could really use it...I've been looking at the source code and twisted-python's cred code, but i don't think i'm at a level with twisted to be able to hack it myself. if there's anything i can do to help expedite the process, i'd be glad to help. -phil

1 0

[Twisted-Python] Memory usage in large file transfers
by Nikolaos Krontiris Dec. 2, 2003

Dec. 2, 2003

Hi there. I am writing a file transfer program using twisted as my framework. I have been having some problems as far as memory usage is concerned (i.e. both client and server just eat through available memory without ever releasing it back to the kernel while transfering data). I am aware that in theory, the client and server will consume at least as much memory as the file to be transferred, but this memory should also be made available to the O/S after the operation has completed. I also … [View More]

5 7

Re: [Twisted-Python] mounting a twisted server
by Brian Warner Dec. 2, 2003

Dec. 2, 2003

stephan <mailinglists(a)shechen.at> writes: > NFS or samba would conceptionally work but does not seem to be supported by > twisted and seems to be overkill anyways. The gnome-vfs layer might be worth looking at: it allows fairly arbitrary things to be interpreted as "filesystems" (auto-mounted ftp sites, synthetic configuration files, etc), but is only accessible to programs using the gnome-vfs library for file access. If you've considered NFS then one of the user-space … [View More]

2 1

[Twisted-Python] tutorial finger14.py error ?
by Martin Waite Dec. 2, 2003

Dec. 2, 2003

Hi, I am working through the excellent tutorial http://twistedmatrix.com/documents/howto/tutorial. In finger14.py, there are two similar definitions of _read() - one as a method of FingerService and the second local to startService(). The version in startService() doesn't seem to do anything. It tries to read self.file instead of self.filename - and so cannot succeed. Can this be deleted to remove the confusion ? regards, Martin

2 1

[Twisted-Python] Some problems with twisted
by Pieter Claerhout Dec. 2, 2003

Dec. 2, 2003

Hello all, I'm having some problems with getting a certain app running under Twisted. I've attached the code I have so far. There are a few things that are not working the way they should (because I probably did something wrong). Twisted is still pretty new for me. 1. If I run this script from the command prompt, e.g.: C:\>python sample.py It does start and performs the processing as defined in the ProcessingService, but it doesn't seem to start the WebAdminService. When I … [View More]try to connect to the web interface by surfing to http://localhost:9119/, it fails to connect. 2. During the execution of the doProcessing function, it's impossible to stop the application with e.g. CTRL+BREAK. Is there a way around this? 3. The code from the doProcessing service is basically blocking the whole application when it's running. The goal of this application is that it does two things: 1. It grabs files from a list of servers every hour and performs some calculations on these files. The results will be stored in a database (SQLite or MySQL). 2. The application will provide a web interface to administer the application and display the results by getting these from the database. Since downloading from the internet is not always as reliable as we would like it to be, it's possible that if a number of the servers are not online, the systems slows down considerably. It would be a waste of time anyway to let the application wait for this single server when it can continue with the other ones in the meantime. What I would like to find is a way to get the data from these servers as fast as possible and do the calculations on them without blocking the system. What is the normal way of doing things like this in Twisted. Should I use threads to do this, or is there another way? Thanks a lot in advance, pieter [ pieter claerhout | pieter(a)yellowduck.be | www.yellowduck.be ] #---- START OF CODE ---- import time from twisted.internet import app from twisted.internet import reactor from twisted.web import static from twisted.web import script from twisted.web import server class ProcessingService( app.ApplicationService ): def __init__( self, serviceName, serviceParent=None ): app.ApplicationService.__init__( self, serviceName, serviceParent=serviceParent ) def startService( self ): reactor.callLater( 0, self.doProcessing ) def doProcessing( self ): for url in [ 'http://www.yellowduck.be/', 'http://www.beachshop.be/' ]: print 'Processing %s' %( url ) time.sleep( 5 ) reactor.callLater( 360, self.doProcessing ) class WebAdminService( app.ApplicationService ): def __init__( self, serviceName, serviceParent=None ): app.ApplicationService.__init__( self, serviceName, serviceParent=serviceParent ) def startService( self ): root = static.File( 'htdocs' ) site = server.Site( root ) self.serviceParent.listenTCP( 9119, site ) def main(): myapp = app.Application( 'myapp' ) ProcessingService( 'processor', myapp ) WebAdminService( 'webadmin', myapp ) myapp.run() if __name__ == '__main__': main() #---- END OF CODE ---- [View Less]

3 2

[Twisted-Python] Twisted 1.1.0 - AssertionError: reactor already installed
by Joe Van Andel Dec. 2, 2003

Dec. 2, 2003

Using Twisted 1.1.0, Python 2.3.2, Redhat 9: Python scripts using that import xmlprc before calling qtreactor.install() e.g: ======================== from twisted.web.xmlrpc import Proxy qtreactor.install(app) ========================= fail with the traceback: Traceback (most recent call last): File "qtdemo2.py", line 28, in ? qtreactor.install(app) File "/opt/local_rh90/lib/python2.3/site-packages/twisted/internet/qtreactor.py", line 197, in install installReactor(… [View More]reactor) File "/opt/local_rh90/lib/python2.3/site-packages/twisted/internet/main.py", line 90, in installReactor assert not sys.modules.has_key('twisted.internet.reactor'), \ AssertionError: reactor already installed ==================================== Another demonstration of this problem: ===================== >>> from twisted.web.xmlrpc import Proxy >>> import sys >>> sys.modules.has_key('twisted.internet.reactor') True ========================= internet/main.py, installReactor() needs a more robust test whether a reactor has already been installed, rather than relying on whether twisted.internet.reactor has been imported. The workaround is to move the import statement, but this isn't always a clean solution. -- Joe VanAndel National Center for Atmospheric Research http://www.atd.ucar.edu/~vanandel/ Internet: vanandel at ucar dot edu # Twisted, the Framework of Your Internet # Copyright (C) 2001 Matthew W. Lefkowitz # # This library is free software; you can redistribute it and/or # modify it under the terms of version 2.1 of the GNU Lesser General Public # License as published by the Free Software Foundation. # # This library is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU # Lesser General Public License for more details. # # You should have received a copy of the GNU Lesser General Public # License along with this library; if not, write to the Free Software # Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA """Qt demo. Fetch a URL's contents. """ import sys, urlparse from qt import * from twisted.internet import qtreactor, protocol from twisted.web.xmlrpc import Proxy app = QApplication([]) qtreactor.install(app) from twisted.protocols import http class TwistzillaClient(http.HTTPClient): def __init__(self, edit, urls): self.urls = urls self.edit = edit def connectionMade(self): print 'Connected.' self.sendCommand('GET', self.urls[2]) self.sendHeader('Host', '%s:%d' % (self.urls[0], self.urls[1]) ) self.sendHeader('User-Agent', 'Twistzilla') self.endHeaders() def handleResponse(self, data): print 'Got response.' self.edit.setText(data) class TwistzillaWindow(QMainWindow): def __init__(self, *args): QMainWindow.__init__(self, *args) self.setCaption("Twistzilla") vbox = QVBox(self) vbox.setMargin(2) vbox.setSpacing(3) hbox = QHBox(vbox) label = QLabel("Address: ", hbox) self.line = QLineEdit("http://www.twistedmatrix.com/", hbox) self.connect(self.line, SIGNAL('returnPressed()'), self.fetchURL) self.edit = QMultiLineEdit(vbox) self.edit.setEdited(0) self.setCentralWidget(vbox) def fetchURL(self): u = urlparse.urlparse(str(self.line.text())) pos = u[1].find(':') if pos == -1: host, port = u[1], 80 else: host, port = u[1][:pos], int(u[1][pos+1:]) if u[2] == '': file = '/' else: file = u[2] print 'Connecting to.' from twisted.internet import reactor protocol.ClientCreator(reactor, TwistzillaClient, self.edit, (host, port, file)).connectTCP(host, port) def main(): """Run application.""" # hook up Qt application to Twisted from twisted.internet import reactor win = TwistzillaWindow() win.show() # make sure stopping twisted event also shuts down QT reactor.addSystemEventTrigger('after', 'shutdown', app.quit ) # shutdown twisted when window is closed app.connect(app, SIGNAL("lastWindowClosed()"), reactor.stop) reactor.run() if __name__ == '__main__': main() [View Less]

3 2

[Twisted-Python] mounting a twisted server
by stephan Dec. 2, 2003

Dec. 2, 2003

I have written a custom file system in python which I use in conjunction with twisted and its http protocol. So, as far as browsers are concerned i am fine. what I would like to do next is to serve my file system in some form so that it could be mounted on a client machine. The idea is that 'web enabled objects' can be directly edited in a certain app. NFS or samba would conceptionally work but does not seem to be supported by twisted and seems to be overkill anyways. Does anybody have … [View More]

4 4