Mailman 3 July 2005 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz Aug. 5, 2021

Aug. 5, 2021

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |… [View More]

4 5

[Twisted-Python] Get IP of connecting client in XMLRPC server
by Remy C. Cool April 28, 2013

April 28, 2013

Hello, On 18 May 2004, the following message was posted to this mailinglist: Jp Calderone exarkun at divmod.com wrote: >Daniel Newton wrote: > > I have a simple XML-PRC server similar to the example below: > > from twisted.web import xmlrpc, server > > class Example(xmlrpc.XMLRPC): > """An example object to be published.""" > > def xmlrpc_add(self, a, b): > """Return sum of arguments.""" > return a + b def … [View More]

3 3

[Twisted-Python] Problem: spawnProcess() never ending when installSignalHandlers=False
by Matt Feifarek Feb. 3, 2007

Feb. 3, 2007

Hello. I'm using Twisted 1.3.0 on python2.4 on an Ubuntu-Hoary x86 Linux box. I'm using twisted and spawnProcess() with a Queue structure to chain processes that need to be called (specifically, imagemagick commands). I use the "processEnded" event/method of t.i.p.ProcessProtocol to go from one task to the next. Twisted shares a python process with a multi-threaded web-app-kit (Webware) so it has to be run in a thread. This worked well on other older versions of twisted and older versions of … [View More]

6 14

[Twisted-Python] Traceback from pb-Server
by Stephan Popp Sept. 6, 2005

Sept. 6, 2005

Hi, Please excuse my bad english, I hope you will understand what I mean, otherwise feel free to ask. I'm trying to get error messages from my server. I'm using twisted 2.0.0 with python 2.4. The server looks like this: from twisted.spread import pb from twisted.internet import reactor, threads class ServerObject(pb.Root): #...some other methods, which aren't involved... def remote_fitness(self, task, taskDescription, serverID): return threads.deferToThread(self.calc, task, serverID, … [View More]

6 6

[Twisted-Python] Errors after upgrading to 2.0.1
by snacktime July 31, 2005

July 31, 2005

I'm testing out an application I wrote in 1.3. In 2.0.1 I get a warning and an exception. The UserWarning about SSL I looked up on the list and I understand why it's there, although I think it's a bad idea. The warning is about a bug in pyopenssl that hasn't been fixed in pyopenssl. In addition there is no reason to think it will ever be fixed after being ignored for this long. Maybe someone could find a better solution for this warning other then leaving it to end user to find the patch … [View More]on the mailing list, which for all I know might not even work at this point. Maybe put up a patched copy of pyopenssl on twistedmatrix.com? Seems better than having an unmaintained dependancy in twisted. The exception I really have no clue about, maybe someone could point out where the problem is? Code: ---------------------------------------- #!/usr/local/bin/python from OpenSSL import SSL import sys import time from twisted.internet.protocol import ClientFactory from twisted.protocols.basic import LineReceiver from twisted.internet import ssl, reactor from curses.ascii import STX,ETX,FS STX = chr(STX) ETX = chr(ETX) FS = chr(FS) class EchoClient(LineReceiver): end="GoodBye" def connectionMade(self): transaction = self.factory.trans self.sendLine("%s" % transaction) def connectionLost(self, reason): #print 'connection lost (protocol)' reactor.stop() def lineReceived(self, line): print "receive:", line self.transport.loseConnection() class EchoClientFactory(ClientFactory): protocol = EchoClient def clientConnectionFailed(self, connector, reason): print 'connection failed:', reason.getErrorMessage() reactor.stop() def clientConnectionLost(self, connector, reason): #print 'connection lost:', reason.getErrorMessage() reactor.stop() def SetTransaction(self,id,a,b,c,d,e,f,g,h,i,j,k,l): self.trans = STX + id + FS + a + FS + b + FS + c + FS + d + FS + e + FS + f + FS + g + FS + h + FS + i + FS + j + FS + k + FS + l + ETX def GetTransaction(self): return self.trans def main(): factory = EchoClientFactory() factory.SetTransaction('id1','vital','VERIFY','poi2','4111111111111111','05','12','100','123 abc street','98034','','','id1') reactor.connectSSL('localhost', 8000, factory, ssl.ClientContextFactory()) reactor.run() if __name__ == '__main__': main() ----------------------------------------------------------- Output: ------------------------------------------------- receive: id1:APPROVED::TRANSACTION PRESENT:::0000123456789 /usr/local/lib/python2.4/site-packages/twisted/internet/tcp.py:216: UserWarning: SSL connection shutdown possibly unreliable, please upgrade to ver 0.XX "please upgrade to ver 0.XX", category=UserWarning) Traceback (most recent call last): File "./error", line 55, in ? main() File "./error", line 51, in main reactor.run() File "/usr/local/lib/python2.4/site-packages/twisted/internet/posixbase.py", line 199, in run self.mainLoop() File "/usr/local/lib/python2.4/site-packages/twisted/internet/posixbase.py", line 207, in mainLoop self.runUntilCurrent() --- <exception caught here> --- File "/usr/local/lib/python2.4/site-packages/twisted/internet/base.py", line 533, in runUntilCurrent call.func(*call.args, **call.kw) File "/usr/local/lib/python2.4/site-packages/twisted/internet/base.py", line 389, in _continueSystemEvent for callList in sysEvtTriggers[1], sysEvtTriggers[2]: exceptions.TypeError: unsubscriptable object [View Less]

2 2

[Twisted-Python] why insecureJelly
by Stephan Popp July 29, 2005

July 29, 2005

Hi, I want to send objects accross the network and all I get is insecure Jelly. My application looks like this: -folder structure: -dispyte --common --GACrysVUn --baseclasses in common is the declaration of the object which should be send: from dispyte.baseclasses import Task #thats the abstract baseclass from twisted.spread import pb class SimpleTask(Task.Task, pb.Copyable, pb.RemoteCopy): def __init__(self): ... pb.setUnjellyableForClass(SimpleTask, SimpleTask) these objects are … [View More]

1 1

[Twisted-Python] PB checkers bug?
by Steve Freitas July 28, 2005

July 28, 2005

Hi all, I didn't get a reply to my earlier post about inventing mad crazy checkers, so I decided to just use the IUsernamePassword interface, but I'm stuck, because it appears PB won't allow me to use only that interface. If I try, it dies like this: Traceback (most recent call last): Failure: twisted.cred.error.UnhandledCredentials: No checker for twisted.cred.credentials.IUsernameHashedPassword, twisted.spread.pb.IUsernameMD5Password, twisted.spread.interfaces.IJellyable To reproduce the … [View More]

2 2

[Twisted-Python] CPU intensive threads
by Nathaniel Haggard July 28, 2005

July 28, 2005

Is there anything twisted can do about CPU intensive threads? When I run a CPU intensive method via threads.deferToThread it takes all the CPU away and renders the twisted process unresponsive. The perspective broker for example will not make any connections until the CPU intensive methods finish. Is there a way to set the priority of the main part of twisted so that it can run CPU intensive threads and still service connections. Thanks, Nate

5 6

[Twisted-Python] Weekly Bug Summary
by James Y Knight July 27, 2005

July 27, 2005

Bug summary ______________________ Since 2005-07-21 20:48:42.470000: Bugs opened: 7 Bugs closed: 2 Total open bugs: 417 (+5) Urgent: 9 (+0) Bug: 181 (+2) Feature: 150 (+3) Wish: 77 (+0) New / Reopened Bugs ______________________ ==== Bug ==== [WEB] web2 file upload and unit test problems (3 days ago) http://twistedmatrix.com/bugs/issue1127 opened by exarkun win32reactor spawnProcess incorrectly escapes cmd line (4 days ago) CLOSED http://… [View More]

1 0

[Twisted-Python] Getting peer IP address from Perspective Broker
by J French July 26, 2005

July 26, 2005

Is there an accessible method to retrieve a peer's ip address from within pb? I just want to log it. I read the Faq and see how to do it when subclassing protocol i.e.: class MyProtocol(protocol.Protocol): def connectionMade(self): print "connection from", self.transport.getPeer() I'd appreciate it if someone can point me in the right direction. TIA

2 1

[Twisted-Python] communication idioms with Perspective Broker
by Antony Kummel July 26, 2005

July 26, 2005

Hello, I am using Twisted for a distributed application, and currently I am designing the basic objects of the application that will be transferred from process to process via PB. I ran into some conceptual problems, and I wonder if there are either general solutions (patterns, etc.) or Twisted-specific ones, or general ones already adapted to Twisted, etc. Problems: 1. Synchronization of events and state/data changes: I want clients to be able to receive notifications from a server … [View More]when certain events occur. When such events are related to changes in state or data of the server that are also accessible to the user, I want the clients interface for retrieving the data and getting notified of the event to be coherent. Example of the problem: Lets say I have a server that can be in a state of being associated with a user, and that I want the server both to provide notifications to clients when it becomes associated or disassociated with a user, and to provide an isAssociated method that says if it is currently associated or not. If I provide the isAssociated functionality using a remote method call (with a referenceable), and the notification functionality also using a remote method call from the server to the client, then it is possible, for example, for a client to call twice the isAssociated method, and get a different result, without having received the notification (it may simply have not yet arrived), or also it is possible for the client to call isAssociated, receive a notification that the state has changed, and only then get the result from the deferred returned by isAssociated, which reflects the state prior to the change. The solution I came up with is to always expose associated events and data using a single cacheable object, so that when there is a change in state/data that should also make an event fire, the data change is propagated to the remote cache, and the remote cache fires an event locally (at the clients side). This way, the clients representation of the servers state is always coherent. 2. Synchronization of remote commands and remote events/data changes: I want clients to be able to issue commands to a server that make its state or associated data change, and also to have an up-to-date representation of the state or data (and possible events issued by changes in the state/data). The problem is how to synchronize the firing of the deferred returned by the remote method call with the change in the clients representation of the servers state/data (i.e. to make sure that when the deferred fires, the clients representation of the state is coherent with the command, i.e. changed). Presently I have no solution for this, but Im pretty sure that it requires some combination of referenceable and cacheable that will insure one coherent interface to associated data, events and commands. I am thinking to achieve this with a copyable that will contain both a referenceable and a cacheable. 3. Wrapping remote objects for non-online representation. I want to be able to have objects that can be used locally, but may also provide an interface to one or more servers that have to do with the state of the object. Another reason for these wrappers is that I want to be able to pass them freely from process to process, without being dependent on the connection or on a specific server. For example, there could be a User object that may have a username and password, etc. and also an event that fires when the user connects to the system, and a remote method for sending him messages. The username and password may be required by a process regardless of being connected to a server that can provide the other functions (for example, a process may want to display to a user a list of all of the users of the system, but may also not be connected to a presence server that provides the other functionality). I would say that what is needed is an anti-Avatar an object that represents some hyper-service entity that may be connected to servers that enable some of its functions and may also not. The question is, how to represent this to the user of the object. Whether to allow access to cached remote data and subscription to events when not online, whether to return a deferred and try to connect in case we dont have the data or throw an exception, etc. I suppose this is mostly a matter of style, but if anyone has done something like this before maybe they would have some insight Cheers, Antony Kummel __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com [View Less]

2 3

[Twisted-Python] Re: [Twisted-commits] r14219 - Add LowLevel HTTP Client code (based on the OSAF zanshin), with support for Basic and Digest authentication. Documentations and unittests to come.
by Jp Calderone July 25, 2005

July 25, 2005

On Mon, 25 Jul 2005 14:02:51 -0600, David Reid <dreid(a)wolfwood.twistedmatrix.com> wrote: >Author: dreid >Date: Mon Jul 25 14:02:50 2005 >New Revision: 14219 > >Added: > trunk/twisted/web2/client/ > trunk/twisted/web2/client/__init__.py > trunk/twisted/web2/client/auth.py > trunk/twisted/web2/client/http.py >Modified: > trunk/twisted/web2/http_headers.py >Log: >Add LowLevel HTTP Client code (based on the OSAF zanshin), with support for … [View More]

1 0

[Twisted-Python] Defgen explanation
by Paolino July 23, 2005

July 23, 2005

Hello all, I have the next running script which cause me some questions. I thought deferredGenerators tech could be easily reconverted to Deferreds ,but I'm having no success in doing it on the piece of code in Indexer.do method. Particularly if I substitute the generator with DeferredList([indexing() for indexing in indexings]).addCallback(self.do) I fall in recursion.But the rescheduling has to happen really at the end of the indexing. I think I miss something :( Thanks for help … [View More]

1 0

[Twisted-Python] listen to a process and react to events
by Daniel Isenegger July 23, 2005

July 23, 2005

Hi, is it possible within the TwistedMatrix framework to listen to processes (e.g. running on local HDs) like you can listen to a port? For example, i have a GUI firing events. Now i want to listen from twistedmatrix to this process, catch the output of the process and process them. can anybody provide me a code example? A somehow similar example is quotes.py from the TwistedMatrix Homepage howto's (http://twistedmatrix.com/projects/core/documentation/howto/process.html). But (as i … [View More]

1 0

[Twisted-Python] PB: New credentials checker?
by Steve Freitas July 23, 2005

July 23, 2005

Hi all, I'm trying to invent my own checkers, with associated credentials, and still use the pbClientFactory's login() function. I saw, however, that the source in pb.py notes that, for now, login() only works with IUsernamePassword: "Currently only credentials implementing IUsernamePassword are supported." (twisted/spread/pb.py, line 1611). So I started by subclassing the pbClientFactory, making my own login() function, and _cbSendUsername() and _cbResponse(), and then as I realized PB is … [View More]

1 0

Re: [Twisted-Python] PB waitingForAnswers KeyError
by Bob Ippolito July 23, 2005

July 23, 2005

On Jul 22, 2005, at 1:32 PM, William Waites wrote: > On Fri, Jul 22, 2005 at 09:19:50AM -1000, Bob Ippolito wrote: > >> >> I expect that you're using TwistedManager incorrectly. There doesn't >> appear to be anything wrong with the code you attached, but it also >> doesn't do anything on its own. >> > > I'm trying to put together a minimal example that is supposed to > work and > doesn't. > > How the bit driven by calls works; the … [View More]

3 4

[Twisted-Python] PB waitingForAnswers KeyError
by William Waites July 22, 2005

July 22, 2005

This is with the Twisted Sumo tar, with threadedselectreactor dropped in: File "/usr/lib/python2.3/site-packages/twisted/internet/threadedselectreactor.py", line 252, in _doReadOrWrite why = getattr(selectable, method)() File "/usr/lib/python2.3/site-packages/twisted/internet/tcp.py", line 351, in doRead return self.protocol.dataReceived(data) File "/usr/lib/python2.3/site-packages/twisted/spread/banana.py", line 184, in dataReceived … [View More]

2 1

[Twisted-Python] Weekly Bug Summary
by James Y Knight July 21, 2005

July 21, 2005

Bug summary ______________________ Since 2005-07-12 14:40:23.400000: Bugs opened: 15 Bugs closed: 4 Total open bugs: 412 (+11) Urgent: 9 (+0) Bug: 179 (+8) Feature: 147 (+3) Wish: 77 (+0) New / Reopened Bugs ______________________ ==== Bug ==== [WEB] twisted.web.proxy doesn't reverse-map redirects like ProxyPassReverse (6 days ago) http://twistedmatrix.com/bugs/issue1109 opened by kragen OS-X vs PTYProcess, OSError vs IOError (yesterday) … [View More]

1 0

[Twisted-Python] timers
by Andrzej Leszczynski July 21, 2005

July 21, 2005

Hi folks, short question, I implement a very custom statefull protocol which need to have some timers in it. Can someone point me to examples how to do that? A.

4 7

[Twisted-Python] subclassing and class methods returning deferreds
by Thomas Vander Stichele July 21, 2005

July 21, 2005

Hi, I wanted to have a class hierarchy where .stop methods would make sure everything is cleaned up properly before reactors get stopped and such. The obvious way to do that was to return a deferred that gets fired when everything else is done, and make sure that deferred is handled correctly everywhere. So I wrote up an example that does this: http://thomas.apestaart.org/download/tmp/subclass-deferred.py I'd appreciate it if someone who's interested would take a look at it to suggest some … [View More]

2 2

[Twisted-Python] spawnProcess and deferreds
by Nathaniel Haggard July 20, 2005

July 20, 2005

I would like to spawn seperate processes from the methods program. What's the equivalent of spawnProcess for internal functions? Is it twisted threads? Nate

1 0

[Twisted-Python] how to invoke an action in twisted matrix from a process
by Daniel Isenegger July 20, 2005

July 20, 2005

Hi, a newby question: i try to invoke an action in a twisted matrix program from a process running on my machine: for example: i start a program (test.py), which generates output. test.py should call the twisted matrix program (which is already running and waiting for input) and hand over its output to the twisted matrix program. to do this i examined the examples process.py and quotes.py (on the HOWTO pages of the twisted matrix homepage). quotes.py seems to be an example which is quite … [View More]

1 0

[Twisted-Python] protocol.Protocol and transport.write
by Michele Petrazzo July 19, 2005

July 19, 2005

I have a very simple application that try to open a connection on a port on the local computer and if it has no program listening, it execute a program file, else if it find a answer program, it send a string ( about 50/80 characters ). After the upgrade to 2.0.x, it don't want to work well, because if it has no response, it open the program correctly, but if it has response, it send the message, but the message don't arrive to the listener. After some tries, I see that into my code, I call … [View More]

2 1

[Twisted-Python] question about twisted conch (SSH) and wxPython
by Astan Chee July 19, 2005

July 19, 2005

Hi Guys, Im trying to make a psudo SSH client GUI, but it seems that I although I can 'ls' to a remote machine using twisted.conch, I cant `ls -al`. Also I cant seem to to ssh commands that have spaces in them. Although Im using a windows environment to SSH, i dont think that is the problem. Here is a snippet of my code. Obviously I've already called reactor.run() and included appropriate modules and variables. I dont understand why ls works and ls -al doesnt. Also I was wondering if there … [View More] are any existing command line SSH clients written with twisted similar to putty, but written in python. Thanks! class SimpleTransport(transport.SSHClientTransport): def verifyHostKey(self, hostKey, fingerprint): print 'host key fingerprint: %s' % fingerprint return defer.succeed(1) def connectionSecure(self): self.requestService( SimpleUserAuth(USER, SimpleConnection())) class SimpleUserAuth(userauth.SSHUserAuthClient): def getPassword(self): return defer.succeed(PASSWORD) def getGenericAnswers(self, name, instruction, questions): print 'Name %s' % name print 'Instruction %s' % instruction answers = [] for prompt, echo in questions: if echo: answer = raw_input(prompt) else: answer = getpass.getpass(prompt) answers.append(answer) return defer.succeed(answers) def getPublicKey(self): path = os.path.expanduser('~/.ssh/id_dsa') # this works with rsa too # just change the name here and in getPrivateKey if not os.path.exists(path) or self.lastPublicKey: # the file doesn't exist, or we've tried a public key return return keys.getPublicKeyString(path+'.pub') def getPrivateKey(self): path = os.path.expanduser('~/.ssh/id_dsa') return defer.succeed(keys.getPrivateKeyObject(path)) class SimpleConnection(connection.SSHConnection): def serviceStarted(self): self.openChannel(TrueChannel(2**16, 2**15, self)) self.openChannel(FalseChannel(2**16, 2**15, self)) self.openChannel(LsChannel(2**16, 2**15, self)) class TrueChannel(channel.SSHChannel): name = 'session' # needed for commands def openFailed(self, reason): print 'true failed', reason def channelOpen(self, ignoredData): self.conn.sendRequest(self, 'exec', common.NS('true')) def request_exit_status(self, data): status = struct.unpack('>L', data)[0] #print 'true status was: %s' % status self.loseConnection() class FalseChannel(channel.SSHChannel): name = 'session' def openFailed(self, reason): print 'false failed', reason def channelOpen(self, ignoredData): self.conn.sendRequest(self, 'exec', common.NS('false')) def request_exit_status(self, data): status = struct.unpack('>L', data)[0] #print 'false status was: %s' % status self.loseConnection() class LsChannel(channel.SSHChannel): name = 'session' def openFailed(self, reason): print 'false failed', reason def channelOpen(self, ignoredData): self.conn.sendRequest(self, 'exec', common.NS('ls -al')) self.data = '' def dataReceived(self, data): self.data += data def closed(self): print 'got data from ls: %s' % repr(self.data) self.loseConnection() reactor.stop() class CatChannel(channel.SSHChannel): name = 'session' def openFailed(self, reason): print 'echo failed', reason def channelOpen(self, ignoredData): self.data = '' d = self.conn.sendRequest(self, 'exec', common.NS('cat'), wantReply = 1) d.addCallback(self._cbRequest) def _cbRequest(self, ignored): self.write('hello conch\n') self.conn.sendEOF(self) def dataReceived(self, data): self.data += data def closed(self): print 'got data from cat: %s' % repr(self.data) self.loseConnection() [View Less]

6 8

[Twisted-Python] High Level Twisted Question [Multiple Protocol Usage]
by J French July 19, 2005

July 19, 2005

I'm working with Twisted and getting my head around it but I still have some general paradigm questions. When using Twisted to create an application to run under twistd, is it possible to implement more than one protocol? For instance, If I write a server which uses PB to interface with its python client, can I then also check pop3 boxes from the same application / twistd process? Put another way: When incorporating functionality into a server app requiring multiple protocols (PB, SMTP, HTTP,… [View More]

3 2