Mailman 3 September 2001 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz Aug. 5, 2021

Aug. 5, 2021

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |… [View More]

4 5

[Twisted-Python] Questions about twisted.python.delay.Delayed
by Matt Campbell Sept. 30, 2001

Sept. 30, 2001

Hello, I'm a relatively new user of Twisted (started using it in late August to write a custom server), and I have a few questions about the twisted.python.delay.Delayed class. 1. Why does Delayed measure time in units of five-second ticks by default? 2. Why is Delayed.run() called every five seconds or so even when there are no delayed tasks scheduled? Wouldn't the process's CPU usage be slightly lower if Delayed.timeout() returned None when the queue is empty? 3. What is the … [View More]

3 2

[Twisted-Python] NBIO: Java Non-blocking I/O Library
by Itamar Shtull-Trauring Sept. 30, 2001

Sept. 30, 2001

<http://www.cs.berkeley.edu/~mdw/proj/java-nbio/#copyright>

3 2

[Twisted-Python] Two Zope proposals that may be relevant someday
by Itamar Shtull-Trauring Sept. 30, 2001

Sept. 30, 2001

http://dev.zope.org/Wikis/DevSite/Proposals/ToleratingHangsAndLeaks http://dev.zope.org/Wikis/DevSite/Proposals/ExtendedForensicLogging

1 0

[Twisted-Python] Earthweb Networking and Communications: Java: Simulating select() in Java
by Itamar Shtull-Trauring Sept. 30, 2001

Sept. 30, 2001

<http://softwaredev.earthweb.com/java/article/0,,12082_626271,00.html>

1 0

[Twisted-Python] Hacking Reality
by Jason L. Asbahr Sept. 30, 2001

Sept. 30, 2001

Greetings, Twisted folks, As Chris mentioned, Reality is about to undergo some refactoring. If you are interested in this process, drop a line. Perhaps a new reality-dev list at twistedmatrix.com is in order. For those of you I haven't met yet, I'm a game developer and serious Python addict. I've committed a large portion of my adult life working toward the growth and development of virtual worlds. My current project is the culmination of many years of work. The specific game design … [View More]I'm working on is called "Netsu" (which is Japanese for "heat" or "fever"). It's an anime-inspired world which incorporates multiple perspectives of play and a reputation network for players to self-organize. It's going to be fun. :-) As I develop use cases and other design documentation for Netsu, I intend to keep them as portable as possible between gaming systems, so that they can benefit the most people. I anticipate this work feeding back into Twisted Reality, expanding it to be a more general simulation framework. And now a little history... The genesis of the project began with my work on virtual reality systems in the early 90's. I developed virtual building walkthroughs for architects, VR games, and created the first hardware accelerated PC-based virtual actor system for Compaq. This work was all done with C and C++, and it was during this period that I realized the need for a dynamic and interactive way to "reach inside" the simulation and manipulate it. And that's how I first became acquainted with Python. :-) The next major phase was to build a 3D client engine with Python embedded as a control language. The fruits of that effort are described in the paper I presented at Python 7, "Beyond: A Portable Virtual World Simulation Framework". (This was also the first mention of 'Netsu'.) In 1998, the next phase of development took a turn when I was recruited into Origin Systems to work on developing the Python foundation for the Ultima Online 2 project. The focus during the period was on innovation on the server side and on client-server communication. The results of that labor are described in another paper presented at Python 9, "Python for Massively Multiplayer Virtual Worlds". [ Both papers at: http://www.asbahr.com/papers.html ] To this point, the software developed was all closed source. The desire for an open source virtual world system was lurking in my head, but it wasn't until the O'Reilly Open Source conference in 2000 that my plan for the open source virtual world crystallized. [ The notes made during that period have evolved into the Linux Journal article which I'll share with you shortly. ] At the 2001 O'Reilly conference, while presenting on the UO2 design work, I took the opportunity to discuss my plans for the future open source virtual world system. The response was extremely positive, which included the invitation to write the LJ article on the subject. :-) Currently, I'm working on combining a number of existing open source technologies to build the new virtual world system. These include the 'Nebula Device' 3D engine from Germany on the client side, the Twisted framework for server-side and client-server communication, and the OpenCyc knowledge base as server-side archetype repository and artificial intelligence server. Glyph and I have been meeting periodically over the last few months to discuss these issues, which intersect nicely with his long term plans for gaming. I've also been meeting with the Cycorp folks (who happen to be just down the road from me) to discuss integrating Cyc and driving Python class generation from Cyc. I'm in the process of integrating Python into the Nebula Device, which will be quickly followed by integrating PB and making Nebula one of the first 3D clients for Twisted. (Yay!) Recently, Chris and I began to share some thoughts. As I mentioned to him, after I wrap up my current consulting project (porting Python to the Playstation 2 and developing a GUI for designers to build Python logic), I'm devoting 100% of my time to Netsu and open source development. I am committed to delivering the next generation open source virtual world framework for gaming, education, simulation, and training. It is my hope that this collaborative approach for virtual world simulation grows, spreading the Twisted word and providing a foundation to help other developers achieve their own goals. Join us! :-) Cheers, Jason [View Less]

1 0

[Twisted-Python] Curses
by Moshe Zadka Sept. 29, 2001

Sept. 29, 2001

As the last living dinosaur, I've written a curses module: it's at http://moshez.org/tcurses.py Here is an example usage program: >---------------------------------------------< from twisted.internet import main from twisted.python import delay, log import tcurses import curses log.startLogging(open("twistd.log", "ab+")) screen = tcurses.Screen() protocol = tcurses.WindowProtocol() window = tcurses.LineInput(15, 0, 79) protocol.addWindow(window) screen.setProtocol(protocol) app = … [View More]

1 0

[Twisted-Python] Roxen Community: RFC 3091 Pi Digit Generation Protocol (Informational)
by Itamar Shtull-Trauring Sept. 29, 2001

Sept. 29, 2001

We have *got* to support this protocol: <http://community.roxen.com/developers/idocs/rfc/rfc3091.html>

4 5

[Twisted-Python] This is Reality: The Next Generation.
by Chris Armstrong Sept. 28, 2001

Sept. 28, 2001

Hello, all. Jason Asbahr and I have been collaborating and discussing simulation systems, especially (my interest) a spatial/graphical MMPG system. We've decided the best route to follow right now is to refactor twisted.reality into a Simulation Base and a Text Simulation. We will also create a Spatial Simulation down the road. All of you who are interested in Reality should be perking your ears up right now =). Reality's been stagnant for a while, not seeing any real development, until now. … [View More]

1 0

[Twisted-Python] Bug tracker is now live
by Itamar Shtull-Trauring Sept. 28, 2001

Sept. 28, 2001

http://twistedmatrix.com:9080/twisted/ Email me or glyph with a password (and an informative topic so we know what you're talking about) and we'll set you up an account.

5 8

[Twisted-Python] connectionLost patch
by Chris Armstrong Sept. 27, 2001

Sept. 27, 2001

I patched connectionLost in server.request to call 'connectionLost' on resources if they have it. This is not a very good patch, and a bad solution, I think, but redoz wanted it for some functionality he needed in a streaming chat web thingy. Any ideas on a better solution for disconnect notification? should this just stay a third party feature?

1 1

[Twisted-Python] System Plugings
by Moshe Zadka Sept. 27, 2001

Sept. 27, 2001

I object to placing plugins/ as a sibling for twisted/ - these should be in something like /usr/share/twisted/plugins/. Advice for a way to have the Debian installation append this directory to the Python page in addDir will be met with thanks. -- The Official Moshe Zadka FAQ: http://moshez.geek The Official Moshe Zadka FAQ For Dummies: http://moshez.org Read the FAQ

4 4

[Twisted-Python] Anon CVS
by Itamar Shtull-Trauring Sept. 26, 2001

Sept. 26, 2001

A few days ago glyph gave in and said he'd set up anonymous CVS and that viewcvs could be setup. So bug him till he does :)

1 0

[Twisted-Python] This might be interesting
by Itamar Shtull-Trauring Sept. 26, 2001

Sept. 26, 2001

<http://web.lfw.org/python/delegate.py>

1 0

[Twisted-Python] Re: [Twisted-commits] CVS: Twisted/twisted/test test_protocols.py,1.6,1.7
by Moshe Zadka Sept. 26, 2001

Sept. 26, 2001

On Tue, 25 Sep 2001, Itamar Shtull-Trauring <itamarst(a)twistedmatrix.com> wrote: > + assert r.brokenPeer, "connection wasn't closed on illegal netstring %s" % repr(s) Itamar, and everybody: STOP DOING THAT!!!!!!!!!!!!!!!!!!!!!!!! Don't use "assert" in tests, since they don't operate under python -O. Someday, we'll want to test it working ok with -O. (say, if there is some less-then-trivial code undef "if __debug__".) -- The Official Moshe Zadka FAQ: http://moshez.geek … [View More]

4 5

[Twisted-Python] Blocking
by Moshe Zadka Sept. 26, 2001

Sept. 26, 2001

Hi! I whipped up the following to help regular client applications use pb even if they are written in a linear manner. class _Blocker: callbackName = 'callback' errbackName = 'errback' def __init__(self, method, args, kw): self.method = method self.args = args self.kw = kw def callback(self, value): self.state = 1 self.value = value main.shutDown() def errback(self, value=None): self.state = 0 self.value = value main.shutDown() … [View More]

1 0

[Twisted-Python] Seperate Out pb.Broker.expressionReceived
by Moshe Zadka Sept. 25, 2001

Sept. 25, 2001

Can pb.Broker inherit from pb.Protocol which will inherit from banana.Banana? I want to use just the proto_ stuff without out all the authorizer stuff in the way. Currently, I'll just copy. -- The Official Moshe Zadka FAQ: http://moshez.geek The Official Moshe Zadka FAQ For Dummies: http://moshez.org Read the FAQ

1 0

[Twisted-Python] Protocol handler are open to DoS attacks
by Itamar Shtull-Trauring Sept. 25, 2001

Sept. 25, 2001

In general, I've been noticing that the behaviour of protocol given illegal inputs is problematic - no length limits, and garbage is raised as part of exceptions. Problem 1 leads to giant memory usage - a line receiver can receive MBs of MBs of data it will happily buffer until it gets a line break. The other problem leads to mucho garbage and exceptions in the log. See protocols.basic.SafeNetstringReceiver to see how I solved it for netstrings. You can test both things in unix - run a … [View More]

1 0

[Twisted-Python] Naming of Names
by Moshe Zadka Sept. 25, 2001

Sept. 25, 2001

Hi! I've written the following cool module to help with unit testing and other beasts. I really want to check it in, but I want to make sure I don't offend anyone's sensibilities. For me, this name is both natural and descriptive, but... (it already found two bugs in the SMTP module, by the way) >--------------------------------------< class MasturbatoryRelay: buffer = '' shouldLose = 0 log = '' def __init__(self, target): self.target = target def write(… [View More]

1 0

[Twisted-Python] twisted.mail.pb
by Moshe Zadka Sept. 24, 2001

Sept. 24, 2001

This pre-alpha module is where I'm trying to develop something that will replace IMAP over pb -- The Official Moshe Zadka FAQ: http://moshez.geek The Official Moshe Zadka FAQ For Dummies: http://moshez.org Read the FAQ

1 0

[Twisted-Python] twisted.web inflexibility
by Moshe Zadka Sept. 24, 2001

Sept. 24, 2001

Would it be possible to have Site not overload buildProtocol and instead just have the regular "protocol" attribute? This way, it is possible to change an instance's "protocol" attribute to change the HTTP request object. -- The Official Moshe Zadka FAQ: http://moshez.geek The Official Moshe Zadka FAQ For Dummies: http://moshez.org Read the FAQ

1 0

[Twisted-Python] Authorizers
by Moshe Zadka Sept. 24, 2001

Sept. 24, 2001

Why is there only one authorizer per application? I want to have an authorizer which is Factory-specific. Rational: Suppose you have a pb-mail toaster (like POP toaster, except users get e-mail via pb instead of POP). The "identities" for each port might be different, since they might be for different domains. I want "identities" to correspond to "users" and "perspectives" to correspond to different top-level directories (you'd have the "inbox" perspective, the "saved-messages" perspective, etc.… [View More]

2 2

[Twisted-Python] Proposed change to producer/consumer interface
by Itamar Shtull-Trauring Sept. 24, 2001

Sept. 24, 2001

When a producer unregisters itself using stopConsuming() (see internet/abstract.py) the consumer closes itself by calling loseConnection(). I contend this is silly, and that the consuming FileDescriptor should not close itself. This is howeever a non-backwards compatible change, so anyone using producers will need to update their code (though e.g. the FTP code seems to explicitly close the consumer.) So - should I make this change or add a new function "unregisterProducer()" the … [View More]

1 0

[Twisted-Python] Newest Resolver Patch
by Moshe Zadka Sept. 24, 2001

Sept. 24, 2001

It seems to work, but I'd like people to play with this a bit more. Note that mktap's default is the native resolver, but the transparent upgrade is to DummyResolver, which cannot resolve at all. Index: bin/mktap =================================================================== RCS file: /cvs/Twisted/bin/mktap,v retrieving revision 1.9 diff -u -r1.9 mktap --- bin/mktap 2001/08/25 07:16:13 1.9 +++ bin/mktap 2001/09/24 05:36:05 @@ -40,6 +40,7 @@ from twisted.protocols import telnet from … [View More]twisted.internet import main,tcp +from twisted.names import native from twisted.python import usage import sys, traceback, os, cPickle @@ -90,6 +91,7 @@ if not options.append: a = main.Application(options.args[0], int(options.uid), int(options.gid)) + a.resolver = native.Resolver() else: a = cPickle.load(open(options.append)) for num, proto in mod.getPorts(a, config): Index: twisted/internet/abstract.py =================================================================== RCS file: /cvs/Twisted/twisted/internet/abstract.py,v retrieving revision 1.5 diff -u -r1.5 abstract.py --- twisted/internet/abstract.py 2001/08/20 04:15:35 1.5 +++ twisted/internet/abstract.py 2001/09/24 05:36:05 @@ -17,7 +17,7 @@ # System Imports -import types +import types, string # Twisted Imports from twisted.python import threadable, log @@ -237,6 +237,19 @@ raise NotImplementedError(str(self.__class__)+' has no fileno method') + +def isIPAddress(addr): + parts = string.split(addr, '.') + if len(parts) == 4: + try: + for part in map(int, parts): + if not (0<=part<256): + break + else: + return 1 + except ValueError: + pass + return 0 # Sibling Imports import main Index: twisted/internet/main.py =================================================================== RCS file: /cvs/Twisted/twisted/internet/main.py,v retrieving revision 1.27 diff -u -r1.27 main.py --- twisted/internet/main.py 2001/09/19 12:18:09 1.27 +++ twisted/internet/main.py 2001/09/24 05:46:21 @@ -50,9 +50,13 @@ if os.name == "posix": self.uid = uid or os.getuid() self.gid = gid or os.getgid() + self.resolver = DummyResolver() - persistentVersion = 1 + persistentVersion = 2 + def upgradeToVersion2(self): + self.resolver = DummyResolver() + def upgradeToVersion1(self): """Version 1 Persistence Upgrade """ @@ -161,6 +165,7 @@ def run(self, save=1): """Run this application, running the main loop if necessary. """ + global resolver if not self.running: threadable.dispatcher.own(self) delayeds.extend(self.delayeds) @@ -174,6 +179,7 @@ return for service in self.services.values(): service.startService() + resolver = self.resolver self.running = 1 threadable.dispatcher.disown(self) if not running: @@ -192,6 +198,11 @@ """ theTimeouts.later(method, seconds) +class DummyResolver: + + def resolve(self, address, success, fail): + fail() + reads = {} writes = {} running = None @@ -199,6 +210,7 @@ if threadable.threaded: delayeds.append(threadtask.theScheduler) shutdowns = [theTimeouts.runEverything] +resolver = DummyResolver() def shutDown(a=None, b=None): """Run all shutdown callbacks (save all running Applications) and exit. @@ -523,6 +535,7 @@ # currentPlugins = os.path.abspath("TwistedPlugins") allPlugins = [systemPlugins, userPlugins, confPlugins] #, currentPlugins] sys.path.extend(allPlugins) + # Sibling Import import process Index: twisted/internet/tcp.py =================================================================== RCS file: /cvs/Twisted/twisted/internet/tcp.py,v retrieving revision 1.22 diff -u -r1.22 tcp.py --- twisted/internet/tcp.py 2001/09/11 04:08:28 1.22 +++ twisted/internet/tcp.py 2001/09/24 05:46:21 @@ -28,6 +28,7 @@ import socket import sys import traceback +import string if os.name == 'nt': EWOULDBLOCK = 10035 @@ -49,7 +50,7 @@ # Sibling Imports import abstract -from main import CONNECTION_LOST, CONNECTION_DONE +import main class Connection(abstract.FileDescriptor, protocol.Transport, @@ -79,9 +80,9 @@ if se.args[0] == EWOULDBLOCK: return else: - return CONNECTION_LOST + return main.CONNECTION_LOST if not data: - return CONNECTION_LOST + return main.CONNECTION_LOST return self.protocol.dataReceived(data) def writeSomeData(self, data): @@ -95,7 +96,7 @@ except socket.error, se: if se.args[0] == EWOULDBLOCK: return 0 - return CONNECTION_LOST + return main.CONNECTION_LOST def connectionLost(self): """See abstract.FileDescriptor.connectionLost(). @@ -145,7 +146,7 @@ self.port = port Connection.__init__(self, skt, protocol) self.doWrite = self.doConnect - self.doConnect() + self.resolveAddress() self.logstr = self.protocol.__class__.__name__+",client" if timeout is not None: main.addTimeout(self.failIfNotConnected, timeout) @@ -161,13 +162,24 @@ # factored out so as to minimise the code necessary for SecureClient return socket.socket(socket.AF_INET,socket.SOCK_STREAM) + def resolveAddress(self): + if abstract.isIPAddress(self.addr[0]): + self.setRealdAddress(self.addr[0]) + else: + main.resolver.resolve(self.addr[0], self.setRealAddress, + self.failIfNotConnected) + + def setRealAddress(self, address): + self.realAddress = address + self.doConnect() + def doConnect(self): """I connect the socket. Then, call the protocol's makeConnection, and start waiting for data. """ try: - self.socket.connect(self.addr) + self.socket.connect((self.realAddress, self.addr[1])) except socket.error, se: if se.args[0] == EMYSTERY: self.startWriting() Index: twisted/internet/udp.py =================================================================== RCS file: /cvs/Twisted/twisted/internet/udp.py,v retrieving revision 1.4 diff -u -r1.4 udp.py --- twisted/internet/udp.py 2001/09/23 01:44:48 1.4 +++ twisted/internet/udp.py 2001/09/24 05:46:23 @@ -35,8 +35,7 @@ from twisted.python import log # Sibling Imports -import abstract -from main import CONNECTION_LOST, CONNECTION_DONE +import abstract, main class Connection(abstract.FileDescriptor, @@ -61,12 +60,26 @@ self.local = local self.sessionno = sessionno self.connected = 1 - self.logstr = "%s,%s,%s (UDP)" % (self.protocol.__class__.__name__, sessionno, self.remote[0]) + self.logstr = "%s,%s,%s (UDP)" % (self.protocol.__class__.__name__, + sessionno, self.remote[0]) + if abstract.isIPAddress(self.remote[0]): + self.realAddress = self.remote[0] + else: + self.realAddress = None + main.resolver.resolve(self.remote[0], self.setRealAddress, + self.connectionLost) + + + def setRealAddress(self, address): + self.realAddress = address + self.startWriting() def write(self,data): res = abstract.FileDescriptor.write(self,data) if not self.keepConnection: self.loseConnection() + if self.realAddress is None: + self.stopWriting() return res def writeSomeData(self, data): @@ -81,7 +94,7 @@ except socket.error, se: if se.args[0] == EWOULDBLOCK: return 0 - return CONNECTION_LOST + return main.CONNECTION_LOST else: return 0 @@ -171,14 +184,11 @@ def createConnection(self, addr): """Creates a virtual connection over UDP""" - try: - protocol = self.factory.buildProtocol(addr) - s = self.sessionno - self.sessionno = s+1 - transport = Connection(self.socket.dup(), protocol, addr, self, s) - protocol.makeConnection(transport, self) - except: - traceback.print_exc(file=log.logfile) + protocol = self.factory.buildProtocol(addr) + s = self.sessionno + self.sessionno = s+1 + transport = Connection(self.socket.dup(), protocol, addr, self, s) + protocol.makeConnection(transport, self) return transport def doRead(self): -- The Official Moshe Zadka FAQ: http://moshez.geek The Official Moshe Zadka FAQ For Dummies: http://moshez.org Read the FAQ [View Less]

1 0

[Twisted-Python] Release Procedure, Patches and Bugs, oh my!
by Moshe Zadka Sept. 23, 2001

Sept. 23, 2001

We have about 20 items in the TODO file, we have loads of patches, and I have a suspicion we are not reporting bugs well enough because it's too frustrating. I suggest using some kind of bug tracking system. I suggest roundup, but please don't fight about this -- anything is better then nothing. Thanks. -- The Official Moshe Zadka FAQ: http://moshez.geek The Official Moshe Zadka FAQ For Dummies: http://moshez.org Read the FAQ

3 3