Mailman 3 September 2006 - Twisted

[Twisted-Python] LineReceiver and setRawMode()
by jarrod roberson 07 Sep '06

07 Sep '06

I got a simple line protocol I am trying to implement, blocks . CMD <byte count>\r\n <payload> when CMD 5\r\n is received, I setRawMode() and then inside of rawDataReceived() handle the blob the problem is when my client sends the data and the next CMD line gets eaten by the rawDataReceived() call before I can set it back to lineMode(). so for something like CMD 5\r\n abcde CMD 10\r\n abcdefghij after I get CMD 5\r\n setRawMode() inside rawDataReceived(data) data = abcdeCMD 10\r\n is there something in twisted that will help with this? or do I need to subclass LineReceiver and add a setRawMode(bytesToRead) or something?

3 2

Re: [Python-Dev] [Twisted-Python] Newbie question
by Timothy Fitz 07 Sep '06

07 Sep '06

On 9/7/06, Jean-Paul Calderone <exarkun(a)divmod.com> wrote: > One could just as easily ask why no one bothers to read mailing list > archives to see if their question has been answered before. Is there a technical reason why they can't? If not I'm opening up a bug on it.

1 0

[Twisted-Python] Newbie question
by Stan Benrsteen 07 Sep '06

07 Sep '06

Gentlemen: I am trying to use the twisted perspective broker in a client that repeatedly makes remote calls to a twisted server. I'm running a MAC OS X. I create a client object, which calls reactor.connectTCP(), builds the deferred object to make the remote call, calls reactor.run(). A deferred callback eventually reactor.stop() and returns the correct answer. Now I need to do this again, so I create a new client object, etc., which goes through the same procedure and eventually call reactor.stop (). Again, I get the correct answer from the remote call, but the reactor keeps running. In other words, the statements after the reactor.stop() execute, but the statement after reactor.run() is never reached. The client hangs. What am I overlooking?? -- perplexed

3 2

[Twisted-Python] Multiple client connections
by Stan Benrsteen 06 Sep '06

06 Sep '06

All, I want to write a client that connects to a Twisted Server using pb. I want my client to make several connections. For example: from twisted.spread import pb from twisted.internet import defer from twisted.internet.tcp import Connector from twisted.internet import reactor PORT = 8992 class ModelCalculator: def __init__(self, host, port): self.host = host self.port = port def add(self, a, b): self.factory = pb.PBClientFactory() deferred = self.factory.getRootObject() deferred.addCallback(self.connected, a, b) deferred.addErrback(self.failure) reactor.run() return self.result def connected(self, perspective, a, b): deferred = perspective.callRemote('calculate', a, b) deferred.addCallback(self.success, perspective) deferred.addErrback(self.failure) def success(self, result, perspective): self.result = result self.stopReactor() def failure(self, reason): self.result = None self.stopReactor() def stopReactor(self): reactor.stop() if __name__ == '__main__': calculator = ModelCalculator("127.0.0.1", PORT) print calculator.add(4,5) print calculator.add(14,5) print calculator.add(24,5) print calculator.add(34,5) As you see, I want to add many numbers and print out the result. This doesn't work because the reactor is been stopped in the stopReactor() method that is invoked in either success() or failure (). How can I change it so I can call my remote add() method many times without waiting for the reactor to be stopped? Is there a way that I can use the PB stuff without the reactor? thanks, /amn

2 1

[Twisted-Python] PB auth with LDAP
by Marvin McNett 05 Sep '06

05 Sep '06

Hi, Just noticed that PB's _PortalAuthChallenger implements IUsernameHashedPassword, IUsernameMD5Passwordauth, but not IUsernamePassword. This requires that I store my passwords in plain text or MD5 hash, then fetch the password to do a comparison at login. However, this is inconvenient when storing passwords in LDAP. First, LDAP doesn't like returning passwords (Unless you're requesting it as the database administrator). Second, storing passwords in plain text or even as MD5 hashes is less than ideal. Finally, LDAP already has a comparison operation (which I can do with minimal privileges), so I should never need to actually fetch the password. All this means that it would be very convenient for _PortalAuthChallenger to also implement IUsernamePassword (what's wrong with sending clear text passwords over SSL anyway?). However, it's not clear to me how I'd go about overriding the current behavior. I've tried the naive thing which is, in a separate file: from twisted.cred import credentials from twisted.spread.pb import *" then overriding the _PortalRoot, _PortalWrapper, and _PortalAuthChallenger classes, and registering the alternate adapter. However, the "registerAdapter(_PortalRoot, Portal, IPBRoot)" comes back to bite me with: exceptions.ValueError: an adapter (twisted.spread.pb._PortalRoot) was already registered. unless I comment it out in the actual twisted.spread.pb.py file. Is there a way to unregister an adapter? I'm sure there's a better way of doing this since I've seen mention of writing alternate login sequences, but I haven't been smart enough to figure it out. Any help would be appreciated. Thanks, Marvin

2 2

[Twisted-Python] callLater
by Manlio Perillo 04 Sep '06

04 Sep '06

Hi. I need to implement a function for scheduling function calls at specific times. A simple implementation is: def callAt(when): from twisted.internet import reactor delta = when - datetime.now() delay = delta.days * 24 * 3600 + delta.seconds + delta.microseconds / 1000000. return reactor.callLater(delay) However I'm going to have lots of this scheduled calls, many of these are far away in the future. Can this be a problem? An alternative implementation is to use LoopingCall that, say, every 15 minutes, check the scheduled functions. Here I can think of some optimization, to avoid a linear search. Thanks Manlio Perillo

3 4

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 03 Sep '06

03 Sep '06

Bug summary ______________________ Summary for 2006-08-27 through 2006-09-03 Bugs opened: 38 Bugs closed: 6 Total open bugs: 722 (+32) |== Type Changes |== Priority Changes |== Component Changes |Defect: +18 |Highest: +2 |Conch: +1 |Enhancement: +14 |High: +3 |Core: +15 |Task: +0 |Normal: +25 |Mail: +2 |Low: +2 |Release Management: +1 |Trial: +2 |Web: +2 |Web2: +10 |Words: -1 New / Reopened Bugs ______________________ ===== Highest ===== [#2021] iocpreactor.tcp.ClientSocket should implement ISystemHandle (opened by ghazel) enhancement core http://twistedmatrix.com/trac/ticket/2021 [#2040] SSL echo client example incorrectly stops the reactor multiple times (opened by exarkun) (CLOSED, fixed) defect core http://twistedmatrix.com/trac/ticket/2040 [#2044] twisted.test.test_logfile.testNoPermission failing will break buildbot (opened by jerub) defect core http://twistedmatrix.com/trac/ticket/2044 [#2045] spelling error in _sslverify.OpenSSLCertificateOptions.__getstate__() (opened by dq) defect core http://twistedmatrix.com/trac/ticket/2045 [#2051] test_imap uses deprecated Deferred.setTimeout (opened by exarkun) enhancement mail http://twistedmatrix.com/trac/ticket/2051 [#2052] test_defer calls reactor.run() (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2052 ===== High ===== [#2020] tkmktap is broken and probably useless, eliminate it (opened by exarkun) task core http://twistedmatrix.com/trac/ticket/2020 [#2033] Removing non-existent property results in error. (opened by rfmohr(a)osc.edu) defect web2 http://twistedmatrix.com/trac/ticket/2033 [#2042] twisted.web2.auth.wrapper's interface is backwards (opened by glyph) enhancement core http://twistedmatrix.com/trac/ticket/2042 ===== Normal ===== [#2022] ConnectionRefusedError's errno and strerror surprising on BSD/OSX (opened by dalke) defect core http://twistedmatrix.com/trac/ticket/2022 [#2023] twisted/mail/smtp.py SenderMixin error logging bug (opened by shieldszero) defect mail http://twistedmatrix.com/trac/ticket/2023 [#2024] trial --dry-run fails with real test_suites, because pyunit suites don't have names (opened by spiv) defect trial http://twistedmatrix.com/trac/ticket/2024 [#2025] Include reference to client in twisted.web's docstring (opened by jml) defect web http://twistedmatrix.com/trac/ticket/2025 [#2026] Edit the twisted.internet docstring to make contents clearer (opened by jml) defect core http://twistedmatrix.com/trac/ticket/2026 [#2027] Provide some general information about the split in the t.protocols' docstring (opened by jml) enhancement core http://twistedmatrix.com/trac/ticket/2027 [#2028] web2's docstring should indicate the stability of web2 (opened by jml) enhancement web2 http://twistedmatrix.com/trac/ticket/2028 [#2029] Use a consistent style for docstrings (opened by jml) enhancement core http://twistedmatrix.com/trac/ticket/2029 [#2030] twisted.web.trp's docstring is murky (opened by jml) defect web http://twistedmatrix.com/trac/ticket/2030 [#2034] Improper handling of properties with no namespace (opened by rfmohr(a)osc.edu) defect web2 http://twistedmatrix.com/trac/ticket/2034 [#2035] twisted.internet.udp.Port implements twisted.internet.interfaces.IConsumer (opened by exarkun) enhancement core http://twistedmatrix.com/trac/ticket/2035 [#2036] trial runs tests from .pyc files even if there is no .py file (opened by exarkun) defect trial http://twistedmatrix.com/trac/ticket/2036 [#2037] twisted.python.reflect.namedAny depends on undocumented import implementation details (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2037 [#2039] Wrong namespace assigned to properties (opened by rfmohr(a)osc.edu) defect web2 http://twistedmatrix.com/trac/ticket/2039 [#2041] web2.auth.wrapper.HTTPAuthResource mis-handles URL path (opened by rfmohr(a)osc.edu) defect web2 http://twistedmatrix.com/trac/ticket/2041 [#2043] defgen would be better without waitForDeferred (opened by ghazel) enhancement core http://twistedmatrix.com/trac/ticket/2043 [#2046] remove license duplication from web2.dav if possible, add note if not (opened by glyph) enhancement web2 http://twistedmatrix.com/trac/ticket/2046 [#2047] use regular class statements in web2.dav, remove bindMethods (opened by glyph) enhancement web2 http://twistedmatrix.com/trac/ticket/2047 [#2048] In twisted.web2 the fileupload.parseMultipartFormData function has an unoverideable keyword argument (opened by fade) enhancement web2 http://twistedmatrix.com/trac/ticket/2048 [#2049] web2/fileupload.py parseMultipartFormData has unoverideable default keyword arguments (opened by fade) enhancement web2 http://twistedmatrix.com/trac/ticket/2049 [#2050] funcion parseMultipartFormData in web2/fileupload.py has unalterable default keword args (opened by fade) enhancement web2 http://twistedmatrix.com/trac/ticket/2050 [#2053] twisted.test.test_import is redundant (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2053 [#2054] ProperlyCloseFilesTestCase.testProperlyCloseFiles written in an aggressively stupid manner (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2054 [#2055] twisted.test.test_ssl.SpammyTLSTestCase exercises codepaths with warnings without suppressing them (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2055 [#2056] twisted.test.test_internet.ReactorCoreTestCase defines a timeout method which conflicts with trial's timeout attribute (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2056 [#2057] twisted.conch.test.test_ssh.UtilityTestCase.testCounter relies on deprecated wrapping behavior of struct module (opened by exarkun) defect conch http://twistedmatrix.com/trac/ticket/2057 ===== Low ===== [#2031] "setup.py clean" does not remove all files after build (opened by rfmohr(a)osc.edu) enhancement release management http://twistedmatrix.com/trac/ticket/2031 [#2032] "setup.py clean" does not remove all files after build (opened by rfmohr(a)osc.edu) (CLOSED, duplicate) enhancement release management http://twistedmatrix.com/trac/ticket/2032 [#2038] Make the pypy builder work (opened by jerub) enhancement core http://twistedmatrix.com/trac/ticket/2038 Closed Bugs ______________________ ===== Highest ===== [#2019] t.w.p.msn does not properly execute errbacks when an error packet is received (opened by habnabit, closed by spiv, fixed) defect words http://twistedmatrix.com/trac/ticket/2019 [#1922] make twistd pluggable, nerf mktap (opened by tjs, closed by radix, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1922 [#2002] t.i.unix.Port fails on bound incoming unix sockets (opened by ghazel, closed by alus, fixed) defect core http://twistedmatrix.com/trac/ticket/2002 [#2040] SSL echo client example incorrectly stops the reactor multiple times (opened by exarkun, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/2040 ===== Normal ===== [#2013] Deprecate mktap and document usage of Twisted Application Plugins with twistd (opened by radix, closed by radix, fixed) task core http://twistedmatrix.com/trac/ticket/2013 ===== Low ===== [#2032] "setup.py clean" does not remove all files after build (opened by rfmohr(a)osc.edu, closed by exarkun, duplicate) enhancement release management http://twistedmatrix.com/trac/ticket/2032

1 0

[Twisted-Python] twisted rpm
by Jorge Sepúlveda Pereda 02 Sep '06

02 Sep '06

Hi, i need to know, if there are, a twisted install RPM for Fedora linux ( FC4) . Thanks. (sorry for my english) Jorge.

3 2

[Twisted-Python] Data management in a Twisted application
by Robert Gravina 02 Sep '06

02 Sep '06

Twisted and Divmod lists, Sorry about the cross posting here - this is mainly a Twisted question but it involves Divmod Axiom a little too. I'm looking for some advice about the best way to implement data management in my application. The way I see it, there is a "client does almost everything" approach, and "server does almost everything" approach. I'd currently using the former, but I'd like to hear some opinions about switching to the latter, or if there is a better approach you can think of. Here are the approaches as I see them: --- 1) Client does almost everything approach When the user logs on they get a Cacheable, which contains a list of Copyable objects that they will be able to add/edit/delete. These objects are quite complex (have list of other objects etc.). There is a main screen which lists the objects details. The user can select a row, and they get a form where that can edit all the various attributes (obviously much more than is displayed on the list on the main screen), and save it to the server. The server calls an update method which essentially copies across all the attributes to the server-side Axiom Item instance which it represents . Using the Cacheable previously mentioned, it notifies all clients that an object has been updated and sends them this updated object. Adding new objects works in a similar way. Problems arise with things like delete - I'd really need to set a flag on the server-side object when someone has it open, so that I can inform other users they can't delete it. At some point I'd like to implement searching on the main interface, so the users can filter their list of objects. This would require me to build up boolean search criteria and roll my own search using the lists of objects. 2) Sever does almost everything When the user logs on they get a Cacheable again, but this time the list is just a summary of the objects attributes, enough to populate the main screen list. When the user edits a row, the client requests the Cacheable from the server it represents (not a Copyable anymore). When they save, they sent the Cacheable back to the server (is this possible I wonder?) and copy accross all the data like before, and update the clients by sending them new summary data for that object (but not the object itself). I hope, it's possible to stop observing the object too. That way, on the server I could maintain a list of who has the object open at the moment. For searching, now that all the objects live on the server I could send my boolean search criteria and use Axiom's search facilities to so a proper database search. This saves my rolling me own. Also, another bonus of this approach is if Axiom one day supports Live Queries (maybe I can help implement this when I get the bulk of this app done) I can update the clients when their query results changes! --- However, it's expected the users will be searching often, so there's something to be said about having all the data close at hand on the client. Obviously, this has drawbacks too. Aside from having to implement my own search, I'm worried this might mean having thousands of objects locally might be a memory hog (but premature optimisation is the root of all evil, so I'll worry about this later). The search might by faster since there's no need to ask the server to do it, but since server-side search is probably going to be much faster than my client side search, it's hard to estimate which will be faster. Anyway, I hope the issues here and my implementation makes sense. I'm torn between which approach to take, and I'd really appreciate some advice. Robert

1 0

[Twisted-Python] unable to install twisted
by Fritz Platzke 02 Sep '06

02 Sep '06

Hello, I hate asking questions like this but quite frankly I'm stumped. I have been trying to install Twisted for the past two days and it just won't go. I've tried multiple versions of Zope and Twisted but nothing seems to work. The box I am attempting the install is a fresh install of CentOS 4.4 on an Intel Celeron 733 mhz processor [root@milky ~]# gcc -v Reading specs from /usr/lib/gcc/i386-redhat-linux/3.4.6/specs Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --enable-shared --enable-threads=posix --disable-checking --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-java-awt=gtk --host=i386-redhat-linux Thread model: posix gcc version 3.4.6 20060404 (Red Hat 3.4.6-3) [root@milky ~]# python -V Python 2.3.4 This is what happens when I attempt to build zope... running build running build_py running build_ext building 'zope.interface._zope_interface_coptimizations' extension gcc -pthread -fno-strict-aliasing -DNDEBUG -O2 -g -pipe -m32 -march=i386 -mtune=pentium4 -D_GNU_SOURCE -fPIC -fPIC -IDependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface -I/usr/include/python2.3 -c Dependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface/_zope_interface_coptimizations.c -o build/temp.linux-i686-2.3/Dependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface/_zope_interface_coptimizations.o Dependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface/_zope_interface_coptimizations.c:15:20: Python.h: Nosuch file or directory Dependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface/_zope_interface_coptimizations.c:16:26: structmember.h: No such file or directory Dependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface/_zope_interface_coptimizations.c:22: error: syntax error before '*' token Dependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface/_zope_interface_coptimizations.c:22: warning: data definition has no type or storage class Dependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface/_zope_interface_coptimizations.c:23: error: syntax error before '*' token Dependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface/_zope_interface_coptimizations.c:23: warning: data definition has no type or storage class Dependencies/zope.interface-ZopeInterface-3.1.0c1/zope.interface/_zope_interface_coptimizations.c:24: error: syntax error before '*' token ... ... etc ... ... error: command 'gcc' failed with exit status 1 Now I realize that I could probably ask for help on the Zope list but seeing as how a person NEEDS zope in order to install twisted I'm hoping someone here has experienced similar issues and can provide some insight into what I'm missing and/or doing wrong. Surely someone running either CentOS or RHEL has encountered this problem and can explain what is going on. Thanks in advance, Fritz

3 3