Mailman 3 June 2006 - Twisted

[Twisted-Python] sub options in twisted applications
by Manlio Perillo 13 Jun '06

13 Jun '06

I don't know if this is useful/safe, but I have written a patch that allow users to pass additional command line arguments to an application started with twistd -y. I don't know if this is compatible with mktap, this is why I have posted the "patch" here and not on the traker. ########## In twisted.scripts.twistd def runApp(config): import sys sys.argv = appArgv ... def configHelper(argv): idx = 1 for i, opt in enumerate(argv[1:]): if not opt.startswith('-'): idx = i + 1 break tmp = argv[idx:] if len(argv) > idx: del argv[idx + 1:] return tmp appArgv = [] def run(): global appArgv import sys appArgv = configHelper(sys.argv) app.run(runApp, ServerOptions) ######### Now if I do twistd -y myapp -x -y sys.argv is ["myapp", "-x", "-y"] Regards Manlio Perillo

4 12

[Twisted-Python] recommended twisted database coding
by Thomas Vander Stichele 13 Jun '06

13 Jun '06

Hi everyone, As of late I've been thinking of rewriting an old PHP application that I used to help out on in Python. It would give me a chance to see if Python and everything I"ve learned while learning Python would help me overcome my innate disgust of doing database/web programming :) The application in question is relatively simple - it's your average "manage-all-my-music" application, with artists, audio files, albums, ratings, ... In the PHP version, I had already moved from doing raw SQL queries everywhere to instantiating objects from the database, so the idea of having an object model that abstracts away persistence to a database is appealing. Being a Twisted groupie I would prefer to use something that works well with Twisted. After looking at all the options available to me, I'm getting a little confused, and would like some feedback to clear up the confusion. - Twisted is, of course, async, so twisted.enterprise.adbapi wraps 2.0 DB API's using threads, which makes sense. Are people using adbapi much in production though ? From scanning the mailing list it seems like people prefer layering stuff on top of adbapi to implement object models. - Axiom seems like a nice Object layer with a database backend. However, the part I don't understand is that suddenly the description claims that Axiom is doing blocking SQLite calls, and that this isn't really a problem. Since Axiom is a Divmod project, I tend to trust their opinion when it comes to Twisted. But why is it suddenly OK to have blocking code being used ? Does this only apply to SQLite, or would it apply to any database being used ? - SQLObject seems to come very close to what I would want to use to abstract away the database backend, and just pretend that I only deal with persistently stored python objects. Has anyone managed to use SQLObject in a twisted project ? If not, what's the closest I can get that gives me the advantage of having a python object backend ? - how do persistent object systems typically deal with transactions ? Suppose you want to do three operations on three different objects as a transaction, is that possible at all ? - Are there any active projects that use a database backend, twisted, persistent objects, and are freely available, that I can sneak a peek at for my further education ? Thanks in advance, Thomas

5 4

[Twisted-Python] how to stop a service
by Manlio Perillo 13 Jun '06

13 Jun '06

Just to be sure. I have written a small application that do some computation, than stop. I have subclassed twisted.application.service.Service, because the application do some persistence, and this seems to be the best solution (?). To stop the application/service I just have to call reactor.stop, "as usual"? Thanks and regards Manlio Perillo

3 8

[Twisted-Python] pb.Broker subclass question
by David Pratt 12 Jun '06

12 Jun '06

Hi. I'm interested in subclassing Broker to extend it. I've subclassed the PBServerFactory and PBClientFactory. The server starts with the new protocol class but the client is unable to communicate. I believe the client is not using the correct protocol since it gets it from Broker to start. Can someone provide some advice on a way to subclassing the client to have it use a subclassed Broker protocol. Many thanks Regards, David

2 2

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 11 Jun '06

11 Jun '06

Bug summary ______________________ Summary for 2006-06-04 through 2006-06-11 Bugs opened: 28 Bugs closed: 32 Total open bugs: 620 (-4) |== Type Changes |== Priority Changes |== Component Changes |Defect: +1 |Highest: -6 |Conch: -1 |Enhancement: -4 |High: -5 |Core: +0 |Task: +1 |Normal: +11 |Ftp: +1 |Low: -2 |Mail: -1 |Names: +0 |Pair: +1 |Release Management: +0 |Trial: +0 |Vfs: +1 |Web: +1 |Web2: -2 |Website: +1 |Words: -3 New / Reopened Bugs ______________________ ===== Highest ===== [#1788] twisted/conch/test/test_filetransfer.py has fragile setUp/tearDown (opened by spiv) (CLOSED, fixed) enhancement conch http://twistedmatrix.com/trac/ticket/1788 [#1797] twisted/web/topfiles/setup.py fails during build_scripts (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/1797 [#1798] iocpreactor should use GetAcceptExSockaddrs instead of getpeername for incoming connections (opened by ghazel) defect core http://twistedmatrix.com/trac/ticket/1798 [#1800] twisted.test.test_process.Win32ProcessTestCase.testBadArgs fails on win32er and iocpr (opened by exarkun) (CLOSED, fixed) defect core http://twistedmatrix.com/trac/ticket/1800 [#1801] Invalid components.implements (opened by therve) (CLOSED, fixed) defect mail http://twistedmatrix.com/trac/ticket/1801 [#1804] numerous coding standard violations, one potential bug not noted in review of #1775 (opened by glyph) (CLOSED, fixed) defect web2 http://twistedmatrix.com/trac/ticket/1804 [#1809] AdvancedPOP3Client doesn't notice SSL is secure (opened by exarkun) (CLOSED, fixed) defect mail http://twistedmatrix.com/trac/ticket/1809 [#1812] Installation error: "Subprocess exited with result 1 for project web" (opened by edsuom) (CLOSED, duplicate) defect release management http://twistedmatrix.com/trac/ticket/1812 ===== Normal ===== [#1786] Twisted VFS SFTP tests can be clearer and have more specific purposes. (opened by spiv) (CLOSED, fixed) enhancement vfs http://twistedmatrix.com/trac/ticket/1786 [#1787] Last line of trial's traceback output is often difficult to read (opened by jml) enhancement trial http://twistedmatrix.com/trac/ticket/1787 [#1789] twisted.conch.test.test_filetransfer.TestOurServerOurClient.testOpenFileAttributes (and perhaps others) leaks file descriptors (opened by exarkun) defect conch http://twistedmatrix.com/trac/ticket/1789 [#1791] Update FAQ links to point to non-obsolete URLs (opened by exarkun) task website http://twistedmatrix.com/trac/ticket/1791 [#1792] qt step of reactors build fails due to Xlib spew on stderr (opened by spiv) defect core http://twistedmatrix.com/trac/ticket/1792 [#1793] Threading guide is unclear on reactor requirements (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/1793 [#1794] protocols/ftp.py SenderProtocol doesn't implement IFInishableConsumer even though it claims it does (opened by thor) defect ftp http://twistedmatrix.com/trac/ticket/1794 [#1795] Trial feature for simulating missing modules for a test run (opened by exarkun) enhancement trial http://twistedmatrix.com/trac/ticket/1795 [#1796] Flumotion could use an API-stable and approved way of stealing the underlying socket of a transport from the reactor (opened by thomasvs) enhancement core http://twistedmatrix.com/trac/ticket/1796 [#1799] Remove usage of exec from twisted/names/dns.py (opened by exarkun) task names http://twistedmatrix.com/trac/ticket/1799 [#1802] No tag in tags/ for release 2.4.0 sumo equivalent (opened by moof) (CLOSED, invalid) enhancement release management http://twistedmatrix.com/trac/ticket/1802 [#1803] unittest using adbapi hang on exit (opened by thomasvs) enhancement core http://twistedmatrix.com/trac/ticket/1803 [#1805] SFTP adapter doesn't translate deferred errors (opened by spiv) defect vfs http://twistedmatrix.com/trac/ticket/1805 [#1806] adbapi.ConnectionPool.noisy defaults to True, when it should be False (opened by moof) defect core http://twistedmatrix.com/trac/ticket/1806 [#1807] Exception handling improvements in web2/dav (opened by troy(a)osc.edu) enhancement web2 http://twistedmatrix.com/trac/ticket/1807 [#1808] Buildbot pyflakes stage (opened by itamarst) enhancement core http://twistedmatrix.com/trac/ticket/1808 [#1810] Release Twisted Web2 0.2 (opened by dreid) enhancement web2 http://twistedmatrix.com/trac/ticket/1810 [#1811] setup.py bdist_rpm fails on FC5 for x86_64 (opened by troy(a)osc.edu) (CLOSED, duplicate) defect core http://twistedmatrix.com/trac/ticket/1811 ===== Low ===== [#1790] Remove obsolete release documentation (opened by exarkun) enhancement web http://twistedmatrix.com/trac/ticket/1790 [#1813] twisted.pair.tuntap uses t.p.c.implements which no longer exists (opened by exarkun) defect pair http://twistedmatrix.com/trac/ticket/1813 Closed Bugs ______________________ ===== Highest ===== [#1454] test failures during chained methods are not reported well (opened by warner, closed by jml, fixed) defect trial http://twistedmatrix.com/trac/ticket/1454 [#1788] twisted/conch/test/test_filetransfer.py has fragile setUp/tearDown (opened by spiv, closed by spiv, fixed) enhancement conch http://twistedmatrix.com/trac/ticket/1788 [#1440] Remove old cred (opened by exarkun, closed by exarkun, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1440 [#1788] twisted/conch/test/test_filetransfer.py has fragile setUp/tearDown (opened by spiv, closed by spiv, fixed) enhancement conch http://twistedmatrix.com/trac/ticket/1788 [#1734] twisted.words.service has NameErrors (opened by radix, closed by exarkun, fixed) defect words http://twistedmatrix.com/trac/ticket/1734 [#1708] twisted.names shouldn't stop listening when crappy data is sent (opened by radix, closed by exarkun, fixed) enhancement names http://twistedmatrix.com/trac/ticket/1708 [#1609] Docs on return type for IReactorUNIX, IReactorArbitrary missing (opened by msmith, closed by exarkun, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1609 [#1800] twisted.test.test_process.Win32ProcessTestCase.testBadArgs fails on win32er and iocpr (opened by exarkun, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/1800 [#1804] numerous coding standard violations, one potential bug not noted in review of #1775 (opened by glyph, closed by wsanchez, fixed) defect web2 http://twistedmatrix.com/trac/ticket/1804 [#1604] Write More Doc Strings (opened by exarkun, closed by exarkun, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1604 [#1812] Installation error: "Subprocess exited with result 1 for project web" (opened by edsuom, closed by exarkun, duplicate) defect release management http://twistedmatrix.com/trac/ticket/1812 [#1735] skip twisted.words' msn tests when twisted.web is not available (opened by radix, closed by exarkun, fixed) task words http://twistedmatrix.com/trac/ticket/1735 [#1801] Invalid components.implements (opened by therve, closed by exarkun, fixed) defect mail http://twistedmatrix.com/trac/ticket/1801 [#1809] AdvancedPOP3Client doesn't notice SSL is secure (opened by exarkun, closed by exarkun, fixed) defect mail http://twistedmatrix.com/trac/ticket/1809 [#1515] Web2 documentation should not disregard the Documentation Standard (opened by dreid, closed by dreid, fixed) defect web2 http://twistedmatrix.com/trac/ticket/1515 ===== High ===== [#1755] t.w2.twscgi.SCGIClientProtocol causes an exception to be raised in t.w2.log._LogByteCounter (opened by dreid, closed by dreid, fixed) defect web2 http://twistedmatrix.com/trac/ticket/1755 [#1755] t.w2.twscgi.SCGIClientProtocol causes an exception to be raised in t.w2.log._LogByteCounter (opened by dreid, closed by dreid, fixed) defect web2 http://twistedmatrix.com/trac/ticket/1755 [#1778] Need a way to locate another resource on the site (opened by wsanchez, closed by wsanchez, fixed) enhancement web2 http://twistedmatrix.com/trac/ticket/1778 [#1775] Attach URI to a resource during lookup (opened by wsanchez, closed by wsanchez, fixed) enhancement web2 http://twistedmatrix.com/trac/ticket/1775 [#926 ] Automatically delete plugin cache at the slightest sign of trouble (BUG: Uninstalled plugins are not uncached) (opened by justinj, closed by glyph, fixed) defect core http://twistedmatrix.com/trac/ticket/926 [#1086] ITCPConnector.disconnect() default implementation (or API?) problem (opened by itamarst, closed by glyph, invalid) defect core http://twistedmatrix.com/trac/ticket/1086 ===== Normal ===== [#1786] Twisted VFS SFTP tests can be clearer and have more specific purposes. (opened by spiv, closed by spiv, fixed) enhancement vfs http://twistedmatrix.com/trac/ticket/1786 [#1648] twisted.mail.imap4.IMAP4Client.append docstring (opened by synapsis, closed by exarkun, fixed) defect mail http://twistedmatrix.com/trac/ticket/1648 [#1802] No tag in tags/ for release 2.4.0 sumo equivalent (opened by moof, closed by radix, invalid) enhancement release management http://twistedmatrix.com/trac/ticket/1802 [#1441] Support registering adapters by the fully qualified python name of objects involved (opened by exarkun, closed by exarkun, invalid) enhancement core http://twistedmatrix.com/trac/ticket/1441 [#1811] setup.py bdist_rpm fails on FC5 for x86_64 (opened by troy(a)osc.edu, closed by glyph, duplicate) defect core http://twistedmatrix.com/trac/ticket/1811 [#1768] Synchronous Task Queue (opened by edsuom, closed by glyph, invalid) enhancement core http://twistedmatrix.com/trac/ticket/1768 [#1324] Cacheable/RemoteCache does not work with new style classes (opened by karlb, closed by glyph, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1324 ===== Low ===== [#1610] assertions in pyunit test cases don't show tracebacks (opened by radix, closed by jml, fixed) defect trial http://twistedmatrix.com/trac/ticket/1610 [#1414] IRCClient.userJoined() argument list (opened by urago, closed by exarkun, invalid) enhancement words http://twistedmatrix.com/trac/ticket/1414 [#1040] Starting threads in a tac file blocks everything (opened by exarkun, closed by exarkun, wontfix) enhancement conch http://twistedmatrix.com/trac/ticket/1040 [#845 ] TAGS table creation for Twisted source (opened by ytrewq1, closed by glyph, wontfix) enhancement conch http://twistedmatrix.com/trac/ticket/845

1 0

[Twisted-Python] Writing a New Plug-In for mktap
by Manlio Perillo 10 Jun '06

10 Jun '06

What's the current Twisted best practice.? Thanks and regards Manlio Perillo

2 2

[Twisted-Python] twisted and PyQt4
by scalet＠yebu.de 10 Jun '06

10 Jun '06

Hi, it seems to me, there is no reactor for PyQt4 yet. What is the preferred way to have a PyQt4 application using the famous twisted framework for networking. Thanks for any hints. Karl

9 15

[Twisted-Python] Passing extra arguments to twistd?
by Terry Jones 10 Jun '06

10 Jun '06

I have a .tac file and am using twistd on it to start the application. I would like to be able to specify a config file on the command line so the .tac file code can figure out what it should do. Twistd doesn't seem to want me to do that though. Something like allowing $ twistd -twistedopts file -- extra args here... would be nice. Or is there a better way to do this? Regards, Terry

3 2

[Twisted-Python] Twisted Fedora Core packages - testing appreciated
by Thomas Vander Stichele 09 Jun '06

09 Jun '06

Hey everyone, I've finally gotten off my ass and started updating the Fedora Extras packages for Twisted. I based myself on the excellent work of Jeff Pitman from PyVault, and refined some things here and there. In addition, I started packaging parts of the DivMod stack (because I"m curious and wanted to try them out). I could use some feedback from people on Fedora Core to see if everything looks fine. I have packages for FC4 and FC5 for both i386 and x86_64. FC5 i386 is up at http://thomas.apestaart.org/download/pkg/fedora-5-i386-extras/ change 5 to 4 for FC4, or i386 to x86_64 for 64 bit, or both. If anything doesn't work, let me know. I will start pushing these to Fedora Extras as soon as we have Flumotion completely converted to 2.4 Enjoy, Thomas

2 1

Re: [Twisted-Python] Passing extra arguments to twistd?
by Terry Jones 09 Jun '06

09 Jun '06

Hi Jean-Paul OK, I take your point. Below are a couple more reasons why I still think it would be useful. >>>>> "JPC" == Jean-Paul Calderone <exarkun(a)divmod.com> writes: JPC> .tac files _are_ configuration, so they don't _take_ configuration. JPC> You should have so little code in your .tac file that it is neither JPC> burdensome nor distasteful to make a copy and change bits of it to JPC> meet particular configuration requirements. .tac files don't always seem to be that small: ~/Nevow-0.8.0/examples $ find . -name '*.tac' -print0 | xargs -0 wc -l 12 ./blogengine/blogengine.tac 7 ./chatola/chatola.tac 189 ./examples.tac 9 ./image_uploader/imagination.tac 13 ./liveanimal/liveanimal.tac 25 ./pastebin/pastebin.tac 9 ./postit/postit.tac 18 ./todo/todo.tac 483 ./userdb/userdb.tac 40 ./with_axiom/main.tac 805 total I'd like to avoid making people edit python files in what I distribute. I know it seems easy, that it is easy, but it's also easy to provide a familiar .ini style config file and let them edit that. Then the .ini file could be passed to twistd and on to my app. This minimizes duplicated code in the case that the .tac file is non trivial and is more idiot proof (especially given python's indentation sensitivity). Anyway, for now I'm taking your advice and simply embedding a config file name in my .tac file. It's not a big deal - I was just wondering. Thanks again, Terry

1 0