Mailman 3 November 2003 - Twisted

[Twisted-Python] LivePage patch? - was (LivePage CACHING Problem)
by Justin Johnson Nov. 17, 2003

Nov. 17, 2003

Working with fzZzy on #divmod, I made the following change to my local twisted/web/woven/flashconduit.py to make LivePage work for me. I'm using guard sessions (which appear to not be supported by the current code) so in my case the sessions are stored on the SessionWrapper. I really don't know squat about the way the code should be, so hopefully someone else can take a look at this and apply a real patch. I'd gladly do the real thing, but it would take me a *lot* longer to do. :-) Thanks. -Justin --- flashconduit.py.orig 2003-11-17 13:18:37.000000000 -0600 +++ flashconduit.py 2003-11-17 13:18:43.000000000 -0600 @@ -16,7 +16,8 @@ #self.lp.unhookOutputConduit() def lineReceived(self, line): - session = self.factory.site.getSession(line) + #session = self.factory.site.getSession(line) + session = self.factory.site.resource.sessions[line] self.lp = lp = session.getComponent(interfaces.IWovenLivePage) lp.hookupOutputConduit(self) ----- Original message ----- From: "Justin Johnson" <justinjohnson(a)fastmail.fm> To: "Twisted-Python" <twisted-python(a)twistedmatrix.com> Date: Thu, 13 Nov 2003 11:19:09 -0600 Subject: Re: [Twisted-Python] LivePage CACHING Problem I found the following post that looks similar to my problem. http://twistedmatrix.com/pipermail/twisted-python/2003-May/004170.html But since I have my own tap, I copied the code from web/tap.py into my code to start up the FlashConduitFactory. It starts up, but I get the following errors. Is this a bug? Any ideas what I'm doing wrong? 2003/11/13 11:08 CST [twisted.web.woven.flashconduit.FlashConduitFactory] connection with flash movie opened 2003/11/13 11:08 CST [FlashConduit,3,xxx.xxx.xxx.xxx] Traceback (most recent call last): File "/usr/local/lib/python2.3/site-packages/twisted/internet/default.py", line 501, in doSelect _logrun(selectable, _drdw, selectable, method, dict) File "/usr/local/lib/python2.3/site-packages/twisted/python/log.py", line 65, in callWithLogger callWithContext({"system": lp}, func, *args, **kw) File "/usr/local/lib/python2.3/site-packages/twisted/python/log.py", line 52, in callWithContext return context.call({ILogContext: newCtx}, func, *args, **kw) File "/usr/local/lib/python2.3/site-packages/twisted/python/context.py", line 32, in callWithContext return func(*args,**kw) --- <exception caught here> --- File "/usr/local/lib/python2.3/site-packages/twisted/internet/default.py", line 510, in _doReadOrWrite why = getattr(selectable, method)() File "/usr/local/lib/python2.3/site-packages/twisted/internet/tcp.py", line 250, in doRead return self.protocol.dataReceived(data) File "/usr/local/lib/python2.3/site-packages/twisted/protocols/basic.py", line 223, in dataReceived why = self.lineReceived(line) File "/usr/local/lib/python2.3/site-packages/twisted/web/woven/flashconduit.py", line 19, in lineReceived session = self.factory.site.getSession(line) File "/usr/local/lib/python2.3/site-packages/twisted/web/server.py", line 470, in getSession return self.sessions[uid] exceptions.KeyError: 'd01be6fe334cded345c0b029e29df7ac' 2003/11/13 11:08 CST [FlashConduit,3,xxx.xxx.xxx.xxx] connection lost On Thu, 13 Nov 2003 10:38:59 -0600, "Justin Johnson" <justinjohnson(a)fastmail.fm> said: > Hi, > > I am currently trying to use LivePage to update the cells of an html > table with results from processes initiated in various PB services. The > client intiates requests in the services and those services call back > into the client's (a pb.Referenceable) remote_updateStatus method to > update the table which displays the results. I have test code that > simulates this and everything works fine. Javascript is sent to the > browser to update the cells of the table. Works really slick. However, > now that I tried to hook it up to PB, the LivePage javascript sending > part isn't working. When I make the page.sendScript(script) call I get > the following in the log. > > 2003/11/13 10:25 CST [Broker,client] Sending javascript to page > <twisted.web.woven.utils.WovenLivePage instance at 0x4089944c> > 2003/11/13 10:25 CST [Broker,client] CACHING > [<twisted.web.woven.utils.Script instance at 0x4089906c>] > > All future sendScript calls append the script to the cache. Everything > else is working appropriately, and all code is executing as I'd expect, > except that the javascript doesn't send properly. Is there something in > particular I should be looking for here? I don't see what I'm doing > different, but since LivePage is quite magical to me I'm not sure where > to look. > > On a slightly different note, is there LivePage-ish support in nevow, and > do you recommend moving to that yet? > > Thanks. > -Justin > > _______________________________________________ > Twisted-Python mailing list > Twisted-Python(a)twistedmatrix.com > http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

1 0

[Twisted-Python] using defers with requests
by charles brandt Nov. 16, 2003

Nov. 16, 2003

I am trying to select some data from a database in hopes of eventually using it to populate a dynamic page. Before I dive into woven, I was trying to get the following to print selected data directly to a html resource using the following code snippet (or various versions of it). I've only been able to get an empty page though ( <html><body></body></html> ). I'm wondering if maybe the request is getting returned before the callback makes it to the defer? Any ideas? Thanks in advance, -Charles. from twisted.web import resource, server from twisted.enterprise import adbapi dbpool = adbapi.ConnectionPool(<connection stuff>) def getData(data): return dbpool.runQuery("SELECT * FROM some_table WHERE some_column = %s", data) def printResult(data, request): request.write("pre-data") request.write(data) request.write("post-data") request.finish() class myResource(resource.Resource): def render(self, request): d = getData("some string") d.addCallback(printResult, request) return server.NOT_DONE_YET resource = myResource()

3 6

RE: [Twisted-Python] Forum vs. mailing list
by benjamin bruheim Nov. 15, 2003

Nov. 15, 2003

>http://z.iwethey.org/forums -- we also have a hosting service. If you I liked those forums. Best of both worlds. It does have a slowness I attribute to Zope, and so on. I liked the mixed threads/flat-view that the forum uses. This is good for real discussion. And also, it allows one to browse faster. However, the CSS is IMHO lousy, and very unattractive. I think we could configure this better. If it is gets to be available on twisted, it would be good. However, I prefer to use lightweight systems; both in bandwidth and CPU. I hope this system is made to be scalable and accessible. You should put up an example setup, clean the CSS to the bare minimums. Put up a minimum of forums. I would think: Development, Twisted, Web Perhaps add: Issues (the workaround forum), Showroom (brag) and General Bullshit Sincerely, Benjamin Bruheim

2 1

[Twisted-Python] Re: [Plone-developers] [Ann] epoz 1.0 beta1 released
by robert Nov. 15, 2003

Nov. 15, 2003

Philipp, thanks for your info and efforts. I am currently working on a Project using Plone 2.0 for which I need a visual editor. Since the project is due by the end of the year, I need to use a solution that is available by then. My question therefore is:what is the state of the plone integration? Is there something I could use to start with? I would very much like to help beta testing, but it must be in an Plone environment. Robert Am Freitag, 14. November 2003 16:27 schrieb Philipp von Weitershausen: > The epoz project is pleased to announce the first beta version of its > cross-browser visual HTML editor! > > Originally written by Maik Jablonski, the editor famous in the world of > Zope and Plone was completely redesigned by Paul Everitt (Zope Europe > Association) and Guido Wesdorp (Infrae) and Philipp von Weitershausen > (philiKON Valley). The result is a very flexible editing machine based > on the following concepts: > > - Integration > > epoz was designed to be highly integrable into target products. It > uses Zope Page Templates (ZPT) for the XHTML templating. ZPTs hide > templating instructions in XML namespaces. That way, all XHTML > templates in epoz remain valid XHTML documents and should be able > to be used in similar templating systems without modification. > That also means, epoz can directly be used off of the filesystem > or served by Apache, without any templating engine. > > - Document-centric and asynchronous editing > > Other in-browser editors simply provide a replacement for the > textarea element in XHTML forms. epoz instead focuses on > document-centric editing. It lets you edit the contents of an > XHTML document and dublin core metadata (Title, Creator etc.) in a > compact and standard-conformant way. Upon save, epoz constructs a > full-fledged XHTML document again and invokes a PUT request to the > server. Being a standard HTTP command, PUT requests can be served > by nearly any webserver, even Apache (with mod_dav)! > > - Customization and extensibility > > The looks of epoz can be modified without having to modify the > XHTML templates by simply customizing the Cascading Style > Sheets. Its JavaScript architecture has been modelled after the > MVC concept. That means you may customize large or small parts of > the editor without having to reimplement or subclass anything, but > it also means extending epoz's functionality is just as easy. > > Where can I get it? > > You may download a tarball at the the epoz project homepage at > Sourceforge: > > http://sourceforge.net/project/showfiles.php?group_id=84377 > > How can I use it? > > epoz comes with a great deal of documentation already. The > INSTALL.txt file in the 'doc' directory should provide a small set > of introductions for Zope users. > > If you would like to see epoz in action without having to install it > in Zope, you may either download the tarball and open > 'common/epozmacros.html' in your browser or visit the following URL > (served by Apache, btw): > > http://www.philikon.de/files/epoz/common/epozmacros.html > > If you happen to succeed at integrating epoz into your favourite web > application server, feel free to contact us if you would like to > contribute your code to the project. Equally, any documentation > about how to integrate, customize or extend are very welcome. > > What to expect for future releases > > - Link and image toolbox: > > The original Epoz editor provided a toolbox for Plone users that > was loaded in a browser pop-up window. Since epoz 1.0 puts a lot > of focus on document-centric editing, it places toolbox elements > such as a link or image browser and table creator right on the > edit page. Results for link and image searching will be loaded > asynchronously in a yet-to-defined XML format. > > In upcoming releases, we will provide asynronous server-side > methods for link and image searching in Zope2, CMF, Plone and > Zope3. > > - Plone integration: > > Although we have made an effort to integrate it with Plone > 1.0/2.0, we have seen that current versions of Plone does not > allow an editor to take over for document-centric editing. Philipp > has made a Plone Improvement Proposal (PLIP) to provide a visual > editing architecture in Plone > (http://plone.org/development/current/projects/PLIP5). The > proposal has been accepted by the community and Philipp is > currently implementing. It is expected that Plone 2.1 will be > ready to be plugged together with upcoming versions of epoz. > > How to report bugs? > > Please help us make epoz 1.0 bugfree and report bugs you encounter > at: > > http://codespeak.net/issues/epoz/ (mind the trailing slash) > > Further questions? Write us to: > > epoz-development(a)lists.sourceforge.net > > We are looking forward to your comments. > On behalf of the epoz project, > > Philipp von Weitershausen > > > > > ------------------------------------------------------- > This SF.Net email sponsored by: ApacheCon 2003, > 16-19 November in Las Vegas. Learn firsthand the latest > developments in Apache, PHP, Perl, XML, Java, MySQL, > WebDAV, and more! http://www.apachecon.com/ > _______________________________________________ > Plone-developers mailing list > Plone-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/plone-developers -- mit freundlichen Grüssen Robert Rottermann www.redCOR.ch

1 0

[Twisted-Python] Deferred model
by Philippe Lafoucrière Nov. 15, 2003

Nov. 15, 2003

Hello Can someone provide me a good example of a deferred model in woven ? I have a big model to build, and the page takes a long time to render... I didn't find any help on twisted site :( thx for help -- Philippe

5 10

[Twisted-Python] Documentation Question
by Steven Bauer Nov. 14, 2003

Nov. 14, 2003

Being new to twisted I may be lacking a clue, but finding the proper arguments to twisted.application.internet.UDPServer() was a major pain in the butt. Only by looking at the code could I find all the valid arguments and that took a lot of tracing because the valid arguments are determined by listenudp() it seems. Is their an easier way or is it always frustrating to determine the acceptable arguments to an init function? Thanks, Steve

5 5

[Twisted-Python] time and date
by Phil Christensen Nov. 14, 2003

Nov. 14, 2003

i might just be insane, but is there something crazy going on with date stamps on this list? about three different messages in the past two days have weird time stamps on them, that are set in the past or the future. i noticed some stuff in the archives like that, too. is this an accidental user thing? or am i suffering from senile dementia exceptionally early in my life?

1 0

RE: [Twisted-Python] Deferred model
by Hegedus, Matthew S Nov. 13, 2003

Nov. 13, 2003

Oops, sorry Chris, I did not see your response. My message will surely displease you. Please disregard since you have already made your case defending the Twisted archives and opposing a forum. Matthew -----Original Message----- From: Christopher Armstrong [mailto:radix@twistedmatrix.com] Sent: Thursday, November 13, 2003 4:04 PM To: twisted-python(a)twistedmatrix.com Subject: Re: [Twisted-Python] Deferred model On Thu, Nov 13, 2003 at 10:14:16PM +0100, Philippe Lafoucri?re wrote: > > > I'm sure this has been answered a million times before, but here > > goes... > > I'm sure too. But I proposed a long time ago (and several times) to > use a forum instead of a mailing list... This is a terrible excuse. Not only do we have our *own* archives: http://twistedmatrix.com/pipermail/twisted-python which, of course, are searchable via google: "deferred blocking code site:twistedmatrix.com" there are *multiple* archives elsewhere that have a built-in search functionality as well: http://marc.free.net.ph/list/twisted-python.html http://news.gmane.org/gmane.comp.python.twisted I found these with a trivial amount of googling: "twisted-python mailing list" Having searchable archives is obviously no reason to switch to a web forum (ugh), as we have that right now. > > If you give more detail about what you're trying to do, I'm sure one > > of the Twisted gurus can explain what the best approach(es) might > > be. > > I thought of using the setUp method of page. I can start the > calculation when the page loads, but I don't know what to call (in the > callback) when it's done (a wmfactory_xxx ?). I'll check the threading > part you gave me. Thank you ! Unfortunately, I don't think there's any special support in Woven to handle Deferreds from setUp. You can return Deferreds from wmfactory_XXX and Woven will handle them correctly: it will not finish rendering the page until that Deferred has fired and the model is ready. -- Twisted | Christopher Armstrong: International Man of Twistery Radix | Release Manager, Twisted Project ---------+ http://radix.twistedmatrix.com/ _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

1 0

[Twisted-Python] adbapi.Augmention
by Jon Dyte Nov. 13, 2003

Nov. 13, 2003

Hi the doc string of adbapi.Augmentation mentions just using the ConnectionPool directly. "A class which augments a database connector with some functionality. This class is now deprecated. Just use the ConnectionPool directly. Conventional usage of me is to write methods that look like..." Presumbably this means DONT inherit from ConnectionPool like you used to inherit from Augmentation( or am I reading that incorrectly) and just create a ConnectionPool instance and run the queries through that. Jon

3 3

[Twisted-Python] LivePage CACHING Problem
by Justin Johnson Nov. 13, 2003

Nov. 13, 2003

Hi, I am currently trying to use LivePage to update the cells of an html table with results from processes initiated in various PB services. The client intiates requests in the services and those services call back into the client's (a pb.Referenceable) remote_updateStatus method to update the table which displays the results. I have test code that simulates this and everything works fine. Javascript is sent to the browser to update the cells of the table. Works really slick. However, now that I tried to hook it up to PB, the LivePage javascript sending part isn't working. When I make the page.sendScript(script) call I get the following in the log. 2003/11/13 10:25 CST [Broker,client] Sending javascript to page <twisted.web.woven.utils.WovenLivePage instance at 0x4089944c> 2003/11/13 10:25 CST [Broker,client] CACHING [<twisted.web.woven.utils.Script instance at 0x4089906c>] All future sendScript calls append the script to the cache. Everything else is working appropriately, and all code is executing as I'd expect, except that the javascript doesn't send properly. Is there something in particular I should be looking for here? I don't see what I'm doing different, but since LivePage is quite magical to me I'm not sure where to look. On a slightly different note, is there LivePage-ish support in nevow, and do you recommend moving to that yet? Thanks. -Justin

1 1

[Twisted-Python] Interfaces
by Phil Christensen Nov. 13, 2003

Nov. 13, 2003

first of all, just wanted to thank you guys for all your help. i'm really starting to get some of the more advanced stuff in twisted, and it's definitely totally cool... i was wondering if someone could give me a quick explanation of how interfaces work in twisted, or point me towards the right docstrigns to read... thanks, -phil

2 1

[Twisted-Python] SSL.SysCallError in doRead
by Sam Jordan Nov. 13, 2003

Nov. 13, 2003

Hi, I noted the following exception while running some msn related code earlier: 2003/11/14 05:09 EST [PassportLogin,client] Traceback (most recent call last): File "/home/sam/Twisted/twisted/python/log.py", line 65, in callWithLogger callWithContext({"system": lp}, func, *args, **kw) File "/home/sam/Twisted/twisted/python/log.py", line 52, in callWithContext return context.call({ILogContext: newCtx}, func, *args, **kw) File "/home/sam/Twisted/twisted/python/context.py", line 32, in callWithContext return func(*args,**kw) File "/home/sam/Twisted/twisted/internet/default.py", line 513, in _doReadOrWrite why = getattr(selectable, method)() --- <exception caught here> --- File "/home/sam/Twisted/twisted/internet/tcp.py", line 98, in doRead return Connection.doRead(self) File "/home/sam/Twisted/twisted/internet/tcp.py", line 234, in doRead data = self.socket.recv(self.bufferSize) SSL.SysCallError: (104, 'Connection reset by peer') On closer inspection it seems that the surrounding try/except clause only cares about SSL.SysCallErrors which pertain to unexpected EOF and all others are re-raised. The only reason I can come up with for why this is the case is that it was not anticipated that other exceptions (like the one above) could arise from the given recv call. I would expect that in the above instance, connectionLost should be called, but it may very well be that i'm missing some subtlety so I am yet to submit a bug report. Cheers, Sam.

2 1

[Twisted-Python] help please: trouble installing twisted python on Windows 2000 Pro, but not Windows XP Pro
by John Benson Nov. 13, 2003

Nov. 13, 2003

Hi, I just installed twisted python on my Windows XP laptop which has Python 2.3.2. I went to install it on Windows 2000 Professional version 5.00.2195 Service Pack 4 running Python 2.3 and got the following dialog box diagnostic: "Setup: CreateFile failed; code 5. Access is denied." I've been able to install piles of stuff on this system before, so I figure I have the required administrative privileges. I logon to a Windows domain, and my ID is in the Administrators group of the domain. There is a separate Administrator logon local to the machine which I haven't used, and probably can't get the password for, since this is a managed PC within the domain. Here are my questions: 1) What does the "code 5" failure mean? 2) What am I doing wrong? 3) Can I just move the twisted site-package folders over from my XP system Python 2.3 folder to the corresponding Windows 2000 Pro folder? I'm mostly interested in just importing the twisted modules and prototyping; I can do without the icons and start menu entries.

2 1

[Twisted-Python] tap2ntsvc in sandbox
by Cory Dodt Nov. 12, 2003

Nov. 12, 2003

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Twisted/sandbox/moonfallen/tap2ntsvc.py If you have an Twisted application that you want to make into a service on Windows, give this a try. It's very basic right now; it absolutely needs py2exe and Inno setup support before I'll consider it done. The goal is to have the output be a complete binary package analogous to the output of tap2deb or tap2rpm. The only difference will be that, instead of depending on software like the Linux versions do, it will do as much as it can to help you include the dependencies in the package using py2exe. Right now, nothing beyond generating a service script is done. Here's the help: Usage: tap2ntsvc.py [options] <filename> Options: ~ -y, --type= Config file type: pickle, xml, source, or python ~ -o, --output-file= Name of the setup executable produced ~ -n, --name= Short name of the service (used with "net start") ~ -d, --display-name= Human-readable name of the service ~ -e, --description= Description of the service ~ -r, --reactor= Reactor to install (like twistd) [default: default] ~ --version ~ --help Display this help and exit. Do something like . . . | python tap2ntsvc.py myapp.tac The output is myappsvc.py (or <name>svc.py). Then you run myappsvc.py: | python myappsvc.py install Installing service myapp to Python class C:\myapp\myappsvc.myapp_ServiceControl Changing service configuration Service updated | net start myapp The myapp run by Twisted service is starting. The myapp run by Twisted service was started successfully. Give it a try, let me know if you have any problems with it. Thanks, C -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3-nr1 (Windows XP) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQE/senW3A5SrXAiHQcRAvNdAJ4n7+yfvB/kcKD1pfGjfgqDbFgqcACcCDYZ jqd+gw+guZ3xg4f5R6I8tIQ= =kTlI -----END PGP SIGNATURE-----

3 3

[Twisted-Python] Re: [Twisted-commits] Somehow the waker still messes up cfreactor, never installing waker for now
by Itamar Shtull-Trauring Nov. 12, 2003

Nov. 12, 2003

On Tue, 11 Nov 2003 21:43:23 -0700 etrepum CVS <etrepum(a)wolfwood.twistedmatrix.com> wrote: > Modified files: > Twisted/twisted/internet/cfreactor.py 1.3 1.4 > > Log message: > Somehow the waker still messes up cfreactor, never installing waker > for now That means threaded programs with cfreactor will be really slow. I think the issue is that the unix waker uses python sockets. You probably want to write your own waker using whatever APIs you are using. While we're at it - warner, could we have the mac os x reactor also run tests with cfreactor? -- Itamar Shtull-Trauring http://itamarst.org/ Available for Python & Twisted consulting

3 5

[Twisted-Python] Re: [Twisted-commits] Somehow the waker still messes up cfreactor, never installing waker for now
by Brian Warner Nov. 12, 2003

Nov. 12, 2003

> While we're at it - warner, could we have the mac os x reactor also run > tests with cfreactor? My tests failed: 24:buildbot@quartz% python2.2 bin/trial -to -r cf twisted.test ... File "/Users/buildbot/Buildbot/slave/OSX-full2.2/Twisted/twisted/internet/cfreactor.py", line 42, in ? import cfsupport as cf ImportError: Failure linking new module It might be related to the following warning during the compilation phase: gcc -arch ppc -bundle -flat_namespace -undefined suppress build/temp.darwin-6.8-Power Macintosh-2.2/cfsupport.o -o twisted/internet/cfsupport.so -framework CoreFoundation -framework CoreServices -framework Carbon ld: warning dynamic shared library: /usr/lib/libSystem.dylib not made a weak library in output with MACOSX_DEPLOYMENT_TARGET environment variable set to: 10.1 It doesn't hang, so I'm going to turn on the test anyway (it will just fail all the time). I don't know a lot about OS-X linker magic.. somebody else will have to figure out the problem here. -Brian

3 2

[Twisted-Python] Twisted Names references
by Rudy Schockaert Nov. 12, 2003

Nov. 12, 2003

Hi, we would like to propose to a customer of our a solution based on Twisted Names. The customer is open to this suggestion, but asked us if we could provide references of companies using Twisted Names in production? If you know of companies we can mention (Name and size of the company, ev. contact person) it would help us a lot. Thanks in advance, Rudy

1 0

[Twisted-Python] Re: [Twisted-commits] Somehow the waker still messes up cfreactor, never installing waker for now
by Brian Warner Nov. 12, 2003

Nov. 12, 2003

> While we're at it - warner, could we have the mac os x reactor also run > tests with cfreactor? Oh, does that work now? If I recall, that used to hang the buildslave. I'll give it a try and turn on a cfreactor pass if it works. -Brian

1 0

[Twisted-Python] an easy twisted application question
by Phil Christensen Nov. 12, 2003

Nov. 12, 2003

okay, so if i've got a tap with the following updateApplication method: def updateApplication(app, config): app.registry = registry.Registry() ... ... and i want to access that app.registry attribute from an arbitrary location, how do i do it? i seem to remember hearing that there was only one instance of Application in a process, so does that mean that there's some (forgive the Java-speak) static method defined on the Application module that will get the current running instance? thanks in advance, -phil

5 9

[Twisted-Python] Twisted and mod_python?
by Patrik Blommaskog Nov. 12, 2003

Nov. 12, 2003

I am wondering about the feasibility of using mod_python in an Apache server to make PB requests to a Twisted application. That is, I have a Twisted application which servers PB requests, e.g. a user manager. I also have an Apache server. I would like the Apache server to present dynamic web pages based on the contents of the user manager application, to act as a web front end (e.g. create/erase/modify user properties). I was thinking that it could be possible to use mod_python and Twisted to act as a client to the user manager. My questions are: 1. Is this possible, fesible and/or reasonable? If so, any hints or examples would be welcome. 2. Any alternative/better solutions? I suppose it would be rather easy to use CGI instead, but I'd like to explore the options. - Patrik

3 2

[Twisted-Python] Scaling problem
by Uwe C. Schroeder Nov. 12, 2003

Nov. 12, 2003

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi guys, is there a way to have one service start several processes ? When using twisted everyone connecting to the server ends in the same process. This leads to "slowing down" when requesting information whenever a certain number of people go on. Each request takes some time to process and meanwhile the server is less responsive. I have one particularly expensive function that takes a bit. So if several people happen to use this function at a time the server slows down, up to where it takes a minute to complete. It's not a problem of system ressources (it's a quad processor xeon server with plenty of RAM and ultra 320 scsi drives running only this application and the postgres backend). The machine has a load of 0.2 while slowing down. Basically most of the machine is idle, since it only runs 2 processes and has 4 processors. Is there a way to have twisted do something like apache or postgres and split the incoming connection to several processes ? It's not a web application, I'm solely using pb. BTW: You might suggest to break down the expensive function into smaller pieces - no way. It has to run in one database transaction otherwise I might end up with a inconsistent database - no good in finance business. Thanks UC - -- Open Source Solutions 4U, LLC 2570 Fleetwood Drive Phone: +1 650 872 2425 San Bruno, CA 94066 Cell: +1 650 302 2405 United States Fax: +1 650 872 2417 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQE/p+2zjqGXBvRToM4RAiLKAKDKjRWiezqXkSLQA0P/TCCcgYwckACePksV 3qxzLR3w0x3jKgKdWf1oNTA= =LzUM -----END PGP SIGNATURE-----

11 21

[Twisted-Python] A real Newbie question - how to get started
by Graham Hansell Nov. 12, 2003

Nov. 12, 2003

Dear All Twisters out there. I am a complete Twisted newbie (with a little bit of Python experience) and having just installed this (what looks like) a great package, I would like advice on my next step. I am looking to start doing simple (spider) based web clients but really would like a guide or tutorial before jsut spending hours pulling my hair out. Where do you advise me to go. I have had a look at the Tutorial on Finger but this seems like a major development in an area I don't even understand. Is there any specific newbie guides being built or assembled possibly by those on this list. Thanks for your help with something that could just change my life (well a bit of it anyway). Graham

2 1

[Twisted-Python] Re: request getUser()/getPassword() in Woven and resources...
by Stuart Hungerford Nov. 12, 2003

Nov. 12, 2003

Hi all, Was this question about getUser() etc ever resolved? > My question goes along the previous one in this thread. > How do you get the browser to prompt for a username and password? > My code is not woking and goes something like this: On every page request > a certain function is called, say genpage()... > > def genpage(request) > request.getUser() > request.getPassword() > > return "hello world" > > > -> Browser does not prompt though. (And this does not even involve woven) > > _stephan Cheers, Stu -- :: Stuart Hungerford (stuart.hungerford(a)anu.edu.au) :: ANU Internet Futures Group

1 0

[Twisted-Python] setUp and rendering
by vicky lupien Nov. 11, 2003

Nov. 11, 2003

I'm working on a web based application. I found that the function setUp is done before the rendering (wmfactory, etc...) of the page. But I need to have a function that is done after the rendering. Is there a function that I can override that do what I need. Vicky

1 0

[Twisted-Python] HTTP Basic Auth using cred, an example
by Itamar Shtull-Trauring Nov. 11, 2003

Nov. 11, 2003

I've put up some code showing how to use HTTP Basic authentication together with cred to guard a resource at http://www.twistedmatrix.com/users/roundup.twistd/twisted/issue393 You need to implement a realm that returns resources, and then wrap it in a portal with an appropriate username/password credential checker. -- Itamar Shtull-Trauring http://itamarst.org/ Available for Python & Twisted consulting

2 1

[Twisted-Python] Twisted Java
by Phil Christensen Nov. 10, 2003

Nov. 10, 2003

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 so, what's the chance of this ever supporting the new auth framework? i don't want to get into a "why use java, anyway?" debate, but i was just curious if there were any plans to continue supporting Java with the twisted framework. thanks, - -phil -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (Darwin) iD8DBQE/r/8cu8x7iJQ4TqURAugoAKCFBpft+N+IhkoSVk+b7+/+AqxJLQCfXrM/ wDDO+TcyH8kpsDANd58xhEE= =w56/ -----END PGP SIGNATURE-----

2 1

[Twisted-Python] pb help needed.
by Syver Enstad Nov. 10, 2003

Nov. 10, 2003

I have a bug in my woven application which manifests itself as win32select failing after doing many http requests. The error is the constant WSAENOBUFS and I it seems pretty likely that this is caused by some socket related resource leaking for each request I make. This hypothesis is further supported by observing that a host of pb.ClientFactory instances are stopped when shutting down the application after it crashes. This seems strange to me as I am thorough in shutting down the connector after every request is finished. Turning to that trusty friend printf style debugging, shows that the PBClientFactory is stopped correctly when performing requests to pages that use the referenceable and wait for it's deferred's to complete. There are two cases when it doesn't stop. The first is when I press reload quickly a number of times. Then I just see start messages because my request finish method is not called (it is a callback to the deferred returned by request.notifyFinish()). The second case is when I call disconnect on the connector before it's deferred has been realised. I see in the log the following pattern: Starting pb.PBClientFactory, disconnect and then the attached event, stopping factory is not called at all. After stepping I see that disconnect doesn't do anything when it is called before the connection has been realized. So I have a bug, and it's in my code. My question is how does one manage pb resources correctly and easily (I don't worry about performance just yet) when each user needs to have it's own connection?

2 4

[Twisted-Python] 1.1 Will Not Build Under Win32
by John Abel Nov. 10, 2003

Nov. 10, 2003

Hi! I noticed a couple of posts about 1.1rc's failing to build on Win32, due to the the installer not being able to find certain files (rpc.h, and portmap.h), but I've not seen any updates. This problem still exists with 1.1. Is there a way round it? Or, do I need to create a bug report for it? Regards John

6 7

[Twisted-Python] Quotient mktap problem
by rddda Nov. 9, 2003

Nov. 9, 2003

anyone here using Quotient? it builds, but on 'mktap quotient' i get an error where it tries to build 'atop'. it tries to import '_bsddb'. I am using bsddb3 - which i believe is the more recent version of bsddb. i can fix the import, but then i have problem with procs within. stops at DBEnv() which is supposed to be in bsddb3, but doesn't seem to be available. any thoughts/clues? twisted-1.1.0 quotient-0.7.0 on OpenBSD __________________________________ Do you Yahoo!? Protect your identity with Yahoo! Mail AddressGuard http://antispam.yahoo.com/whatsnewfree

2 1

[Twisted-Python] Re: [Twisted-commits] make log.err return the thing you pass to it
by Andrew Bennetts Nov. 8, 2003

Nov. 8, 2003

On Sat, Nov 08, 2003 at 04:51:25AM -0700, radix CVS wrote: > Modified files: > Twisted/twisted/python/log.py 1.52 1.53 > > Log message: > make log.err return the thing you pass to it Isn't this a fairly significant change to the API? Now doing deferred.addErrback(log.err) will log the error, and then log it again when the deferred is garbage-collected... I guess it won't actually break anything, just add some confusion to log files, but what's the new idiom for d.addErrback(log.err) # log and swallow any errors that happened going to be? -Andrew.

3 4

[Twisted-Python] API doc
by Philippe Lafoucrière Nov. 8, 2003

Nov. 8, 2003

I just discovered the twisted-1.1.0 API doc. The "Inherited from ..." part are a GREAT idea ! Does it come from epydoc, or it's twisted related ?

2 2

[Twisted-Python] sessions example
by stephan Nov. 7, 2003

Nov. 7, 2003

Just by reading the API doc I somehow cannot figure out how to use session in the twisted webserver. Would anybody be so kind and give my a short example of how to create a session, store some objects in it and then retrive the same session again. That would be very helpful, thanks, _stephan

3 2

[Twisted-Python] Woven broken by exceptions
by Philippe Lafoucrière Nov. 7, 2003

Nov. 7, 2003

Hi, when Woven (or twistd) catch exceptions like that : exceptions.Exception: Node had a model=rootURL attribute, but the submodel was not found in [<__builtin__.PGAT_Index instance at 0x8488ec4>]. I can't access any pages of the site. I have to restart the whole service ! Is it normal ? (means that is there's a bug on a site, the whole site will crash down) :(

1 0

[Twisted-Python] twistd and woven restart
by Philippe Lafoucrière Nov. 7, 2003

Nov. 7, 2003

Hi, I'm playing with woven and twistd. Every time I change something, I have to stop the server, and start it again (except for HTML changes in templates). Am I doing something wrong ? This is very painful to restart every time ! I'd love to see a deploy tool like a j2ee application server (you would just put your tap in the deploy environnement, and the app server loads it automatically). There was such a tool before in twisted, but it was removed :( (can't remember the name). thx for advice ! -- Phil

1 0

[Twisted-Python] Deferred problem
by vicky lupien Nov. 7, 2003

Nov. 7, 2003

I know that I'd already post a message about deferred but I think I haven't understand very well. I have a function that is suppose to return a new dictionnary but it returns a deferred. class MainPage(pages.BasePage): templateFile = "main.html" def initialize(self, dbpool=None): self.dbpool = dbpool def setUp(self, request, *args): var = self.initPermissions(request) #var is suppose to get the new list print var def wmfactory_welcome(self, request): return "Bienvenue, %s" % request.getComponent(myguard.Authenticated).name def initPermissions(self, request): #create and return the results of a sql query group = request.getComponent(myguard.Authenticated).group listGroup = group.split(',') sql = "select permission from permissions where 1" for item in listGroup: sql += " or permissions.group='%s'" % item.lstrip() theDeferred = self.dbpool.runQueryDict(sql) return theDeferred.addCallback(self.makeDict) # suppose to call makeDict when the results has arrived def makeDict(self, results): # when I print what is in results, I can see all the data from the sql query listPermissions = [] for item in results: listPermissions.append(item.get('permission')) return listPermissions # return the new list but the function setUp receive a deferred I've put some comments in the code to help you understand what I want. The big problem is that var receive a deferred and not the new list Vicky

2 1

[Twisted-Python] Form model examples
by Martin Stoufer Nov. 6, 2003

Nov. 6, 2003

I noticed that the Form model document page (http://www.twistedmatrix.com/documents/howto/formindepth) had not been put up yet. Does anyone out there have any working examples that uses this or has some more info on the twisted.web.woven.form <http://www.twistedmatrix.com/documents/TwistedDocs/current/api/toc-twisted.…> class? Furthermore, if I can get enough knowledge on this, I would be happy to help contribute to the formindepth page. -- * Martin C. Stoufer * * MCStoufer(a)lbl.gov * * DIDC/DSD/ITG * * Lawrence Berkeley National Lab * * MS 50B-2215 510-486-6882 *

2 2

[Twisted-Python] SelectReactor, readers and writers
by Sam Jordan Nov. 6, 2003

Nov. 6, 2003

Hi, While looking at the code for the default SelectReactor I noticed that the selectables are stored in the form {object : 1, ...}. Is there any particular reason they're not stored in the format: { fd : object, ...}? A couple I can think of are that duplicate file-descriptors would cause problems (which they currently most likely would anyway) and objects which return different values from fileno based on context would no longer work correctly -- are either of these use-cases valid? The reason i'm bringing this up is because since 2.3 (I think) calls to socket.fileno are wrapped in a python function (as defined in socket.py) which I assume, when called in a tight loop over a large number of objects may result in a bottleneck (I certainly remember profiling code in the past where this was the case). This could be alleviated by passing a sequence of integers to select instead of the connection objects themselves. It could be that i'm missing something, or it could also be that this has never come up because until a short time ago socket.fileno was, of course, a C function :-). Another thing to think about for the future is that on September 10 selectmodule.c was changed so that select.select now supports any sequence. Currently SelectReactor makes a list from the readers and writers dictionary (calling dict.keys()) every iteration -- of course this is likely to remain the same for a while considering the need for backwards compatibility and i'm not even sure if the patch has been backported to 2.3 yet (unlikely since my 2.3.2 is dated Oct 6 and it does not exhibit this behaviour). Still, it's interesting to note for the future. Cheers, Sam.

1 0

[Twisted-Python] MANIFEST.in for RPMs
by John Landahl Nov. 6, 2003

Nov. 6, 2003

If anyone has an interest in using the bdist_rpm option with setup.py to build Twisted RPMs, the MANIFEST.in file needs the following additions: include twisted/runner/portmap.c include twisted/protocols/_c_urlarg.c include twisted/lore/template.mgp include twisted/web/woven/FlashConduit* include twisted/web/woven/WebConduit* include twisted/test/process.alias.sh* include twisted/test/rfc822.message include twisted/test/server.pem Also, for a Twisted installation that works with any installed version of Python (e.g. 2.2 and 2.3), you can install Twisted to /usr/lib/site-python by adding these lines to setup.cfg: [install] install-lib = /usr/lib/site-python /usr/lib/site-python seems far more convenient than /usr/lib/pythonX/site-packages, don't know why it isn't the default. John Landahl john(a)landahl.org

4 4

[Twisted-Python] smtp server
by rddda Nov. 6, 2003

Nov. 6, 2003

new to twisted. can't figure how to set up smtp server. is there doc somewhere for Twisted.Mail? i will try searching archive next --------------------------------- Do you Yahoo!? Protect your identity with Yahoo! Mail AddressGuard

1 0

[Twisted-Python] request getUser()/getPassword() in Woven and resources...
by Stuart Hungerford Nov. 5, 2003

Nov. 5, 2003

Hi all, I've had a twisted web application running for a while that uses request.getUser() and request.getPassword() in a resource subclass render() method to make the web browser prompt for a username/password. I've been refactoring this application to use Woven page subclasses and the same request.getFoo() calls now return empty strings rather than None, and no prompting from the browser is done. Is there some gotcha in using request.getUser() and request.getPassword() from Woven page subclasses? Cheers, Stu -- :: Stuart Hungerford (stuart.hungerford(a)anu.edu.au) :: ANU Internet Futures Group

2 1

[Twisted-Python] Woven web question about clearing http request.args
by Hegedus, Matthew S Nov. 5, 2003

Nov. 5, 2003

I've got multiple input buttons and their view is the same logic. The logic is delete some data on a button press, then rerender the page with the updated data. The data it will remove depends on the unique ID of the button pressed. When the web page is rerendered the view gets called for each button with the same http request, so the deletion logic will be evaluated for each button, even though it should be evaluated for just the button that was pressed. I don't like that. I want to clear request.args so the behavior will be as if there was only one http event, corresponding to a single button press. I tried "request.args.clear()", but that doesn't seem to have the expected effect. What's worse is when I click the browser's reload button, request.args still has the last http request that occurred. In other words, if I click my delete button the page will be rerendered with updated data, then if I click the browser's reload it will try to delete more data as if I had hit on of my delete buttons again. Can anyone help me with this problem? _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

2 1

[Twisted-Python] form and submit
by vicky lupien Nov. 3, 2003

Nov. 3, 2003

I have a form with a submit button. I want to send my data from the form in a web page to an other web page. Also, I want to check if the data is correct. I'm new to twisted, so I need some help Vicky _________________________________________________________________ MSN Messenger : discutez en direct avec vos amis ! http://messenger.fr.msn.ca/

2 1

[Twisted-Python] Dynamic form with twisted
by vicky lupien Nov. 3, 2003

Nov. 3, 2003

I really need help. I want to make a form dynamically. I don't want to use FormProcess and I do not understand very well how it works. If someone have documentation on forms (not the one on twisted matrix), it will be appreciated. Vicky _________________________________________________________________ MSN Messenger : discutez en direct avec vos amis ! http://messenger.fr.msn.ca/

3 2

[Twisted-Python] design issue wrt exceptional events
by Dennis Allison Nov. 3, 2003

Nov. 3, 2003

I need a front-end to a complex of Zope systems. The front-end listens on an address/port and examines incoming http transactions, and, based upon http headers and other information, connects to one or another of the Zope systems. The underlying approach is straightforward -- a Listener waits for a http transaction, it spawns a receiver which gathers the message, decides what to do, spawns a sender to the destination. When the sender responds, the process is reversed. I currently use an adaptation of Antony Baxter's pydirector to do the job. I use his asynchat version, but have found that it leaks file descriptors in my application. I've not tried the twisted version. So I thought I'd try to craft a tailored, light-weight version using the twisted framework. I see how to manage things when everything works, but what if one or another of the endpoints fails? How do I get everything cleaned up?

2 3

[Twisted-Python] Adapting RemoteReferences
by Sam Jordan Nov. 3, 2003

Nov. 3, 2003

Hi, What is the general opinion on having a standard way to adapt RemoteReferences to specific interfaces which basically just wraps callRemote for each respective method? The reason i'm bringing this up is I can imagine various use-cases for wanting to treat remote objects and local objects as semantically equivalent. For example, I may be employing the observer pattern for a simple system to separate UI components from data components. Currently if I wish to have both remote and local observers interoperate I would have to either store them in separate data structures and treat each differently when sending notifications, or, I could store them in a single data structure and use appropriate type-checking to dispatch the calls. IMHO both of these solutions are relatively ugly. Whether or not there are sufficient use-cases for a standard twisted way to do this is another story, so i'm wondering what the views of people are on this subject. Certainly one could just register their own adapter for RemoteReference in each case, but the code to do this is rather ugly and for those that _do_ have to deal with such cases I think it would be nicer to have a simple, standard way of doing it, e.g. remoteRef.adaptTo(Interface). I've written a function that outlines the functionality I think it should provide which is included below; while this implementation is rather ugly i'm more worried about the idea rather than how it would eventually be implemented if someone decides this is worth having. Of course, there are certain constraints, such as the method wrappers having no way of knowing if the remote object actually implements the desired interface or not, but I don't see this as a problem for something that already requires string based dispatch. I guess you could say this proposal is somewhat similar to java's 'stub' approach, only it doesn't force it :-). Cheers, Sam. ------------------------------------------ import types class Interface: def add(x,y): pass def mul(x,y): pass class Interface2(Interface): def div(x,y): pass def sub(x,y): pass class Foo: def callRemote(self, name, *args, **kw): print 'calling %s with %s %s' % (name, args, kw) # this would likely put put in RemoteReference # to provide context def adaptTo(self, interface): # obtain all interface methods methods = interface.__dict__ for base in interface.__bases__: for attrib,val in base.__dict__.iteritems(): if not methods.has_key(attrib) and isinstance(val, types.FunctionType): methods[attrib] = base.__dict__[attrib] class _Adapter: def __init__(self, original): self.original = original for m in methods: exec "def %s(self, *args, **kw): return self.original.callRemote('%s', *args, **kw)" % (m,m) del _Adapter.m del _Adapter.methods return _Adapter(self) def test(): a = adaptTo(Foo(), Interface2) a.add(1,2) a.mul(2,4) a.div(8,4) a.sub(3,5) test() ------------------------------------------

3 3

[Twisted-Python] Socket Read Write
by Ted Patrick Nov. 3, 2003

Nov. 3, 2003

I am writing a chat socket server and need to make sure that there are no conflicts when writing to other attached clients. I am concerned that when the server receives lots of messages from many socket connections, several sockets may encounter write contention. Is there a queue for the write method of a socket? Should one expect errors in this regard? Does the Twisted architecture eliminate this class of error? Using twisted.protocol.basic can 2 lineReceived events happen simultaneously? How is this addressed? Thanks, Theodore E. Patrick PowerSDK - Code for a distributed world http://www.powersdk.com

2 1

[Twisted-Python] SNMPProtocol, request for review...
by Mike C. Fletcher Nov. 2, 2003

Nov. 2, 2003

I've built an SNMP Protocol for Twisted (based on a pattern from Patrick K. O'Brien), but as I'm a rather new Twisted developer, I'm wondering if someone more "in the know" could take a look at the package and see if I got the "ideas" right. That is, whether I'm going about the entire thing incorrectly/correctly, or whether I've missed anything that would be obvious to an experienced twisted developer. The protocol provides for sending get, getnext and getbulk requests, but doesn't yet support trap or answering any query (i.e. in SNMP-eese it's a manager-only protocol at the moment, not an agent-side protocol). I'm particularly interested in: * whether the timeouts are handled properly (we do a crude callLater and check for deferred.called for them), is there a more elegant Twisted mechanism for handling timed-out operations? * whether the message IDs are handled properly (we just store all "live" messages in a dictionary and delete them when they are timed out or responded to), is there some more elegant Twisted solution? * whether the entire approach is okay. I put most of the code and API on the protocol object, with a helper object for managing tabular downloads. Is there a more "Twisted" way of doing this? Should the get method on the protocol be implemented as a separate object driving the protocol as well? What should be in the "protocol" level, (as opposed to higher-level "application" code)? Package is here: http://members.rogers.com/mcfletch/programming/TwistedSNMP-0.1.tar.gz It requires pysnmp-3.3.5, available here: http://download.sourceforge.net/pysnmp/ You'll need an SNMP agent against which to test (as well as some OIDs for that agent), as the ips in the scripts won't work without the proper community IDs (or from unrecognised manager IPs, for that matter). Feedback appreciated, Mike _______________________________________ Mike C. Fletcher Designer, VR Plumber, Coder http://members.rogers.com/mcfletch/

2 1

[Twisted-Python] connectTCP/listenTCP socks/ssh
by Kev Nov. 1, 2003

Nov. 1, 2003

I'm writing a socks proxy that uses ssh tunnels for connections, I can get it working by making my connectClass listenTCP with a forwarding.SSHListenForwardingFactory and then ClientCreator a SOCKSv4Outgoing to connectTCP, but obviously that's a bad method. How can I cut the listen/connect? Is there a way I can do it at that level or do I need to implement my own .connectSSH method? It seems I need to get both sides placed in the reactor somehow, but SSHChannel.conn doesn't have a fileno() so addReader doesn't accept it. (Is addReader the right function? I found it in the curses example and am assuming it's just a generic file descriptor handler) Thanks much

2 2