Mailman 3 January 2013 - Twisted-web

Test
by Philippe Lafoucrière 06 Aug '21

06 Aug '21

Hi all just a test

3 2

Re: [Twisted-web] [Twisted-Python] Speed of rendering?
by Glyph 28 Feb '13

28 Feb '13

On Jun 22, 2012, at 2:52 PM, Peter Westlake <peter.westlake(a)pobox.com> wrote: > On Thu, Jun 21, 2012, at 10:16, Glyph wrote: >> >> Le Jun 21, 2012 à 6:52 AM, Peter Westlake <peter.westlake(a)pobox.com> a >> écrit : >> >>> How fast is rendering in nevow? I have a page which is mostly a large >>> table with a couple of hundred rows, each containing a form. The >>> generated HTML is about 500 KB. Leaving aside the question of whether >>> this is a good design or not, how long would you expect it to take? I'm >>> interested specifically in what happens between the end of beforeRender >>> and the request being completed. It takes about a minute and a quarter. >>> Is that normal, or is there a delay in my code that I haven't found yet? >>> >>> Thanks, >>> >>> Peter. >> >> What does your profiler tell you? > > There's a profiler? There's a profiler! There it is, > right up there at the top of the man page! Thank you! Not only is there a profiler, there's benchmarks! <http://speed.twistedmatrix.com/timeline/> Maybe you could add one for twisted.web.template rendering speed? > Peter. > > P.S. sorry, this was really meant to go to the twisted-web list. > I suspect a last-minute substitution by my email client. Thanks for the thought, at least. Cross-posted. -glyph

3 21

Re: [Twisted-web] Twisted-web Digest, Vol 105, Issue 2
by Levi Nie 15 Jan '13

15 Jan '13

tks 2013/1/6 <twisted-web-request(a)twistedmatrix.com> > Send Twisted-web mailing list submissions to > twisted-web(a)twistedmatrix.com > > To subscribe or unsubscribe via the World Wide Web, visit > http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-web > or, via email, send a message with subject or body 'help' to > twisted-web-request(a)twistedmatrix.com > > You can reach the person managing the list at > twisted-web-owner(a)twistedmatrix.com > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Twisted-web digest..." > > > Today's Topics: > > 1. Re: [Twisted-Python] Speed of rendering? (Peter Westlake) > 2. Re: [Twisted-Python] Speed of rendering? > (exarkun(a)twistedmatrix.com) > 3. file upload with twisted (Levi Nie) > 4. Re: file upload with twisted (Glyph) > 5. Re: file upload with twisted (??????? ?????) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 04 Jan 2013 18:30:47 +0000 > From: Peter Westlake <peter.westlake(a)pobox.com> > Subject: Re: [Twisted-web] [Twisted-Python] Speed of rendering? > To: Twisted Web World <twisted-web(a)twistedmatrix.com> > Message-ID: > < > 1357324247.31399.140661173476561.11F56E5E(a)webmail.messagingengine.com> > > Content-Type: text/plain > > A while back I promised to write some benchmarks for > twisted.web.template's flattening functions. Is something like this > suitable? If so, I'll add lots more test cases. The output format could > be improved, too - any preferences? > > Peter. > > from twisted.web.template import flatten > from twisted.web.server import Request > import twisted.web.http > > channel = twisted.web.http.HTTPChannel() > request = Request(channel, False) > > > def make(content): > def f(): > d = flatten(request, content, lambda _: None) > assert d.called > return f > > > def test(content): > return timeit.timeit(stmt=make(content), number=repeats) > > repeats = 1000 > > deeplist = ['centre'] > for n in range(100): > deeplist = [deeplist] > > tests = { > 'empty': '', > 'string': 'hello', > 'shortlist': ['hello'], > 'longlist': [str(n) for n in range(100)], > 'deeplist': deeplist, > } > > > if __name__ == '__main__': > import timeit > from sys import argv > for name in argv[1:] or tests: > print name, test(tests[name]) > > > > ------------------------------ > > Message: 2 > Date: Fri, 04 Jan 2013 19:58:13 -0000 > From: exarkun(a)twistedmatrix.com > Subject: Re: [Twisted-web] [Twisted-Python] Speed of rendering? > To: Twisted Web World <twisted-web(a)twistedmatrix.com> > Message-ID: > > <20130104195813.4649.1661214274.divmod.xquotient.20(a)localhost6.localdomain6 > > > > Content-Type: text/plain; charset="utf-8"; format="flowed" > > On 06:30 pm, peter.westlake(a)pobox.com wrote: > >A while back I promised to write some benchmarks for > >twisted.web.template's flattening functions. Is something like this > >suitable? If so, I'll add lots more test cases. The output format could > >be improved, too - any preferences? > > The output should be something that we can load into our codespeed > instance. The output of any of the existing benchmarks in lp:twisted- > benchmarks should be a good example of that format (I don't even recall > what it is right now - it may not even be a "format" so much as a shape > of data to submit to an HTTP API). > > The `timeit` module is probably not suitable to use to collect the data, > as it makes some questionable choices with respect to measurement > technique, and at the very least it's inconsistent with the rest of the > benchmarks we have. > > Selecting data to operate on is probably an important part of this > benchmark (or collection of benchmarks). It may not be possible to > capture all of the interesting performance characteristics in a single > dataset. However, at least something that includes HTML tags is > probably desirable, since that is the primary use-case. > > There are some other Python templating systems with benchmarks. One > approach that might make sense is to try to build analogous benchmarks > for twisted.web.template. (Or perhaps a little thought will reveal that > it's not possible to make comparisons between twisted.web.template and > those systems, so there's no reason to follow their benchmarking lead.) > > Jean-Paul > >Peter. > > > >from twisted.web.template import flatten > >from twisted.web.server import Request > >import twisted.web.http > > > >channel = twisted.web.http.HTTPChannel() > >request = Request(channel, False) > > > > > >def make(content): > > def f(): > > d = flatten(request, content, lambda _: None) > > assert d.called > > return f > > > > > >def test(content): > > return timeit.timeit(stmt=make(content), number=repeats) > > > >repeats = 1000 > > > >deeplist = ['centre'] > >for n in range(100): > > deeplist = [deeplist] > > > >tests = { > > 'empty': '', > > 'string': 'hello', > > 'shortlist': ['hello'], > > 'longlist': [str(n) for n in range(100)], > > 'deeplist': deeplist, > >} > > > > > >if __name__ == '__main__': > > import timeit > > from sys import argv > > for name in argv[1:] or tests: > > print name, test(tests[name]) > > > >_______________________________________________ > >Twisted-web mailing list > >Twisted-web(a)twistedmatrix.com > >http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-web > > > > ------------------------------ > > Message: 3 > Date: Sat, 5 Jan 2013 09:50:37 +0800 > From: Levi Nie <levinie001(a)gmail.com> > Subject: [Twisted-web] file upload with twisted > To: "twisted-web(a)twistedmatrix.com" <twisted-web(a)twistedmatrix.com> > Message-ID: > <CAEMsKDudEvLCeVf= > sVPW_BE7rX2qtx9rAQERvssAMsckF9yYfA(a)mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > When i send a http request with a big file, can i check the content-length > then enable or disable the > file upload? > > I use the s3cmd client sent the request. And i need disable the file upload > if the file size is over the quota. > > how can i do this? >

1 0

interrupt the file sending if the file size over the quota...some errors here...
by Levi Nie 15 Jan '13

15 Jan '13

i want to interrupt the file sending. but i can't change the client. so i need change the server. All things go well, but the message i wanna response seem not work. is the self.transport.loseConnection() (the last line) blocking the messages? in fact, i work on Cumulus(nimbus project) which based on twisted. And i use s3cmd as the client. here is the my code: def headerReceived(self,line): pycb.log(logging.INFO, "===== def headerReceived of cumulus.py") http.HTTPChannel.headerReceived(self,line) pycb.log(logging.INFO, "===== self.length is %s"%self.length) header, data = line.split(':', 1) header = header.lower() data = data.strip() if header=='authorization': self.authorization=data if self.length and self.authorization: user_id = self.authorization.split(':')[0].split()[1].strip() user = pycb.config.auth.get_user(user_id) pycb.log(logging.INFO, "===== user who put this object is %s"%user) remaining_quota = user.get_remaining_quota() pycb.log(logging.INFO, "===== remaining_quota is %s"%remaining_quota) quota_check=self.length-remaining_quota pycb.log(logging.INFO, "===== quota_check=self.length-remaining_quota of cumulus.py") if quota_check>0: requestId = str(uuid.uuid1()).replace("-", "") ex=cbException('AccountProblem') m_msg = "HTTP/1.1 %s %s\r\n" % (ex.httpCode, ex.httpDesc) self.transport.write(m_msg) m_msg = "%s: %s\r\n" % (('x-amz-request-id', requestId)) self.transport.write(m_msg) #req.setHeader('x-amz-request-id', requestId) m_msg = "%s: %s\r\n" % (('x-amz-id-2', str(uuid.uuid1()))) self.transport.write(m_msg) e_msg = ex.make_xml_string(self._path, str(uuid.uuid1())) pycb.log(logging.INFO, "===== e_msg is %s"%e_msg) #self.transport.write("\r\n") self.transport.write(e_msg) pycb.log(logging.INFO, "===== self.transport.write(e_msg)") self.transport.loseConnection()

1 0

file upload with twisted
by Levi Nie 05 Jan '13

05 Jan '13

When i send a http request with a big file, can i check the content-length then enable or disable the file upload? I use the s3cmd client sent the request. And i need disable the file upload if the file size is over the quota. how can i do this?

3 2

Redirect after login with nevow guard
by Peter Westlake 05 Jan '13

05 Jan '13

I'm using nevow.guard, and when someone logs in I would like to send them to the URL they originally typed. It's possible to do this by posting to the URL guard.LOGIN_AVATAR + other stuff, e.g. to go to http://example.com/foo/bar after logging in, the login page should post to http://example.com/__login__/foo/bar. This works nicely. The problem is, the login page doesn't know that the user was trying to go to foo/bar. How can it get that information? I would have thought that it would be available as the segments argument in locateChild, but for some reason it isn't. Before logging in, the segments argument is always empty. Peter.

2 2