Trent,

Can you post source for the regular and pyparallel HTTP servers you used?

On Wed, Nov 26, 2014 at 12:56 PM, Trent Nelson <trent@snakebite.org> wrote:
Relevant part of the video with the normal Python stats on the left and PyParallel on the right:

https://www.youtube.com/watch?v=4L4Ww3ROuro#t=838

Transcribed stats:

Regular Python HTTP server:

Thread Stats    Avg     Stdev   Max
 Latency        4.93ms  714us   10ms
 Req/Seq        552     154     1.1k
10,480 requests in 10s, 69MB
1048 reqs/sec, 6.9MB/s

PyParallel (4 core Windows VM):

Thread Stats    Avg     Stdev   Max
 Latency        2.41ms  531us   10ms
 Req/Seq        1.74k   183     2.33k
32,831 requests in 10s, 216MB
3263 reqs/sec, 21MB/s

So basically a bit less than linear scaling with more cores, which isn't too bad for a full debug build running on a VM.

-----Original Message-----
From: Trent Nelson
Sent: Wednesday, November 26, 2014 3:36 PM
To: 'Paul Colomiets'; python-ideas
Subject: RE: [Python-ideas] Asynchronous IO ideas for Python

Have you seen this?:

        https://speakerdeck.com/trent/pyparallel-how-we-removed-the-gil-and-exploited-all-cores

I spend the first 80-ish slides on async I/O.

(That was a year ago.  I've done 2-3 sprints on it since then and have gotten it to a point where I can back up the claims with hard numbers on load testing benchmarks, demonstrated in the most recent video: https://www.youtube.com/watch?v=4L4Ww3ROuro.)


        Trent.

-----Original Message-----
From: Python-ideas [mailto:python-ideas-bounces+trent=snakebite.org@python.org] On Behalf Of Paul Colomiets
Sent: Wednesday, November 26, 2014 12:35 PM
To: python-ideas
Subject: [Python-ideas] Asynchronous IO ideas for Python

Hi,

I've written an article about how I perceive the future of asynchronous I/O in Python. It's not something that should directly be incorporated into python now, but I believe it's useful for python-ideas list.

https://medium.com/@paulcolomiets/the-future-of-asynchronous-io-in-python-ce200536d847

And a place for comments at Hacker News:

https://news.ycombinator.com/item?id=8662782

I hope being helpful with this writeup :)

--
Paul
_______________________________________________
Python-ideas mailing list
Python-ideas@python.org
https://mail.python.org/mailman/listinfo/python-ideas
Code of Conduct: http://python.org/psf/codeofconduct/
_______________________________________________
Python-ideas mailing list
Python-ideas@python.org
https://mail.python.org/mailman/listinfo/python-ideas
Code of Conduct: http://python.org/psf/codeofconduct/



--
--Guido van Rossum (python.org/~guido)