[Baypiggies] Web Crawler/Backend Engineer - San Francisco, CA

[Jeremy Fishman]

My experience tells me something slightly different about Python:
  * for parallel processing, use multiple processes, ideally one per
processor
  * for responsive I/O with an intuitive model, use threads
  * for high throughput I/O, use asynchronous I/O and/or an event framework

Plenty of relatively high performance systems use one or a combination of
the above.  Clearly some use cases, especially in scientific computing,
require tight parallel loops on local memory.  I find it hard to believe
numpy+boost can't go the distance.

  - Jeremy


--
Jeremy Fishman
Quantcast Corporation
jeremy.r.fishman at gmail.com

On Tue, Feb 2, 2010 at 1:28 PM, Tung Wai Yip <tungwaiyip at yahoo.com> wrote:

> On Tue, 02 Feb 2010 12:17:57 -0800, Crshonda Williams <
> crshonda at hotmail.com> wrote:
>
>
>> Please send resumes to:  crshonda at chompapps.com
>> Crawler/Backend  Engineer
>> Chomp
>> San Francisco, CA
>>
>>  ....
>
>  Experience
>> - Strong Python skills. Experience with building multi-threaded
>> applications in Python
>>
>
>
> I think my experience tells me don't build multi-threaded applications in
> Python ;-)
>
>
> Wai Yip
>
>
>
>
> _______________________________________________
> Baypiggies mailing list
> Baypiggies at python.org
> To change your subscription options or unsubscribe:
> http://mail.python.org/mailman/listinfo/baypiggies
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/baypiggies/attachments/20100202/a685ff21/attachment-0001.htm>