sequential multiple processes

Wolodja Wentland wentland at cl.uni-heidelberg.de
Sat Oct 24 18:07:14 CEST 2009


On Sun, Oct 25, 2009 at 00:41 +0900, Hyunchul Kim wrote:
>    How to run multiple processes with sequential input of a thousand of data    
>    in a script run?                                                             
>    I have a python script and 1,000 independent input data for it.              
>    Previously, I divided input data into n groups and ran a  same python        
>    script n times to use n processors.                                          
>    It's inconvenient.                                                           
>    How can I do same thing in a signle script running?                          

Have a look at [1] it describes a way to multiplex data to different
receivers. You can then combine that with the multiprocessing/threading
module in the stdlib.

kind regards

    Wolodja

[1] http://www.dabeaz.com/generators/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 853 bytes
Desc: Digital signature
URL: <http://mail.python.org/pipermail/python-list/attachments/20091024/c1a0b9cd/attachment.pgp>


More information about the Python-list mailing list