Hi, I made some changes to the ParallelProgramming wiki page to outline use of the (multi)processing module as well as the threading module. I'm very much not an expert on this - just researched it for myself, so please feel free to correct/ extend/ delete as appropriate. Robin
On Monday 27 October 2008 12:56:56 Robin wrote:
Hi,
I made some changes to the ParallelProgramming wiki page to outline use of the (multi)processing module as well as the threading module.
I'm very much not an expert on this - just researched it for myself, so please feel free to correct/ extend/ delete as appropriate.
I would mention the backport of multiprocessing for python-2.{4,5}: http://code.google.com/p/python-multiprocessing so the amount of editing when one switches from 2.{4,5} to 2.6 is minimal :) cheers, sebastien. -- ################################### # Dr. Sebastien Binet # Lawrence Berkeley National Lab. # 1 Cyclotron Road # Berkeley, CA 94720 ###################################
On Mon, Oct 27, 2008 at 15:20, Sebastien Binet <hep.sebastien.binet@gmail.com> wrote:
On Monday 27 October 2008 12:56:56 Robin wrote:
Hi,
I made some changes to the ParallelProgramming wiki page to outline use of the (multi)processing module as well as the threading module.
I'm very much not an expert on this - just researched it for myself, so please feel free to correct/ extend/ delete as appropriate.
I would mention the backport of multiprocessing for python-2.{4,5}: http://code.google.com/p/python-multiprocessing so the amount of editing when one switches from 2.{4,5} to 2.6 is minimal :)
Go for it. The wiki is open to editing. -- Robert Kern "I have come to believe that the whole world is an enigma, a harmless enigma that is made terrible by our own mad attempt to interpret it as though it had an underlying truth." -- Umberto Eco
Hi, Their exist open source version of parallel BLAS library. I modified the section "Use parallel primitives" to tell it. But my English is bad, so if someone can check it, it would be nice. Fred On Mon, Oct 27, 2008 at 4:24 PM, Robert Kern <robert.kern@gmail.com> wrote:
On Mon, Oct 27, 2008 at 15:20, Sebastien Binet <hep.sebastien.binet@gmail.com> wrote:
On Monday 27 October 2008 12:56:56 Robin wrote:
Hi,
I made some changes to the ParallelProgramming wiki page to outline use of the (multi)processing module as well as the threading module.
I'm very much not an expert on this - just researched it for myself, so please feel free to correct/ extend/ delete as appropriate.
I would mention the backport of multiprocessing for python-2.{4,5}: http://code.google.com/p/python-multiprocessing so the amount of editing when one switches from 2.{4,5} to 2.6 is minimal :)
Go for it. The wiki is open to editing.
-- Robert Kern
"I have come to believe that the whole world is an enigma, a harmless enigma that is made terrible by our own mad attempt to interpret it as though it had an underlying truth." -- Umberto Eco _______________________________________________ Numpy-discussion mailing list Numpy-discussion@scipy.org http://projects.scipy.org/mailman/listinfo/numpy-discussion
Did you mean this one http://www.netlib.org/scalapack/pblas_qref.html ? As for the ParallelProgramming wiki page, there are some words in section "Use parallel primitives" about numpy.dot still I can't understand from the section: if I get numpy from sources and compile it (via "python setup.py build") in my AMD X2, will numpy.dot use 2nd CPU or not? Regards, D. Frédéric Bastien wrote:
Hi,
Their exist open source version of parallel BLAS library. I modified the section "Use parallel primitives" to tell it. But my English is bad, so if someone can check it, it would be nice.
Fred
On Mon, Oct 27, 2008 at 4:24 PM, Robert Kern <robert.kern@gmail.com> wrote:
On Mon, Oct 27, 2008 at 15:20, Sebastien Binet <hep.sebastien.binet@gmail.com> wrote:
On Monday 27 October 2008 12:56:56 Robin wrote:
Hi,
I made some changes to the ParallelProgramming wiki page to outline use of the (multi)processing module as well as the threading module.
I'm very much not an expert on this - just researched it for myself, so please feel free to correct/ extend/ delete as appropriate.
I would mention the backport of multiprocessing for python-2.{4,5}: http://code.google.com/p/python-multiprocessing so the amount of editing when one switches from 2.{4,5} to 2.6 is minimal :)
Go for it. The wiki is open to editing.
-- Robert Kern
"I have come to believe that the whole world is an enigma, a harmless enigma that is made terrible by our own mad attempt to interpret it as though it had an underlying truth." -- Umberto Eco _______________________________________________ Numpy-discussion mailing list Numpy-discussion@scipy.org http://projects.scipy.org/mailman/listinfo/numpy-discussion
_______________________________________________ Numpy-discussion mailing list Numpy-discussion@scipy.org http://projects.scipy.org/mailman/listinfo/numpy-discussion
On Mon, Oct 27, 2008 at 9:17 PM, dmitrey <dmitrey.kroshko@scipy.org> wrote:
As for the ParallelProgramming wiki page, there are some words in section "Use parallel primitives" about numpy.dot still I can't understand from the section: if I get numpy from sources and compile it (via "python setup.py build") in my AMD X2, will numpy.dot use 2nd CPU or not?
Not unless you build numpy against a paralell enabled BLAS, for example Intel MKL, ATLAS etc. I think if you compile ATLAS with threading enabled, and then build numpy using the appropriate ptlapack libraries (I forget the exact name) then the dot should use the second CPU. As Frederic added to the wiki - the number of threads to use can only be provided to atlas at compile time. With MKL I think you can choose this at run time (I think through an environment variable but I'm not sure). Similarly with the GOTO blas, but I'm not sure if numpy builds with that, so maybe we should take that reference out. Robin
On Mon, Oct 27, 2008 at 5:28 PM, Robin <robince@gmail.com> wrote: [...]
Similarly with the GOTO blas, but I'm not sure if numpy builds with that, so maybe we should take that reference out.
I'd like to let it their, as it is at the same performance level then MKL. ATLAS don't have the same performence level of MKL... If you build GOTO BLAS and build lapack with it, it should link with numpy. But I haven't the time to test this. Fred
participants (5)
-
dmitrey -
Frédéric Bastien -
Robert Kern -
Robin -
Sebastien Binet