[BangPypers] Help in understanding Hadoop with python
vnbang2003 at yahoo.com
Thu Oct 18 04:31:32 CEST 2012
Thanks for helping . Will give try on this .
From: Yoganand Anandaraju <yoganand at gmx.com>
To: vijay <vnbang2003 at yahoo.com>; Bangalore Python Users Group - India <bangpypers at python.org>
Sent: Wednesday, 10 October 2012 12:01 PM
Subject: Re: [BangPypers] Help in understanding Hadoop with python
You can write python map-reduce for hadoop by using HadoopStreaming. Take a look at this example http://www.michael-noll.com/tutorials/writing-an-hadoop-mapreduce-program-in-python/.
For processing Bigdata, I suggest take a look at Disco Framework http://discoproject.org/. I felt it was much easier using disco than Hadoop.
----- Original Message -----
>Sent: 10/10/12 11:41 AM
>To: Bangalore Python Users Group - India
>Subject: [BangPypers] Help in understanding Hadoop with python
I am planing to use hadoop for processing millions record text file for my project .Am looking for suggestion on hadoop with python programs.
If any one has used do let me know.
BangPypers mailing list
BangPypers at python.org
More information about the BangPypers