[BangPypers] Help in understanding Hadoop with python

Yoganand Anandaraju yoganand at gmx.com
Wed Oct 10 08:31:13 CEST 2012


You can write python map-reduce for hadoop by using HadoopStreaming. Take a look at this example http://www.michael-noll.com/tutorials/writing-an-hadoop-mapreduce-program-in-python/ .

 For processing Bigdata, I suggest take a look at Disco Framework http://discoproject.org/ . I felt it was much easier using disco than Hadoop.

 thanks,
 Yoganand 

----- Original Message -----
From: vijay
Sent: 10/10/12 11:41 AM
To: Bangalore Python Users Group - India
Subject: [BangPypers] Help in understanding Hadoop with python

 Hi , I am planing to use hadoop for processing millions record text file for my project .Am looking for suggestion on hadoop with python programs. If any one has used do let me know. With Thanks Vijay _______________________________________________ BangPypers mailing list BangPypers at python.org http://mail.python.org/mailman/listinfo/bangpypers


More information about the BangPypers mailing list