[BangPypers] Help in understanding Hadoop with python

vijay vnbang2003 at yahoo.com
Thu Oct 18 04:31:32 CEST 2012


Yoganand,

    Thanks for helping . Will give try on this .

With Thanks
Vijay



________________________________
 From: Yoganand Anandaraju <yoganand at gmx.com>
To: vijay <vnbang2003 at yahoo.com>; Bangalore Python Users Group - India <bangpypers at python.org> 
Sent: Wednesday, 10 October 2012 12:01 PM
Subject: Re: [BangPypers] Help in understanding Hadoop with python
 

You can write python map-reduce for hadoop by using HadoopStreaming. Take a look at this example http://www.michael-noll.com/tutorials/writing-an-hadoop-mapreduce-program-in-python/.

For processing Bigdata, I suggest take a look at Disco Framework http://discoproject.org/. I felt it was much easier using disco than Hadoop.

thanks,
Yoganand 


 
----- Original Message -----
>From: vijay
>Sent: 10/10/12 11:41 AM
>To: Bangalore Python Users Group - India
>Subject: [BangPypers] Help in understanding Hadoop with python
>
>Hi , 
   I am planing to use hadoop for processing millions record text file for my project .Am looking for suggestion on hadoop with python programs. 
   If any one has used do let me know. 
    
With Thanks 
Vijay 
_______________________________________________ 
BangPypers mailing list 
BangPypers at python.org 
http://mail.python.org/mailman/listinfo/bangpypers


More information about the BangPypers mailing list