[BangPypers] Help in understanding Hadoop with python
vijay
vnbang2003 at yahoo.com
Thu Oct 18 04:31:32 CEST 2012
Yoganand,
Thanks for helping . Will give try on this .
With Thanks
Vijay
________________________________
From: Yoganand Anandaraju <yoganand at gmx.com>
To: vijay <vnbang2003 at yahoo.com>; Bangalore Python Users Group - India <bangpypers at python.org>
Sent: Wednesday, 10 October 2012 12:01 PM
Subject: Re: [BangPypers] Help in understanding Hadoop with python
You can write python map-reduce for hadoop by using HadoopStreaming. Take a look at this example http://www.michael-noll.com/tutorials/writing-an-hadoop-mapreduce-program-in-python/.
For processing Bigdata, I suggest take a look at Disco Framework http://discoproject.org/. I felt it was much easier using disco than Hadoop.
thanks,
Yoganand
----- Original Message -----
>From: vijay
>Sent: 10/10/12 11:41 AM
>To: Bangalore Python Users Group - India
>Subject: [BangPypers] Help in understanding Hadoop with python
>
>Hi ,
I am planing to use hadoop for processing millions record text file for my project .Am looking for suggestion on hadoop with python programs.
If any one has used do let me know.
With Thanks
Vijay
_______________________________________________
BangPypers mailing list
BangPypers at python.org
http://mail.python.org/mailman/listinfo/bangpypers
More information about the BangPypers
mailing list