<div dir="ltr"><div>Hi,</div><div><br></div><div>Another approach is to convert the data as Pandas dataframe and use some vector operations.</div><div>A sample code is attached.</div><div><br></div><div>Regards,</div><div>Vignesh</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 24, 2021 at 2:23 PM Saravanan Muthuramalingam <<a href="mailto:saravana4285@gmail.com">saravana4285@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Abirami,<div>     Please find the attached sample to use yield , when you call yield with next keyword, it will iterate and send you next batch of lines , so that your memory will be cleaned and the execution can be fast, try tweaking this to meet your requirement, thanks </div><div><br></div><div>Sara </div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 24, 2021 at 12:12 PM Abirami Moorthy <<a href="mailto:mabirami8799@gmail.com" target="_blank">mabirami8799@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, 24 Jun 2021 at 09:41, Thirunarayanan Srinivasan <<a href="mailto:tstnarayan@gmail.com" target="_blank">tstnarayan@gmail.com</a>> wrote:</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, 24 Jun 2021 at 6:22 AM Saravanan Muthuramalingam <<a href="mailto:saravana4285@gmail.com" target="_blank">saravana4285@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><br></div>Hello,<br><div class="gmail_quote"><div class="gmail_attr">     </div></div></blockquote></div></div></blockquote><div>            Here  25 lakhs tamil words collected link in below </div><div><br></div><div>            <a href="https://github.com/KaniyamFoundation/all_tamil_words" target="_blank">https://github.com/KaniyamFoundation/all_tamil_words</a>. </div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div>i have done a simple program using  above the  text file </div></div></blockquote></div></blockquote></div></div></blockquote><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div><a href="https://github.com/KaniyamFoundation/all_tamil_words" target="_blank">https://github.com/KaniyamFoundation/all_tamil_words</a></div><div>it takes 4 min to execute the program. </div><div dir="auto"></div></div></blockquote></div></blockquote></div></div></blockquote><div>          </div><div>           thankyou for your all kind replies, i'll keep trying what you said.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div dir="auto">Regards,</div><div dir="auto">M.Abirami<br><div dir="auto"><br></div></div></div></blockquote></div></blockquote></div></div>
</blockquote></div></div></div>
_______________________________________________<br>
Chennaipy mailing list<br>
<a href="mailto:Chennaipy@python.org" target="_blank">Chennaipy@python.org</a><br>
<a href="https://mail.python.org/mailman/listinfo/chennaipy" rel="noreferrer" target="_blank">https://mail.python.org/mailman/listinfo/chennaipy</a><br>
</blockquote></div>
_______________________________________________<br>
Chennaipy mailing list<br>
<a href="mailto:Chennaipy@python.org" target="_blank">Chennaipy@python.org</a><br>
<a href="https://mail.python.org/mailman/listinfo/chennaipy" rel="noreferrer" target="_blank">https://mail.python.org/mailman/listinfo/chennaipy</a><br>
</blockquote></div></div>