[Tutor] ideas on how to process a file
sander.sweers at gmail.com
Fri Apr 10 19:12:15 CEST 2009
2009/4/10 Spencer Parker <inthefridge at gmail.com>:
> The question is now...what do I do to find duplicate entries in the text
> file I am reading. I just want to filter them out. There are a ton of
> duplicate entries in there.
>>> for line in text_file: # No need for readlines(), a file is iterable
>>> if 'FULLNAME' in line:
>>> write_file.write(line) # writelines() is for writing multiple lines
>>> at once
results = 
for line in text_file:
if 'FULLNAME' in line and line not in results:
Now you write out line immeditaly or wait and write out the results list.
More information about the Tutor