Suggestions on mechanism or existing code - maintain persistence of file download history
R.Wieser
address at not.available
Fri Jan 31 04:40:55 EST 2020
jkn,
> I think a combination of hashing the URL,
I hope you're not thinking of saving the hash (into the "done" list) instead
if the URL itself. While hash collisions do not happen often (especially
not in a small list), you cannot rule them out. And when that happens that
would mean you would be skipping downloads ...
Regards,
Rudy Wieser
More information about the Python-list
mailing list