Suggestions on mechanism or existing code - maintain persistence of file download history
jkn
jkn_gg at nicorp.f9.co.uk
Fri Jan 31 09:19:24 EST 2020
On Friday, January 31, 2020 at 9:41:32 AM UTC, R.Wieser wrote:
> jkn,
>
> > I think a combination of hashing the URL,
>
> I hope you're not thinking of saving the hash (into the "done" list) instead
> if the URL itself. While hash collisions do not happen often (especially
> not in a small list), you cannot rule them out. And when that happens that
> would mean you would be skipping downloads ...
>
> Regards,
> Rudy Wieser
I'm happy to consider the risk and choose (eg.) the hash function accordingly, thanks.
Jon N
More information about the Python-list
mailing list