On Friday, January 31, 2020 at 9:41:32 AM UTC, R.Wieser wrote:
> jkn,
>
> > I think a combination of hashing the URL,
>
> I hope you're not thinking of saving the hash (into the "done" list) instead
> if the URL itself. While hash collisions do not happen often (especially
> not in a small list), you cannot rule them out. And when that happens that
> would mean you would be skipping downloads ...
>
> Regards,
> Rudy Wieser
I'm happy to consider the risk and choose (eg.) the hash function accordingly,
thanks.
Jon N
--
https://mail.python.org/mailman/listinfo/python-list