How to remove subset from a file efficiently?

[bonono at gmail.com]

fynali wrote:
> Sorry, pls read that ~15 secs.
That is more or less about it. As set() is faster than dict(), about 2x
on my machine and I assume a portion of your time is in set/dict
creation as it is pretty large data set.