Orders of magnitude

[Paul Rubin]

"Robert Brewer" <fumanchu at amor.org> writes:
> No, don't rewrite it! :D I have even *more* requirements, which are
> mostly in my code but not really documented, and some are changing. I'm
> working on a more scalable solution, since I then need to apply the same
> code to a 20-million-record DB. I'm doing fine--just wondered in
> particular about ways to optimize that single step. Thanks for your
> help.

Maybe you're at the point where you should use a real database
(e.g. MySQL) to hold that kind of data, instead of rolling your own
and messing with it on the fly.