In message: <16370.22611.419923.477159@montanaro.dyndns.org> Skip Montanaro <skip@pobox.com> writes:

There's the rub. What might be really good ideas at this point will probably only result in very small changes in performance because the baseline system is currently so good.

Aye, I think that's what killed this sort of tokenizer/classifier testing a year ago... - Alex