Aug. 21, 2002
3:49 a.m.
I wonder if using something like SciPy's weave tool would make it (relatively) painless to incorporate fairly high-speed scanners into Python programs.
I haven't given up on the re module for fast scanners (see Tim's note on the speed of tokenizing 20,000 messages in mere minutes). Note that the Bayes approach doesn't *need* a trick to apply many regexes in parallel to the text. --Guido van Rossum (home page: http://www.python.org/~guido/)