[Spambayes-checkins] spambayes tokenizer.py,1.35,1.36

[Anthony Baxter]

Update of /cvsroot/spambayes/spambayes
In directory usw-pr-cvs1:/tmp/cvs-serv14947

Modified Files:
	tokenizer.py 
Log Message:
*sigh* do them in the right order. 
This is why we run the full test before we do Mr. Checkin, isn't
it, Anthony? 



Index: tokenizer.py
===================================================================
RCS file: /cvsroot/spambayes/spambayes/tokenizer.py,v
retrieving revision 1.35
retrieving revision 1.36
diff -C2 -d -r1.35 -r1.36
*** tokenizer.py	26 Sep 2002 08:24:30 -0000	1.35
--- tokenizer.py	26 Sep 2002 08:35:06 -0000	1.36
***************
*** 1043,1048 ****
              if (part.get_content_type() == "text/plain" or
                      not options.retain_pure_html_tags):
-                 text = html_re.sub(' ', text)
                  text = stylesheet_re.sub(' ', text)
  
              # Tokenize everything in the body.
--- 1043,1048 ----
              if (part.get_content_type() == "text/plain" or
                      not options.retain_pure_html_tags):
                  text = stylesheet_re.sub(' ', text)
+                 text = html_re.sub(' ', text)
  
              # Tokenize everything in the body.