FW: [spambayes-dev] Results for DNS lookup in tokenizer

[Skip Montanaro]

    >> I'll restate my question.  What does Matt's proposal do that
    >> mine_received_headers doesn't do already?

    Phillip> It looks at URLs embedded in the message *body*.  As a simple
    Phillip> contrast, if I link here to:

    Phillip> http://enlarge-my-spam.com?id=123456

    Phillip> That will produce a very *different* set of IP tokens than the
    Phillip> Received: headers of this message.  

Ah, okay.  I missed that in Matt's post.  If the tokenizer's
x-pick_apart_urls option is True, it picks apart URLs embedded in the body
of the message.  It's not as ip-centered as Matt's code.

Skip