On Fri, Jan 23, 2009 at 12:07 PM, amit sethi <amit.pureenergy at gmail.com> wrote: > well thanks ... it worked well ... but robotparser is in urllib isn't there > a module like robotparser in > urllib2 You'll have to ask someone else about that part... -- André Engels, andreengels at gmail.com