[Tutor] Creating a webcrawler

[Whom Isac]

Hi I want to create a web-crawler but dont have any lead to choose any
module. I have came across the Jsoup but I am not familiar with how to use
it in 3.5 as I tried looking at a similar web crawler codes from 3.4 dev
version.
I just want to build that crawler to crawl through a javascript enable site
and automatically detect a download link (for video file)
.
And should I be using pickles to write the data in the text file/ save file.
Thanks