This isn't a Python question unless you are looking for a Python implementation. HTTrack is one that I have used in the past as a general purpose tool. http://www.httrack.com/ As for Python http://harvestman.freezope.org/ I have no experience with it. I just searched in the CheeseShop.