Mirror Urls

Squzer Squzer at gmail.com
Tue Jun 26 02:08:59 EDT 2007


I am involving in the development of a crawler. i need my script to
detect the mirror urls of the page. so that i can ignor the urls.
Please tell me any idea to detect......




More information about the Python-list mailing list