Fundamental problem with urllib...

[Skip Montanaro]

    Jonathan> Urllib will always have problems with some sites.  Notably,
    Jonathan> sites with cookies that also redirect.

    Jonathan> This is certainly not possible without overriding some
    Jonathan> functions in FancyURLopener....  This isn't a big deal (I did
    Jonathan> it myself for my program), but this can be simply fixed by
    Jonathan> adding support for cookies within urllib.

    Jonathan> Shall I take it upon myself to make such a patch?

Please do.  You can submit patches here:

    http://sourceforge.net/tracker/?group_id=5470&atid=305470

-- 
Skip Montanaro (skip at pobox.com - http://www.mojam.com/)