best set of modules for web automation without javascript

News123 news123 at
Fri Feb 13 10:09:05 EST 2009

Hi Joel,

This (the urllib2 methods you combined with cookielib) is what I am
currently trying to do.

I would just like to retrieve all the field names and default values of
a form. (Some forms are huge) and wondered thus whether there's already
a python module parsing a html documents for forms , form fields and
field vaules, returning an objcet. that could be modified and posted.



Joe Riopel wrote:
> On Fri, Feb 13, 2009 at 9:04 AM, News123 <news123 at> wrote:
>> Hi,
>> I'd like to do some web automation with python 2.5
>> - https:
>> - a cookiejar
>> - some forms to be filled in
>> what is the best set of modules.
> I have automated some testing of our product, using it's web UI with
> Python with urllib2 and urrlib. I don't actually fill in the forms, I
> just recreate the post and set the values of the post variables (so I
> don't get any form validation).
> Check out:
> urllib2.build_opener
> urllib2.HTTPCookieProcessor
> urllib2.Request

More information about the Python-list mailing list