<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 10pt;
font-family:Tahoma
}
--></style>
</head>
<body class='hmmessage'><div dir='ltr'>
<br>What do people use for scraping on a website requiring (login form-based) authentication?<br><ul><li>BeautifulSoup: does not handle authentication or cookies</li><li>Scrapy: does but more heavyweight paradigm to learn, incl. XPath</li></ul><br>Some discussion: <a href="http://stackoverflow.com/questions/4328271/best-way-for-a-beginner-to-learn-screen-scraping-with-python">http://stackoverflow.com/questions/4328271/best-way-for-a-beginner-to-learn-screen-scraping-with-python</a><br><br>Thanks,<br>Stephen<br><br> </div></body>
</html>