retrieving ATOM/FSS feeds

Diez B. Roggisch deets at nospam.web.de
Mon Aug 13 09:14:12 EDT 2007


_spitFIRE wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> Lawrence Oluyede wrote:
>> If the content producer doesn't provide the full article via RSS/ATOM
>> there's no way you can get it from there. Search for full content feeds
>> if any, otherwise get the article URL and feed it to BeautifulSoup to
>> scrape the content.
>> 
> 
> For the same feed (where the content producer doesn't provide the full
> article!) I was able to see the complete post in other RSS aggregators
> (like Blam). I wanted to know how they were able to collect the feed!

Either it is referred to in the data - or it might be that they do have
affiliate-deals with certain partners.

Diez



More information about the Python-list mailing list