Examples¶

Soupstars includes various examples that you can reference or use directly.

NYTimes¶

Extract article links and article metadata from nytimes.com

class soupstars.examples.nytimes.NytimesArticleParser(url)[source]¶

Parse attributes from a NY times article.

>>> from soupstars.examples.nytimes import NytimesArticleParser

title()[source]¶: The title of the article.

author()[source]¶: The author(s) of the article.

class soupstars.examples.nytimes.NytimesLinkParser(url)[source]¶

Parse the links from a NY times webpage.

Parameters:	url (str) – The webpage to parse

>>> from soupstars.examples.nytimes import NytimesLinkParser

article_links()[source]¶: A list of links that point to NYTimes articles

non_article_links()[source]¶: A list of links that points to NYTimes pages that are not articles.

Economist¶

Extract metadata from economist index and article pages

class soupstars.examples.economist.WeeklyIndexPages(**kwargs)[source]¶: Example model for storing the results of the parser

class soupstars.examples.economist.WeeklyIndexPageParser(url)[source]¶

Parse metadata from the weekly updated index pages

Model¶: alias of WeeklyIndexPages

base_url()[source]¶: The url used

article_date()[source]¶: The date of the article

status_code()[source]¶: Status code of the request

num_articles()[source]¶: The number of articles foudn on the page