You are here: Foswiki>Dmi Web>ToolDatabase>ToolGoogleNewsScraper>ToolGoogleNewsScraperHowTo (24 Feb 2015, ErikBorra)Edit Attach
The scraper batch queries news.google.com, outputting a table of returns including URL, title, source, date, teaser text, and thumbnail image, .
Enter sources to be queried (optional, one per line, e.g. www.nyt.com), a set of key words (one per line) and a project name for the results file. Select desired number of results per query (default is 100, as greater numbers require multiple scrapes). In the advanced options you can also set a date range for your query, amongst other things.
Optionally, the scraper retrieves thumbnail images attached to each search return.
Enter sources to be queried (optional, one per line, e.g. www.nyt.com), a set of key words (one per line) and a project name for the results file. Select desired number of results per query (default is 100, as greater numbers require multiple scrapes). In the advanced options you can also set a date range for your query, amongst other things.
Optionally, the scraper retrieves thumbnail images attached to each search return.
Edit | Attach | Print version | History: r3 < r2 < r1 | Backlinks | View wiki text | Edit wiki text | More topic actions
Topic revision: r3 - 24 Feb 2015, ErikBorra
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding Foswiki? Send feedback