Scrape reader's comments from news sites



I am a social scientist and would like to get scraped all readers' comments posted to news articles that were related to politics and some additional social issues (e.g. race, immigration) from 4 US news sites within the last 12 months: Washington Post, Breitbart News, New York Times, and Wall Street Journal. We would agree about the appropriate keywords to be used to select the articles for which we want to have comments scraped. The files can be delivered in any suitable format (e.g. json, csv,..). AWS can be used if needed. The comments should be accompanied by all available metadata (commentator's id, link to the article, timestamp, 'likes', etc.). I need the scraping to start as soon as possible. I have a very limited budget, but am willing to pay what's fair. If the project is successful, it might receive more funding and be continued. Just ask for more details if needed.

Habilidades: Extracción de datos web

Ver más: scrape news sites, sites comments links, simple news sites, php pull news sites, news sites php, pro wrestling news sites, persian news sites, news sites pulling rss feeds, joomla news sites, farsi news sites, rewrite news sites, php news script comments, news sites link exchange, auto updating news sites, fetch news sites

ID de proyecto: #12139886