Skip to content

Latest commit

 

History

6 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Slant Scraper

Scrapes info from www.slant.co Only for educational purposes. Use at own risk, it might violate Slant policies.

  • Versus. A comparison of two techs.
  • Options. A detailed description of a particular option.
  • Topics. A comparison of different topics.

Dependencies

Install:

Tested configuration

  • Python 3.6.4 + Scrapy 1.5

Usage - Have fun!

cd slant-scraper/

Scrape and save data in JSON lines format:

scrapy crawl main -o output/result.json

For JSON format use:

scrapy crawl main -o output/result.json -t json

About

Scrapy project for scraping www.slant.co.

Topics

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages