GitHub - B0R0koko/HSE-Lab: Higher School of Economics. Retail Lab Project. Scripts to collect data on biggest grocery chains in Russia · GitHub

Repository navigation

HSE-Lab

Public

About

Higher School of Economics. Retail Lab Project. Scripts to collect data on biggest grocery chains in Russia

3 stars

1 watching

Report repository

Name		Name	Last commit message	Last commit date
__pycache__		__pycache__
crawlers		crawlers
data		data
env		env
misc		misc
.DS_Store		.DS_Store
README.MD		README.MD
requirements.txt		requirements.txt
run.py		run.py

Repository files navigation

HSE LAB Retail project

Developed by Mikhail Mironov - BEC-191

Currently scrapers implemented

Diksi scraper

Scrapy
Vprok (Perekrestok) scraper

Requests + Selectolax
Magnit scraper

Scrapy
Svetofor scraper

Scrapy

To run script open the project in the root folder and run the following

source env/bin/activate - to activate venv
python run.py "store_name" "-o" "data output path"

About

Higher School of Economics. Retail Lab Project. Scripts to collect data on biggest grocery chains in Russia

3 stars

1 watching

Report repository

Releases

Packages

Contributors

Languages