Skip to content

mike-petrov/scrapy_instagram

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

instaParse - automatic aggregator of data from Instagram

Parsing the video files + the texts from this post and searching for them in the app

More detailed (presentation)

Technology stack

  • Scrapy
  • Scrapyrt
  • Flask
  • React js
  • MongoDB

Also used

  • VK Mini App platrofm
  • ScraperApi
  • Cron task

Get started

Frontend

cd web
npm install
npm start

it will be better to use vk mini app hosting:

npm run deploy

Backend

Flask
cd api
python3 -m venv env
source env/bin/activate
pip3 install -r requirements.txt
python run.py
Scrapy & Scrapyrt
pip3 install Scrapy
pip3 install Scrapyrt
scrapyrt
MongoDB

good manual

Cron task
crontab -e
sudo systemctl enable cron

grep CRON /var/log/syslog // check logs

Сreators

made by Mike Petrov (@mike_petrov) & Leonid Romanychev (@romanychev-l)

433 group of AM-CP Faculty SPBU

About

No description or website provided.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published