Skip to content

Page Crawler is a script to automatically collect data from web pages, and send it to a Telegram channel.

Notifications You must be signed in to change notification settings

self51/PageCrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Page crawler


About

This is a pet-project, it should not be used for commercial purposes!
Page Crawler is a script to automatically collect data from web pages,
and send it to a Telegram channel.

Technology stack:
  • Python 3.8;
  • Redis;
Getting Started
  • Clone the repository;
  • Go to the project directory;
  • Make sure you have Redis installed, set up Redis;
  • Set up Telegram API;
    • You need to have: TELEGRAM_BOT_TOKEN, TELEGRAM_CHAT_ID;
  • Make sure you have a www.tesmanian.com account
    • (you need a password and email address in .env)
  • Create your .env file;
    • File must contain: TELEGRAM_BOT_TOKEN, TELEGRAM_CHAT_ID,
    • REDIS_HOST, REDIS_PORT, PASSWORD, EMAIL;
  • $ pip install -r requirements.txt.

Made by Self.

About

Page Crawler is a script to automatically collect data from web pages, and send it to a Telegram channel.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages