This Rust program is run every few minutes to scrape data not already existing in my database.
Just cargo run it.
Fetches from the archive a list of paste urls/ids, then goes one by one every 4 seconds to scrape them.
-
Notifications
You must be signed in to change notification settings - Fork 0
Set to run on a cron tab, this program will scrape new entries from pastebin and put them in a sql table.
License
sjqtentacles/pastebin_scraper
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Set to run on a cron tab, this program will scrape new entries from pastebin and put them in a sql table.
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published