Python framework to scrape PasteBin pastes and analyze them
Branch: master
Clone or download
d-Rickyy-b Merge pull request #52 from d-Rickyy-b/mysql-fix-2
FIX: Several issues with the mysql adapter
Latest commit 9f424da Jan 9, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github/ISSUE_TEMPLATE TASK: Update issue templates Sep 17, 2018
examples TASK: Turn down log level in example file Oct 21, 2018
pastepwn FIX: Several issues with the mysql adapter Jan 9, 2019
.gitignore TASK: Add PyCharm documents to gitignore Sep 5, 2018
.travis.yml
LICENSE TASK: Create License Sep 17, 2018
MANIFEST.in ADD: Manifest file Oct 22, 2018
README.md FIX: Typo in readme Oct 26, 2018
requirements.txt TASK: Remove certifi from requirements Oct 21, 2018
setup.cfg FEATURE: Build pypi module Oct 21, 2018
setup.py TASK: Add version file for easy trackable version changes Oct 25, 2018

README.md

Build Status

pastepwn - Paste-Scraping Python Framework

Pastebin is a very helpful tool to store or rather share ascii encoded data online. In the world of OSINT, pastebin is being used by researchers all around the world to retreive e.g. leaked account data, in order to find indicators about security breaches.

Pastepwn is a framework to scrape pastes and scan them for certain indicators. There are several analyzers and actions to be used out-of-the-box, but it is also easily extensible - you can create your own analyzers and actions on the fly.

Please note: This framework is not to be used for illegal actions. It can be used for querying public Pastebin pastes for e.g. your username or email address in order to increase your own security.

Setup pastepwn

To use the pastepwn framework you need to follow these simple steps:

  1. Make sure to have a Pastebin premium account!
  2. Install pastepwn via pip (pip install pastepwn)
  3. Create a file (e.g. main.py) in your project root, where you put your code in¹
  4. Fill that file with content - add analyzers and actions. Check the example implementation.

¹ (If you want to store all pastes, make sure to setup a mongodb, mysql or sqlite instance)

Behind a proxy

There is 2 ways to use this tool behind a proxy:

  • Define the following environment variables: HTTP_PROXY, HTTPS_PROXY, NO_PROXY.
  • When initializing the PastePwn object, use the proxies argument. proxies is a dict as defined in requests' documentation.

ToDos

There are quite some features which will be implemented in the (near) future. Check the bug tracker on GitHub to get an up-to-date status about features and ToDos.

  • REST API for querying paste data
  • Adding more analyzers and actions, based on community input
  • Adding support for other paste sites
  • Add a helpful wiki with instructions and examples