Skip to content

Grab the data from N mastodon streams and provide a central mastodon streamer with a simple token based authentication.

Notifications You must be signed in to change notification settings

osome-iu/OSoMeMastodonStreamer

Repository files navigation

Mastodon Streamer

This project uses Mastodon.py to collect data from different Mastodon servers and save them to json files by date.

quick start.

  • get conda installed if not https://docs.anaconda.com/free/miniconda/#quick-command-line-install
  • create conda venv
    • conda env create -p ./<myvenv> -f environment.yml
    • conda activate ./<myvenv>
    • pip install -r requirements.txt
  • make a copy of config.yml.template and mastodon_servers.json.template, fill out the contents accordingly.
  • run
    • python streamer.py saves to {base_folder}/{yyyy-mm}/{domain}_{yyyy-mm-dd}.json
    • python stream_new_users.py saves to {base_folder}/{yyyy-mm}/new_users/{domain}_{yyyy-mm-dd}_new_users.json

*optional backup bash script uses python package yq that wraps around jq

sudo apt-get install jq pip3 install yq

About

Grab the data from N mastodon streams and provide a central mastodon streamer with a simple token based authentication.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •