Skip to content

Data Flow

Admin9705 edited this page Feb 28, 2019 · 5 revisions

📂 Click Here - Sign up for Google's Suite for Business - Unlimited Space

📂 Click Here - NZB's with from NewsHost - PG Members Receive a 58% Discount

Table of Contents

  1. Intro
  2. Summary

NOTE: Rough Draft

1. Intro

Understanding the data flow in PG is quite complex. Overtime, I'll do my best to continue documenting the data flow here for you, so that you have a better understanding. What constrains the data flow is when a user who is novice and doesn't understand much about linux, but that's ok. We all started somewhere at one point.

2. Understanding UnionFS

Within all editions of PlexGuide, there is a certain path that is critical... and that is UnionFS. UnionFS is a path that merges multiple paths as one together. Well... you may ask... why does this need to occur in the first place. Ah, good question! A quick learner.

PlexGuide utilizes a program known as RClone. RClone provides the user that ability to move files locally and to other cloud drives. If you search for how to mount a Google Drive, you may tend to notice there is not a real solution and you'll stumble onto other GITHUB project like PlexGuide. To achieve this, PlexGuide mounts your Google Drive in very particular locations, including UnionFS. The paths that are merged are:

  • /mnt/move (writeable)
  • /mnt/gdrive (read only)
  • /mnt/tdrive (read only)
  • /mnt/unionfs (read only)

New users will attempt to send their data to /mnt/gdrive. A hard lesson to learn is that regardless of how you setup rclone, you are not able to directly move data to /mnt/gdrive. So wait? How does data get to gdrive then? First, a user will point their data to /mnt/unionfs ... yes.. yes... it's readonly. What makes UnionFS special is that it combined all your drives in the first place. You notice that /mnt/move is writeable correct? When data touches /mnt/unionfs, UnionFS says the following:

  • hey gdrive... can you write this? GDrive says... nope.
  • hey tdrive... can you write this? TDrive says... nope.
  • hey move... can you write this? Yes I can!

So now the data goes to /mnt/move. Awesome right? Well that was half the battle.

3. Data Movement

PlexGuide has two mechanism to assist you with the movement of your data! That is PG Blitz and PG Move.

PG Move dead simple in that RClone is utilized to send data from /mnt/move to gdrive:/path. Basically, RClone is saying... hey data! I need you to move to gdrive:/path which is a cloud drive. RClone syncs everything and moves data from /mnt/move to gdrive:/path. You know what the great thing is? All your programs cannot tell that your data moved due to UnionFS combining all of the same paths.

PG Blitz is a bit more complicated in that RClone is utilized to send data from /mnt/move, to /mnt/pgblitz/upload, then to tdrive:/path... which is a team drive. Why a team drive? Most users who utilize PG Blitz do so to break the 750GB daily upload cap imposed by Google.

--- UNDER CONSTRUCTION STILL ---

http://PGBlitz.wiki

Useful Starter Links

  1. Introduction
  2. Blitz YouTube Channel
  3. G-Suite Signup
  4. Recommended NewsHosts

Prior Planning 101

  1. Recommended Pre-Reading
  2. Server - Storage Planning
  3. Usenet or BitTorrent
  4. PG Editions
  5. PGBlitz Repos
  6. Common Issues

Deploy & Config

PGBlitz
  1. SSH Server Access
  2. Create a SUDO User
  3. Install PGBlitz
  4. WatchTower
  5. Remote Path Mappings

Data Transport
  1. PG Clone
    1. Google OAuth Keys
    2. PG Move
    3. PG Blitz
    4. 2nd HD Option

Key Components

  1. Traefik
  2. Port Guard
  3. PG Shield
  4. PG Press
  5. Google Cloud - GCE
    1. Automated setup
  6. Hetzner Cloud
  7. PG Fork
  8. Extra PG Commands

Blitz App Info

  1. Accessing PG Apps
  2. App Port Scheme
  3. Plex to AutoScan

Tools & Services

Core Apps [Expand]
  1. Emby
  2. Jackett
  3. Jellyfin
  4. LazyLibrarian
  5. Lidarr
  6. Netdata
  7. NZBGet
  8. Ombi
  9. Plex
  10. Portainer
  11. qBittorrent
  12. Radarr
  13. RuTorrent
  14. SABNZBD
  15. Sonarr
  16. Tautulli
Community Apps [Expand]
  1. AirSonic
  2. AllTube
  3. Bazarr
  4. Beets
  5. Bitwarden
  6. BookSonic
  7. cAdvisor
  8. Cloud Commander
  9. DDClient
  10. Deezloaderremix
  11. Deluge
  12. DelugeVPN
  13. Duplicati
  14. EmbyStats
  15. FlexGet
  16. Gazee
  17. Gitea
  18. Handbrake
  19. Headphones
  20. Heimdall
  21. HomeAssistant
  22. HTPCManager
  23. JDownloader2
  24. jd2-openvpn
  25. Kitana
  26. Logarr
  27. MakeMKV
  28. MariaDB
  29. McMyadmin
  30. MEDUSA
  31. Mellow
  32. Monitorr
  33. Muximux
  34. Mylar
  35. NextCloud
  36. NowShowing
  37. NZBHydra2
  38. NZBThrottle
  39. Organizr
  40. pyLoad
  41. Radarr4k
  42. Resilio
  43. rflood-openvpn
  44. rutorrent-openvpn
  45. ShareSite
  46. Shoko Anime Server
  47. SpeedTest
  48. SyncLounge
  49. Syncthing
  50. The Lounge
  51. Transmission
  52. Trakt.or
  53. Ubooquity
  54. x TeVe
  55. Zammad

Misc Info & Articles

  1. Change Server Time
  2. Fail2Ban
  3. Custom Containers
Scripts
  1. Scripting Area
    1. Auto Upload for Sonarr and Lidarr
    2. Auto Delete Log
    3. Plex Plugin DB Backup
    4. Plex fast BACKUP
Clone this wiki locally
You can’t perform that action at this time.