Skip to content

RClone Cache

Admin9705 edited this page Feb 22, 2019 · 64 revisions

CLICKING the STAR in the UPPER RIGHT promotes our PROJECT on GITHUB! - WARNING, PLEASE VISIT https://pgblitz.com/wikis/ - This is the old wiki!


WARNING! This has nothing to do with SuperTransfer2

Table of Contents: RClone (Cache)

Official Logo

About RClone

Is a "rsync for cloud storage" - Google Drive, Amazon Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Cloudfiles, Google Cloud Storage, Yandex Files

Installing RClone Unencrypted Cache via PG

Launch PlexGuide

Select the following options once PG is loaded: PG Program Suite > Beta > RClone (Unencyrpted)


Configure RClone (Cache)

When you deploy the unencrypted portion of the program for the FIRST TIME, you should see RClone complaining about a file missing. Basically, you are creating a file for the first time. You may be asking if you catch on; why unionFS? Well, it was part of the prior setup we had, but it allows us to move data across on our terms, with better control. This also prevents endless amounts of data building up in the cache; where as everything that is ready to be transfered is sitting in /mnt/move... thus meaning while your waiting; your able to watch your media!


[Part 1 of 2 - Setting up Google Drive]

Demo Picture: New RClone Start Configuration

  • Type the Letter "n" to create a NEW Remote for RClone.

Next, call the remote "gdrive" <<< case sensitive

  • Drive Type: Select Option #11 for Google Drive (Version RClone 1.40)
  • Google Client ID: LEAVE BLANK and Press ENTER
  • Google Client Secret: LEAVE BLANK and Press ENTER

  • Drive Scope: Select Option Number 1 (From the Picture Above)
  • Root Folder ID: Just Press [ENTER]
  • Service Account File: Just Press [ENTER]
  • Asks you About Config?
    • y - only if you are physically on the machine (rarer these days)
      • Login with the CORRECT Google Account and Copy the Code
    • n - if using remotely, somewhere else (most cases these days)
      • Copy the http:// link & Paste it into your Browser
  • Login with the CORRECT Google Account and Copy the Code.
  • Paste the Code into Terminal and Press Enter
  • n - for 'Configure this as a team drive?'
  • y - Yes this is OK
  • DO NOT QUIT - Continue

[Part 2 of 2 - Setting up Cache]

  1. Setup a New Remote

  1. Name it cache - This is case senstive!

  2. Press 6 for Cache (make sure to check, the numbers can change)

  1. Type gdrive: - This is case senstive!

  1. Leave the URL Blank

  1. Type in your PLEX User Name (Recommend to keep it case sensitive)

  1. Type in your PLEX Password

  1. Chunk Size: 10MB - You can type exactly

  1. Info Age: 6h - You can type exactly

  1. Chunk Total Size: 10G - You can type exactly

  1. Check your config, type y and press ENTER to SAVE! Then press q and then ENTER to exit!

  2. To check on everything, type:

  • ls -la /mnt/gdrive
  • ls -la /mnt/unionfs

They should mirror each other (it's recommend to drop some kind of file in Google to verify that it's correct)

-----

Installing RClone Encrypted Cache via PG

NOTE: Still in testing - Do Not Use!!!!

Launch PlexGuide

Select the following options once PG is loaded: PG Program Suite > Beta > RClone (Encyrpted)


Configure RClone (Cache Encryption)

When you deploy the encrypted portion of the program for the FIRST TIME, you should see RClone complaining about a file missing. Basically, you are creating a file for the first time. You may be asking if you catch on; why unionFS? Well, it was part of the prior setup we had, but it allows us to move data across on our terms, with better control. This also prevents endless amounts of data building up in the cache; where as everything that is ready to be transfered is sitting in /mnt/move... thus meaning while your waiting; your able to watch your media!


[Part 1 of 4 - Setting up Google Drive]

Demo Picture: New RClone Start Configuration

  • Type the Letter "n" to create a NEW Remote for RClone.

Next, call the remote "gdrive" <<< case sensitive

  • Drive Type: Select Option #11 for Google Drive (Version RClone 1.40)
  • Google Client ID: LEAVE BLANK and Press ENTER
  • Google Client Secret: LEAVE BLANK and Press ENTER

  • Drive Scope: Select Option Number 1 (From the Picture Above)
  • Root Folder ID: Just Press [ENTER]
  • Service Account File: Just Press [ENTER]
  • Asks you About Config?
    • y - only if you are physically on the machine (rarer these days)
      • Login with the CORRECT Google Account and Copy the Code
    • n - if using remotely, somewhere else (most cases these days)
      • Copy the http:// link & Paste it into your Browser
  • Login with the CORRECT Google Account and Copy the Code.
  • Paste the Code into Terminal and Press Enter
  • n - for 'Configure this as a team drive?'
  • y - Yes this is OK
  • DO NOT QUIT - Continue

[Part 2 of 4 - Setting up Cache]

  1. Setup a New Remote

  1. Name it cache - This is case senstive!

  2. Press 6 for Cache (make sure to check, the numbers can change)

  1. Type gdrive:/encrypt - This is case senstive!

  1. Leave the URL Blank

  2. Type in your PLEX User Name (Recommend to keep it case sensitive)

  1. Type in your PLEX Password

  1. Chunk Size: 10MB - You can type exactly

  1. Info Age: 6h - You can type exactly

  1. Chunk Total Size: 10G - You can type exactly

  1. Check your config, type y and press ENTER to SAVE!

  1. DO NOT QUIT - Continue

[Part 3 of 4 - Setting up Encryption side of cache]

This encrypted mount will be for unionfs.service.

  • n < For New remote
  • cachecrypt < for the name
  • 8 < For Encrypt/Decrypt (double check the number select incase)
  • cache: (this will already point to the encrypted folder within your gdrive)
  • 2 < Encrypt standard
  • 1 < Turn on Directory Encryption
  • y < type your own password (make up a secure one and write it down somewhere safe otherwise use the one from before if you already created it for whichever original encrypted folder you want to use - for example DTHBCH434G45)
  • y < type your own salt password (make up a different secure one and write it down somewhere safe otherwise use the one from before if you already created it for whichever original encrypted folder you want to use - for example ER7UNK7UB6C44)

Should see something like this:

[N|Demo]

[Part 4 of 4 - Setting up Encryption for move script]

This encrypted mount will be used for the move.sh to upload stuff to your Google Drive.

  • n < For New remote
  • gcrypt < for the name
  • 8 < For Encrypt/Decrypt (double check the number select in case)
  • gdrive:/encrypt (encrypt being the name of the rclone encrypted folder within your gdrive)
  • 2 < Encrypt standard
  • 1 < Turn on Directory Encryption
  • Y < type your own password (use the same password as above for crypt - for example DTHBCH434G45)
  • Y < type your own salt password (use the same SALT password as above for crypt - for example ER7UNK7UB6C44)

Should see something like this:

[N|Demo]

  • Then press q and then ENTER to exit!

To check on everything, type:

  • ls -la /mnt/gdrive
  • ls -la /mnt/unionfs

They should mirror each other (it's recommended to drop some kind of file in Google to verify that it's correct)


PG Forum Support: RClone

https://pgblitz.com/forums/pg-3rd-party-programs.148/


N|Demo

N|Solid N|Solid


IGNORE ALL THIS (Notes)

DEVELOPMENT: RClone Cache is being implemented for PlexGuide, but is not fully ready.

RClone Cache basically is ... (will continue to be improved upon).

RClone Beta Install: Before you proceed onward an as a warning for now, install RClone Beta before proceeding onward for testing with

curl https://rclone.org/install.sh | sudo bash -s beta

Below are two major ways you can utilized RClone Cache for PlexGuide:

RClone Cache Unencrypted

In rclone config, make a Google Drive mount (type 11 as of RClone 1.40). Name it "gdrive". Select type 1, "Drive" Put in your API and Secret from console.developers.google.com. Note that this can be from a different account than your unlimited. Say no to the token question, then copy paste this into your web browser. Sign in to the account with unlimited GD storage, then copy the confirmation code it gives you back into RClone. Finally, confirm the mount.

Next, make a Cache mount (type 6 as of RClone 1.40) and name it "cache". It is currently unknown what settings are ideal for PG users. Point it at gdrive: (or whatever your PG folder in GD is) and put in your Plex credentials if auto-sync is desired. All reading traffic (Sonarr, Radarr, Plex, etc) should be passed through this mount, whereas uploading traffic (Move script) should point at the direct mount.

RClone Cache Encrypted

In rclone config, make a Google Drive mount (type 11 as of RClone 1.40). Name it "gdrive". Select type 1, "Drive" Put in your API and Secret from console.developers.google.com. Note that this can be from a different account than your unlimited. Say no to the token question, then copy paste this into your web browser. Sign in to the account with unlimited GD storage, then copy the confirmation code it gives you back into RClone. Finally, confirm the mount.

Next, make a Cache mount (type 6 as of RClone 1.40) and name it "cache". It is currently unknown what settings are ideal for PG users. Point it at gdrive:/encrypt (or whatever your PG folder in GD is) and put in your Plex credentials if auto-sync is desired.

Next, make a Crypt mount (type 8 as of RClone 1.40) and name it "crypt" and point it at "cache::". This will be the output directory that will be read by Plex. Secure it with a Password and Salt. All reading traffic (UnionFS, Plex, Sonarr, Radarr) should read from here as to avoid API bans.

Finally, make another Crypt mount and name it "gcrypt". Point this at "gdrive:/encrypt" directly. This should be used by the Move script and all other write-traffic.

Use or RClone guide if you need more info.

Visit our Website By Click the Picture Below! N|Demo

N|Solid N|Solid

http://PGBlitz.wiki

Useful Starter Links

  1. Introduction
  2. Blitz YouTube Channel
  3. G-Suite Signup
  4. Recommended NewsHosts

Prior Planning 101

  1. Recommended Pre-Reading
  2. Server - Storage Planning
  3. Usenet or BitTorrent
  4. PG Editions
  5. PGBlitz Repos
  6. Common Issues

Deploy & Config

PGBlitz
  1. SSH Server Access
  2. Create a SUDO User
  3. Install PGBlitz
  4. WatchTower
  5. Remote Path Mappings

Data Transport
  1. PG Clone
    1. Google OAuth Keys
    2. PG Move
    3. PG Blitz
    4. 2nd HD Option

Key Components

  1. Traefik
  2. Port Guard
  3. PG Shield
  4. PG Press
  5. Google Cloud - GCE
    1. Automated setup
  6. Hetzner Cloud
  7. PG Fork
  8. Extra PG Commands

Blitz App Info

  1. Accessing PG Apps
  2. App Port Scheme
  3. Plex to AutoScan

Tools & Services

Core Apps [Expand]
  1. Emby
  2. Jackett
  3. Jellyfin
  4. LazyLibrarian
  5. Lidarr
  6. Netdata
  7. NZBGet
  8. Ombi
  9. Plex
  10. Portainer
  11. qBittorrent
  12. Radarr
  13. RuTorrent
  14. SABNZBD
  15. Sonarr
  16. Tautulli
Community Apps [Expand]
  1. AirSonic
  2. AllTube
  3. Bazarr
  4. Beets
  5. Bitwarden
  6. BookSonic
  7. cAdvisor
  8. Cloud Commander
  9. DDClient
  10. Deezloaderremix
  11. Deluge
  12. DelugeVPN
  13. Duplicati
  14. EmbyStats
  15. FlexGet
  16. Gazee
  17. Gitea
  18. Handbrake
  19. Headphones
  20. Heimdall
  21. HomeAssistant
  22. HTPCManager
  23. JDownloader2
  24. jd2-openvpn
  25. Kitana
  26. Logarr
  27. MakeMKV
  28. MariaDB
  29. McMyadmin
  30. MEDUSA
  31. Mellow
  32. Monitorr
  33. Muximux
  34. Mylar
  35. NextCloud
  36. NowShowing
  37. NZBHydra2
  38. NZBThrottle
  39. Organizr
  40. pyLoad
  41. Radarr4k
  42. Resilio
  43. rflood-openvpn
  44. rutorrent-openvpn
  45. ShareSite
  46. Shoko Anime Server
  47. SpeedTest
  48. SyncLounge
  49. Syncthing
  50. The Lounge
  51. Transmission
  52. Trakt.or
  53. Ubooquity
  54. x TeVe
  55. Zammad

Misc Info & Articles

  1. Change Server Time
  2. Fail2Ban
  3. Custom Containers
Scripts
  1. Scripting Area
    1. Auto Upload for Sonarr and Lidarr
    2. Auto Delete Log
    3. Plex Plugin DB Backup
    4. Plex fast BACKUP
Clone this wiki locally
You can’t perform that action at this time.