Skip to content

Server Storage Planning

Clownfused edited this page Apr 17, 2019 · 13 revisions
WANT TO HELP? CLICK THE ★ (STAR LOGO) in the Upper-Right!

  • 📂 [Click Here] - Google G-Suite (Unlimited Hard Drive Space & Storage)
  • 📂 [Click Here] - Top Performance NewsHost! - Blitz Members Receive a 58% Discount

Reference Shortcut - http://server.pgblitz.com | Discord ( !server )


Table of Contents

  1. Intro
  2. Server & Storage Planning - Conceptual
  3. Server Strategy
  4. Summary

1. Intro

So why does selecting and planning the right server matter? It seems to be a simple question to answer, but it is not. Below, we will bring up key planning points you should take into consideration and why conducting a test run will save you so much grief!

2. Server and Storage Planning - Conceptual

In this area, we talk about server planning. Here, we will use 3 of the 10 project management (PMP) process to assist you!

I. PG YouTube - Conceptual Planning

II. Something to Think About

Plex, Sonarr, and Radarr are going to be the largest apps that utilize the greatest amount of disk space. Plex alone with 1000 shows and 5000 movies can generate 35GB of metadata.

Conducting backups can be problematic with a server with low disk space. Take this into account.

100GB Diskspace

  • 35 GB Plex Library
  • 5 GB Sonarr
  • 8 GB Radarr
  • 15 GB Pending Uploads
  • 10 GB of random garbage files left by NZBGET
  • 8 GB of seeding files

So... how much disk space do you have left... oh and remember, users require disk space to transcode files for Plex, so that can eat at another 5 - 10 GB.

So what about backup space? So now there is a problem. A 35 GB Plex Library may result in another 20 GB of space for a pending zip file for upload. The point here is what planning was done prior? Let's talk about practical planning and actual planning to execute your plan!

III. Scope Management

Scope Management is the process to define a goal, endstate and processes in-between while balancing your resources to accomplish a mission. Long story short, poor planning will cost you time and money (which is known as scope creep).

So the goal here is to define your goal. Even though you may just say, just to run a server; you need to define that endstate. By creating a scope, you will prevent scope creep. If your goal is to build a remote server that supports no more than 5 people across the globe, then everything you should plan for should be based on that. Adding unnecessary and unrealistic goals will just cost you more time and money!

IV. Stakeholder Management

Prior to starting, you need to define who your stakeholders are.

If users are located in the US, GB, and South America while your server is deployed in South Korea... what problems do you think you will encounter? Understanding who your stakeholders are, what they require from you while considering their location and needs will assist you on what type of server capabilities are required. In regards to the question above, most of the users will have issues due to their locations and where the server is located at. This process should result in the questions known as RFIs (Request for Information) to help drive your understanding of the process.

Example RFIs

  • Do I need two servers, one in the EU and United States for my users?
  • Do I charge them for upkeep and if so; how will that work?
  • Do I give my users admin rights to my programs?

V. Cost Management

Probably the most important aspect of this process. There are users who have reported to have spent over $500 monthly on a server. In having discussions with them, they failed to account for what type of server needed and required. We will provide you a list of hosting providers to help you start, but plan accordingly.

We recommend that you test PG on a home virtual machine or Hetzner Cloud Server (which charges .01 penny per hour; no more than $2.49 per month). This way, you can test what will work for you. Be aware of each hosting companies policies, charges, and upgrade/downgrade cost. For example, online.net will bill you for an entire month, if you fail to cancel by the 20th month; yes an entire month!

3. Server Strategy

United States

Servers suited for members in this geographical location!

WholeSaleInternet / NOCIX.net

Huge transfer, but several users have reported slow Usenet/download speeds at times (depends on hardware). It seems likely that they do QoS their servers as downloads jump to 90MB/s but then slowly get throttled to around 12-50MB/s (around 100Mbps). No refunds, unless for extreme reasons beyond your control. In addition, should you reach the 100TB cap, additional bandwidth is very expensive, priced at $20/TB. Tech support is very quick to respond and provide reasonable assistance. If you're knowledgeable at Linux, you should be fine overall. Great hardware prices.

  • Dedicated, VPS, Custom servers offered
  • Bandwidth transfer is typically around 100TB
  • 10MB, 1GB, or 10GB speed connections
  • Servers are located in Kansas City, KS

Incero

  • Dedicated, VPS, Custom servers offered
  • Bandwidth transfer is typically around 30TB
  • 1GB, or 10GB speed connections
  • Servers are located in Dallas, Seattle, and New York City

SSDnodes

  • VPS Service
  • Bandwidth transfer is typically around 8-16TB
  • 10GB speeds
  • Servers are located in Dallas, Texas

Europe

Servers suited for members in this geographical location!

WISHosting

  • VPS and Custom servers offered
  • Bandwidth transfer is unmetered
  • 1GB (shared)
  • Servers are located in France & Canada

Online.net

Good service, but be careful; they have terrible billing practice. Your server must be canceled NLT than 20th of each month or they will rebill you for an entire month and you cannot cancel out the billing; nor receive a refund.

  • Dedicated and VPS servers offered
  • Bandwidth transfer is unmetered
  • 25MB, 50MB, or 1gb speeds
  • Servers are located in France & Netherlands

Hetnzer

  • Dedicated, VPS, Custom and Cloud servers offered
  • Bandwidth transfer is outbound and inbound unlimited
  • 1gb speeds
  • Servers are located in Germany or Finland

SoYouStart

  • Dedicated and Custom servers offered
  • Bandwidth transfer is unlimited
  • 250 Mbps speeds
  • Servers are located in France & Canada

KimSufi

  • Semi-Dedicated and VPS servers offered
  • Bandwidth transfer is unlimited
  • 100 Mbps (10MB) speeds
  • Servers are located in France & Canada

ServDiscount

  • Dedicated servers offered
  • Bandwidth transfer is unknown
  • 1gbps (100 MB) speeds
  • Servers are located in Germany

Serwery

The i7 machine is an i7-4970 CPU. Live chat support is very fast at resolving issues (response under 5 minutes during weekdays in my experience).

  • Dedicated servers offered
  • Bandwidth transfer is unlimited
  • 100mbps, 500mbps, and 1gbps (100MB) speeds shared
  • Servers are located in Germany

Worldwide

Servers suited for members in all geographical locations!

OneProvider

  • Dedicated and VPS servers offered
  • Bandwidth transfer is unmetered
  • Speeds - Depends
  • Servers are located in Seoul, Buenos Aires, Cairo, Melbourne, Montreal, and Amsterdam

Other Resources

VPS or Dedicated?

A Virtual Private Server (VPS) means that you will be sharing the machine with other people. You'll still get root access and no one else will be able to touch your files, but your Ubuntu server will actually be running as a Virtual Machine amongst many others. This option is usually far cheaper but may come with added restrictions on bandwidth and CPU usage. Much of the time, VPS's are oversold, meaning that the amount of CPU cores allocated to all of the users on that particular machine exceeds the number of physical cores. The Internet Connection will definitely be shared as well, resulting in potential network congestion. For a personal-use server without 4k files, a VPS is a good option.

Dedicated Servers are far more expensive, but you may run your CPU at 100% while saturating your gigabit line all day and no one will complain (probably). You'll usually get the full network speeds advertised, greater storage capacity and beefier CPU's. If you have many users you'd like to stream to, A dedicated server may be what you're looking for.

Notes

  • Some cheap hosts advertise "dedicated servers" but actually provision VPS's! The easiest tell is if the CPU offered has more cores than what is listed. Another keyword to look for is "Fair Usage" and "Shared IP"
  • See the section on "Server Requirements" for the exact specifications you should look for.

Unmetered vs Unlimited?

Unmetered hosting usually means it is a hosting plan with unmetered traffic, the cost of the plan is not dependent on the amount of data that is used per month.

Some unmetered plans can often be extremely limited due to the fact that the data transfer may be at a greatly reduced speed.

To put this another way, the plan may be unmetered, and unlimited, BUT the amount of data that you can use is restricted because of the speed of the servers.

What About a Seedbox?

Usually, you should avoid seedboxes because they don't often don't include root access. You'll want to install Plexguide on top of a clean installation of Ubuntu. Many Seedboxes are dedicated machines bought from a larger host, then split into VPS's by a third party and resold that way. It's best to avoid them if you can.

Beware websites that offer a list of "best hosting providers" (except this one) They are usually affiliate-link hell for overpriced hosts that spend more money on advertising than servers

4. Summary

Hopefully, the overwhelming amount of information has been useful to you! If you wish to add more, please let post in the forums and let us know!

📂 Click Here - NZB's from USENET Server - PG Members Receive a 60% Discount

http://PGBlitz.wiki

Useful Starter Links

  1. Introduction
  2. Blitz YouTube Channel
  3. G-Suite Signup
  4. Recommended NewsHosts

Prior Planning 101

  1. Recommended Pre-Reading
  2. Server - Storage Planning
  3. Usenet or BitTorrent
  4. PG Editions
  5. PGBlitz Repos
  6. Common Issues

Deploy & Config

PGBlitz
  1. SSH Server Access
  2. Create a SUDO User
  3. Install PGBlitz
  4. WatchTower
  5. Remote Path Mappings

Data Transport
  1. PG Clone
    1. Google OAuth Keys
    2. PG Move
    3. PG Blitz
    4. 2nd HD Option

Key Components

  1. Traefik
  2. Port Guard
  3. PG Shield
  4. PG Press
  5. Google Cloud - GCE
    1. Automated setup
  6. Hetzner Cloud
  7. PG Fork
  8. Extra PG Commands

Blitz App Info

  1. Accessing PG Apps
  2. App Port Scheme
  3. Plex to AutoScan

Tools & Services

Core Apps [Expand]
  1. Emby
  2. Jackett
  3. Jellyfin
  4. LazyLibrarian
  5. Lidarr
  6. Netdata
  7. NZBGet
  8. Ombi
  9. Plex
  10. Portainer
  11. qBittorrent
  12. Radarr
  13. RuTorrent
  14. SABNZBD
  15. Sonarr
  16. Tautulli
Community Apps [Expand]
  1. AirSonic
  2. AllTube
  3. Bazarr
  4. Beets
  5. Bitwarden
  6. BookSonic
  7. cAdvisor
  8. Cloud Commander
  9. DDClient
  10. Deezloaderremix
  11. Deluge
  12. DelugeVPN
  13. Duplicati
  14. EmbyStats
  15. FlexGet
  16. Gazee
  17. Gitea
  18. Handbrake
  19. Headphones
  20. Heimdall
  21. HomeAssistant
  22. HTPCManager
  23. JDownloader2
  24. jd2-openvpn
  25. Kitana
  26. Logarr
  27. MakeMKV
  28. MariaDB
  29. McMyadmin
  30. MEDUSA
  31. Mellow
  32. Monitorr
  33. Muximux
  34. Mylar
  35. NextCloud
  36. NowShowing
  37. NZBHydra2
  38. NZBThrottle
  39. Organizr
  40. pyLoad
  41. Radarr4k
  42. Resilio
  43. rflood-openvpn
  44. rutorrent-openvpn
  45. ShareSite
  46. Shoko Anime Server
  47. SpeedTest
  48. SyncLounge
  49. Syncthing
  50. The Lounge
  51. Transmission
  52. Trakt.or
  53. Ubooquity
  54. x TeVe
  55. Zammad

Misc Info & Articles

  1. Change Server Time
  2. Fail2Ban
  3. Custom Containers
Scripts
  1. Scripting Area
    1. Auto Upload for Sonarr and Lidarr
    2. Auto Delete Log
    3. Plex Plugin DB Backup
    4. Plex fast BACKUP
Clone this wiki locally
You can’t perform that action at this time.