Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow trusted instances to provide redundancy for videos of unlisted videos #2719

Open
tilllt opened this issue May 3, 2020 · 11 comments
Open

Comments

@tilllt
Copy link
Contributor

tilllt commented May 3, 2020

I am running a main Peertube instance on my home server: lots of storage, bad bandwith. To mitigate for that, i am running a VPS instance with high bandwidth. I configured the Redundancy Settings to just mirror everything from the main instance. The problem is, that afaik unlisted and private videos are not considered for the redundancy. In a "hostile" federated environment, this is correct behaviour, but i think it would be great if Peertube could make a difference between trusted follower instance (i.e. run by the same admin) and untrusted instances, when it comes to redundancy mirroring.

If i have a unlisted video (personal, family stuff, stuff thats needs to be reviewed) - i'd like it to take advantage of my second VPS instance as well to provide higher bandwidth.

@rigelk rigelk changed the title Feature Request: Allow trusted instances to provide redundancy for ALL videos Allow trusted instances to provide redundancy for videos of all privacy settings May 3, 2020
@Chocobozzz Chocobozzz changed the title Allow trusted instances to provide redundancy for videos of all privacy settings Allow trusted instances to provide redundancy for videos of unlisted videos May 4, 2020
@Chocobozzz
Copy link
Owner

Chocobozzz commented May 4, 2020

Private videos are not federated so you won't be able to add them in the redundancy system, and federating them changes the assumptions made on external videos' privacy.

@tilllt
Copy link
Contributor Author

tilllt commented May 4, 2020

I don't know Peertube enough to have an expert opinion about what's the best way to achieve seeding of all videos of any visibility / privacy settings from multiple locations. My idea is that "trusted" instances, run by the same admin, could seed private and unlisted videos as well. What I DO know is that it would be desirable to seed also private and unlisted videos from several instances to overcome the problem of low bandwidth Peertube home servers.

@JohnXLivingston
Copy link
Contributor

Why don't you invert your 2 servers? It seems more logical that the main server has a good bandwidth.

@tilllt
Copy link
Contributor Author

tilllt commented May 4, 2020

  • less storage on vps
  • blazing fast uploads over local network
  • might switch vps provider frequently to change to best offer
  • much beefier hardware on local server for transcoding

@tilllt
Copy link
Contributor Author

tilllt commented May 4, 2020

So IMHO a seeding "satellite" server makes much more sense. Think caching proxy.

@JohnXLivingston
Copy link
Contributor

* less storage on vps

Ok, that's a good point.

* blazing fast uploads over local network

But the redundancy will take the same time... And.. Will be done multiple time if there are other instances that wants to redondate.

* might switch vps provider frequently to change to best offer

You can change provider, and change your dns records to keep your domain name pointing on the good vps.

* much beefier hardware on local server for transcoding

That's a good point. I think there is work in progress for remote transcoding.

@tilllt
Copy link
Contributor Author

tilllt commented May 4, 2020

  • blazing fast uploads over local network

But the redundancy will take the same time... And.. Will be done multiple time if there are other instances that wants to redondate.

The distribution process happens without any active participation, yes the transfer takes time, but the work of tagging, selecting a thumbnail, writing a description etc is finished and the video is published.

* might switch vps provider frequently to change to best offer

You can change provider, and change your dns records to keep your domain name pointing on the good vps.

No you cannot, there is no "good vps" just a good home server. So when changing the vps, you have to copy all the data, set up the new instance etc. So it's much more work then just setting the redundancy setting and following your main instance and wait for the videos to be copied over automatically...

@JohnXLivingston
Copy link
Contributor

So it's much more work then just setting the redundancy setting and following your main instance and wait for the videos to be copied over automatically...

Are you keeping the same domain name when you change your server? If so, you will mess up the fediverse. If not, it will still have side effects on the fediverse.

On the other hand, you should have a backup strategy for your main instance. If so, it is easy to backup and restore when you want to change your server.

@tilllt
Copy link
Contributor Author

tilllt commented May 4, 2020

The main (homeserver) instance is running on a ZFS filesystem with mirrored drives and a backup. So i think its pretty well secured. Maybe this is a misunderstanding, the VPS' i am talking about are 2-8€ a month low end VPS, which run Peertube instances just fine. Its not a nifty Hetzner Root server with remote ILO, for 100€ a month. so yes, having the main server at home is the easier and better solution (for me anyways).

why would i reuse the names of the "satellite" vps`they can be named 001.pixelscope.de 002.pixelscope.de etc. their name will never be posted anywhere, they just seed together with the main instance.

@Ranlvor
Copy link

Ranlvor commented May 10, 2020

Another use case for cache-only-instances for unlisted Videos: At my university some professors upload their lecture-videos to a centrally managed Peertube-instance. All videos are unlisted and organised in unlisted playlists. The students get the playlist-urls.

If this Peertube-instance get's popular it could get overloaded with video-traffic. So it would be nice to be able to scale it horizontally to more nodes if necessary. All nodes are managed by the same administrators.

@c0xc
Copy link

c0xc commented Apr 17, 2021

Similar question: Would it be possible to remove the origin instance from the list of peers when viewing through a mirror instance?
#3512

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants