Gitea hosted Gitea #1029

Open
lunny opened this Issue Feb 23, 2017 · 32 comments

Comments

Projects
None yet
@lunny
Member

lunny commented Feb 23, 2017

For the first big stage, we would like Gitea's development could be based on a Gitea hosted and github will only a mirror. This will maybe completed in v1.x. So that this issue will list all the features needed to be implemented before v1.x. And of course please discuss them and change my post.

@lunny lunny added the kind/proposal label Feb 23, 2017

@lunny lunny added this to the 1.x.x milestone Feb 23, 2017

@Lourens-Rich

This comment has been minimized.

Show comment
Hide comment
@Lourens-Rich

Lourens-Rich Feb 23, 2017

Very good idea!

Very good idea!

@bkcsoft

This comment has been minimized.

Show comment
Hide comment
@bkcsoft

bkcsoft Feb 27, 2017

Member

1.2 in February, 1.3 in April, 1.4 in June, 1.5 in August? should be enough time to implement all that 😄

Member

bkcsoft commented Feb 27, 2017

1.2 in February, 1.3 in April, 1.4 in June, 1.5 in August? should be enough time to implement all that 😄

@zellyn

This comment has been minimized.

Show comment
Hide comment
@zellyn

zellyn Mar 10, 2017

If you haven't seen it, fantastic and insightful comment supporting your approach to self-hosting only when ready: https://lobste.rs/s/gokjbo/gitea_1_1_0_released/comments/dg9pwe#c_dg9pwe

zellyn commented Mar 10, 2017

If you haven't seen it, fantastic and insightful comment supporting your approach to self-hosting only when ready: https://lobste.rs/s/gokjbo/gitea_1_1_0_released/comments/dg9pwe#c_dg9pwe

@bkcsoft

This comment has been minimized.

Show comment
Hide comment
@bkcsoft

bkcsoft Apr 7, 2017

Member

@lunny Now that I think about it (thanks @zellyn for that link 😂 ) Why do we need oauth-provider, complete webhook support, api-documentation, and a complete API for self-hosting?

OAuth Consumer is required (it's merged AFAIK) so people can login using github auth.
Drone only uses push hooks, so why would we need the other?

As for API, not sure why self-hosting requires that at all TBH :)

Member

bkcsoft commented Apr 7, 2017

@lunny Now that I think about it (thanks @zellyn for that link 😂 ) Why do we need oauth-provider, complete webhook support, api-documentation, and a complete API for self-hosting?

OAuth Consumer is required (it's merged AFAIK) so people can login using github auth.
Drone only uses push hooks, so why would we need the other?

As for API, not sure why self-hosting requires that at all TBH :)

@strk

This comment has been minimized.

Show comment
Hide comment
@strk

strk Apr 7, 2017

Member

I agree about trimming that list. Earlier self-hosting will very likely help us setting priorities better :)

Member

strk commented Apr 7, 2017

I agree about trimming that list. Earlier self-hosting will very likely help us setting priorities better :)

@lunny

This comment has been minimized.

Show comment
Hide comment
@lunny

lunny Apr 7, 2017

Member

@bkcsoft maybe we can setup a hosted site and have a try.

Member

lunny commented Apr 7, 2017

@bkcsoft maybe we can setup a hosted site and have a try.

@lunny

This comment has been minimized.

Show comment
Hide comment
@lunny

lunny Apr 7, 2017

Member

@bkcsoft I updated the issue, do you mean that?

Member

lunny commented Apr 7, 2017

@bkcsoft I updated the issue, do you mean that?

@ekozan

This comment has been minimized.

Show comment
Hide comment
@ekozan

ekozan Aug 31, 2017

-> OAuth provider (#27) is not closed

ekozan commented Aug 31, 2017

-> OAuth provider (#27) is not closed

@bkcsoft

This comment has been minimized.

Show comment
Hide comment
@bkcsoft

bkcsoft Aug 31, 2017

Member

@ekozan not closed, but scratched from the list of "things we need"

Member

bkcsoft commented Aug 31, 2017

@ekozan not closed, but scratched from the list of "things we need"

@bkcsoft

This comment has been minimized.

Show comment
Hide comment
@bkcsoft

bkcsoft Sep 14, 2017

Member

Added "Repository Size Limits" since we don't have unlimited storage on the servers...

My proposal for limits:

  • 0 Orgs
  • 3 Repos
  • 1GB/repo
Member

bkcsoft commented Sep 14, 2017

Added "Repository Size Limits" since we don't have unlimited storage on the servers...

My proposal for limits:

  • 0 Orgs
  • 3 Repos
  • 1GB/repo
@lunny

This comment has been minimized.

Show comment
Hide comment
@lunny

lunny Sep 14, 2017

Member

@bkcsoft Did you mean it will be a public service for anyone?

Member

lunny commented Sep 14, 2017

@bkcsoft Did you mean it will be a public service for anyone?

@bkcsoft

This comment has been minimized.

Show comment
Hide comment
@bkcsoft

bkcsoft Sep 14, 2017

Member

Maybe, maybe not, but if it becomes a public service we can't have it unlimited ;)

Member

bkcsoft commented Sep 14, 2017

Maybe, maybe not, but if it becomes a public service we can't have it unlimited ;)

@stevegt

This comment has been minimized.

Show comment
Hide comment
@stevegt

stevegt May 5, 2018

Contributor

I think dogfooding is important enough that repo size limits may not need to be in the critical path for self-hosting gitea. In the first few days after migrating to gitea, I've run across several feature omissions that made me think self-hosting will help focus effort on getting those things done. Gitea is already a fantastic, highly usable, high-performance tool -- it's a real shame you aren't using it yourselves. ;-)

Rather than depend on hard size limits, it might instead be helpful to think about how the self-hosted server is going to be administered, who's going to police bad behavior, and what tools they will want. For instance, contributor forks of the gitea project ought to be supported on gitea's own server. This exposes the risk that a user forks gitea, then pushes warez to their fork. Size limits might help prevent pushing large binaries, but might not help with a list of passwords or credit card numbers. A tool that might help in that case is something that detects alien files by diff line count or rolling hash.

A nice side-effect of having a diff-size tool available is that the code could be available as an option to run during pushes to flag legitimate commits that should have been broken up into smaller pieces anyway. (Related discussion for ways to do this: #3658 (comment).)

I'd bet there are a lot of other subtle things that will need to be addressed for public-facing servers. It might make sense to use a separate "public hosting" master issue or milestone to track these things.

Contributor

stevegt commented May 5, 2018

I think dogfooding is important enough that repo size limits may not need to be in the critical path for self-hosting gitea. In the first few days after migrating to gitea, I've run across several feature omissions that made me think self-hosting will help focus effort on getting those things done. Gitea is already a fantastic, highly usable, high-performance tool -- it's a real shame you aren't using it yourselves. ;-)

Rather than depend on hard size limits, it might instead be helpful to think about how the self-hosted server is going to be administered, who's going to police bad behavior, and what tools they will want. For instance, contributor forks of the gitea project ought to be supported on gitea's own server. This exposes the risk that a user forks gitea, then pushes warez to their fork. Size limits might help prevent pushing large binaries, but might not help with a list of passwords or credit card numbers. A tool that might help in that case is something that detects alien files by diff line count or rolling hash.

A nice side-effect of having a diff-size tool available is that the code could be available as an option to run during pushes to flag legitimate commits that should have been broken up into smaller pieces anyway. (Related discussion for ways to do this: #3658 (comment).)

I'd bet there are a lot of other subtle things that will need to be addressed for public-facing servers. It might make sense to use a separate "public hosting" master issue or milestone to track these things.

@stevegt

This comment has been minimized.

Show comment
Hide comment
@stevegt

stevegt May 5, 2018

Contributor

Speaking of milestones, should this issue be added to 1.5.0?

Contributor

stevegt commented May 5, 2018

Speaking of milestones, should this issue be added to 1.5.0?

@JonasFranzDEV

This comment has been minimized.

Show comment
Hide comment
@JonasFranzDEV

JonasFranzDEV May 6, 2018

Member

@stevegt No, since I think that not all of the PRs will get merged / resolved at 1.5.0.

Member

JonasFranzDEV commented May 6, 2018

@stevegt No, since I think that not all of the PRs will get merged / resolved at 1.5.0.

@lunny

This comment has been minimized.

Show comment
Hide comment
@lunny

lunny May 8, 2018

Member

I removed Repository Size Limits (#3658) from the issue since it will not affect Gitea hosted gitea.

Member

lunny commented May 8, 2018

I removed Repository Size Limits (#3658) from the issue since it will not affect Gitea hosted gitea.

@mxmehl

This comment has been minimized.

Show comment
Hide comment
@mxmehl

mxmehl May 9, 2018

I removed Repository Size Limits (#3658) from the issue since it will not affect Gitea hosted gitea.

Great! I'm positive that the sooner Gitea hosts itself, the faster will the whole project profit from real-life experiences, and gain trust and confidence :)

mxmehl commented May 9, 2018

I removed Repository Size Limits (#3658) from the issue since it will not affect Gitea hosted gitea.

Great! I'm positive that the sooner Gitea hosts itself, the faster will the whole project profit from real-life experiences, and gain trust and confidence :)

@justinclift

This comment has been minimized.

Show comment
Hide comment
@justinclift

justinclift Jun 4, 2018

Contributor

@lafriks mentions in another thread:

Self-hosted would probably require additional funding/sponsorship to pay for additional virtual machine

And @lunny asks above:

@bkcsoft Did you mean it will be a public service for anyone?

Would it be feasible to combine those thoughts into a "How about setting up an online Gitea service, where people pay for (say) private repos?".

If done ok, that should generate the funds to pay for itself + the public repos.

As a concept, it seems to be fairly well travelled ground. 😄

Contributor

justinclift commented Jun 4, 2018

@lafriks mentions in another thread:

Self-hosted would probably require additional funding/sponsorship to pay for additional virtual machine

And @lunny asks above:

@bkcsoft Did you mean it will be a public service for anyone?

Would it be feasible to combine those thoughts into a "How about setting up an online Gitea service, where people pay for (say) private repos?".

If done ok, that should generate the funds to pay for itself + the public repos.

As a concept, it seems to be fairly well travelled ground. 😄

@drsect0r

This comment has been minimized.

Show comment
Hide comment
@drsect0r

drsect0r Jun 4, 2018

Contributor

To promptly add to @justinclift idea; the timing might be right with the current news of Microsoft taking over GitHub.

Contributor

drsect0r commented Jun 4, 2018

To promptly add to @justinclift idea; the timing might be right with the current news of Microsoft taking over GitHub.

@mxmehl

This comment has been minimized.

Show comment
Hide comment
@mxmehl

mxmehl Jun 4, 2018

@lafriks mentions in another thread:

Self-hosted would probably require additional funding/sponsorship to pay for additional virtual machine

I'm confident that there will be funding from the community or sponsorship from organisations to make gitea hosting itself possible. Since Gitea is resource-friendly (yes, GitLab, I'm looking at you) this won't be a big deal.

mxmehl commented Jun 4, 2018

@lafriks mentions in another thread:

Self-hosted would probably require additional funding/sponsorship to pay for additional virtual machine

I'm confident that there will be funding from the community or sponsorship from organisations to make gitea hosting itself possible. Since Gitea is resource-friendly (yes, GitLab, I'm looking at you) this won't be a big deal.

@techknowlogick

This comment has been minimized.

Show comment
Hide comment
@techknowlogick

techknowlogick Jun 4, 2018

Member

@mxmehl so far there have been 5 individuals that have contributed since the opencollective was open last month: https://opencollective.com/gitea

Member

techknowlogick commented Jun 4, 2018

@mxmehl so far there have been 5 individuals that have contributed since the opencollective was open last month: https://opencollective.com/gitea

@lafriks

This comment has been minimized.

Show comment
Hide comment
@lafriks

lafriks Jun 4, 2018

Member

@justinclift as Gitea is purely community for driven there is no way we could set up paid private repositories as that requires creating company, dealing with taxes, and have full time staff to deal with technical problems

Member

lafriks commented Jun 4, 2018

@justinclift as Gitea is purely community for driven there is no way we could set up paid private repositories as that requires creating company, dealing with taxes, and have full time staff to deal with technical problems

@mxmehl

This comment has been minimized.

Show comment
Hide comment
@mxmehl

mxmehl Jun 4, 2018

@mxmehl so far there have been 5 individuals that have contributed since the opencollective was open last month: https://opencollective.com/gitea

@techknowlogick Didn't know this page. Now it's 6 ;)

mxmehl commented Jun 4, 2018

@mxmehl so far there have been 5 individuals that have contributed since the opencollective was open last month: https://opencollective.com/gitea

@techknowlogick Didn't know this page. Now it's 6 ;)

@justinclift

This comment has been minimized.

Show comment
Hide comment
@justinclift

justinclift Jun 4, 2018

Contributor

@lafriks Well.... there are Community projects around - for both software and non-software things - which seem to manage themselves ok, including financial matters, things they pay for, staff (where needed), and so on.

That being said, it does require a level of will to make it happen + keep it going. The people in any needed roles also need to be good custodians (trustworthy, reliable, clueful).

If there's no interest, then it won't go anywhere anyway. Ditto if no suitable "custodian" types can be agreed upon.

From the Open Collective link mentioned above, it looks like some initial seeds are in place. It demonstrates there are people around who are considered ok as custodians. 😄

Contributor

justinclift commented Jun 4, 2018

@lafriks Well.... there are Community projects around - for both software and non-software things - which seem to manage themselves ok, including financial matters, things they pay for, staff (where needed), and so on.

That being said, it does require a level of will to make it happen + keep it going. The people in any needed roles also need to be good custodians (trustworthy, reliable, clueful).

If there's no interest, then it won't go anywhere anyway. Ditto if no suitable "custodian" types can be agreed upon.

From the Open Collective link mentioned above, it looks like some initial seeds are in place. It demonstrates there are people around who are considered ok as custodians. 😄

@lafriks

This comment has been minimized.

Show comment
Hide comment
@lafriks

lafriks Jun 4, 2018

Member

@justinclift I'm not saying it is not possible but just not at current stage but in future it could happen. Currently at least I would better focus on developing new Gitea features and improving documentation :) So any help is much appreciated to move faster to this goal.

Member

lafriks commented Jun 4, 2018

@justinclift I'm not saying it is not possible but just not at current stage but in future it could happen. Currently at least I would better focus on developing new Gitea features and improving documentation :) So any help is much appreciated to move faster to this goal.

@justinclift

This comment has been minimized.

Show comment
Hide comment
@justinclift

justinclift Jun 4, 2018

Contributor

Heh Heh Heh

No worries at all @lafriks. 😄

Contributor

justinclift commented Jun 4, 2018

Heh Heh Heh

No worries at all @lafriks. 😄

aaronpk pushed a commit to indieweb/wiki that referenced this issue Jun 4, 2018

@lunny

This comment has been minimized.

Show comment
Hide comment
@lunny

lunny Jun 5, 2018

Member

First of the goal is Gitea hosted Gitea since github married with Microsoft. :)

Member

lunny commented Jun 5, 2018

First of the goal is Gitea hosted Gitea since github married with Microsoft. :)

@lunny

This comment has been minimized.

Show comment
Hide comment
@lunny

lunny Jun 5, 2018

Member

I think only #2519 and #3748 need review and merge before we close this issue.

Member

lunny commented Jun 5, 2018

I think only #2519 and #3748 need review and merge before we close this issue.

@axifive

This comment has been minimized.

Show comment
Hide comment
@axifive

axifive Jun 5, 2018

Contributor

@bkcsoft

Added "Repository Size Limits" since we don't have unlimited storage on the servers...

My proposal for limits:

  • 0 Orgs
  • 3 Repos
  • 1GB/repo

I think, with the repos quantity limit, we can add allows setting for fork only existing repositories for all users not in the Gitea team:

  • 0 Orgs
  • 3 Repos (allow only forks)
  • 1GB/repo
Contributor

axifive commented Jun 5, 2018

@bkcsoft

Added "Repository Size Limits" since we don't have unlimited storage on the servers...

My proposal for limits:

  • 0 Orgs
  • 3 Repos
  • 1GB/repo

I think, with the repos quantity limit, we can add allows setting for fork only existing repositories for all users not in the Gitea team:

  • 0 Orgs
  • 3 Repos (allow only forks)
  • 1GB/repo
@lafriks

This comment has been minimized.

Show comment
Hide comment
@lafriks

lafriks Jun 5, 2018

Member

I don't think fork count need to be limited, it would be limited by gitea org repository count anyway, so that should be ok.
As for repo size, yeah, probably there should be some limits

Member

lafriks commented Jun 5, 2018

I don't think fork count need to be limited, it would be limited by gitea org repository count anyway, so that should be ok.
As for repo size, yeah, probably there should be some limits

@lunny

This comment has been minimized.

Show comment
Hide comment
@lunny

lunny Jun 5, 2018

Member

We should limit creating orgs, creating repos, so repo size limit is not a necessary issue for Gitea hosted Gitea.

Member

lunny commented Jun 5, 2018

We should limit creating orgs, creating repos, so repo size limit is not a necessary issue for Gitea hosted Gitea.

@stevegt

This comment has been minimized.

Show comment
Hide comment
@stevegt

stevegt Jun 23, 2018

Contributor

We might consider adding #3134 and #4302 (PR and issue backlinks) to the prereq list for self-hosting -- maybe I'm unique, but our own little gitea install started getting unwieldy without those backlinks as soon as we added more than a few users and issues. We've been able to work around that some with issue search, but that's limited without global issue search (#2434/#3841).

Contributor

stevegt commented Jun 23, 2018

We might consider adding #3134 and #4302 (PR and issue backlinks) to the prereq list for self-hosting -- maybe I'm unique, but our own little gitea install started getting unwieldy without those backlinks as soon as we added more than a few users and issues. We've been able to work around that some with issue search, but that's limited without global issue search (#2434/#3841).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment