Migrating gitea repo to gitea repo leads to really huge repository

[99rgosse]

Description

Hello
While working on another bug I tried to import the problematic repository from my other gitea instance.
I noticed that the migration takes a really long time and is consuming disk space

Original Gitea instance : 1.16.5 - Repository Size : 862M with 2,6k Pull requests
Migration Gitea Instance : built from source (1.17...) - Repository size (migration still not finished) 100Gb

When all the disk space is consumed, the task fail and the repository is deleted.

Gitea Version

1.16.5 / 1.17 dev

Can you reproduce the bug on the Gitea demo site?

No

Log Gist

No response

Screenshots

Git Version

2.27

Operating System

Linux

How are you running Gitea?

The original gitea is on Docker 1.16.5 with postgresql
The migration is taking part on a built from source on Linux Ubuntu 18.04 with sqlite, and does the same with a PGsql

Database

SQLite & Postgresql

[supermangithu]

I think our problem and things we faced is similar to you #19593
It‘s about migrating gitea repo /SQLdatabase from normal install(SQLite) to another database.
Did you solve it ? Can you show me some technical details on solving the problem?Kindly regards.

[99rgosse]

Hello !
I did not have time yet to investigate this issue unfortunately, it is just that migrating gitea to gitea leads to some kind of "recursion" when it migrates the pull requests.
To have something really quick, you can dump a backup and restore it, it is really more fast.

As I see you ask for differential backup you could still try to make it repo per repo : https://docs.gitea.io/en-us/command-line/#dump-repo

[supermangithu]

Hello ! I did not have time yet to investigate this issue unfortunately, it is just that migrating gitea to gitea leads to some kind of "recursion" when it migrates the pull requests. To have something really quick, you can dump a backup and restore it, it is really more fast.

As I see you ask for differential backup you could still try to make it repo per repo : https://docs.gitea.io/en-us/command-line/#dump-repo

Yes, with ./gitea dump command. Oh I see you are importing a huge repository from another instance. Our problem is using dump to export a huge SQL database.emmmm I kindly hope Gitea official add " incremental"and"and"differential" backup mode(and restore),This may not a formal backup mode like other snapshot software(I guess),What I mentioned maybe like " incremental"and"and"differential" export database ?
Thanks in advance!