[Bug][upgrade] upgrade from 1.0.3-beta5 to beta15 fails

[Damounet]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

I had an old instance of apache devlake that was setup last year, worked a bit on it and let it run for a few month without using it.
These days, the dora metrics needs was bump in our roadmap and we got devlake up again.

I tried to upgrade our instance (deployed on GCP via helm chart) from beta 5 to beta15, but the migration process fails.

time="2026-08-06 12:00:58" level=info msg=" [migrator] applying migration script change _tool_sonarqube_issue_code_blocks.component type to text:20260701000000"
time="2026-08-06 12:00:58" level=info msg="\x1b[31;1m/app/impls/dalgorm/dalgorm.go:456 \x1b[35;1mError 1091 (42000): Can't DROP 'idx__tool_sonarqube_issue_code_blocks_component'; check that column/key exists\n\x1b[0m\x1b[33m[2.342ms] \x1b[34;1m[rows:0]\x1b[0m DROP INDEX `idx__tool_sonarqube_issue_code_blocks_component` ON `_tool_sonarqube_issue_code_blocks`"
time="2026-08-06 12:00:58" level=error msg="failed to execute migration\n\tcaused by: Error 1091 (42000): Can't DROP 'idx__tool_sonarqube_issue_code_blocks_component'; check that column/key exists (500)\n\tWraps: (2) Error 1091 (42000): Can't DROP 'idx__tool_sonarqube_issue_code_blocks_component'; check that column/key exists\n\tError types: (1) *hintdetail.withDetail (2) *mysql.MySQLError"


�[31m2026/08/06 12:00:58 [Recovery] 2026/08/06 - 12:00:58 panic recovered:
[GIN] 2026/08/06 - 12:00:58 | 500 | 11.142794944s |       127.0.0.1 | GET      "/proceed-db-migration"
GET /proceed-db-migration HTTP/1.1
Host: apache-devlake-lake.apache-devlake.svc.cluster.local:8080
Accept: application/json, text/plain, */*
Accept-Encoding: gzip, deflate, br, zstd
Accept-Language: fr-FR,fr;q=0.9,en-US;q=0.8,en;q=0.7
Cache-Control: no-cache
Pragma: no-cache
Priority: u=1, i
Referer: https://devlake.platform.isoftcloud.cloud/db-migrate
Sec-Ch-Ua: "Not=A?Brand";v="99", "Google Chrome";v="151", "Chromium";v="151"
Sec-Ch-Ua-Mobile: ?0
Sec-Ch-Ua-Platform: "Windows"
Sec-Fetch-Dest: empty
Sec-Fetch-Mode: cors
Sec-Fetch-Site: same-origin
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.0.0 Safari/537.36
X-Forwarded-For: 127.0.0.1
X-Forwarded-Host: devlake.platform.isoftcloud.cloud
X-Forwarded-Port: 443
X-Forwarded-Proto: https
X-Forwarded-Scheme: https
X-Real-Ip: 127.0.0.1
X-Request-Id: 5ca0b78552ce153d408294f0ed253733
X-Scheme: https


Error 1091 (42000): Can't DROP 'idx__tool_sonarqube_issue_code_blocks_component'; check that column/key exists (500)
Wraps: (2) Error 1091 (42000): Can't DROP 'idx__tool_sonarqube_issue_code_blocks_component'; check that column/key exists
Error types: (1) *hintdetail.withDetail (2) *mysql.MySQLError
/app/core/errors/util.go:34 (0x16b6fc4)
/app/server/api/api.go:134 (0x16b6f72)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 (0x12cc44a)
/app/server/api/auth/middleware.go:140 (0x16b2acf)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 (0x12cc44a)
/app/server/api/auth/middleware.go:104 (0x16b2c45)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 (0x16b44a5)
/app/server/api/middlewares.go:114 (0x16b4493)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 (0x12cc44a)
/app/server/api/auth/middleware.go:61 (0x16b2f84)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 (0x16b4d81)
/app/server/api/middlewares.go:157 (0x16b49de)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 (0x16b483d)
/app/server/api/middlewares.go:135 (0x16b4716)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 (0x12d986e)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/recovery.go:102 (0x12d985b)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 (0x12d895c)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/logger.go:240 (0x12d8943)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 (0x12d7d1a)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:620 (0x12d79a7)
/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:576 (0x12d74ec)
/usr/local/go/src/net/http/server.go:3311 (0xdd208d)
/usr/local/go/src/net/http/server.go:2073 (0xdafdaf)
/usr/local/go/src/runtime/asm_amd64.s:1771 (0xa98a00)
�[0m

full log of the pod: apache-devlake-apache-devlake-lake-597779c69f-jghbw-lake.log

It did do some stuff, rising the number of table from 388 to 472 but can't finish the job.
This is my second test, restored an old backup to try again, same issue.

How can I upgrade my instance?
Do I need to start from a fresh one ? Can I retrieve the 30Go of data that is part of my dump in my new instance?

What do you expect to happen

The migration must succeed

How to reproduce

Can't really share my 30 Go dump with our internal data.

But having a beta5 instance and try to upgrade it directly to beta15 ?

Anything else

No response

Version

v1.0.3-beta5/15

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[VaughanJ]

fixed here