[Question][devLake UI] Helm chart deployed successful but UI show "New Migration Scripts Detected"

[DevOpsAutomationCloud]

Question

This is a fresh installation on GKE cluster. Helm chart deployed successful with newly created ENCRYPTION_SECRET.

helm install devlake devlake/devlake --version=1.0.1-beta9 --set lake.encryptionSecret.secret=$ENCRYPTION_SECRET --set commonEnvs.TZ="EST",grafana.env.TZ="EST" -n devlake

Port forward to my local:

kubectl -n devlake port-forward service/devlake-ui 30090:4000

Open browser to "http://localhost:30090/", then it redirect to migration page.

This is a new fresh installation(first time deploy to GKE and in a newly created namespace), why it redirect to migration page?

Screenshots

Additional context

Add any other context here.

[dosubot]

Hey @diwangcanada! I'm here to help you with any bugs, questions, or contributions. Let's work together to solve this issue.

The DevLake UI redirects to the migration page after a fresh installation on a GKE cluster using the provided Helm chart because the ENCRYPTION_SECRET environment variable is required to encrypt sensitive information in the database. If this secret is not set correctly, the application will not function properly and may redirect to the migration page.

To ensure the ENCRYPTION_SECRET is set correctly, follow these steps during installation:

1. Generate a secure encryption key:

   openssl rand -base64 2000 | tr -dc 'A-Z' | fold -w 128 | head -n 1

2. Set the ENCRYPTION_SECRET environment variable:

   export ENCRYPTION_SECRET="copied string"

3. Install the Helm chart with the encryption secret:

   helm repo add devlake https://apache.github.io/incubator-devlake-helm-chart
   helm repo update
   helm install devlake devlake/devlake --version=1.0.1-beta9 --set lake.encryptionSecret.secret=$ENCRYPTION_SECRET --set commonEnvs.TZ="EST" --set grafana.env.TZ="EST" -n devlake

Ensure that the ENCRYPTION_SECRET is kept safe and is correctly set during the installation process ^{[1][2][3][4][5]}.

To continue talking to Dosu, mention @dosu.

[DevOpsAutomationCloud]

I did created encryption secret, here is the exact command I run:

➜ tmp ENCRYPTION_SECRET=$(openssl rand -base64 2000 | tr -dc 'A-Z' | fold -w 128 | head -n 1)
➜ tmp helm install devlake devlake/devlake --version=1.0.1-beta9 --set lake.encryptionSecret.secret=$ENCRYPTION_SECRET -n devlake

➜ tmp kubectl -n devlake get secret
NAME TYPE DATA AGE
devlake-encryption-secret Opaque 1 7s
devlake-grafana Opaque 3 7s
devlake-mysql-auth Opaque 6 7s
sh.helm.release.v1.devlake.v1 helm.sh/release.v1 1 7s

➜ tmp kubectl -n devlake get cm
NAME DATA AGE
devlake-grafana 1 16s
kube-root-ca.crt 1 3d23h

➜ tmp kubectl -n devlake get pod
NAME READY STATUS RESTARTS AGE
devlake-grafana-84958c46df-9zls7 1/1 Running 0 2m21s
devlake-lake-5889879f98-gf5m2 1/1 Running 0 2m21s
devlake-mysql-0 1/1 Running 0 2m20s
devlake-ui-6896bdcb9f-jq864 1/1 Running 0 2m21s

➜ tmp kubectl -n devlake get service
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
devlake-grafana ClusterIP 172.19.10.119 80/TCP 2m45s
devlake-lake ClusterIP 172.19.10.81 8080/TCP 2m45s
devlake-mysql ClusterIP 172.19.10.97 3306/TCP 2m45s
devlake-ui NodePort 172.19.10.21 4000:32001/TCP 2m45s

With port-forwarding to my local, I still get the same error

➜ tmp kubectl port-forward service/devlake-ui 4000:4000 -n devlake
Forwarding from 127.0.0.1:4000 -> 4000
Forwarding from [::1]:4000 -> 4000

Handling connection for 4000
Handling connection for 4000

[klesh]

Can you log into the mysql container and check if there is any record in the _devlake_migration_history table?

[DevOpsAutomationCloud]

yes, there are 220 rows of records, but this is a new fresh installation, how come it has migration history?

mysql> select * from _devlake_migration_history;
+-------------------------+----------------+---------------------------------------------------------------------------------------------------------------+------------------+
| created_at              | script_version | script_name                                                                                                   | comment          |
+-------------------------+----------------+---------------------------------------------------------------------------------------------------------------+------------------+
| 2024-09-06 10:29:31.241 |       20240115 | Bitbucket Server init schema 20240115                                                                         | bitbucket_server |
| 2024-09-06 10:29:31.416 |   202209221033 | add commit line change table                                                                                  | Framework        |
| 2024-09-06 10:29:31.444 |  2023041111938 | add column `repo_id` and `commit_sha` at _tool_bitbucket_pipelines                                            | bitbucket        |
| 2024-09-06 10:29:31.683 | 20220406212344 | create init schemas                                                                                           | Framework        |
| 2024-09-06 10:29:31.732 | 20220407201138 | Jira init schemas                                                                                             | jira             |
| 2024-09-06 10:29:31.752 | 20220505212344 | Rename source to connection                                                                                   | jira             |
| 2024-09-06 10:29:31.770 | 20220505212344 | Rename step to stage                                                                                          | Framework        |
| 2024-09-06 10:29:31.801 | 20220601000005 | add column `subtasks` at _devlake_tasks                                                                       | Framework        |
| 2024-09-06 10:29:31.842 | 20220616110537 | add mode field to blueprint                                                                                   | Framework        |
| 2024-09-06 10:29:31.925 | 20220622110537 | blueprint normal mode support                                                                                 | Framework        |
| 2024-09-06 10:29:33.247 | 20220707232344 | create domain layer init schemas                                                                              | Framework        |
| 2024-09-06 10:29:33.292 | 20220711000001 | create subtask schema                                                                                         | Framework        |
| 2024-09-06 10:29:33.806 | 20220714201133 | AE init schemas                                                                                               | ae               |
| 2024-09-06 10:29:33.930 | 20220714201237 | Jenkins init schemas                                                                                          | jenkins          |
| 2024-09-06 10:29:34.715 | 20220714231236 | Gitlab init schemas                                                                                           | gitlab           |
| 2024-09-06 10:29:35.510 | 20220714231268 | Gitee init schemas                                                                                            | gitee            |
| 2024-09-06 10:29:36.438 | 20220715000001 | Github init schemas 20220707                                                                                  | github           |
| 2024-09-06 10:29:37.499 | 20220716201138 | Jira init schemas                                                                                             | jira             |
| 2024-09-06 10:29:37.616 | 20220722165805 | add commit_file_components components table,update commit_files table                                         | Framework        |
| 2024-09-06 10:29:37.648 | 20220725152355 | add project_mapping table to domain layer                                                                     | Framework        |
| 2024-09-06 10:29:37.667 | 20220727165805 | remove notes from domain layer                                                                                | Framework        |
| 2024-09-06 10:29:37.704 | 20220728000001 | Github add github_runs table                                                                                  | github           |
| 2024-09-06 10:29:37.744 | 20220729000001 | Github add github_jobs table                                                                                  | github           |
| 2024-09-06 10:29:37.776 | 20220729165805 | rename pull_request_number to pull_request_key, issue_number to issue_key                                     | Framework        |
| 2024-09-06 10:29:37.860 | 20220729231236 | pipeline and job                                                                                              | gitlab           |
| 2024-09-06 10:29:38.128 | 20220729231237 | Jenkins modify build and job                                                                                  | jenkins          |
| 2024-09-06 10:29:38.370 | 20220801162735 | add NoPKModel to commit_parents                                                                               | Framework        |
| 2024-09-06 10:29:38.414 | 20220803000001 | Github add github_pipelines table                                                                             | github           |
| 2024-09-06 10:29:38.921 | 20220803220824 | Bitbucket init schema 20220803                                                                                | bitbucket        |
| 2024-09-06 10:29:38.990 | 20220804230912 | add pipeline id to job                                                                                        | gitlab           |
| 2024-09-06 10:29:39.117 | 20220818232735 | add cicd models                                                                                               | Framework        |
| 2024-09-06 10:29:39.267 | 20220826120824 | rename user_id to account_id in pull_request_comments and issue_comments                                      | Framework        |
| 2024-09-06 10:29:39.446 | 20220829232735 | modify tables for dora                                                                                        | Framework        |
| 2024-09-06 10:29:39.471 | 20220830142321 | add column `type` at boards                                                                                   | Framework        |
| 2024-09-06 10:29:39.595 | 20220904142321 | encrypt Blueprint                                                                                             | Framework        |
| 2024-09-06 10:29:39.658 | 20220904162121 | encrypt Pipeline                                                                                              | Framework        |
| 2024-09-06 10:29:39.877 | 20220905232735 | modify cicd pipeline                                                                                          | Framework        |
| 2024-09-06 10:29:39.950 | 20220906000005 | UpdateSchemas for fixDurationToFloat8                                                                         | gitlab           |
| 2024-09-06 10:29:39.992 | 20220907230912 | gitlab add _tool_gitlab_pipeline_projects table                                                               | gitlab           |
| 2024-09-06 10:29:40.051 | 20220908000001 | Github delete github_pipelines table                                                                          | github           |
| 2024-09-06 10:29:40.030 | 20220908000001 | webhook init schemas                                                                                          | webhook          |
| 2024-09-06 10:29:40.079 | 20220909232735 | modify cicd tasks                                                                                             | Framework        |
| 2024-09-06 10:29:40.334 | 20220913165805 | add length of commit_file file_path                                                                           | Framework        |
| 2024-09-06 10:29:40.433 | 20220913232735 | modify board repos                                                                                            | Framework        |
| 2024-09-06 10:29:40.528 | 20220913235535 | add origin change lead time for pr                                                                            | Framework        |
| 2024-09-06 10:29:40.566 | 20220914111223 | bitbucket add _tool_bitbucket_pipelines table                                                                 | bitbucket        |
| 2024-09-06 10:29:40.683 | 20220915000025 | UpdateSchemas for renamePipelineCommits                                                                       | Framework        |
| 2024-09-06 10:29:40.819 | 20220916231237 | Jenkins modify build primary key                                                                              | jenkins          |
| 2024-09-06 10:29:40.855 | 20220919223048 | add column `head_repo_id` at tool_github_pull_requests                                                        | github           |
| 2024-09-06 10:29:40.888 | 20220928000001 | add dora benchmark                                                                                            | dora             |
| 2024-09-06 10:29:40.952 | 20220929145125 | modify lead_time_minutes                                                                                      | Framework        |
| 2024-09-06 10:29:40.987 | 20221008182354 | bitbucket add _tool_bitbucket_pull_requests_commits table                                                     | bitbucket        |
| 2024-09-06 10:29:41.018 | 20221009111241 | add snapshot table                                                                                            | Framework        |
| 2024-09-06 10:29:41.051 | 20221013152349 | bitbucket add _tool_bitbucket_deployments table                                                               | bitbucket        |
| 2024-09-06 10:29:41.091 | 20221014114623 | add column `repo_id` and `commit_sha` at _tool_bitbucket_pipelines                                            | bitbucket        |
| 2024-09-06 10:29:41.129 | 20221021183022 | create _tool_icla_committers                                                                                  | icla             |
| 2024-09-06 10:29:41.156 | 20221101000001 | Create collector state table                                                                                  | Framework        |
| 2024-09-06 10:29:41.172 | 20221107000001 | Remove cicd_pipeline_relation                                                                                 | Framework        |
| 2024-09-06 10:29:41.224 | 20221107095744 | add skip_on_fail to _devlake_pipelines and _devlake_blueprint                                                 | Framework        |
| 2024-09-06 10:29:41.342 | 20221108231237 | add fields for jenkins jobs                                                                                   | jenkins          |
| 2024-09-06 10:29:41.403 | 20221108231237 | add job path for builds                                                                                       | jenkins          |
| 2024-09-06 10:29:41.489 | 20221109194734 | add project tables                                                                                            | Framework        |
| 2024-09-06 10:29:43.418 | 20221109201138 | Tapd init schemas                                                                                             | tapd             |
| 2024-09-06 10:29:43.516 | 20221109232735 | modify commits diffs                                                                                          | Framework        |
| 2024-09-06 10:29:43.597 | 20221110231237 | add url to jenkinsJob                                                                                         | jenkins          |
| 2024-09-06 10:29:43.864 | 20221111000001 | add project pr metric tables                                                                                  | Framework        |
| 2024-09-06 10:29:43.887 | 20221111000008 | UpdateSchemas for addEnableGraphqlForConnection                                                               | github           |
| 2024-09-06 10:29:44.298 | 20221115000001 | Opsgenie init schemas                                                                                         | opsgenie         |
| 2024-09-06 10:29:44.490 | 20221115000001 | PagerDuty init schemas                                                                                        | pagerduty        |
| 2024-09-06 10:29:44.562 | 20221115000034 | add labels' schema for blueprint and pipeline                                                                 | Framework        |
| 2024-09-06 10:29:44.620 | 20221117122534 | add table _tool_jira_transformation_rules, add transformation_rule_id to _tool_jira_boards                    | jira             |
| 2024-09-06 10:29:44.646 | 20221117184342 | add project to blueprint                                                                                      | Framework        |
| 2024-09-06 10:29:44.697 | 20221120000001 | add project issue metric tables                                                                               | Framework        |
| 2024-09-06 10:29:44.734 | 20221125000038 | save state for collector                                                                                      | Framework        |
| 2024-09-06 10:29:44.805 | 20221125102502 | add table _tool_gitlab_transformation_rules, add transformation_rule_id and html_url to _tool_gitlab_projects | gitlab           |
| 2024-09-06 10:29:44.935 | 20221131000008 | add full name for builds                                                                                      | jenkins          |
| 2024-09-06 10:29:44.954 | 20221201000001 | rename fields in project pr metric tables                                                                     | Framework        |
| 2024-09-06 10:29:44.979 | 20221201190341 | add enable to project metric                                                                                  | Framework        |
| 2024-09-06 10:29:45.046 | 20221205113502 | add table _tool_jenkins_transformation_rules, add transformation_rule_id to _tool_jenkins_jobs                | jenkins          |
| 2024-09-06 10:29:45.134 | 20221207000001 | add cicd scope and add cicd_scope_id and drop builds&jobs                                                     | Framework        |
| 2024-09-06 10:29:45.416 | 20221214095902 | add table _tool_github_transformation_rules, add transformation_rule_id&clone_url to _tool_github_repos       | github           |
| 2024-09-06 10:29:45.550 | 20221214115900 | concat owner and name for old github_repos and drop owner for github_repos                                    | github           |
| 2024-09-06 10:29:45.584 | 20221215142316 | add project_name to _tool_jira_issues                                                                         | jira             |
| 2024-09-06 10:29:45.614 | 20221215142543 | add original_project to issues                                                                                | Framework        |
| 2024-09-06 10:29:45.668 | 20221221150548 | add error_name to _devlake_tasks and _devlake_pipelines                                                       | Framework        |
| 2024-09-06 10:29:45.733 | 20221221162121 | encrypt task.options                                                                                          | Framework        |
| 2024-09-06 10:29:45.820 | 20221230095900 | add std type to github issue                                                                                  | github           |
| 2024-09-06 10:29:45.767 | 20221230095900 | add std type to gitlab issue                                                                                  | gitlab           |
| 2024-09-06 10:29:45.849 | 20221230162121 | add original type to issue                                                                                    | Framework        |
| 2024-09-06 10:29:45.867 | 20222123191424 | rename project metrics                                                                                        | Framework        |
| 2024-09-06 10:29:45.885 | 20230115201138 | Tapd encode connection token                                                                                  | tapd             |
| 2024-09-06 10:29:45.942 | 20230123000000 | add connection config fields                                                                                  | pagerduty        |
| 2024-09-06 10:29:45.985 | 20230129115901 | add multiauth to _tool_jira_connections                                                                       | jira             |
| 2024-09-06 10:29:46.015 | 20230201093311 | add _tool_customized_fields                                                                                   | customize        |
| 2024-09-06 10:29:46.077 | 20230203201814 | add endpoint/proxy to opsgenie connection                                                                     | opsgenie         |
| 2024-09-06 10:29:46.025 | 20230203201814 | add endpoint/proxy to pagerduty connection                                                                    | pagerduty        |
| 2024-09-06 10:29:46.628 | 20230206000008 | add scope and table _tool_bitbucket_transformation_rules                                                      | bitbucket        |
| 2024-09-06 10:29:46.653 | 20230213200040 | add time_after to _devlake_collector_latest_state                                                             | Framework        |
| 2024-09-06 10:29:46.726 | 20230214145125 | modify issues story_point from int64 to float64                                                               | Framework        |
| 2024-09-06 10:29:46.751 | 20230214232735 | remove _tool_jira_issues column std_story_point                                                               | jira             |
| 2024-09-06 10:29:47.102 | 20230215000009 | add pipeline step                                                                                             | bitbucket        |
| 2024-09-06 10:29:47.215 | 20230222145127 | add commit_sha index for commit_files                                                                         | Framework        |
| 2024-09-06 10:29:47.398 | 20230222153154 | add host, namespace, repo_name to issue_repo_commits                                                          | Framework        |
| 2024-09-06 10:29:47.424 | 20230223112532 | add remotelink_repo_pattern to _tool_jira_transformation_rules                                                | jira             |
| 2024-09-06 10:29:47.442 | 20230223200040 | remove created_date_after from _devlake_collector_latest_state                                                | Framework        |
| 2024-09-06 10:29:47.739 | 20230227220071 | sonarqube init schemas                                                                                        | sonarqube        |
| 2024-09-06 10:29:47.823 | 20230228161031 | add IsDetailRequired to _tool_gitlab_merge_requests and _tool_gitlab_pipelines                                | gitlab           |
| 2024-09-06 10:29:47.990 | 20230301000082 | add code quality domain                                                                                       | Framework        |
| 2024-09-06 10:29:48.048 | 20230303001814 | add transformation rules to opsgenie                                                                          | opsgenie         |
| 2024-09-06 10:29:48.104 | 20230303001814 | add transformation rules to pagerduty                                                                         | pagerduty        |
| 2024-09-06 10:29:48.517 | 20230305000014 | trello init schemas                                                                                           | trello           |
| 2024-09-06 10:29:48.972 | 20230314000001 | teambition init schemas                                                                                       | teambition       |
| 2024-09-06 10:29:49.479 | 20230315205035 | bamboo init schemas                                                                                           | bamboo           |
| 2024-09-06 10:29:49.581 | 20230316220071 | sonarqube modify character set                                                                                | sonarqube        |
| 2024-09-06 10:29:49.737 | 20230321000003 | expend project_key                                                                                            | sonarqube        |
| 2024-09-06 10:29:49.992 | 20230322150357 | add connection_id to _tool_bamboo_transformation_rules                                                        | bamboo           |
| 2024-09-06 10:29:50.022 | 20230322150357 | add connection_id to _tool_bitbucket_transformation_rules                                                     | bitbucket        |
| 2024-09-06 10:29:49.873 | 20230322150357 | add connection_id to _tool_github_transformation_rules                                                        | github           |
| 2024-09-06 10:29:50.051 | 20230322150357 | add connection_id to _tool_gitlab_transformation_rules                                                        | gitlab           |
| 2024-09-06 10:29:49.766 | 20230322150357 | add connection_id to _tool_jenkins_transformation_rules                                                       | jenkins          |
| 2024-09-06 10:29:49.963 | 20230322150357 | add connection_id to _tool_jira_transformation_rules                                                          | jira             |
| 2024-09-06 10:29:49.798 | 20230322150357 | add connection_id to _tool_trello_transformation_rules                                                        | trello           |
| 2024-09-06 10:29:49.933 | 20230322150357 | add type/env to github runs and run_jobs                                                                      | github           |
| 2024-09-06 10:29:49.845 | 20230322150357 | add type/env to gitlab pipelines                                                                              | gitlab           |
| 2024-09-06 10:29:50.370 | 20230322153324 | expand _tool_jira_remotelinks.url and _tool_jira_issue_commits.commit_url to LONGTEXT                         | jira             |
| 2024-09-06 10:29:50.606 | 20230323000003 | Tapd add transformation, update _raw_data_params                                                              | tapd             |
| 2024-09-06 10:29:50.622 | 20230323000004 | Tapd delete issue and remote link                                                                             | tapd             |
| 2024-09-06 10:29:50.876 | 20230326000003 | circleci init schemas                                                                                         | circleci         |
| 2024-09-06 10:29:50.913 | 20230402000041 | add issue_assignees table                                                                                     | Framework        |
| 2024-09-06 10:29:50.933 | 20230405000001 | Rename Collector state table for Singer Taps                                                                  | Framework        |
| 2024-09-06 10:29:50.955 | 20230406170701 | Rename cicd_piopeline_commits repo to repo_url                                                                | Framework        |
| 2024-09-06 10:29:51.062 | 20230410150357 | add type/env to bitbucket pipelines and pipeline_steps                                                        | bitbucket        |
| 2024-09-06 10:29:58.376 | 20230411000004 | modify tapd custom field name                                                                                 | tapd             |
| 2024-09-06 10:29:58.482 | 20230412000011 | add issue desc and comments                                                                                   | jira             |
| 2024-09-06 10:29:58.582 | 20230412000015 | modify tapd custom field name                                                                                 | tapd             |
| 2024-09-06 10:29:58.617 | 20230412142316 | add changelog_total field to _tool_jira_issues                                                                | jira             |
| 2024-09-06 10:29:58.633 | 20230416080701 | Rename project_pr_metrics.deployment_id to deployment_commit_id                                               | Framework        |
| 2024-09-06 10:29:58.818 | 20230417150357 | add repo_id to pr as part of the primary key                                                                  | bitbucket        |
| 2024-09-06 10:29:58.872 | 20230419135129 | add commit author info to _tool_github_pull_request_commits table                                             | github           |
| 2024-09-06 10:29:59.015 | 20230419141352 | add type and environment to bamboo build tables                                                               | bamboo           |
| 2024-09-06 10:29:59.071 | 20230419145129 | add commit author info to pull_request_commits table                                                          | Framework        |
| 2024-09-06 10:29:59.181 | 20230420135129 | add commit author info to _tool_bitbucket_pull_request_commits table                                          | bitbucket        |
| 2024-09-06 10:29:59.126 | 20230420135129 | add commit author info to _tool_gitee_pull_request_commits table                                              | gitee            |
| 2024-09-06 10:29:59.233 | 20230420135129 | add commit author info to _tool_gitlab_mr_commits table                                                       | gitlab           |
| 2024-09-06 10:29:59.478 | 20230421000001 | Feishu init schemas                                                                                           | feishu           |
| 2024-09-06 10:29:59.336 | 20230421000001 | Slack init schemas                                                                                            | slack            |
| 2024-09-06 10:29:59.522 | 20230426150702 | add cicd_deployment_commits table                                                                             | Framework        |
| 2024-09-06 10:29:59.584 | 20230428000010 | UpdateSchemas for addGithubMultiAuth                                                                          | github           |
| 2024-09-06 10:29:59.828 | 20230501000001 | initialize schemas for Azure Devops                                                                           | azuredevops      |
| 2024-09-06 10:30:00.438 | 20230505000001 | zentao init schemas                                                                                           | zentao           |
| 2024-09-06 10:30:00.468 | 20230508162121 | add original status to pull_requests                                                                          | Framework        |
| 2024-09-06 10:30:00.531 | 20230510110029 | expand _tool_jira_remotelinks.self to LONGTEXT                                                                | jira             |
| 2024-09-06 10:30:00.568 | 20230511000001 | add calendar months                                                                                           | Framework        |
| 2024-09-06 10:30:00.594 | 20230512113738 | add repo_url to _tool_jira_issue_commits                                                                      | jira             |
| 2024-09-06 10:30:00.700 | 20230516000001 | change pull_request_comments.pr_id to varchar(255) type                                                       | Framework        |
| 2024-09-06 10:30:00.716 | 20230516000002 | Rename finished_commits_diffs to _tool_refdiff_finished_commits_diffs                                         | Framework        |
| 2024-09-06 10:30:00.746 | 20230517162121 | add updated_date to issue_comments                                                                            | Framework        |
| 2024-09-06 10:30:00.825 | 20230518000002 | UpdateSchemas for fixRunNameToText                                                                            | github           |
| 2024-09-06 10:30:00.881 | 20230518141352 | rename transformation rule to scope config                                                                    | bamboo           |
| 2024-09-06 10:30:01.067 | 20230524181430 | add_build_id_as_job_primary_key                                                                               | azuredevops      |
| 2024-09-06 10:30:01.128 | 20230525161352 | rename transformation rule to scope config                                                                    | bitbucket        |
| 2024-09-06 10:30:01.339 | 20230526161352 | rename transformation rule to scope config for github                                                         | github           |
| 2024-09-06 10:30:01.403 | 20230529173435 | rename transformation rule to scope config for gitlab                                                         | gitlab           |
| 2024-09-06 10:30:01.467 | 20230530134905 | rename transformation rule to scope config for jenkins                                                        | jenkins          |
| 2024-09-06 10:30:01.530 | 20230530150031 | rename transformation rule to scope config for jira                                                           | jira             |
| 2024-09-06 10:30:01.570 | 20230530161510 | add _tool_github_issue_assignees table                                                                        | github           |
| 2024-09-06 10:30:01.706 | 20230531130109 | rename transformation rule to scope config for opsgenie                                                       | opsgenie         |
| 2024-09-06 10:30:01.638 | 20230531130109 | rename transformation rule to scope config for pagerduty                                                      | pagerduty        |
| 2024-09-06 10:30:01.775 | 20230531135926 | rename transformation rule to scope config for tapd                                                           | tapd             |
| 2024-09-06 10:30:01.835 | 20230531150250 | rename transformation rule to scope config for trello                                                         | trello           |
| 2024-09-06 10:30:01.863 | 20230601213738 | add application_type to _tool_jira_scope_configs                                                              | jira             |
| 2024-09-06 10:30:02.372 | 20230602000001 | zentao add scope config tables                                                                                | zentao           |
| 2024-09-06 10:30:02.619 | 20230605000011 | zentao add issue repo commits tables                                                                          | zentao           |
| 2024-09-06 10:30:02.635 | 20230605130109 | remove _tool_opsgenie_scope_configs table                                                                     | opsgenie         |
| 2024-09-06 10:30:02.650 | 20230605130109 | remove _tool_pagerduty_scope_configs table                                                                    | pagerduty        |
| 2024-09-06 10:30:02.691 | 20230606110339 | add _tool_gitlab_issue_assignees table                                                                        | gitlab           |
| 2024-09-06 10:30:02.712 | 20230606165630 | rename_tx_rule_table_to_scope_config                                                                          | azuredevops      |
| 2024-09-06 10:30:02.735 | 20230607165630 | add entities column to gitrepositoryconfig table                                                              | azuredevops      |
| 2024-09-06 10:30:02.899 | 20230608000001 | zentao init changelog schemas                                                                                 | zentao           |
| 2024-09-06 10:30:02.902 | 20230609093856 | clear the value of _tool_jira_scope_configs.remotelink_repo_pattern                                           | jira             |
| 2024-09-06 10:30:02.934 | 20230612184111 | add full_name to _tool_github_repos                                                                           | github           |
| 2024-09-06 10:30:02.990 | 20230625110339 | add squash and diff sha columns                                                                               | gitlab           |
| 2024-09-06 10:30:03.035 | 20230627000001 | zentao init changelog schemas                                                                                 | zentao           |
| 2024-09-06 10:30:03.038 | 20230630000001 | populated _raw_data_table column for azuredevops git repos                                                    | azuredevops      |
| 2024-09-06 10:30:03.049 | 20230630000002 | populated _raw_data columns for jenkins jobs                                                                  | jenkins          |
| 2024-09-06 10:30:03.058 | 20230630000002 | populated _raw_data columns for opsgenie services                                                             | opsgenie         |
| 2024-09-06 10:30:03.061 | 20230630000002 | populated _raw_data columns for pagerduty services                                                            | pagerduty        |
| 2024-09-06 10:30:03.042 | 20230630000002 | populated _raw_data columns for tapd workspaces                                                               | tapd             |
| 2024-09-06 10:30:03.055 | 20230630000002 | populated _raw_data columns for trello boards                                                                 | trello           |
| 2024-09-06 10:30:03.052 | 20230630000002 | populated _raw_data columns for zentao projects                                                               | zentao           |
| 2024-09-06 10:30:03.336 | 20230705135809 | add table _tool_zentao_execution_stories, _tool_zentao_execution_summary and _tool_zentao_product_summary     | zentao           |
| 2024-09-06 10:30:03.361 | 20230712095900 | add archived to _tool_gitlab_projects                                                                         | gitlab           |
| 2024-09-06 10:30:03.364 | 20230714000001 | populated _raw_data columns for azuredevops                                                                   | azuredevops      |
| 2024-09-06 10:30:03.396 | 20230725093602 | add scope_config_id to _tool_bamboo_plans                                                                     | bamboo           |
| 2024-09-06 10:30:03.453 | 20230725142900 | add api key tables                                                                                            | Framework        |
| 2024-09-06 10:30:03.491 | 20230727122534 | add table _tool_jira_issue_relationships table                                                                | jira             |
| 2024-09-06 10:30:03.558 | 20230728162121 | tasks uses json                                                                                               | Framework        |
| 2024-09-06 10:30:03.579 | 20230801213814 | add env_name_pattern to _tool_bamboo_scope_configs                                                            | bamboo           |
| 2024-09-06 10:30:03.589 | 20230802000001 | rename startTime/finishTime to start_time/finish_time                                                         | azuredevops      |
| 2024-09-06 10:30:03.618 | 20230803145723 | drop the column total_real from the table _tool_zentao_projects                                               | zentao           |
| 2024-09-06 10:30:03.698 | 20230807165119 | add plan_result_key to _tool_bamboo_deploy_build and _tool_bamboo_plan_build_commits                          | bamboo           |
| 2024-09-06 10:30:03.722 | 20230808162534 | add table _tool_jira_issues.all_fields column                                                                 | jira             |
| 2024-09-06 10:30:03.763 | 20230816000001 | add issue_relationships table                                                                                 | Framework        |
| 2024-09-06 10:30:03.821 | 20230821145125 | modify cicd_pipelines name from varchar to text                                                               | Framework        |
| 2024-09-06 10:30:03.844 | 20230822145125 | drop _devlake_collector_tap_state table                                                                       | Framework        |
| 2024-09-06 10:30:04.094 | 20230825090504 | Decrypt Azure DevOps connection fields                                                                        | azuredevops      |
| 2024-09-06 10:30:04.106 | 20230825150421 | add missing migrations from 0.17 to 0.18                                                                      | azuredevops      |
| 2024-09-06 10:30:04.268 | 20230829145125 | normalize bp settings to multiple tables                                                                      | Framework        |
| 2024-09-06 10:30:04.325 | 20230831162403 | add cicd deployments table                                                                                    | Framework        |
| 2024-09-06 10:30:04.338 | 20230905000000 | add connection config fields                                                                                  | opsgenie         |
| 2024-09-06 10:30:04.444 | 20230911000041 | add sync policy to _devlake_blueprints and _devlake_pipelines table                                           | Framework        |
| 2024-09-06 10:30:04.482 | 20230913170100 | add github deployment table                                                                                   | github           |
| 2024-09-06 10:30:04.502 | 20230919000000 | rename _tool_bamboo_deploy_build to _tool_bamboo_deploy_builds                                                | bamboo           |
| 2024-09-06 10:30:04.529 | 20230919000001 | rename _tool_bamboo_deploy_environment to _tool_bamboo_deploy_environments                                    | bamboo           |
| 2024-09-06 10:30:04.554 | 20230920000001 | rename raw tables' name to their plural form                                                                  | bamboo           |
| 2024-09-06 10:30:04.586 | 20230920130004 | add priority to _tool_pagerduty_incidents table                                                               | pagerduty        |
| 2024-09-06 10:30:04.625 | 20230921000083 | add issue custom array field                                                                                  | Framework        |
| 2024-09-06 10:30:04.687 | 20230922152829 | add scope_config_id to _tool_gitee_repos table                                                                | gitee            |
| 2024-09-06 10:30:04.654 | 20230922152829 | add scope_config_id to _tool_sonarqube_projects table                                                         | sonarqube        |
| 2024-09-06 10:30:04.740 | 20230926140000 | add deployment table in tool layer                                                                            | gitlab           |
+-------------------------+----------------+---------------------------------------------------------------------------------------------------------------+------------------+
220 rows in set (0.00 sec)

mysql>

[DevOpsAutomationCloud]

I see these PV get created, and looks like not cleaned up when uninstall helm chart? I uninstalled and installed several times in the past few days.

➜  tmp kubectl -n devlake get pv -n devlake |grep mysql
pvc-6f10b9ba-f1bb-4477-870c-b6595c7da39b   50Gi       RWO            Delete           Bound      default/devlake-mysql-data-devlake-mysql-0   standard                22h
pvc-de9144d5-506c-428a-a8ae-bd49191db5cd   50Gi       RWO            Delete           Bound      devlake/devlake-mysql-data-devlake-mysql-0   standard                3d22h

[DevOpsAutomationCloud]

Delete all devlake pvc and pv, and re-install helm chart, proceed migration process.
Wait a few mins and it successfully landed to the DevLake home page.

However, mysql command hanging on below:

mysql> use lake;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

[klesh]

This could help: https://dba.stackexchange.com/questions/99304/use-db-name-takes-too-long-to-change-when-login-remotely

Delete all devlake pvc and pv, and re-install helm chart, proceed migration process. Wait a few mins and it successfully landed to the DevLake home page.

However, mysql command hanging on below:

mysql> use lake;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

I would guess the container somehow got killed during the first boot-up, and you were actually seeing the second boot with some previously executed scripts in the database.

[DevOpsAutomationCloud]

Looks like that is what happened.
However, the pv reclaim policy is "delete", it should be cleaned up when uninstall helm chart, right? but it didn't and left over which was picked up later by a new helm chart installation.

[klesh]

@diwangcanada I am not familiar with helm-chart.

Can you check why it got killed on the first boot? I think we need to address the problem because there were already a couple of reports.

[DevOpsAutomationCloud]

The pvc did not release after uninstall helm chart because of the protection. This is properly by design, but does it make more sense to set pv reclaim policy to "retain"?

➜  tmp kubectl -n devlake describe pvc devlake-mysql-data-devlake-mysql-0
Name:          devlake-mysql-data-devlake-mysql-0
Namespace:     devlake
StorageClass:  standard
Status:        Bound
Volume:        pvc-1ebb7410-0e43-460f-af0b-f7d4be573b2a
Labels:        app.kubernetes.io/instance=devlake
               app.kubernetes.io/name=devlake
Annotations:   pv.kubernetes.io/bind-completed: yes
               pv.kubernetes.io/bound-by-controller: yes
               volume.beta.kubernetes.io/storage-provisioner: pd.csi.storage.gke.io
               volume.kubernetes.io/storage-provisioner: pd.csi.storage.gke.io
**Finalizers:    [kubernetes.io/pvc-protection]**
Capacity:      50Gi
Access Modes:  RWO
VolumeMode:    Filesystem
Used By:       <none>
Events:        <none>

Btw, pvc "devlake-grafana" also has the same protection finalizer, but it was released after uninstall helm chart.

[DevOpsAutomationCloud]

@diwangcanada I am not familiar with helm-chart.

Can you check why it got killed on the first boot? I think we need to address the problem because there were already a couple of reports.

Unfortunately, I re-installed a few times, but can't reproduce the same issue again.

[klesh]

@diwangcanada I am not familiar with helm-chart.
Can you check why it got killed on the first boot? I think we need to address the problem because there were already a couple of reports.

Unfortunately, I re-installed a few times, but can't reproduce the same issue again.

No worry.
Let me know if you run into the problem again.