v0.19.0

New Features

• [PagerDuty] Add data source dashboard for PagerDuty: #5605
• [Config UI] Improve the ux of the sync frequency setting: #5382
• [Config UI] Allow Data Scope search when creating a Blueprint in the user flow: #5203
• [Config UI] Adding more info to the project list: #4654
• [Data Model] Modeling issue relations: #5688
• [Bamboo] Collect Bamboo deployments: #5381
• [Bamboo] Use Plan as the data scope of Bamboo CI: #5317
• [GitLab] Filter out the GitLab repos that users only have the Guest permission when setting data scope: #5104

Bug Fixes

• [Framework] Explicit manual migrations for Remote plugins: #5689

How to Upgrade

For docker-compose users, please update your docker-compose.yml file with the following image tags:

• apache/devlake:v0.19.0
• apache/devlake-dashboard:v0.19.0
• apache/devlake-config-ui:v0.19.0

For helm users, please follow our docs

v0.20.0-beta5

What's Changed

• fix cert update issue (#6622) in #6625

Full Changelog: v0.20.0-beta4...v0.20.0-beta5

v0.19.1-beta3

What's Changed

• #6484 fix(pipeline): fix potiential panic to v0.19 in #6487
• #6488 fix(bamboo): update tool layer table _tool_bamboo_plan_build_commits's schema to v0.19 in #6489
• #6483 fix: yarn library license issues in #6515
• fix(config-ui): bamboo connection helptooltip link error in #6523
• #6507 fix: add collect sonarqube mode by file in #6531
• fix cert update issue (#6622) in #6624

Full Changelog: v0.19.1-beta2...v0.19.1-beta3

v0.18.1-beta3

What's Changed

• fix(config-ui): missed entities when upgraded in #6287
• fix cert update issue (#6622) in #6623

Full Changelog: v0.18.1-beta2...v0.18.1-beta3

v0.20.0-beta4

What's Changed

• refactor: added CreateAndRunApiServer in #6582
• fix: split the collector into collector+extractor in #6590
• fix: incorrect datetime value: '0000-00-00' for column latest_updated in #6591
• fix: github grapahql increment collector #6603
• fix(config-ui): wrong default value in #6604
• fix(config-ui): use fullname to replace name in data scope search in #6605

Full Changelog: v0.20.0-beta3...v0.20.0-beta4

v0.20.0-beta3

What's Changed

• fix(pipeline): fix potiential panic to v0.20 by @d4x1 in #6486
• fix(config-ui): style error for connection name by @mintsweet in #6482
• fix(bamboo): update tool layer table _tool_bamboo_plan_build_commits's schema to v0.20 by @d4x1 in #6490
• fix: panic during github_graphql task when grabbing deployments by @github-actions in #6514
• fix: yarn library license issues by @github-actions in #6516
• fix: update certifi version to address CVE-2023-37920 (#6509) to v0.20 by @klesh in #6518
• fix: add collect sonarqube mode by file by @github-actions in #6532
• fix(config-ui): add label UTC to sync frequency by @github-actions in #6533
• fix(db): add missing primary keys to v0.20 by @d4x1 in #6534

Full Changelog: v0.20.0-beta2...v0.20.0-beta3

v0.20.0-beta2

Bug Fixes

• [Webhook] add migration script when webhooks have no API keys #6467
• [Config UI] show error when initializing connection error #6467
• [Jenkins] subtask convertStages ended unexpectedly, encoding error when converting value #6463
• [Grafana] current grafana version 9.5.2 authentication bypass vulnerability #6456

v0.19.1-beta2

Bug Fixes

• [Grafana] Fixes the current grafana version 9.5.2 authentication bypass vulnerability: #6456
• [Jenkins] Fixes the subtask convertStages ended unexpectedly, encoding error when converting value: #6463

How to Upgrade

Please follow the steps below to upgrade Apache Incubator DevLake:
Important Note: This upgrade requires manual configuration for the "ENCRYPTION_SECRET" (Formerly referred to as 'ENCODE_KEY' in versions preceding v0.18.0). You can copy the value of your existing "ENCODE_KEY" and set it as the value for "ENCRYPTION_SECRET".

For Docker Compose and Kubernetes (k8s) Users:

1. Update your docker-compose.yml or k8s-deploy.yaml file with the following image tags:
   • devlake.docker.scarf.sh/apache/devlake:v0.19.1-beta2
   • devlake.docker.scarf.sh/apache/devlake-dashboard:v0.19.1-beta2
   • devlake.docker.scarf.sh/apache/devlake-config-ui:v0.19.1-beta2
2. Set the value for "ENCRYPTION_SECRET" by copying the value of your existing "ENCODE_KEY". Please refer to the documentation at Docker Compose Setup for detailed instructions based on your installation method.

For Helm Users:

1. Follow the instructions provided in the documentation at Helm Setup.
2. Ensure that you have set the value for "ENCRYPTION_SECRET" by copying the value of your existing "ENCODE_KEY".

Upgrade Notes:
For detailed upgrade instructions and further information, please refer to the documentation at Upgrade Guide.

v0.20.0-beta1

New Features

• [Website] Add the full-text search to the website: #605
• [Data Schema] Add deployment table in domain layer: #5475
• [Data Schema] Update transformation rules for status and result fields in tables cicd_tasks \ cicd_pipelines \ cicd_deployment_commits : #6398
• [Config UI] Add transform-box-styled UI to "Select Data Scope": #5640
• [Config UI] Add the Pipeline list back: #3673
• [Jira] Support extracting array data from Jira's raw layer: #5868
• [Jira] Search boards for adding data scope: #5089
• [GitHub/GitLab] Collect deployments from GitLab/GitHub: #5949
• [GitLab] Allow selecting GitLab projects owned by others that have no groups: #5914
• [GitExtractor] Make commit files collection optional: #5819

Bug Fixes

• [GitHub] Support using the branch_name of a GitHub run to indicate the environment: #6128
• [GitHub] Settings for GitHub App configuration: #5723
• [Azure Devops] Fix 400 error when cloning Azure repos#6246
• [Azure Devops] Add missing fields in _tool_azuredevops_gitrepositoryconfigs and _tool_azuredevops_gitrepositories : #6240
• [Bamboo] Fix cicd_deployment_commits.id, remove PlanResultKey from the primary key list from BambooDeployBuild#6375
• [Bamboo] Keep plan name the same in both /search-remote-scopes and /remote-scopes: #6284
• [BitBucket] Fix wrong create_date in pull_request_comments: #6367
• [BitBucket] normalise cicd_deployment_commits.environment field: #6333
• [BitBucket] Add build number to pipeline's name: #6330
• [BitBucket] lots of fixes about result\status and pipeline's name fields : #6321
• [BitBucket] Make cicd_tasks.type empty#6297
• [TAPD] Fix JSON unmarshal error when decoding bug and story status : #6396 #6379
• [TAPD] Update workspace's id and parent_id's type: #6239
• [PagerDuty] Search remote scope by keyword: #6255
• [Zentao] Fix type conversion when setting scopes: #6286
• [Gitextractor] Update close function: #6306
• [Config UI] Fix the enableGraphql option in the GitHub connection: #6391
• [Framework] Remove deprecated position fields in table pull_request_comments: #6393

Refactors

• [Framwork] Break up Blueprint config in the database : #5360
• [Framwork] Adjust the API about scope: #6198
• [Framework] Remove Temporal support: #6176
• [Framework] Convert bp.settings into multiple tables: #6006
• [Gitextractor]: Move "clone a repo" from "PrePareTaskData" to a new subtask called "CloneGitRepo": #5992
• [Developer] Deprecate plugin code generator: #5922
• [Tap] Remove all Singer Spec / tap related tables and code: #5923
• [Framework] Unify Field types for JSON : #3729

Breaking Changes

• [Framework] Allow users to configure the sync modes for plugins that support incremental sync: #5841
• [Framework] Add API Keys Management: #5791 (Webhooks will be effected, see #6472)
• [Framwork] Unify connection/scope/scopeConfig helpers : #5519

How to Upgrade

Please follow the steps below to upgrade Apache Incubator DevLake:

For Docker Compose and Kubernetes (k8s) Users:

1. Update your docker-compose.yml or k8s-deploy.yaml file with the following image tags:

• apache/devlake:v0.20.0-beta1
• apache/devlake-dashboard:v0.20.0-beta1
• apache/devlake-config-ui:v0.20.0-beta1

2. Set the value for "ENCRYPTION_SECRET". Please refer to the documentation at Docker Compose Setup for detailed instructions based on your installation method.

For Helm Users:

1. Follow the instructions provided in the documentation at Helm Setup.
2. Ensure that you have set the value for "ENCRYPTION_SECRET".

Upgrade Notes:

For detailed upgrade instructions and further information, please refer to the documentation in Upgrade Guide.

v0.19.1-beta1

Bug Fixes

• [Azure Devops] Fixes can not add repositories: #6401
• [Azure DevOps] Fixes devlake does not display list of repositories when there are more than 200 repos under a project: #6244
• [Zentao] Fixes subtask collectTaskRepoCommits ended unexpectedly: #6433
• [Gitlab] Removes the GitLab cloud non-own organization repos: #6438

How to Upgrade

Please follow the steps below to upgrade Apache Incubator DevLake:
Important Note: This upgrade requires manual configuration for the "ENCRYPTION_SECRET" (Formerly referred to as 'ENCODE_KEY' in versions preceding v0.18.0). You can copy the value of your existing "ENCODE_KEY" and set it as the value for "ENCRYPTION_SECRET".

For Docker Compose and Kubernetes (k8s) Users:

1. Update your docker-compose.yml or k8s-deploy.yaml file with the following image tags:
   • devlake.docker.scarf.sh/apache/devlake:v0.19.1-beta1
   • devlake.docker.scarf.sh/apache/devlake-dashboard:v0.19.1-beta1
   • devlake.docker.scarf.sh/apache/devlake-config-ui:v0.19.1-beta1
2. Set the value for "ENCRYPTION_SECRET" by copying the value of your existing "ENCODE_KEY". Please refer to the documentation at Docker Compose Setup for detailed instructions based on your installation method.

For Helm Users:

1. Follow the instructions provided in the documentation at Helm Setup.
2. Ensure that you have set the value for "ENCRYPTION_SECRET" by copying the value of your existing "ENCODE_KEY".

Upgrade Notes:
For detailed upgrade instructions and further information, please refer to the documentation at Upgrade Guide.