v34.0.0

Changelog:

• Add ability to "group" pipeline steps to control their inclusion in a pipeline run.
  The groups can be selected in the UI, or provided using the
  "pipeline_name:group1,group2" syntax in CLI and REST API. #1045

• Refine pipeline choices in the "Add pipeline" modal based on the project context.

  • When there is at least one existing pipeline in the project, the modal now includes
    all addon pipelines along with the existing pipeline for selection.
  • In cases where no pipelines are assigned to the project, the modal displays all
    base (non-addon) pipelines for user selection. #1071

• Rename pipeline for consistency and precision:

  • scan_codebase_packages: inspect_packages

  Restructure the inspect_manifest pipeline into:

  • load_sbom: for loading SPDX/CycloneDX SBOMs and ABOUT files
  • resolve_dependencies: for resolving package dependencies
  • inspect_packages: gets package data from package manifests/lockfiles

  A data migration is included to facilitate the migration of existing data.
  Only the new names are available in the web UI but the REST API and CLI are backward
  compatible with the old names. #1034 https://github.com/nexB/scancode.io/discussions/1035

• Remove "packageFileName" entry from SPDX output. #1076

• Add an add-on pipeline for collecting DWARF debug symbol compilation
  unit paths when available from elfs. aboutcode-org/purldb#260

• Extract all archives recursively in the scan_single_package pipeline. #1081

• Add URL scheme validation with explicit error messages for input URLs. #1047

• All supported output_format can now be downloaded using the results_download API
  action providing a value for the new output_format parameter. #1091

• Add settings related to fetching private files. Those settings allow to
  define credentials for various authentication types. #620 #203

• Update matchcode-toolkit to v3.0.0

What's Changed

• Refine pipeline choices in the "Add pipeline" modal #1071 by @tdruez in #1072
• Add ability to "group" pipeline steps to control inclusion #1045 by @tdruez in #1055
• Improve the documentation about external service (integrations) by @tdruez in #1073
• Restructure pipelines for verbosity by @AyanSinhaMahapatra in #1074
• Add an add-on pipeline for collecting dwarfs from elfs by @TG1999 in #1068
• Run the extract_archives step in ScanSinglePackage #1081 by @tdruez in #1083
• Use new /collect/index_packages/ endpoint to populate PurlDB by @keshav-space in #1084
• Add URL scheme validation with explicit error messages #1047 by @tdruez in #1085
• Bump matchcode-toolkit version to v3.0.0 by @JonoYang in #1088
• Improve the results_download API action to accept output_format #1091 by @tdruez in #1092
• Add support for fetching authentications #620 by @tdruez in #1097
• Add settings for providing Skopeo credentials #203 by @tdruez in #1098

Full Changelog: v33.1.0...v34.0.0