Consolidate and Automate Enterprise Release Process

[scottietremendous]

There are now three releases that we need to ship every time that we release the commercial version of Concourse:

• BOSH
• Helm
• Concourse for Platform Automation

Unfortunately, these releases all have separate pipelines/steps to deploy. Some are more automated than others:

• BOSH
  • Completely manually driven process
  • See steps here
• Helm
  • Pipeline exists to automate putting the release on Tanzu Network
  • See instructions here
• Concourse for Platform Automation
  • Fully pipeline automated

It would be nice to consolidate all of these pipelines/process as much as we can into one large enterprise release pipeline. This would make it easier for anyone on the team to ship the enterprise release as well as remove a lot of the manual toil of which @scottietremendous holds most of the context.

As an added bonus, it'd be nice to use these pipelines to automate the OSL and OSM process. This would make releasing especially stress-free.

[taylorsilva]

All work is being done on a branch on gitlab, on our internal-ci repo: https://gitlab.eng.vmware.com/concourse/internal-ci/-/tree/issue/6606

All the enterprise stuff should happen in gitlab + runway. That way we can open up the governance teams to non-vmware employees.

[xtremerui]

pipeline is set in https://runway-ci.eng.vmware.com/teams/concourse-team/pipelines/enterprise-release. The publish job will create a release that contains both bosh and helm release together with related license files.

Tasks remaining:

• figure out how to get tkgi(pks), helm and kubectl version for helm release description.
• decide how we should maintain concourse for platform autonmation pipeline. Currently that repo is not maintained by concourse but we have the pipeline set in runway. Ideally the platform automation pipeline should be merged in enterprise release pipeline, which means the whole repo might need to move into internal-ci repo on Gitlab.

[xtremerui]

Added https://gitlab.eng.vmware.com/concourse/osm for manually OSM source package uploading.