Upgrade jenkins x

[axsaucedo]

Relevant features of jenxins x 3:

• Now all triggers (/test ) are defined in each project repo under .lighthouse/jenkins-x/
• Pipelines are vanilla Tekton pipelines which adds a lot of flexibility
• Requests and limits now work which should make pipelines more reliable
• Jenkins X infrastructure is now managed through terraform gitops repo
• New UI now makes it easy to visualise pipeline logs (best if we make it public / no password)

All integration pipelines and release pipeline upgraded.

You can check lint with jx pipeline lint

Project is imported with jx project import . - this creates the automated PR chore to add to the jx gitops repo:

Here is the sample view of the pr, which then is automatically merged

Once this is merged, you can view the triggered pipeline with the jx admin log command:

Current available triggers are:

• /test notebooks - runs notebook tests
• /test integration - runs integration tests
• /test release - runs the build and push on PR
• Also contains the trigger on build/push when merging to master

These can be seen as before in the merge pipelines:

Jenkins X now includes:

• Public pipeline viewer which can be opened with jx dash

• Management UI which can be triggered with jx ui

Jenkins X cluster was set up:

• Using the Terraform Gitops infra repo to trigger cluster creation
  • Scaled nodes to fit the larger integration tests
  • This is the infra gitops repo https://github.com/SeldonIO/jenkins-x-infrastructure
• Created the dev jenkins x installation gitops repo where all config is available
  • This is the jx dev gitops cluster https://github.com/SeldonIO/jenkins-x-gitops-main/

For anyone curious on how the initial infra/gitops cluster was setup there is a great video that provides high level intuition, although the work itself was much more involved: https://www.youtube.com/watch?v=fKGZrNgs8So