Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Keeping CI builds green at all times for all our repositories #6544

Closed
mattab opened this Issue Oct 28, 2014 · 13 comments

Comments

Projects
None yet
3 participants
@mattab
Copy link
Member

mattab commented Oct 28, 2014

The goal of this issue is that every week we want our 40+ projects CI builds to be green with as little pain and effort as possible. Having green builds across the board will increase quality of our work in general, increase developer happiness and help prevent us from deploying broken code.

Scope: this issue covers builds for our official Piwik Plugins (VisitorGenerator, CustomAlerts, etc.) and components and all Piwik PRO plugins.

Proposed steps For The Win

  1. Make all builds green on https://ci-status.com (at east once!)
  2. Automatically trigger the build for each repository once a week #6542
  3. in CI job against latest stable, allow failures when plugin requires a recent beta #6930

Related to

  1. Detect automatically when plugins use code that is @deprecated or not tagged with @api #6539

What we already have today

  • Plugins run tests against piwik/piwik master, to check pro-actively that plugins work with bleeding edge Piwik core platform
  • Plugins run tests against the latest stable release, to check that plugins work with current stable Piwik release.
  • Plugins can include their own Unit / Integration / Systems tests and UI Screenshot tests
  • Each developer is responsible for fixing the build after he broke the build
  • Piwik core developers are responsible to fix failures in a plugin when the failure is caused by a BC break or change in core platform (when it occurs then plugin developer should create an issue on piwik/piwik issue tracker to notify core developers)

What else can we do to help us achieve green builds every week on 40+ repositories?

@mattab mattab added this to the Piwik 2.10.0 milestone Oct 28, 2014

@mnapoli

This comment has been minimized.

Copy link
Contributor

mnapoli commented Oct 28, 2014

And we discussed "Detect automatically when plugins use code tagged with @deprecated"?

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Oct 28, 2014

@mnapoli Good point, it will be included in scope of #6539

mnapoli added a commit to matomo-org/plugin-LoginLdap that referenced this issue Oct 29, 2014

mnapoli added a commit to matomo-org/plugin-PiwikDebugger that referenced this issue Oct 29, 2014

mnapoli added a commit to matomo-org/plugin-VisitorGenerator that referenced this issue Oct 29, 2014

@mattab mattab modified the milestones: Piwik 2.10.0 , Piwik 2.11.0 Dec 3, 2014

@diosmosis diosmosis self-assigned this Dec 15, 2014

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Dec 19, 2014

Current CI status: 26 builds failing out of 50 builds.

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Jan 5, 2015

Current CI status: 17 builds failing out of 45 builds.

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Jan 7, 2015

it's starting to look pretty green on CI status! 5 builds failing out of 45 builds

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Jan 7, 2015

CI Status: 9 builds failing out of 50 builds.

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Jan 11, 2015

after the automatic Sunday Builds refresh we have: 12 builds failing out of 50 builds.

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Feb 5, 2015

CI Status: 9 builds failing out of 49 builds.

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Feb 9, 2015

we're almost there! Ci Status: 6 builds failing out of 49 builds.

@mattab mattab modified the milestones: Piwik 2.11.0, Piwik 2.12.0 Feb 11, 2015

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Feb 27, 2015

This is getting really exciting! Summary: 2 builds failing out of 47 builds.

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Mar 13, 2015

Yesterday, 10 builds failing. Today 4 builds failing.

This new feature in ci-status will get rid of 2 failed builds: mattab/deprecated-ci-status#20

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Mar 13, 2015

When following issues are closed we can close this issue:

The next step will be:

  • Decide who is responsible to fix the builds so that they are green each monday.

maybe someone from the team will volunteer to "own this" (eg. for a few months), or maybe a person rotating each week or month?

@mattab

This comment has been minimized.

Copy link
Member Author

mattab commented Mar 17, 2015

Created follow up issue: Decide who is responsible to fix the builds so that they are green each monday #7453

Well done to us, for the huge progress made in this area in the last few months... 👍

@mattab mattab closed this Mar 17, 2015

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.