New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-run individual builds environments #794

Closed
hanloong opened this Issue Nov 20, 2014 · 7 comments

Comments

Projects
None yet
7 participants
@hanloong

hanloong commented Nov 20, 2014

Is it possible to run individual builds (So just build 19.2 not 19.X which would include (19.1, 19.2, 19.3 etc)).

We have setup environments to run builds separately.

  • unit tests
  • integration tests
  • external integration tests (rely on external API's)

Unit tests are super reliable, integration tests less so, and external integration even less than that. On Travis if one of these fails we can just trigger a re-run of that test and leave the others as passed.

I know most people tend to mock out external API calls during tests but we have been burnt by our payment gateway API making breaking changes to existing API versions, so this is the best way to make sure our code is stable.

@avinci

This comment has been minimized.

Member

avinci commented Nov 26, 2014

I think you can do this by using ENV variables. If you have three different ENVs then it will fire 3 builds
ENV

  • TESTMODE=UT
  • TESTMODE=IT
  • TESTMODE=ET

Then in your tests depending on your TESTMODE value, different tests can be run. Does this help?

@hanloong

This comment has been minimized.

hanloong commented Nov 26, 2014

hey @avinci not exactly,

We have the three testing modes already setup. But say TESTMODE=IT fails but the other two pass, is there any way to just Re-Run TESTMODE=IT without re-running the other two?

This could be either in the shippable.com interface or within the buiid scripts.

I hope that makes sense

@avinci

This comment has been minimized.

Member

avinci commented Nov 26, 2014

ahh interesting. I don't think we can run individual builds out of a matrix. I just saw another request for the same and I think it seems like we need to support this. We need another feature where we need to create API tokens so that a direct call can be made to redo the build. I will get back to you on the timing, but it should be totally doable...

@ralfschimmel

This comment has been minimized.

ralfschimmel commented Jul 11, 2016

This would be great, we have 12 test jobs, and when one fails (due to npm/docker/whatever one-off reason) we need to re-run all of them. This is not good for us, but also not for your shared resources 👍

@manishas manishas added this to the Conan milestone Aug 30, 2016

@avinci avinci removed the core label Feb 28, 2017

@avinci avinci removed this from the Conan milestone Mar 12, 2017

@ambarish2012

This comment has been minimized.

Contributor

ambarish2012 commented Jan 31, 2018

Closing as dup of #680

@rmmcnulty9

This comment has been minimized.

rmmcnulty9 commented Apr 26, 2018

@ambarish2012 #680 does not have anything to do this with issue.

We also need a way to re-run a single build from a build matrix. This issue should be reopened or the correct duplicate should be linked.

@trriplejay

This comment has been minimized.

trriplejay commented Apr 26, 2018

I believe it's this one that should've been linked (though this issue is older...):
#2680

We are currently working on this feature.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment