Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run eyes tests without diffs on Circle CI by default #14580

Merged
merged 1 commit into from Apr 25, 2017

Conversation

islemaster
Copy link
Contributor

@islemaster islemaster commented Apr 21, 2017

Make Circle builds run eyes tests (without actually using Applitools) by default. This is really simple after @davidsbailey did the work of making this work again with the commit tag.

Tested over five builds:

_ Build Duration Eyes duration Eyes reruns
35857 1:07:21 13:37 2
35866 1:09:33 13:08 2
35867 1:07:39 12:59 2
35868 1:07:28 13:07 2
35869 1:13:42 14:02 2

@islemaster islemaster changed the title [WIP] Run eyes tests without diffs on Circle CI by default Run eyes tests without diffs on Circle CI by default Apr 22, 2017
Copy link
Contributor

@balderdash balderdash left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Neat!

@davidsbailey
Copy link
Member

My 3 or so test runs showed this added 12 minutes to each circle build. are we cool with that?

@davidsbailey
Copy link
Member

Oh, I see we wait for every last UI test to run before we start the eyes run. It seems like kicking off both suites in parallel, with less parallelism on each, might perform better. I'm also fine with shipping this now and optimizing later.

@islemaster islemaster merged commit a92172e into staging Apr 25, 2017
@islemaster islemaster deleted the diffless-eyes-on-circle branch April 25, 2017 16:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants