Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration Tests via Travis #1729

Merged
merged 8 commits into from Jul 24, 2015
Merged

Conversation

arm4b
Copy link
Member

@arm4b arm4b commented Jul 17, 2015

armab added 2 commits July 17, 2015 16:38
launchdev.sh always exits with 1, because of `screen -ls`:

$ screen -ls; echo Exit Code: $?
There are screens on:
        4333.st2-auth   (07/17/2015 06:55:44 AM)        (Detached)
        4330.st2-notifier       (07/17/2015 06:55:44 AM)        (Detached)
        4327.st2-resultstracker (07/17/2015 06:55:44 AM)        (Detached)
        4324.st2-rulesengine    (07/17/2015 06:55:43 AM)        (Detached)
        4321.st2-sensorcontainer        (07/17/2015 06:55:43 AM)        (Detached)
        4317.st2-actionrunner-1 (07/17/2015 06:55:43 AM)        (Detached)
        4314.st2-api    (07/17/2015 06:55:43 AM)        (Detached)
7 Sockets in /var/run/screen/S-vagrant.

Exit Code: 1
@arm4b arm4b added the WIP label Jul 17, 2015
@arm4b
Copy link
Member Author

arm4b commented Jul 17, 2015

@manasdk @lakshmi-kannan @Kami this is where I'm in stuck and need your help/ideas:

I've included this PR in shared st2:travis-integration-tests branch, so you could commit to it/debug.


Except of this error, Integration tests in Travis should work OK (verified before in my forked branch).

armab added 2 commits July 19, 2015 15:23
Travis runs under Ubuntu 12.04 LTS with outdated gpg. Strange compatibility issues are possible.
@Kami
Copy link
Member

Kami commented Jul 20, 2015

Hm, looking at the changes, we don't run "lint" task anymore? Or am I missing something and we run it as part of a separate job now?

@Kami
Copy link
Member

Kami commented Jul 20, 2015

Ignore my last comment. I just now saw the "Remove code style checks from Travis (in favor of Scrutinizer)" line in the PR description.

I'm personally not too big of a fan of that. I'd prefer to run everything on Travis CI. This way you only need to go to a single page to see the results.

@arm4b
Copy link
Member Author

arm4b commented Jul 20, 2015

@Kami There are also some advantages behind that, see: #1724

And errored build looks pretty nice:
https://scrutinizer-ci.com/g/armab/st2/inspections/708d945a-2906-4fe0-9f44-7ef410714e13

Also in usual Travis build if something exited with error - further execution is stopped. See Scrutinizer ^^ log. All tasks are processed, which is especially good for different code style checks.

Include entire st2 project in tests scope, remove limiting `--cover-package` argument when running tests.
This fixes coverage, providing fair reports.

Eg. now when running tests for example in `st2actions`, other st2 modules triggered in tests are included in coverage.
@arm4b
Copy link
Member Author

arm4b commented Jul 21, 2015

Last commit provides more fair, aggregate coverage reports.
When code in module A is touched during tests from module B, they are both included in reports now.

Coverage Status (+4%)

@Kami @lakshmi-kannan @manasdk this PR is ready for review now 👀

@arm4b arm4b added RFR and removed WIP labels Jul 21, 2015
@lakshmi-kannan
Copy link
Contributor

When code in module A is touched during tests from module B, they are both included in reports now.

That's awesome.

@manasdk
Copy link
Contributor

manasdk commented Jul 24, 2015

LGTM.

@lakshmi-kannan
Copy link
Contributor

LGTM. I'll merge.

lakshmi-kannan added a commit that referenced this pull request Jul 24, 2015
@lakshmi-kannan lakshmi-kannan merged commit 34216d3 into master Jul 24, 2015
@lakshmi-kannan lakshmi-kannan deleted the travis-integration-tests branch July 24, 2015 18:24
@cognifloyd cognifloyd removed the RFR label Aug 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants