Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Coveralls broken for Node 11 #1682

Closed
Neitsch opened this issue Jan 22, 2019 · 6 comments
Closed

Coveralls broken for Node 11 #1682

Neitsch opened this issue Jan 22, 2019 · 6 comments
Assignees
Labels

Comments

@Neitsch
Copy link

Neitsch commented Jan 22, 2019

@IvanGoncharov already found this, but adding tracking here: Coveralls appears to be broken for Node 11 on Travis. Sample Travis log: https://travis-ci.org/graphql/graphql-js/jobs/482864463

At this point it is unclear why Node 11 specifically is broken.

@IvanGoncharov
Copy link
Member

IvanGoncharov commented Jan 22, 2019

@Neitsch Thanks for the opening issue 👍
It's not the first time we had problems with coveralls and it looks like it's abandoned
https://github.com/lemurheavy/coveralls-public/issues
Plus API in constant "Degraded Performance" state:
image

I did a quick search and it looks like Babel and some other projects switched to codecov
https://github.com/marketplace/codecov
+ it has a few useful features missing in coveralls
I already contacted FB engineers about possibility to set it up for graphql org.

@Neitsch
Copy link
Author

Neitsch commented Jan 24, 2019

@mjmahone I still don't see reports showing up. Could nyc be broken, so that the coverage report does not work? I believe coveralls was complaining about an empty report before we switched.

@IvanGoncharov
Copy link
Member

@Neitsch I finally manage to make it work:
https://codecov.io/gh/graphql/graphql-js/tree/5a957cc7efecf642143d33e2be239c76be5c82b7/src
Currently trying to isolate fix and understand what was root cause.

@IvanGoncharov
Copy link
Member

@Neitsch Finally nailed it. Update from node 11.6 to node 11.7 broke coverage.
It was bad luck that it coincides with my experiments with disabling on coverage in #1173.
So the problem was nothing to do with coverall or #1173 it was just Travis switching node 11.6 to node 11.7.

@mjmahone
Copy link
Contributor

@IvanGoncharov should we switch back to coveralls in that case? Or perhaps upload to both for the time being?

We have a lot of historical information still in coveralls, so it may be worth generating both reports if possible.

@IvanGoncharov
Copy link
Member

IvanGoncharov commented Jan 24, 2019

should we switch back to coveralls in that case?

@mjmahone Coveralls was lagging from time to time and it forced me to manually review Travis logs every time + it has a few annoying UI quirks that were constantly pestering me.

But most importantly codecov has some very useful features that coveralls lacks. For example, ability to have a separate report for Flow type coverage: facebook/flow#3231

We have a lot of historical information still in coveralls, so it may be worth generating both reports if possible.

All historical data will stay on coverall intact until someone removes account.
Depending on two services makes package.json more complex and introducing more points of failure.

Let's try codecov for some time and if we experience any practical scenarios where coverall will be useful we can always reenable it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants