Skip to content
This repository has been archived by the owner on Jul 8, 2020. It is now read-only.

lighthousebot not failing PRs when score < minScore #8

Open
ankeetmaini opened this issue Sep 16, 2017 · 16 comments
Open

lighthousebot not failing PRs when score < minScore #8

ankeetmaini opened this issue Sep 16, 2017 · 16 comments

Comments

@ankeetmaini
Copy link

I debugged this by running the frontend server in my local and the reason is when I add lighthousebot as a collaborator, the request isn't accepted by the bot and hence it doesn't have the rights and fails. It can only post a comment.

I even checked github api to add a webhook and a handler in server to auto accept requests but at this time there isn't a way we can automate this process.

@ebidel
Copy link
Contributor

ebidel commented Sep 18, 2017

If you're trying to run your own CI server, the lighthouse bot won't work with that setup. That's because you don't have the correct .oauth_token credentials. Instead, I'd get an oauth token for yourself, follow the instructions at https://github.com/ebidel/lighthouse-ci#running-your-own-ci-server, and it will post as you.

@ankeetmaini
Copy link
Author

No, I created my own .oauth_token, it's just that if I don't accept the collaborator request github api doesn't allow to change the status.

See this PR -> ankeetmaini/react-hn#11, here your bot posts a comment but fails to mark the PR as a failure.

The one I tried with my own .oauth_token passes because I accepted the collaborator request from my bot account visible in the screenshot perf-bot ankeetmaini/react-hn#9
screen shot 2017-09-18 at 10 17 13 pm

@ankeetmaini
Copy link
Author

So I'm guessing that the lighthousebot account needs to accept collaborator request from all the repos. Correct me if I am wrong?

@ebidel
Copy link
Contributor

ebidel commented Sep 18, 2017

I see what you mean! Didn't realize there was an invitation link to collaborate on repos. I accepted your invite.

Hmm, do you know of a way to work around that? Email invites are not going to scale well :(

@ankeetmaini
Copy link
Author

ankeetmaini commented Sep 18, 2017 via email

@ebidel
Copy link
Contributor

ebidel commented Sep 18, 2017

An Authorization header with the user's oauth token would be great, but that would that work?
Wouldn't that also post as the user and not the lighthouse bot profile icon?

@ankeetmaini
Copy link
Author

ankeetmaini commented Sep 18, 2017 via email

@ankeetmaini
Copy link
Author

ankeetmaini commented Sep 18, 2017 via email

@ebidel
Copy link
Contributor

ebidel commented Sep 18, 2017

Those might be an option. Without a proper Github Integration, I do like that users see the official name and icon:

27059055-70ba6e86-4f89-11e7-8ead-932aab0f2634

Otherwise, they're going to see themselves and their name. Could be confusing.

Right now the volume of collaborator emails is low. I was just ignoring them :(

@ankeetmaini
Copy link
Author

Let me know if I can help in resolving this!

@schoenwaldnils
Copy link
Contributor

schoenwaldnils commented Oct 13, 2017

Hi, I'm having the same issue.

Even when I dont use my own CI server.

https://travis-ci.org/schoenwaldnils/timeline/builds/287505971
schoenwaldnils/timeline#1

The comment is there, but I don't get a failing test.

@ebidel
Copy link
Contributor

ebidel commented Oct 16, 2017

@schoenwaldnils That setup looks good to me. You've got the bot as a collaborator on the repo and using an API as the Travis env https://github.com/ebidel/lighthouse-ci#get-an-api-key?

@schoenwaldnils
Copy link
Contributor

It works now. I might had to wait until @lighthousebot accepts the collaborator-request.

@riderx
Copy link

riderx commented Mar 29, 2018

3 days and lighthouse still didn't accept :/ how can i change that ?

@EoinTraynor
Copy link
Contributor

This is obviously still an ongoing issue.
What is the expected duration for lighthouse to accept my collaborator-request? It's been 6 days since I have requested it.

@krzkaczor
Copy link

If anyone still needs it lighthouse-keeper supports failing PRs if score is too low, as well as tracking score changes between PRs and many other things. Cheers!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants