WIP: LH Issue Runner Testing Issue

[connorjclark]

test my url: https://hoten.cc/

[devtools-bot]

I ran Lighthouse for https://hoten.cc/blog/, here's what I found.

index
✅ html json output lighthouse@​master-f8ae4f
✅ html json output lighthouse@​4.0.0-beta
✅ html json output lighthouse@​3.2.0

[devtools-bot]

I ran Lighthouse for https://hoten.cc/blog/, here's what I found.

index
✅ html json output lighthouse@​master-f8ae4f
✅ html json output lighthouse@​4.0.0-beta
✅ html json output lighthouse@​3.2.1

[connorjclark]

LH Runner Go! http://www.example.com

[devtools-bot]

I ran Lighthouse for http://www.example.com, here's what I found.

index
✅ html json output lighthouse@​master-f8ae4f
✅ html json output lighthouse@​4.0.0-beta
✅ html json output lighthouse@​3.2.1

[connorjclark]

LH Runner Go! https://www.paulirish.com/

[devtools-bot]

I ran Lighthouse for https://hoten.cc/blog/, here's what I found.

index
✅ html json output lighthouse@​master-f8ae4f
✅ html json output lighthouse@​4.0.0-beta
✅ html json output lighthouse@​3.2.1

[devtools-bot]

I ran Lighthouse for https://www.paulirish.com/, here's what I found.

index
✅ html json output lighthouse@​master-f8ae4f
✅ html json output lighthouse@​4.0.0-beta
✅ html json output lighthouse@​3.2.1

[devtools-bot]

I ran Lighthouse for https://hoten.cc/blog/, here's what I found.

index
✅ html json output lighthouse@​master-f8ae4f
✅ html json output lighthouse@​4.0.0-beta
✅ html json output lighthouse@​3.2.1
✅ json output PSI

[connorjclark]

LH Runner Go! https://www.paulirish.com/

[devtools-bot]

I ran Lighthouse for https://hoten.cc/blog/, here's what I found.

index
✅ html json output lighthouse@​4.0.0-beta
✅ html json output lighthouse@​3.2.1
✅ json output PSI
✅ html json output lighthouse@​master-0f46eb
✅ html json output Extension@​3.3.0.4001

[devtools-bot]

I ran Lighthouse for https://www.paulirish.com/, here's what I found.

index
✅ html json output lighthouse@​4.0.0-beta
✅ html json output lighthouse@​3.2.1
✅ json output PSI
✅ html json output lighthouse@​master-0f46eb
✅ html json output Extension@​3.3.0.4001

[exterkamp]

LH Runner Go! https://zach.diemer.codes/

[devtools-bot]

I ran Lighthouse for https://zach.diemer.codes/, here's what I found.

index
❌ output lighthouse@​master-e52ee0

[connorjclark]

^ master has a page load time out set, so when LH hangs on an insecure page (#6608 not merged yet) it times out in master. but all the other versions just hang forever and the bot script just gives up eventually :)

[connorjclark]

LH Runner Go! https://zach.diemer.codes/

[connorjclark]

LH Runner Go! https://hoten.cc/blog/

[devtools-bot]

I ran Lighthouse for https://zach.diemer.codes/, here's what I found.

index
❌ output lighthouse@​4.0.0-beta
❌ output lighthouse@​3.2.1
❌ output PSI
❌ output lighthouse@​master-e52ee0
❌ output Extension@​3.3.0.4001-Chrome72.0.3617.0

[devtools-bot]

I ran Lighthouse for https://hoten.cc/blog/, here's what I found.

index
✅ html json output lighthouse@​4.0.0-beta
✅ html json output lighthouse@​3.2.1
✅ json output PSI
✅ html json output lighthouse@​master-e52ee0
✅ html json output Extension@​3.3.0.4001-Chrome72.0.3617.0

[connorjclark]

Set up a timeout around each run, so if LH hangs the bot still reports something

[connorjclark]

I ran Lighthouse for https://hoten.cc/, here's what I found.

index
✅ html json output lighthouse@​7.0.0
✅ html json output lighthouse@​6.5.0
✅ html json output lighthouse@​5.6.0
✅ json output PSI
✅ html json output lighthouse@​master-96eda6