Run Scholia automatically for a set of test pages

[Daniel-Mietchen]

Some useful starting points here would be

• the examples from the respective aspect landing pages
• cases where we know to have difficulties
  • here, we have documentation spread across https://github.com/fnielsen/scholia/labels/examples and various wiki pages. I have started to make this a bit more systematic via https://www.wikidata.org/wiki/Wikidata:WikiProject_Scholia/Components but it's not ready yet.

[nunogit]

@Daniel-Mietchen regarding this topic, I came across Selenium. I used it a couple of years ago, and I didn't even remember it until I came across it again.

Pro's: renders javascript, which would be great for us. Drivers for several browsers (although chrome is the one best supported).
Con's: it's slower than most frameworks when crawling/testing for errors.

Do you know it? If so, what do you think?

[nunogit]

DataTables on pages are now being tested.

Code:
https://github.com/nunogit/scholia-junit-selenium

CI / automated testing
https://travis-ci.org/nunogit/scholia-junit-selenium

Next steps:
Now that the basic infrastructure is set, the next steps are:

1. extend to test other widgets
   1.1 improve the way widgets / DataTables fail, to be easier to detect failures Improve the way a query fails(table or Iframe) #1026
2. Make a list (or dynamic list) of pages to test Create test set of pages (URI's) #1033 / https://www.wikidata.org/wiki/Wikidata:WikiProject_Scholia/Testing

In parallel test this against a proxy and/or with in-page optimization and assess if the failure rate decreases. Issues: #1024, #67 and #1012

[Daniel-Mietchen]

I just added some examples but think this flat file with just the Wikidata URLs is a bit hard to manage in the long run. What about using a Wikidata page as a source for the tests, e.g. something similar to but more machine friendly than https://www.wikidata.org/wiki/Wikidata:WikiProject_Scholia/Testing ?