Add nightly test metrics to track test results over time

[rajanashok]

It will be helpful to have some form of historical test reporting for nightlies, that can tell us how long a test has been passing/failing(pass/fail rate). This will provide us with some insight on if we are making the tests more stable over time and also will give us some confidence with the nightly results.

There are some prebuilt solutions that might help us to tackle this.
https://sqa.stackexchange.com/questions/3021/are-there-ready-solutions-for-saving-robot-framework-test-results-into-a-databas?utm_medium=organic&utm_source=google_rich_qa&utm_campaign=google_rich_qa

1. For a pre-built solution you might want to look at dbbot (https://github.com/robotframework/DbBot)
2. Not sure if this can work without using the Jenkins Build Pipeline.
   https://wiki.jenkins-ci.org/display/JENKINS/Robot+Framework+Plugin

[mhagen-vmware]

https://vic-jenkins.eng.vmware.com/job/vic-nightly-60/103/robot/

already tells you both duration and pass/fail trend lines and it shows you how long a test has been failing (Age column in the failed test cases table)

[rajanashok]

Nice, will keep this open for now to see if there is anything more we want to address here in terms of metrics.

May be we should share this metrics link from the daily nightly email report that gets sent out.

[rajanashok]

Reconfigured Jenkins to add the job url to the nightly email template for 6.0, 6.5 & 6.7
6.7 Jenkins Nightly Job:
https://vic-jenkins.eng.vmware.com/job/vic-nightly-67

[rajanashok]

Updated the nightly email with the Jenkins job link to show the detailed test results for the current run. Jenkins has an age column for the failed test to show how long the test has been failing.

We can do one of two things to gain visibility to the failed test.

1. Add the age to the nightly email report.
2. Send a weekly nightly report that shows some trending data for the tests and also highlight some of the open issues that are blockers, and make it a daily report during our testing phase before the release.