Harden testing (super-linter#982)

.automation/test/arm/reports/expected-ARM.tap

@@ -0,0 +1,7 @@
+TAP version 13
+1..2
+not ok 1 - arm_bad_1.json
+  ---
+  message:                                                                                                                                                                                                                                                                                                                                                                                                                 \nValidating arm\arm_bad_1.json\n  deploymentTemplate\n    [+] adminUsername Should Not Be A Literal\n    [+] apiVersions Should Be Recent\n    [+] artifacts parameter\n    [+] DependsOn Best Practices\n    [+] Deployment Resources Must Not Be Debug\n    [+] DeploymentTemplate Must Not Contain Hardcoded Uri\n    [+] DeploymentTemplate Schema Is Correct\n    [+] Dynamic Variable References Should Not Use Concat\n    [+] IDs Should Be Derived From ResourceIDs\n    [+] Location Should Not Be Hardcoded\n    [+] ManagedIdentityExtension must not be used\n    [+] Min And Max Value Are Numbers\n    [+] Outputs Must Not Contain Secrets\n    [+] Parameters Must Be Referenced\n    [+] Parameters Property Must Exist\n    [+] providers apiVersions Is Not Permitted\n    [+] ResourceIds should not contain\n    [+] Resources Should Have Location\n    [+] Secure String Parameters Cannot Have Default\n    [-] Template Should Not Contain Blanks\n        Empty property   [] found on line  28 Index 1331\n        Empty property   "" found on line  3 Index 121\n\n    [-] Variables Must Be Referenced\n        Unreferenced variable  Network.Location\n        Unreferenced variable  Test.Blank.Variable\n\n    [+] Virtual Machines Should Not Be Preview\n    [+] VM Images Should Use Latest Version\n    [+] VM Size Should Be A Parameter\n                                                                                                                                                                                                                                                                                                                                                                                                                \n
+  ...
+ok 2 - arm_good_1.json

.automation/test/bash/reports/expected-BASH.tap

@@ -4,4 +4,4 @@ not ok 1 - shell_bad_1.sh
   ---
   message: \nIn /tmp/lint/.automation/test/bash/shell_bad_1.sh line 10 \nif [ $ERROR_CODE -ne 0]; then\n^-- SC1009  The mentioned syntax error was in this if expression.\n   ^-- SC1073  Couldn't parse this test expression. Fix to allow more checks.\n                       ^-- SC1020  You need a space before the ].\n                       ^-- SC1072  Missing space before ]. Fix any mentioned problems and try again.\n\nFor more information \n  https //www.shellcheck.net/wiki/SC1020 -- You need a space before the ].\n  https //www.shellcheck.net/wiki/SC1072 -- Missing space before ]. Fix any m...\n  https //www.shellcheck.net/wiki/SC1073 -- Couldn't parse this test expressi...\n
   ...
-ok 2 - /tmp/lint/.automation/test/bash/shell_good_1.sh
+ok 2 - shell_good_1.sh

.automation/test/bash_exec/reports/expected-BASH_EXEC.tap

@@ -0,0 +1,7 @@
+TAP version 13
+1..2
+not ok 1 - shell_bad_1.sh
+  ---
+  message: Error  File [/tmp/lint/.automation/test/bash_exec/shell_bad_1.sh] is not executable\n
+  ...
+ok 2 - shell_good_1.sh

.automation/test/clojure/reports/expected-CLOJURE.tap.ignored → .automation/test/clojure/reports/expected-CLOJURE.tap

@@ -2,6 +2,6 @@ TAP version 13
 1..2
 not ok 1 - clojure_bad_1.clj
   ---
-  message: /tmp/lint/.automation/test/clojure/clojure_bad_1.clj 5 5  warning  namespace clojure.set is required but never used\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 8 2  error  unresolved symbol but-last\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 12 1  error  clojure.string/join is called with 0 args but expects 1 or 2\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 15 17  warning  unused binding y\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 17 3  warning  redundant do\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 19 5  warning  inline def\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 22 7  warning  Redundant let expression.\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 22 13  warning  unused binding z\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 24 9  error  y is called with 1 arg but expects 0\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 26 9  error  recur argument count mismatch (expected 2, got 0)\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 29 9  error  h is called with 1 arg but expects 0\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 30 9  error  f is called with 1 arg but expects 0\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 34 1  warning  redefined var #'foo/private-fn\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 34 8  warning  Unused private var foo/private-fn\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 38 6  error  Expected  number, received  keyword.\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 42 1  error  java.lang.Thread/sleep is called with 3 args but expects 1 or 2\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 48 1  error  foo/foo-fn is called with 0 args but expects 2\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 51 1  error  #'foo/private-fn is private\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 54 7  error  duplicate key  a\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 56 5  error  duplicate set element 1\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 58 7  error  missing value for key  b\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 64 3  warning  missing test assertion\nlinting took 18ms, errors  13, warnings  9\n
+  message: /tmp/lint/.automation/test/clojure/clojure_bad_1.clj 5 5  warning  namespace clojure.set is required but never used\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 8 2  error  unresolved symbol but-last\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 12 1  error  clojure.string/join is called with 0 args but expects 1 or 2\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 15 17  warning  unused binding y\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 17 3  warning  redundant do\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 19 5  warning  inline def\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 22 7  warning  Redundant let expression.\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 22 13  warning  unused binding z\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 24 9  error  y is called with 1 arg but expects 0\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 26 9  error  recur argument count mismatch (expected 2, got 0)\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 29 9  error  h is called with 1 arg but expects 0\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 30 9  error  f is called with 1 arg but expects 0\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 34 1  warning  redefined var #'foo/private-fn\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 34 8  warning  Unused private var foo/private-fn\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 38 6  error  Expected  number, received  keyword.\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 42 1  error  java.lang.Thread/sleep is called with 3 args but expects 1 or 2\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 48 1  error  foo/foo-fn is called with 0 args but expects 2\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 51 1  error  #'foo/private-fn is private\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 54 7  error  duplicate key  a\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 56 5  error  duplicate set element 1\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 58 7  error  missing value for key  b\n/tmp/lint/.automation/test/clojure/clojure_bad_1.clj 64 3  warning  missing test assertion\nlinting took, errors  13, warnings  9\n
   ...
 ok 2 - clojure_good_1.clj

.automation/test/cloudformation/reports/expected-CLOUDFORMATION.tap

@@ -16,7 +16,7 @@ not ok 4 - cloudformation_bad_4.yaml
   ---
   message: E3002 Invalid Property Resources/myDNSRecord/Properties/Ttl\n/tmp/lint/.automation/test/cloudformation/cloudformation_bad_4.yaml 9 7\n
   ...
-ok 5 - /tmp/lint/.automation/test/cloudformation/cloudformation_good_1.json
-ok 6 - /tmp/lint/.automation/test/cloudformation/cloudformation_good_2.yaml
-ok 7 - /tmp/lint/.automation/test/cloudformation/cloudformation_good_3.json
-ok 8 - /tmp/lint/.automation/test/cloudformation/cloudformation_good_4.yaml
+ok 5 - cloudformation_good_1.json
+ok 6 - cloudformation_good_2.yaml
+ok 7 - cloudformation_good_3.json
+ok 8 - cloudformation_good_4.yaml

.automation/test/coffeescript/reports/expected-COFFEESCRIPT.tap

@@ -4,4 +4,4 @@ not ok 1 - coffeescript_bad_1.coffee
   ---
   message:   ✗ /tmp/lint/.automation/test/coffeescript/coffeescript_bad_1.coffee\n     ✗ #39  [stdin] 39 29  error  unmatched )\nmodule.exports = (robot) -> )\n                            ^. (coffeescript_error)\n\n✗ Lint! » 1 error and 0 warnings in 1 file\n
   ...
-ok 2 - /tmp/lint/.automation/test/coffeescript/coffeescript_good_1.coffee
+ok 2 - coffeescript_good_1.coffee

.automation/test/csharp/reports/expected-CSHARP.tap

@@ -0,0 +1,7 @@
+TAP version 13
+1..2
+not ok 1 - csharp_bad_01.cs
+  ---
+  message:   Formatting code files in workspace '/tmp/lint/.automation/test/csharp'.\n  csharp/csharp_bad_01.cs(3,21)  Fix whitespace formatting.\n  csharp/csharp_bad_01.cs(4,16)  Fix whitespace formatting.\n  csharp/csharp_bad_01.cs(5,36)  Fix whitespace formatting.\n  Formatted code file '/tmp/lint/.automation/test/csharp/csharp_bad_01.cs'.\n  Format complete in.\n
+  ...
+ok 2 - csharp_good_01.cs

.automation/test/css/reports/expected-CSS.tap

@@ -4,4 +4,4 @@ not ok 1 - css_bad_01.css
   ---
   message: \ncss/css_bad_01.css\n 2 1   ✖  Expected empty line before comment   comment-empty-line-before\n 3 1   ✖  Expected empty line before comment   comment-empty-line-before\n 5 5   ✖  Expected indentation of 2 spaces     indentation              \n 5 33  ✖  Expected "#FFFFFF" to be "#ffffff"   color-hex-case           \n 5 33  ✖  Expected "#FFFFFF" to be "#FFF"      color-hex-length         \n 6 5   ✖  Expected indentation of 2 spaces     indentation              \n 7 5   ✖  Expected indentation of 2 spaces     indentation              \n 8 5   ✖  Expected indentation of 2 spaces     indentation              \n 8 12  ✖  Expected "#AAAAAA" to be "#aaaaaa"   color-hex-case           \n 8 12  ✖  Expected "#AAAAAA" to be "#AAA"      color-hex-length\n
   ...
-ok 2 - /tmp/lint/.automation/test/css/css_good_01.css
+ok 2 - css_good_01.css

.automation/test/dart/reports/expected-DART.tap

@@ -4,4 +4,4 @@ not ok 1 - dart_bad_1.dart
   ---
   message: Analyzing /tmp/lint/.automation/test/dart/dart_bad_1.dart...\n  lint • Use `;` instead of `{}` for empty constructor bodies. • dart/dart_bad_1.dart 4 25 • empty_constructor_bodies\n1 lint found.\n
   ...
-ok 2 - /tmp/lint/.automation/test/dart/dart_good_1.dart
+ok 2 - dart_good_1.dart