Upgrade JSON Schema Test Suite to bc919bdb266a4949f8a2425f2f540371604d82b4

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: e3fdf6e	Previous: 74e2d3c	Ratio
Compiler_Draft6_AdaptiveCard	63027022214.999985 ns/iter	63322717452.00001 ns/iter	1.00
Compiler_2019_09_OMC_JSON_V2	9341561235.000029 ns/iter	9186497195.000015 ns/iter	1.02
Evaluator_Draft4_Meta_1_No_Callback	279.2637270062589 ns/iter	281.9000538397274 ns/iter	0.99
Evaluator_Draft4_Required_Properties	633.9612666254174 ns/iter	636.0531847254365 ns/iter	1.00
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	32.45526387236936 ns/iter	33.18375114037498 ns/iter	0.98
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	13.744829429328378 ns/iter	14.059257848936443 ns/iter	0.98
Evaluator_Draft4_Items_Schema	627.948879476873 ns/iter	638.4721907461035 ns/iter	0.98
Evaluator_Draft4_Nested_Object	4.977545736132442 ns/iter	5.0687791000001425 ns/iter	0.98
Evaluator_Draft4_Properties_Triad_Optional	953.6813428041061 ns/iter	981.9282090553943 ns/iter	0.97
Evaluator_Draft4_Properties_Triad_Closed	759.5148861607787 ns/iter	781.6044125971109 ns/iter	0.97
Evaluator_Draft4_Properties_Triad_Required	941.3459377940246 ns/iter	948.2800173006602 ns/iter	0.99
Evaluator_Draft4_Properties_Closed	84.19704209738899 ns/iter	84.69221777477806 ns/iter	0.99
Evaluator_Draft4_Non_Recursive_Ref	29.25613893990128 ns/iter	29.249818193204625 ns/iter	1.00
Evaluator_Draft4_Pattern_Properties_True	250.68584932893918 ns/iter	245.95462606277573 ns/iter	1.02
Evaluator_Draft4_Ref_To_Single_Property	13.387981043694328 ns/iter	13.411773371144674 ns/iter	1.00
Evaluator_Draft4_Additional_Properties_Type	53.472075890421 ns/iter	53.50583846258361 ns/iter	1.00
Evaluator_Draft4_Nested_Oneof	88.68989987629602 ns/iter	89.11524279874975 ns/iter	1.00
Evaluator_Draft4_Short_Enum	16.337131290441846 ns/iter	16.189000719313576 ns/iter	1.01
Evaluator_Draft4_Long_Enum	20.843354223000432 ns/iter	20.542388364282115 ns/iter	1.01
Evaluator_Draft4_Long_Enum_Short_Strings	16.212220579745594 ns/iter	16.1879532193469 ns/iter	1.00
Evaluator_Draft4_Type_Object	10.920559469988124 ns/iter	10.89467584176227 ns/iter	1.00
Evaluator_Draft6_Property_Names	140.52330097501843 ns/iter	135.7097993378461 ns/iter	1.04
Evaluator_Draft7_If_Then_Else	41.70851140558775 ns/iter	41.730964245020964 ns/iter	1.00
Evaluator_Draft7_Vercel_1	49679.03260555477 ns/iter	49677.89135856514 ns/iter	1.00
Evaluator_Draft7_Helm_Chart_Lock_1	284.62739797913713 ns/iter	283.6656566951164 ns/iter	1.00
Evaluator_Draft7_Helm_Chart_Lock_2	269.8517460163591 ns/iter	277.0149645222315 ns/iter	0.97
Evaluator_Draft7_Jasmine_1	180.47167689603157 ns/iter	181.10633264436578 ns/iter	1.00
Evaluator_Draft7_Dependabot_1	1306.1169031694592 ns/iter	1292.6000069589013 ns/iter	1.01
Evaluator_2019_09_Unevaluated_Properties	54.08404579393731 ns/iter	53.89217282861106 ns/iter	1.00
Evaluator_2019_09_OMC_JSON_V2_1	1457.062318184333 ns/iter	1452.465485018075 ns/iter	1.00
Evaluator_2020_12_Dynamic_Ref	589.7007366558054 ns/iter	571.308356618857 ns/iter	1.03
Evaluator_2020_12_Dynamic_Ref_Single	10.648538210662359 ns/iter	10.595757229507013 ns/iter	1.00
Evaluator_2020_12_CQL_1	3798.6347101114675 ns/iter	3751.970978002357 ns/iter	1.01
Evaluator_2020_12_OpenAPI	198343.60349127115 ns/iter	200681.8807235759 ns/iter	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: e3fdf6e	Previous: 74e2d3c	Ratio
Compiler_Draft6_AdaptiveCard	49298504208.00005 ns/iter	49554916375.00006 ns/iter	0.99
Compiler_2019_09_OMC_JSON_V2	8008617415.999992 ns/iter	8908020541.000042 ns/iter	0.90
Evaluator_Draft4_Meta_1_No_Callback	191.89832848831057 ns/iter	197.75096081870007 ns/iter	0.97
Evaluator_Draft4_Required_Properties	425.47968976848466 ns/iter	413.26599444873244 ns/iter	1.03
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	20.911643671544674 ns/iter	20.381558085744267 ns/iter	1.03
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	8.73889573086046 ns/iter	8.550930067938836 ns/iter	1.02
Evaluator_Draft4_Items_Schema	437.7774525163821 ns/iter	431.4344906717768 ns/iter	1.01
Evaluator_Draft4_Nested_Object	3.368213464991554 ns/iter	3.2005512170279866 ns/iter	1.05
Evaluator_Draft4_Properties_Triad_Optional	803.9235359774593 ns/iter	812.7890553167439 ns/iter	0.99
Evaluator_Draft4_Properties_Triad_Closed	653.1230893862657 ns/iter	649.6948645483243 ns/iter	1.01
Evaluator_Draft4_Properties_Triad_Required	816.0304463112492 ns/iter	778.986776691959 ns/iter	1.05
Evaluator_Draft4_Properties_Closed	49.763685983197625 ns/iter	49.95170435245148 ns/iter	1.00
Evaluator_Draft4_Non_Recursive_Ref	19.28072014452754 ns/iter	18.20739199925433 ns/iter	1.06
Evaluator_Draft4_Pattern_Properties_True	187.45343630911853 ns/iter	173.52797809290922 ns/iter	1.08
Evaluator_Draft4_Ref_To_Single_Property	8.748367589835835 ns/iter	8.345056206006527 ns/iter	1.05
Evaluator_Draft4_Additional_Properties_Type	33.9934246664838 ns/iter	31.73440208230862 ns/iter	1.07
Evaluator_Draft4_Nested_Oneof	52.68146790704877 ns/iter	49.57657933640134 ns/iter	1.06
Evaluator_Draft4_Short_Enum	9.533319647760269 ns/iter	8.80461471859079 ns/iter	1.08
Evaluator_Draft4_Long_Enum	28.314230771129917 ns/iter	26.425519864613285 ns/iter	1.07
Evaluator_Draft4_Long_Enum_Short_Strings	11.177593246943783 ns/iter	10.415968316476372 ns/iter	1.07
Evaluator_Draft4_Type_Object	6.38691099306981 ns/iter	6.035180351907698 ns/iter	1.06
Evaluator_Draft6_Property_Names	101.91369001515672 ns/iter	110.73343219476463 ns/iter	0.92
Evaluator_Draft7_If_Then_Else	29.79527701259491 ns/iter	27.713198090025823 ns/iter	1.08
Evaluator_Draft7_Vercel_1	38950.959502743215 ns/iter	35903.28377820819 ns/iter	1.08
Evaluator_Draft7_Helm_Chart_Lock_1	164.56189690719842 ns/iter	153.02779752167737 ns/iter	1.08
Evaluator_Draft7_Helm_Chart_Lock_2	164.73958601526047 ns/iter	153.1530896707394 ns/iter	1.08
Evaluator_Draft7_Jasmine_1	121.3302454299746 ns/iter	114.79761013130002 ns/iter	1.06
Evaluator_Draft7_Dependabot_1	809.5644937650421 ns/iter	746.6132454288432 ns/iter	1.08
Evaluator_2019_09_Unevaluated_Properties	40.42333701863657 ns/iter	38.15090119698392 ns/iter	1.06
Evaluator_2019_09_OMC_JSON_V2_1	1011.1036967080049 ns/iter	988.4311260858774 ns/iter	1.02
Evaluator_2020_12_Dynamic_Ref	552.9855830000088 ns/iter	408.84763088985346 ns/iter	1.35
Evaluator_2020_12_Dynamic_Ref_Single	6.471540893171227 ns/iter	6.199256748183391 ns/iter	1.04
Evaluator_2020_12_CQL_1	2539.5043588191384 ns/iter	2314.0349494735115 ns/iter	1.10
Evaluator_2020_12_OpenAPI	166470.60594708787 ns/iter	152508.20349387106 ns/iter	1.09

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/gcc)

Details

Benchmark suite	Current: e3fdf6e	Previous: 74e2d3c	Ratio
Compiler_Draft6_AdaptiveCard	53778084039.68811 ns/iter	53864883184.43298 ns/iter	1.00
Compiler_2019_09_OMC_JSON_V2	7296633005.142212 ns/iter	7254601955.413818 ns/iter	1.01
Evaluator_Draft4_Meta_1_No_Callback	162.4710488903748 ns/iter	159.6176750837326 ns/iter	1.02
Evaluator_Draft4_Required_Properties	332.6027518813894 ns/iter	327.0580552061117 ns/iter	1.02
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	18.778808126586085 ns/iter	19.14386482448633 ns/iter	0.98
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	7.1370470396792784 ns/iter	7.2662953342352035 ns/iter	0.98
Evaluator_Draft4_Items_Schema	455.39680250582217 ns/iter	454.425190915182 ns/iter	1.00
Evaluator_Draft4_Nested_Object	2.0113737503915945 ns/iter	2.0298126534886327 ns/iter	0.99
Evaluator_Draft4_Properties_Triad_Optional	791.565275811885 ns/iter	823.9895475895281 ns/iter	0.96
Evaluator_Draft4_Properties_Triad_Closed	645.9346925497256 ns/iter	651.5844946008505 ns/iter	0.99
Evaluator_Draft4_Properties_Triad_Required	798.3311210987346 ns/iter	793.4425954333138 ns/iter	1.01
Evaluator_Draft4_Properties_Closed	63.77464899322215 ns/iter	63.87781025304769 ns/iter	1.00
Evaluator_Draft4_Non_Recursive_Ref	13.190790641695092 ns/iter	12.895278442986047 ns/iter	1.02
Evaluator_Draft4_Pattern_Properties_True	179.08832548053854 ns/iter	178.74134920123106 ns/iter	1.00
Evaluator_Draft4_Ref_To_Single_Property	6.922284309027918 ns/iter	6.9344534193867595 ns/iter	1.00
Evaluator_Draft4_Additional_Properties_Type	25.500353669675935 ns/iter	25.065770986596736 ns/iter	1.02
Evaluator_Draft4_Nested_Oneof	57.16141143798227 ns/iter	57.1816152207935 ns/iter	1.00
Evaluator_Draft4_Short_Enum	7.840261581494962 ns/iter	7.864159000737172 ns/iter	1.00
Evaluator_Draft4_Long_Enum	8.78110777376542 ns/iter	8.9636643492028 ns/iter	0.98
Evaluator_Draft4_Long_Enum_Short_Strings	8.152830998124422 ns/iter	8.241645963916328 ns/iter	0.99
Evaluator_Draft4_Type_Object	4.609958193994849 ns/iter	4.516829863245476 ns/iter	1.02
Evaluator_Draft6_Property_Names	117.81754393137174 ns/iter	109.16687080692917 ns/iter	1.08
Evaluator_Draft7_If_Then_Else	24.636227431549894 ns/iter	24.542609062805294 ns/iter	1.00
Evaluator_Draft7_Vercel_1	38310.14584359416 ns/iter	38126.07092308625 ns/iter	1.00
Evaluator_Draft7_Helm_Chart_Lock_1	164.8212217146184 ns/iter	164.95088068759406 ns/iter	1.00
Evaluator_Draft7_Helm_Chart_Lock_2	158.0467227950502 ns/iter	158.0074647171946 ns/iter	1.00
Evaluator_Draft7_Jasmine_1	124.03428469211022 ns/iter	126.00221843333004 ns/iter	0.98
Evaluator_Draft7_Dependabot_1	849.9660691583329 ns/iter	850.4943139523352 ns/iter	1.00
Evaluator_2019_09_Unevaluated_Properties	32.756064648808405 ns/iter	32.673522865250476 ns/iter	1.00
Evaluator_2019_09_OMC_JSON_V2_1	1107.140495676598 ns/iter	1183.0149927138684 ns/iter	0.94
Evaluator_2020_12_Dynamic_Ref	464.50263975255257 ns/iter	492.0248984332031 ns/iter	0.94
Evaluator_2020_12_Dynamic_Ref_Single	4.763731654068572 ns/iter	4.669282317850616 ns/iter	1.02
Evaluator_2020_12_CQL_1	2783.366956732368 ns/iter	2702.332825915104 ns/iter	1.03
Evaluator_2020_12_OpenAPI	168278.51936205648 ns/iter	187288.67317866354 ns/iter	0.90

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (windows/msvc)

Details

Benchmark suite	Current: e3fdf6e	Previous: 74e2d3c	Ratio
Compiler_Draft6_AdaptiveCard	216785622099.99997 ns/iter	216605546000.00012 ns/iter	1.00
Compiler_2019_09_OMC_JSON_V2	27258311400.000027 ns/iter	27021743199.999947 ns/iter	1.01
Evaluator_Draft4_Meta_1_No_Callback	361.89454294169803 ns/iter	367.5756972132101 ns/iter	0.98
Evaluator_Draft4_Required_Properties	839.605741247433 ns/iter	853.7435027930702 ns/iter	0.98
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	36.935806483289696 ns/iter	36.903366270727005 ns/iter	1.00
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	15.816585608371506 ns/iter	15.929522321427621 ns/iter	0.99
Evaluator_Draft4_Items_Schema	659.3433035714722 ns/iter	657.4773214284489 ns/iter	1.00
Evaluator_Draft4_Nested_Object	6.5266946195085636 ns/iter	6.519349107143008 ns/iter	1.00
Evaluator_Draft4_Properties_Triad_Optional	1562.3232142856532 ns/iter	1578.7379464283292 ns/iter	0.99
Evaluator_Draft4_Properties_Triad_Closed	1259.3524999999772 ns/iter	1263.4257142857614 ns/iter	1.00
Evaluator_Draft4_Properties_Triad_Required	1614.001785714184 ns/iter	1604.5243303567854 ns/iter	1.01
Evaluator_Draft4_Properties_Closed	89.21414333864874 ns/iter	89.95525044841024 ns/iter	0.99
Evaluator_Draft4_Non_Recursive_Ref	32.19488839286149 ns/iter	32.18078487783269 ns/iter	1.00
Evaluator_Draft4_Pattern_Properties_True	225.4669168006226 ns/iter	220.4905937500001 ns/iter	1.02
Evaluator_Draft4_Ref_To_Single_Property	15.835250000004105 ns/iter	15.835354910710262 ns/iter	1.00
Evaluator_Draft4_Additional_Properties_Type	57.34201785713822 ns/iter	58.39977678572186 ns/iter	0.98
Evaluator_Draft4_Nested_Oneof	100.99716513405629 ns/iter	101.28432137122286 ns/iter	1.00
Evaluator_Draft4_Short_Enum	24.4152597617109 ns/iter	24.665517857142405 ns/iter	0.99
Evaluator_Draft4_Long_Enum	22.928534342316553 ns/iter	23.31648571428754 ns/iter	0.98
Evaluator_Draft4_Long_Enum_Short_Strings	27.909269071836093 ns/iter	27.21182934279766 ns/iter	1.03
Evaluator_Draft4_Type_Object	13.032385714284699 ns/iter	12.745296428570489 ns/iter	1.02
Evaluator_Draft6_Property_Names	165.86104910710932 ns/iter	165.4053571428956 ns/iter	1.00
Evaluator_Draft7_If_Then_Else	50.5899399999862 ns/iter	50.64642999998341 ns/iter	1.00
Evaluator_Draft7_Vercel_1	72429.84374999294 ns/iter	74853.25892856918 ns/iter	0.97
Evaluator_Draft7_Helm_Chart_Lock_1	303.02183035705156 ns/iter	303.2081581240783 ns/iter	1.00
Evaluator_Draft7_Helm_Chart_Lock_2	271.3037423525326 ns/iter	271.1741262868431 ns/iter	1.00
Evaluator_Draft7_Jasmine_1	212.46065625000196 ns/iter	210.45443703329266 ns/iter	1.01
Evaluator_Draft7_Dependabot_1	1497.580045723096 ns/iter	1504.0301339287305 ns/iter	1.00
Evaluator_2019_09_Unevaluated_Properties	72.67884821426865 ns/iter	73.32227678570494 ns/iter	0.99
Evaluator_2019_09_OMC_JSON_V2_1	1859.9981785697091 ns/iter	1874.3406020899088 ns/iter	0.99
Evaluator_2020_12_Dynamic_Ref	847.6579251526438 ns/iter	841.5386160715498 ns/iter	1.01
Evaluator_2020_12_Dynamic_Ref_Single	13.020748214285861 ns/iter	13.038751785716483 ns/iter	1.00
Evaluator_2020_12_CQL_1	4896.517857143782 ns/iter	4901.881452572684 ns/iter	1.00
Evaluator_2020_12_OpenAPI	279430.3736440195 ns/iter	279523.7042988526 ns/iter	1.00

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: e3fdf6e	Previous: 74e2d3c	Ratio
Evaluator_2020_12_Dynamic_Ref	640.8310823466575 ns/iter	655.5366959572524 ns/iter	0.98
Evaluator_2020_12_Dynamic_Ref_Single	9.710089814921151 ns/iter	9.700816175354529 ns/iter	1.00
Evaluator_2020_12_CQL_1	4044.6102417575994 ns/iter	3840.6496784368687 ns/iter	1.05
Evaluator_2020_12_OpenAPI	228371.3992909928 ns/iter	229063.48294900372 ns/iter	1.00
Evaluator_2019_09_Unevaluated_Properties	52.93192889351465 ns/iter	53.04137315321078 ns/iter	1.00
Evaluator_2019_09_OMC_JSON_V2_1	1445.444011936491 ns/iter	1451.8638153948289 ns/iter	1.00
Evaluator_Draft7_If_Then_Else	44.925406829774055 ns/iter	45.09630806035609 ns/iter	1.00
Evaluator_Draft7_Vercel_1	46892.4661539445 ns/iter	47391.17690401778 ns/iter	0.99
Evaluator_Draft7_Helm_Chart_Lock_1	129.1381333146692 ns/iter	129.0543152533998 ns/iter	1.00
Evaluator_Draft7_Helm_Chart_Lock_2	131.7362080286683 ns/iter	125.50362726001403 ns/iter	1.05
Evaluator_Draft7_Jasmine_1	154.10202246855576 ns/iter	154.6907038871095 ns/iter	1.00
Evaluator_Draft7_Dependabot_1	949.6537457135198 ns/iter	942.9888183299885 ns/iter	1.01
Evaluator_Draft6_Property_Names	164.92519753212676 ns/iter	164.70788705104295 ns/iter	1.00
Evaluator_Draft4_Meta_1_No_Callback	246.84907904526563 ns/iter	249.9822996967009 ns/iter	0.99
Evaluator_Draft4_Required_Properties	553.5803920602991 ns/iter	558.992454217452 ns/iter	0.99
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	30.953326051286968 ns/iter	29.54517124500654 ns/iter	1.05
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	12.456409222110086 ns/iter	12.455394639730939 ns/iter	1.00
Evaluator_Draft4_Items_Schema	504.741367340136 ns/iter	511.6777841560839 ns/iter	0.99
Evaluator_Draft4_Nested_Object	4.212204224247525 ns/iter	3.848131079191198 ns/iter	1.09
Evaluator_Draft4_Properties_Triad_Optional	1040.1058436257504 ns/iter	1049.542960651034 ns/iter	0.99
Evaluator_Draft4_Properties_Triad_Closed	824.3561503795197 ns/iter	824.5762697915693 ns/iter	1.00
Evaluator_Draft4_Properties_Triad_Required	1067.210778417587 ns/iter	1064.9729898507744 ns/iter	1.00
Evaluator_Draft4_Properties_Closed	74.68117480186622 ns/iter	77.97192638969813 ns/iter	0.96
Evaluator_Draft4_Non_Recursive_Ref	12.44803955248593 ns/iter	12.443785126951832 ns/iter	1.00
Evaluator_Draft4_Pattern_Properties_True	243.60675890279265 ns/iter	242.9385078266239 ns/iter	1.00
Evaluator_Draft4_Ref_To_Single_Property	12.465785928900411 ns/iter	12.450453607917945 ns/iter	1.00
Evaluator_Draft4_Additional_Properties_Type	14.933393373612802 ns/iter	14.952699562655184 ns/iter	1.00
Evaluator_Draft4_Nested_Oneof	110.36006938673052 ns/iter	110.79499085246842 ns/iter	1.00
Evaluator_Draft4_Short_Enum	17.834327786489588 ns/iter	17.788739977180043 ns/iter	1.00
Evaluator_Draft4_Long_Enum	23.46495136870411 ns/iter	22.94897080879551 ns/iter	1.02
Evaluator_Draft4_Long_Enum_Short_Strings	17.744969359426783 ns/iter	17.839565134868586 ns/iter	0.99
Evaluator_Draft4_Type_Object	9.684601617397515 ns/iter	9.688298194162451 ns/iter	1.00
Compiler_2019_09_OMC_JSON_V2	9929895969.999962 ns/iter	10142173767.999907 ns/iter	0.98
Compiler_Draft6_AdaptiveCard	64570009570.9999 ns/iter	64868305071.999886 ns/iter	1.00

This comment was automatically generated by workflow using github-action-benchmark.