Test config metrics #3613

chrzaszcz · 2022-03-28T13:08:50Z

Add tests for module opts reported to system metrics

Test multiple modules at once to reduce time (it can't be parallel).
Skip modules without dynamic domains support when needed.

Update config_metrics callbacks in modules

Remove when not used (mod_mam, mod_keystore).
Update when the old way of providing defaults was used.

Also:

Use export_all to simplify maintenance
Rename functions returning booleans. An additional reason for this was a clash with CT callback names.

codecov · 2022-03-28T13:17:04Z

Codecov Report

Merging #3613 (ffc4515) into master (f1bca29) will increase coverage by 0.07%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master    #3613      +/-   ##
==========================================
+ Coverage   80.86%   80.94%   +0.07%     
==========================================
  Files         425      425              
  Lines       32233    32226       -7     
==========================================
+ Hits        26066    26086      +20     
+ Misses       6167     6140      -27

Impacted Files	Coverage Δ
src/mam/mod_mam.erl	`89.11% <ø> (+0.71%)`	⬆️
src/mod_keystore.erl	`90.24% <ø> (+2.14%)`	⬆️
src/mod_muc.erl	`74.42% <100.00%> (-0.06%)`	⬇️
src/mod_private.erl	`83.05% <100.00%> (+3.05%)`	⬆️
src/muc_light/mod_muc_light.erl	`85.44% <100.00%> (+0.68%)`	⬆️
src/privacy/mod_privacy.erl	`85.77% <100.00%> (+0.77%)`	⬆️
...bal_distrib/mod_global_distrib_hosts_refresher.erl	`66.66% <0.00%> (-2.23%)`	⬇️
src/inbox/mod_inbox_rdbms_async.erl	`66.10% <0.00%> (-1.70%)`	⬇️
src/mod_bosh_socket.erl	`78.57% <0.00%> (-0.32%)`	⬇️
src/mod_roster.erl	`78.75% <0.00%> (-0.24%)`	⬇️
... and 17 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f1bca29...ffc4515. Read the comment docs.

mongoose-im · 2022-03-28T13:17:06Z

small_tests_24 / small_tests / b6f82e7
Reports root / small

small_tests_23 / small_tests / b6f82e7
Reports root / small

dynamic_domains_pgsql_mnesia_24 / pgsql_mnesia / b6f82e7
Reports root/ big
OK: 2821 / Failed: 0 / User-skipped: 133 / Auto-skipped: 6

dynamic_domains_mysql_redis_24 / mysql_redis / b6f82e7
Reports root/ big
OK: 2804 / Failed: 0 / User-skipped: 150 / Auto-skipped: 6

ldap_mnesia_23 / ldap_mnesia / b6f82e7
Reports root/ big
OK: 1500 / Failed: 1 / User-skipped: 399 / Auto-skipped: 7

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,[qs,'_'],[]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,765}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1754}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1263}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1195}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       {line,243}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1754}]},
    {test_server,r...

Report log

dynamic_domains_mssql_mnesia_24 / odbc_mssql_mnesia / b6f82e7
Reports root/ big
OK: 2821 / Failed: 0 / User-skipped: 133 / Auto-skipped: 6

ldap_mnesia_24 / ldap_mnesia / b6f82e7
Reports root/ big
OK: 1500 / Failed: 1 / User-skipped: 399 / Auto-skipped: 7

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       ...

Report log

internal_mnesia_24 / internal_mnesia / b6f82e7
Reports root/ big
OK: 1541 / Failed: 1 / User-skipped: 358 / Auto-skipped: 7

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       ...

Report log

pgsql_mnesia_23 / pgsql_mnesia / b6f82e7
Reports root/ big
OK: 3194 / Failed: 0 / User-skipped: 142 / Auto-skipped: 7

mysql_redis_24 / mysql_redis / b6f82e7
Reports root/ big
OK: 3189 / Failed: 0 / User-skipped: 147 / Auto-skipped: 7

pgsql_mnesia_24 / pgsql_mnesia / b6f82e7
Reports root/ big
OK: 3194 / Failed: 0 / User-skipped: 142 / Auto-skipped: 7

elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / b6f82e7
Reports root/ big
OK: 1848 / Failed: 1 / User-skipped: 366 / Auto-skipped: 7

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       ...

Report log

mssql_mnesia_24 / odbc_mssql_mnesia / b6f82e7
Reports root/ big
OK: 3194 / Failed: 0 / User-skipped: 142 / Auto-skipped: 7

riak_mnesia_24 / riak_mnesia / b6f82e7
Reports root/ big
OK: 1691 / Failed: 1 / User-skipped: 365 / Auto-skipped: 7

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       ...

Report log

mongoose-im · 2022-03-29T08:12:32Z

small_tests_24 / small_tests / 13858db
Reports root / small

small_tests_23 / small_tests / 13858db
Reports root / small

dynamic_domains_pgsql_mnesia_23 / pgsql_mnesia / 13858db
Reports root/ big
OK: 2851 / Failed: 0 / User-skipped: 133 / Auto-skipped: 0

dynamic_domains_mysql_redis_24 / mysql_redis / 13858db
Reports root/ big
OK: 2834 / Failed: 0 / User-skipped: 150 / Auto-skipped: 0

dynamic_domains_mssql_mnesia_24 / odbc_mssql_mnesia / 13858db
Reports root/ big
OK: 2851 / Failed: 0 / User-skipped: 133 / Auto-skipped: 0

ldap_mnesia_23 / ldap_mnesia / 13858db
Reports root/ big
OK: 1507 / Failed: 1 / User-skipped: 399 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,[qs,'_'],[]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,765}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1754}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1263}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1195}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       {line,243}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1754}]},
    {test_server,r...

Report log

ldap_mnesia_24 / ldap_mnesia / 13858db
Reports root/ big
OK: 1507 / Failed: 1 / User-skipped: 399 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       ...

Report log

internal_mnesia_24 / internal_mnesia / 13858db
Reports root/ big
OK: 1548 / Failed: 1 / User-skipped: 358 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       ...

Report log

pgsql_mnesia_23 / pgsql_mnesia / 13858db
Reports root/ big
OK: 3225 / Failed: 0 / User-skipped: 142 / Auto-skipped: 0

elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / 13858db
Reports root/ big
OK: 1855 / Failed: 1 / User-skipped: 366 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       ...

Report log

pgsql_mnesia_24 / pgsql_mnesia / 13858db
Reports root/ big
OK: 3225 / Failed: 0 / User-skipped: 142 / Auto-skipped: 0

mysql_redis_24 / mysql_redis / 13858db
Reports root/ big
OK: 3220 / Failed: 0 / User-skipped: 147 / Auto-skipped: 0

mssql_mnesia_24 / odbc_mssql_mnesia / 13858db
Reports root/ big
OK: 3225 / Failed: 0 / User-skipped: 142 / Auto-skipped: 0

riak_mnesia_24 / riak_mnesia / 13858db
Reports root/ big
OK: 1698 / Failed: 1 / User-skipped: 365 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_backend_is_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,404}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_backend_is_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,243}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_backend_is_reported,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       ...

Report log

mongoose-im · 2022-03-29T08:32:03Z

small_tests_24 / small_tests / aef8320
Reports root / small

small_tests_23 / small_tests / aef8320
Reports root / small

dynamic_domains_pgsql_mnesia_23 / pgsql_mnesia / aef8320
Reports root/ big
OK: 2851 / Failed: 0 / User-skipped: 133 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_24 / pgsql_mnesia / aef8320
Reports root/ big
OK: 2851 / Failed: 0 / User-skipped: 133 / Auto-skipped: 0

dynamic_domains_mysql_redis_24 / mysql_redis / aef8320
Reports root/ big
OK: 2834 / Failed: 0 / User-skipped: 150 / Auto-skipped: 0

ldap_mnesia_23 / ldap_mnesia / aef8320
Reports root/ big
OK: 1507 / Failed: 1 / User-skipped: 399 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_module_opts_are_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,[qs,'_'],[]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,765}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,402}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_module_opts_are_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,241}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1754}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1263}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1195}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_module_opts_are_reported,
      1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       {line,241}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1754}]},
 ...

Report log

dynamic_domains_mssql_mnesia_24 / odbc_mssql_mnesia / aef8320
Reports root/ big
OK: 2851 / Failed: 0 / User-skipped: 133 / Auto-skipped: 0

ldap_mnesia_24 / ldap_mnesia / aef8320
Reports root/ big
OK: 1507 / Failed: 1 / User-skipped: 399 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_module_opts_are_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,402}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_module_opts_are_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,241}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_module_opts_are_reported,
      1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUI...

Report log

internal_mnesia_24 / internal_mnesia / aef8320
Reports root/ big
OK: 1548 / Failed: 1 / User-skipped: 358 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_module_opts_are_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,402}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_module_opts_are_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,241}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_module_opts_are_reported,
      1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUI...

Report log

pgsql_mnesia_23 / pgsql_mnesia / aef8320
Reports root/ big
OK: 3225 / Failed: 0 / User-skipped: 142 / Auto-skipped: 0

pgsql_mnesia_24 / pgsql_mnesia / aef8320
Reports root/ big
OK: 3225 / Failed: 0 / User-skipped: 142 / Auto-skipped: 0

elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / aef8320
Reports root/ big
OK: 1855 / Failed: 1 / User-skipped: 366 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_module_opts_are_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,402}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_module_opts_are_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,241}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_module_opts_are_reported,
      1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUI...

Report log

mysql_redis_24 / mysql_redis / aef8320
Reports root/ big
OK: 3220 / Failed: 0 / User-skipped: 147 / Auto-skipped: 0

mssql_mnesia_24 / odbc_mssql_mnesia / aef8320
Reports root/ big
OK: 3225 / Failed: 0 / User-skipped: 142 / Auto-skipped: 0

riak_mnesia_24 / riak_mnesia / aef8320
Reports root/ big
OK: 1698 / Failed: 1 / User-skipped: 365 / Auto-skipped: 0

service_mongoose_system_metrics_SUITE:module_opts:rdbms_module_opts_are_reported

{error,
  {{timeout,true,
     [{times,50,
        {error,badarg,
          [{ets,match_object,
             [qs,'_'],
             [{error_info,
              #{cause => id,module => erl_stdlib_errors}}]},
           {ets,tab2list,1,[{file,"ets.erl"},{line,764}]},
           {service_mongoose_system_metrics_SUITE,is_in_table,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,402}]},
           {mongoose_helper,do_wait_until,2,
             [{file,
              "/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
            {line,374}]},
           {service_mongoose_system_metrics_SUITE,
             rdbms_module_opts_are_reported,1,
             [{file,
              "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
            {line,241}]},
           {test_server,ts_tc,3,
             [{file,"test_server.erl"},{line,1783}]},
           {test_server,run_test_case_eval1,6,
             [{file,"test_server.erl"},{line,1292}]},
           {test_server,run_test_case_eval,9,
             [{file,"test_server.erl"},{line,1224}]}]}}]},
   [{mongoose_helper,do_wait_until,2,
      [{file,"/home/circleci/project/big_tests/tests/mongoose_helper.erl"},
       {line,371}]},
    {service_mongoose_system_metrics_SUITE,rdbms_module_opts_are_reported,
      1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUI...

Report log

- Test multiple modules at once to reduce time (it can't be parallel) - Skip modules without dynamic domains support when needed Also: - Use export_all to simplify maintenance - Rename functions returning booleans. One reason is a clash with CT callback names

- mod_mam_meta already handles the one in mod_mam - mod_keystore does not have a backend option (it's RAM-only mnesia)

mongoose-im · 2022-03-29T09:01:28Z

small_tests_24 / small_tests / ffc4515
Reports root / small

small_tests_23 / small_tests / ffc4515
Reports root / small

dynamic_domains_pgsql_mnesia_24 / pgsql_mnesia / ffc4515
Reports root/ big
OK: 2851 / Failed: 0 / User-skipped: 133 / Auto-skipped: 0

dynamic_domains_pgsql_mnesia_23 / pgsql_mnesia / ffc4515
Reports root/ big
OK: 2851 / Failed: 0 / User-skipped: 133 / Auto-skipped: 0

dynamic_domains_mysql_redis_24 / mysql_redis / ffc4515
Reports root/ big
OK: 2834 / Failed: 0 / User-skipped: 150 / Auto-skipped: 0

dynamic_domains_mssql_mnesia_24 / odbc_mssql_mnesia / ffc4515
Reports root/ big
OK: 2851 / Failed: 0 / User-skipped: 133 / Auto-skipped: 0

ldap_mnesia_23 / ldap_mnesia / ffc4515
Reports root/ big
OK: 1507 / Failed: 0 / User-skipped: 400 / Auto-skipped: 0

ldap_mnesia_24 / ldap_mnesia / ffc4515
Reports root/ big
OK: 1507 / Failed: 0 / User-skipped: 400 / Auto-skipped: 0

internal_mnesia_24 / internal_mnesia / ffc4515
Reports root/ big
OK: 1548 / Failed: 0 / User-skipped: 359 / Auto-skipped: 0

pgsql_mnesia_24 / pgsql_mnesia / ffc4515
Reports root/ big
OK: 3225 / Failed: 0 / User-skipped: 142 / Auto-skipped: 0

pgsql_mnesia_23 / pgsql_mnesia / ffc4515
Reports root/ big
OK: 3225 / Failed: 0 / User-skipped: 142 / Auto-skipped: 0

elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / ffc4515
Reports root/ big
OK: 1855 / Failed: 0 / User-skipped: 367 / Auto-skipped: 0

mysql_redis_24 / mysql_redis / ffc4515
Reports root/ big
OK: 3220 / Failed: 0 / User-skipped: 147 / Auto-skipped: 0

mssql_mnesia_24 / odbc_mssql_mnesia / ffc4515
Reports root/ big
OK: 3225 / Failed: 0 / User-skipped: 142 / Auto-skipped: 0

riak_mnesia_24 / riak_mnesia / ffc4515
Reports root/ big
OK: 1698 / Failed: 0 / User-skipped: 366 / Auto-skipped: 0

gustawlippa

Looks good!

mongoose-im mentioned this pull request Mar 28, 2022

CI build failures summary #3360

Closed

chrzaszcz force-pushed the test-config-metrics branch from b6f82e7 to 13858db Compare March 29, 2022 08:03

chrzaszcz force-pushed the test-config-metrics branch from 13858db to aef8320 Compare March 29, 2022 08:24

chrzaszcz added 3 commits March 29, 2022 10:53

Remove config_metrics callbacks when it is not needed.

a3e1820

- mod_mam_meta already handles the one in mod_mam - mod_keystore does not have a backend option (it's RAM-only mnesia)

Update config_metrics callbacks in modules already using maps

ffc4515

chrzaszcz force-pushed the test-config-metrics branch from aef8320 to ffc4515 Compare March 29, 2022 08:53

chrzaszcz marked this pull request as ready for review March 29, 2022 09:44

gustawlippa approved these changes Mar 29, 2022

View reviewed changes

gustawlippa merged commit 6b301b2 into master Mar 29, 2022

gustawlippa deleted the test-config-metrics branch March 29, 2022 15:05

Premwoik added this to the 5.1.0 milestone May 25, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Test config metrics #3613

Test config metrics #3613

chrzaszcz commented Mar 28, 2022 •

edited

codecov bot commented Mar 28, 2022 •

edited

mongoose-im commented Mar 28, 2022 •

edited

mongoose-im commented Mar 29, 2022 •

edited

mongoose-im commented Mar 29, 2022 •

edited

mongoose-im commented Mar 29, 2022 •

edited

gustawlippa left a comment

Test config metrics #3613

Test config metrics #3613

Conversation

chrzaszcz commented Mar 28, 2022 • edited

codecov bot commented Mar 28, 2022 • edited

Codecov Report

mongoose-im commented Mar 28, 2022 • edited

mongoose-im commented Mar 29, 2022 • edited

mongoose-im commented Mar 29, 2022 • edited

mongoose-im commented Mar 29, 2022 • edited

gustawlippa left a comment

Choose a reason for hiding this comment

chrzaszcz commented Mar 28, 2022 •

edited

codecov bot commented Mar 28, 2022 •

edited

mongoose-im commented Mar 28, 2022 •

edited

mongoose-im commented Mar 29, 2022 •

edited

mongoose-im commented Mar 29, 2022 •

edited

mongoose-im commented Mar 29, 2022 •

edited