Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add metrics_api_SUITE to dynamic_domains #3280

Merged
merged 3 commits into from
Sep 20, 2021
Merged

Conversation

vkatsuba
Copy link
Contributor

@vkatsuba vkatsuba commented Sep 16, 2021

  • Adding metrics_api_SUITE to dynamic domains
  • Added helper function domain/0 into domain_helper and start use it

@codecov
Copy link

codecov bot commented Sep 16, 2021

Codecov Report

Merging #3280 (c96af86) into master (28bf705) will decrease coverage by 0.03%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #3280      +/-   ##
==========================================
- Coverage   80.25%   80.22%   -0.04%     
==========================================
  Files         398      398              
  Lines       32559    32559              
==========================================
- Hits        26131    26119      -12     
- Misses       6428     6440      +12     
Impacted Files Coverage Δ
src/elasticsearch/mongoose_elasticsearch.erl 76.92% <0.00%> (-7.70%) ⬇️
src/event_pusher/mod_event_pusher_sns.erl 84.21% <0.00%> (-5.27%) ⬇️
src/domain/mongoose_domain_sql.erl 82.85% <0.00%> (-2.86%) ⬇️
src/mam/mod_mam_elasticsearch_arch.erl 85.08% <0.00%> (-1.76%) ⬇️
src/global_distrib/mod_global_distrib_receiver.erl 78.88% <0.00%> (-1.12%) ⬇️
src/rdbms/mongoose_rdbms.erl 60.88% <0.00%> (-0.81%) ⬇️
src/ejabberd_c2s.erl 89.22% <0.00%> (-0.08%) ⬇️
src/mod_muc_room.erl 77.12% <0.00%> (-0.06%) ⬇️
src/mod_muc_log.erl 77.88% <0.00%> (ø)
src/mod_muc.erl 73.99% <0.00%> (+0.22%) ⬆️
... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 28bf705...c96af86. Read the comment docs.

@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 16, 2021

small_tests_24 / small_tests / 08a0ecb
Reports root / small


internal_mnesia_24 / internal_mnesia / 08a0ecb
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0


small_tests_23 / small_tests / 08a0ecb
Reports root / small


small_tests_22 / small_tests / 08a0ecb
Reports root / small


dynamic_domains_24 / pgsql_mnesia / 08a0ecb
Reports root/ big
OK: 2454 / Failed: 0 / User-skipped: 141 / Auto-skipped: 0


dynamic_domains_23 / pgsql_mnesia / 08a0ecb
Reports root/ big
OK: 2454 / Failed: 0 / User-skipped: 141 / Auto-skipped: 0


ldap_mnesia_23 / ldap_mnesia / 08a0ecb
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


ldap_mnesia_24 / ldap_mnesia / 08a0ecb
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / 08a0ecb
Reports root/ big
OK: 1862 / Failed: 0 / User-skipped: 316 / Auto-skipped: 0


pgsql_mnesia_23 / pgsql_mnesia / 08a0ecb
Reports root/ big
OK: 3070 / Failed: 2 / User-skipped: 211 / Auto-skipped: 0

mod_event_pusher_rabbit_SUITE:group_chat_message_publish:group_chat_message_received_event_properly_formatted
{error,
  {{assertMatch,
     [{module,mod_event_pusher_rabbit_SUITE},
      {line,435},
      {expression,
        "get_decoded_message_from_rabbit ( AliceGroupChatMsgRecvRK )"},
      {pattern,
        "# { << \"from_user_id\" >> := BobRoomJID , << \"to_user_id\" >> := AliceFullJID , << \"message\" >> := Message }"},
      {value,
        #{<<"from_user_id">> =>
          <<"muc_publish@muc.localhost/bOb_unnamed_17.182945">>,
        <<"message">> => <<"Hi there!">>,
        <<"to_user_id">> =>
          <<"alice_unnamed_17.311749@localhost/res1">>}}]},
   [{mod_event_pusher_rabbit_SUITE,
      '-group_chat_message_received_event_properly_formatted/1-fun-0-',3,
      [{file,
         "/home/circleci/app/big_tests/tests/mod_event_pusher_rabbit_SUITE.erl"},
       {line,435}]},
    {escalus_story,story,4,
      [{file,
         "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
       {line,72}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1784}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1293}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1225}]}]}}

Report log

mod_event_pusher_rabbit_SUITE:group_chat_message_publish:group_chat_message_received_event_properly_formatted
{error,
  {{assertMatch,
     [{module,mod_event_pusher_rabbit_SUITE},
      {line,435},
      {expression,
        "get_decoded_message_from_rabbit ( AliceGroupChatMsgRecvRK )"},
      {pattern,
        "# { << \"from_user_id\" >> := BobRoomJID , << \"to_user_id\" >> := AliceFullJID , << \"message\" >> := Message }"},
      {value,
        #{<<"from_user_id">> =>
          <<"muc_publish@muc.localhost/bOb_unnamed_17.311749">>,
        <<"message">> => <<"Hi there!">>,
        <<"to_user_id">> =>
          <<"alice_unnamed_17.993408@localhost/res1">>}}]},
   [{mod_event_pusher_rabbit_SUITE,
      '-group_chat_message_received_event_properly_formatted/1-fun-0-',3,
      [{file,
         "/home/circleci/app/big_tests/tests/mod_event_pusher_rabbit_SUITE.erl"},
       {line,435}]},
    {escalus_story,story,4,
      [{file,
         "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
       {line,72}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1784}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1293}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1225}]}]}}

Report log


mysql_redis_24 / mysql_redis / 08a0ecb
Reports root/ big
OK: 3047 / Failed: 0 / User-skipped: 228 / Auto-skipped: 0


pgsql_mnesia_24 / pgsql_mnesia / 08a0ecb
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


mssql_mnesia_24 / odbc_mssql_mnesia / 08a0ecb
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


ldap_mnesia_22 / ldap_mnesia / 08a0ecb
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


pgsql_mnesia_22 / pgsql_mnesia / 08a0ecb
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


riak_mnesia_24 / riak_mnesia / 08a0ecb
Reports root/ big
OK: 1709 / Failed: 0 / User-skipped: 319 / Auto-skipped: 0


pgsql_mnesia_23 / pgsql_mnesia / 08a0ecb
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0

@vkatsuba vkatsuba marked this pull request as ready for review September 16, 2021 17:35
Copy link
Member

@chrzaszcz chrzaszcz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's going in the right direction, but please eliminate localhost from the test suite. see lines 170 and 197 of the test suite. We should use domain from the config instead.

big_tests/dynamic_domains.config Outdated Show resolved Hide resolved
Copy link
Contributor Author

@vkatsuba vkatsuba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need resolve conflicts big_tests/dynamic_domains.spec.

@vkatsuba vkatsuba force-pushed the ct/dynamic_domains-metrics branch 2 times, most recently from 383903f to b341d1c Compare September 17, 2021 09:28
@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 17, 2021

small_tests_24 / small_tests / f0073f6
Reports root / small


internal_mnesia_24 / internal_mnesia / f0073f6
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0

@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 17, 2021

small_tests_24 / small_tests / 383903f
Reports root / small


internal_mnesia_24 / internal_mnesia / 383903f
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0

@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 17, 2021

small_tests_24 / small_tests / b341d1c
Reports root / small


internal_mnesia_24 / internal_mnesia / b341d1c
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0


small_tests_22 / small_tests / b341d1c
Reports root / small


small_tests_23 / small_tests / b341d1c
Reports root / small


ldap_mnesia_22 / ldap_mnesia / b341d1c
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


ldap_mnesia_23 / ldap_mnesia / b341d1c
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


dynamic_domains_23 / pgsql_mnesia / b341d1c
Reports root/ big
OK: 2572 / Failed: 3 / User-skipped: 182 / Auto-skipped: 0

service_domain_db_SUITE:db:db_keeps_syncing_after_cluster_join
{error,{test_case_failed,{[<<"example1.com">>],
              [<<"example1.com">>,<<"example2.com">>]}}}

Report log

service_domain_db_SUITE:db:rest_with_auth:rest_delete_domain_cleans_data_from_mam
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"bob_rest_delete_domain_cleans_data_from_mam_14.453852@example.org/res1">>,
          escalus_tcp,<0.26164.1>,
          [{event_manager,<0.26158.1>},
           {server,<<"example.org">>},
           {username,
             <<"bob_rest_delete_domain_cleans_data_from_mam_14.453852">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.26158.1>},
            {server,<<"example.org">>},
            {username,
              <<"bob_rest_delete_domain_cleans_data_from_mam_14.453852">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"bob_rest_delete_domain_cleans_data_from_mam_14.453852">>},
           {server,<<"example.org">>},
           {host,<<"localhost">>},
           {port,5232},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"bob_rest_delete_domain_cleans_data_from_mam_14.453852">>},
           {server,<<"example.org">>},
           {host,<<"localhost">>},
           {password,<<"makota3">>},
           {port,5232},
           {stream_id,<<"049460c25ae2603a">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {service_domain_db_SUITE,
       '-rest_delete_domain_cleans_data_from_mam/1-fun-0-',5...

Report log

service_domain_db_SUITE:db:rest_without_auth:rest_delete_domain_cleans_data_from_mam
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"bob_rest_delete_domain_cleans_data_from_mam_22.646582@example.org/res1">>,
          escalus_tcp,<0.26797.1>,
          [{event_manager,<0.26791.1>},
           {server,<<"example.org">>},
           {username,
             <<"bob_rest_delete_domain_cleans_data_from_mam_22.646582">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.26791.1>},
            {server,<<"example.org">>},
            {username,
              <<"bob_rest_delete_domain_cleans_data_from_mam_22.646582">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"bob_rest_delete_domain_cleans_data_from_mam_22.646582">>},
           {server,<<"example.org">>},
           {host,<<"localhost">>},
           {port,5232},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"bob_rest_delete_domain_cleans_data_from_mam_22.646582">>},
           {server,<<"example.org">>},
           {host,<<"localhost">>},
           {password,<<"makota3">>},
           {port,5232},
           {stream_id,<<"a0f5f8ad348bf134">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {service_domain_db_SUITE,
       '-rest_delete_domain_cleans_data_from_mam/1-fun-0-',5...

Report log


ldap_mnesia_24 / ldap_mnesia / b341d1c
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


dynamic_domains_24 / pgsql_mnesia / b341d1c
Reports root/ big
OK: 2575 / Failed: 0 / User-skipped: 182 / Auto-skipped: 0


pgsql_mnesia_22 / pgsql_mnesia / b341d1c
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


pgsql_mnesia_24 / pgsql_mnesia / b341d1c
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


pgsql_mnesia_23 / pgsql_mnesia / b341d1c
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / b341d1c
Reports root/ big
OK: 1862 / Failed: 0 / User-skipped: 316 / Auto-skipped: 0


mysql_redis_24 / mysql_redis / b341d1c
Reports root/ big
OK: 3047 / Failed: 0 / User-skipped: 228 / Auto-skipped: 0


mssql_mnesia_24 / odbc_mssql_mnesia / b341d1c
Reports root/ big
OK: 3069 / Failed: 2 / User-skipped: 211 / Auto-skipped: 0

inbox_SUITE:one_to_one:other_resources_do_not_interfere
{error,
  {test_case_failed,
    #{check_params => #{},
      error => {badmatch,1},
      expected_items =>
        [#{content => <<"How are you">>,
         from =>
           <<"kate_other_resources_do_not_interfere_11.648112@localhost/res1">>,
         to =>
           <<"mike_other_resources_do_not_interfere_11.648112@localhost/res1">>,
         unread => 2,verify => #Fun<inbox_SUITE.117.122357169>}],
      inbox_items =>
        [<<"<message from='mike_other_resources_do_not_interfere_11.648112@localhost' to='mike_other_resources_do_not_interfere_11.648112@localhost/res1' id='dd5c80c2-b2b8-40e5-ad43-565d1691259e'><result xmlns='erlang-solutions.com:xmpp:inbox:0' unread='1' queryid='dc638e96c104bb971f3999879115071b'><forwarded xmlns='urn:xmpp:forward:0'><delay xmlns='urn:xmpp:delay' stamp='2021-09-17T09:50:16.568902Z'/><message from='kate_other_resources_do_not_interfere_11.648112@localhost/res1' xml:lang='en' to='mike_other_resources_do_not_interfere_11.648112@localhost/res1' type='chat' id='f51202ea64efa1ab4b8e3154014e44ef'><body>How are you</body></message></forwarded><archive>false</archive><mute>0</mute></result></message>">>],
      query_params => #{},reason => inbox_mismatch,
      stacktrace =>
        [{inbox_helper,process_inbox_message,4,
           [{file,
            "/home/circleci/app/big_tests/tests/inbox_helper.erl"},
          {line,194}]},
         {lists,foreach,2,[{file,"lists.erl"},{line,1342}]},
         {inbox_helper,check_inbox,4,
           [{f...

Report log

mod_ping_SUITE:server_ping_kill:server_ping_pong
{error,{{badmatch,[{[<<"localhost">>,mod_ping,ping_response],
          {expected_diff,5},
          {before_story,5},
          {after_story,9}}]},
    [{escalus_mongooseim,post_story_check_metrics,1,
               [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,74}]},
     {escalus_mongooseim,maybe_check_metrics_post_story,1,
               [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,51}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,75}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1783}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1292}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1224}]}]}}

Report log


riak_mnesia_24 / riak_mnesia / b341d1c
Reports root/ big
OK: 1709 / Failed: 0 / User-skipped: 319 / Auto-skipped: 0

@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 17, 2021

small_tests_24 / small_tests / cc53e85
Reports root / small


internal_mnesia_24 / internal_mnesia / cc53e85
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0

@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 17, 2021

small_tests_24 / small_tests / 3437e53
Reports root / small


internal_mnesia_24 / internal_mnesia / 3437e53
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0


small_tests_22 / small_tests / 3437e53
Reports root / small


small_tests_23 / small_tests / 3437e53
Reports root / small


ldap_mnesia_22 / ldap_mnesia / 3437e53
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


ldap_mnesia_23 / ldap_mnesia / 3437e53
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


dynamic_domains_24 / pgsql_mnesia / 3437e53
Reports root/ big
OK: 2675 / Failed: 0 / User-skipped: 183 / Auto-skipped: 0


ldap_mnesia_24 / ldap_mnesia / 3437e53
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


dynamic_domains_23 / pgsql_mnesia / 3437e53
Reports root/ big
OK: 2675 / Failed: 0 / User-skipped: 183 / Auto-skipped: 0


pgsql_mnesia_22 / pgsql_mnesia / 3437e53
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / 3437e53
Reports root/ big
OK: 1862 / Failed: 0 / User-skipped: 316 / Auto-skipped: 0


mssql_mnesia_24 / odbc_mssql_mnesia / 3437e53
Reports root/ big
OK: 3069 / Failed: 7 / User-skipped: 211 / Auto-skipped: 0

pep_SUITE:pep_tests:delayed_receive_with_sm
{error,{{badmatch,[]},
    [{pep_SUITE,'-delayed_receive_with_sm/1-fun-0-',3,
          [{file,"/home/circleci/app/big_tests/tests/pep_SUITE.erl"},
           {line,295}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1783}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1292}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1224}]}]}}

Report log

pep_SUITE:pep_tests:authorize_access_model
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"alicE_authorize_access_model_88.785173@localhost/res1">>,
          escalus_tcp,<0.23828.1>,
          [{event_manager,<0.23796.1>},
           {server,<<"localhost">>},
           {username,<<"alicE_authorize_access_model_88.785173">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.23796.1>},
            {server,<<"localhost">>},
            {username,
              <<"alicE_authorize_access_model_88.785173">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,<<"alicE_authorize_access_model_88.785173">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,<<"alicE_authorize_access_model_88.785173">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"62f443f499e7c7c9">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {pubsub_tools,receive_response,3,
       [{file,"/home/circleci/app/big_tests/tests/pubsub_tools.erl"},
        {line,479}]},
     {pubsub_tools,receive_and_check_response,4,
       [{file,"/home/circleci/app/big_tests/tests/pubsub_tools.erl"},
        {line,470}]},
   ...

Report log

pep_SUITE:pep_tests:delayed_receive
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,<<"alicE_delayed_receive_88.783542@localhost/res1">>,
          escalus_tcp,<0.23829.1>,
          [{event_manager,<0.23789.1>},
           {server,<<"localhost">>},
           {username,<<"alicE_delayed_receive_88.783542">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.23789.1>},
            {server,<<"localhost">>},
            {username,<<"alicE_delayed_receive_88.783542">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,<<"alicE_delayed_receive_88.783542">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,<<"alicE_delayed_receive_88.783542">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"e0b936a60505e247">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {pubsub_tools,receive_response,3,
       [{file,"/home/circleci/app/big_tests/tests/pubsub_tools.erl"},
        {line,479}]},
     {pubsub_tools,receive_and_check_response,4,
       [{file,"/home/circleci/app/big_tests/tests/pubsub_tools.erl"},
        {line,470}]},
     {pep_SUITE,'-delayed_receive/1-fun-0-',3,
       [{file,"/h...

Report log

pep_SUITE:pep_tests:h_ok_after_notify_test
{error,{{assertion_failed,assert_many,false,[is_roster_set],[],[]},
    [{escalus_new_assert,assert_true,2,
               [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"},
                {line,84}]},
     {escalus_story,'-make_all_clients_friends/1-fun-0-',2,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,117}]},
     {escalus_utils,'-each_with_index/3-fun-0-',3,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,87}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1267}]},
     {escalus_utils,'-each_with_index/3-fun-0-',3,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,87}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1267}]},
     {escalus_utils,distinct_pairs,2,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,60}]},
     {escalus_story,make_all_clients_friends,1,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,106}]}]}}

Report log

pep_SUITE:pep_tests:unsubscribe_after_presence_unsubscription
{error,{{assertion_failed,assert_many,false,
              [is_roster_set,is_presence,is_presence],
              [],[]},
    [{escalus_new_assert,assert_true,2,
               [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"},
                {line,84}]},
     {escalus_story,'-make_all_clients_friends/1-fun-0-',2,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,114}]},
     {escalus_utils,'-each_with_index/3-fun-0-',3,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,87}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1267}]},
     {escalus_utils,'-each_with_index/3-fun-0-',3,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,87}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1267}]},
     {escalus_utils,distinct_pairs,2,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,60}]},
     {escalus_story,make_all_clients_friends,1,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,106}]}]}}

Report log

pep_SUITE:pep_tests:publish_and_notify_test
{error,{{assertion_failed,assert_many,false,[is_roster_set],[],[]},
    [{escalus_new_assert,assert_true,2,
               [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"},
                {line,84}]},
     {escalus_story,'-make_all_clients_friends/1-fun-0-',2,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,117}]},
     {escalus_utils,'-each_with_index/3-fun-0-',3,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,87}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1267}]},
     {escalus_utils,'-each_with_index/3-fun-0-',3,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,87}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1267}]},
     {escalus_utils,distinct_pairs,2,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,60}]},
     {escalus_story,make_all_clients_friends,1,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,106}]}]}}

Report log

pep_SUITE:pep_tests:send_caps_after_login_test
{error,{{assertion_failed,assert_many,false,[is_roster_set],[],[]},
    [{escalus_new_assert,assert_true,2,
               [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"},
                {line,84}]},
     {escalus_story,'-make_all_clients_friends/1-fun-0-',2,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,108}]},
     {escalus_utils,'-each_with_index/3-fun-0-',3,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,87}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1267}]},
     {escalus_utils,'-each_with_index/3-fun-0-',3,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,87}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1267}]},
     {escalus_utils,distinct_pairs,2,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_utils.erl"},
             {line,60}]},
     {escalus_story,make_all_clients_friends,1,
            [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,106}]}]}}

Report log


pgsql_mnesia_23 / pgsql_mnesia / 3437e53
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


pgsql_mnesia_24 / pgsql_mnesia / 3437e53
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


mysql_redis_24 / mysql_redis / 3437e53
Reports root/ big
OK: 3047 / Failed: 0 / User-skipped: 228 / Auto-skipped: 0


riak_mnesia_24 / riak_mnesia / 3437e53
Reports root/ big
OK: 1709 / Failed: 0 / User-skipped: 319 / Auto-skipped: 0

@chrzaszcz
Copy link
Member

It's going in the right direction, but please eliminate localhost from the test suite. see lines 170 and 197 of the test suite. We should use domain from the config instead.

Please don't forget about this.

@vkatsuba
Copy link
Contributor Author

Please don't forget about this.

Sorry, I was miss it. Thanks for remind me. Fixed.

@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 17, 2021

small_tests_24 / small_tests / bb466d1
Reports root / small


internal_mnesia_24 / internal_mnesia / bb466d1
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0


small_tests_22 / small_tests / bb466d1
Reports root / small


ldap_mnesia_22 / ldap_mnesia / bb466d1
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


dynamic_domains_24 / pgsql_mnesia / bb466d1
Reports root/ big
OK: 2675 / Failed: 0 / User-skipped: 183 / Auto-skipped: 0


elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / bb466d1
Reports root/ big
OK: 1862 / Failed: 0 / User-skipped: 316 / Auto-skipped: 0


mysql_redis_24 / mysql_redis / bb466d1
Reports root/ big
OK: 3050 / Failed: 1 / User-skipped: 228 / Auto-skipped: 0

mod_event_pusher_rabbit_SUITE:group_chat_message_publish:group_chat_message_received_event_properly_formatted
{error,
  {{assertMatch,
     [{module,mod_event_pusher_rabbit_SUITE},
      {line,435},
      {expression,
        "get_decoded_message_from_rabbit ( AliceGroupChatMsgRecvRK )"},
      {pattern,
        "# { << \"from_user_id\" >> := BobRoomJID , << \"to_user_id\" >> := AliceFullJID , << \"message\" >> := Message }"},
      {value,
        #{<<"from_user_id">> =>
          <<"muc_publish@muc.localhost/bOb_unnamed_14.45375">>,
        <<"message">> => <<"Hi there!">>,
        <<"to_user_id">> =>
          <<"alice_unnamed_14.205696@localhost/res1">>}}]},
   [{mod_event_pusher_rabbit_SUITE,
      '-group_chat_message_received_event_properly_formatted/1-fun-1-',3,
      [{file,
         "/home/circleci/app/big_tests/tests/mod_event_pusher_rabbit_SUITE.erl"},
       {line,435}]},
    {escalus_story,story,4,
      [{file,
         "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
       {line,72}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1783}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1292}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1224}]}]}}

Report log


ldap_mnesia_24 / ldap_mnesia / bb466d1
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


pgsql_mnesia_24 / pgsql_mnesia / bb466d1
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


pgsql_mnesia_22 / pgsql_mnesia / bb466d1
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


small_tests_23 / small_tests / bb466d1
Reports root / small


mssql_mnesia_24 / odbc_mssql_mnesia / bb466d1
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


riak_mnesia_24 / riak_mnesia / bb466d1
Reports root/ big
OK: 1709 / Failed: 0 / User-skipped: 319 / Auto-skipped: 0


ldap_mnesia_23 / ldap_mnesia / bb466d1
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


dynamic_domains_23 / pgsql_mnesia / bb466d1
Reports root/ big
OK: 2675 / Failed: 0 / User-skipped: 183 / Auto-skipped: 0


pgsql_mnesia_23 / pgsql_mnesia / bb466d1
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


small_tests_22 / small_tests / bb466d1
Reports root / small

Copy link
Contributor

@Premwoik Premwoik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, I have only minor suggestions :)

big_tests/tests/metrics_api_SUITE.erl Outdated Show resolved Hide resolved
big_tests/tests/mod_aws_sns_SUITE.erl Outdated Show resolved Hide resolved
big_tests/tests/mod_aws_sns_SUITE.erl Outdated Show resolved Hide resolved
big_tests/tests/vcard_SUITE.erl Outdated Show resolved Hide resolved
@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 20, 2021

small_tests_24 / small_tests / 1490eb8
Reports root / small


internal_mnesia_24 / internal_mnesia / 1490eb8
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0


small_tests_22 / small_tests / 1490eb8
Reports root / small


small_tests_23 / small_tests / 1490eb8
Reports root / small


ldap_mnesia_24 / ldap_mnesia / 1490eb8
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


dynamic_domains_23 / pgsql_mnesia / 1490eb8
Reports root/ big
OK: 2675 / Failed: 0 / User-skipped: 183 / Auto-skipped: 0


dynamic_domains_24 / pgsql_mnesia / 1490eb8
Reports root/ big
OK: 2675 / Failed: 0 / User-skipped: 183 / Auto-skipped: 0


ldap_mnesia_22 / ldap_mnesia / 1490eb8
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


ldap_mnesia_23 / ldap_mnesia / 1490eb8
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / 1490eb8
Reports root/ big
OK: 1862 / Failed: 0 / User-skipped: 316 / Auto-skipped: 0


pgsql_mnesia_23 / pgsql_mnesia / 1490eb8
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


pgsql_mnesia_24 / pgsql_mnesia / 1490eb8
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


pgsql_mnesia_22 / pgsql_mnesia / 1490eb8
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


mssql_mnesia_24 / odbc_mssql_mnesia / 1490eb8
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


mysql_redis_24 / mysql_redis / 1490eb8
Reports root/ big
OK: 3053 / Failed: 1 / User-skipped: 228 / Auto-skipped: 0

mam_SUITE:rdbms_async_pool_prefs_cases:messages_filtered_when_prefs_default_policy_is_never
{error,{test_case_failed,"ASSERT EQUAL\n\tExpected []\n\tValue [ok]\n"}}

Report log


riak_mnesia_24 / riak_mnesia / 1490eb8
Reports root/ big
OK: 1709 / Failed: 0 / User-skipped: 319 / Auto-skipped: 0

@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 20, 2021

small_tests_24 / small_tests / 2e6581b
Reports root / small


internal_mnesia_24 / internal_mnesia / 2e6581b
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0

@mongoose-im
Copy link
Collaborator

mongoose-im commented Sep 20, 2021

small_tests_24 / small_tests / c96af86
Reports root / small


internal_mnesia_24 / internal_mnesia / c96af86
Reports root/ big
OK: 1589 / Failed: 0 / User-skipped: 290 / Auto-skipped: 0


small_tests_22 / small_tests / c96af86
Reports root / small


small_tests_23 / small_tests / c96af86
Reports root / small


ldap_mnesia_24 / ldap_mnesia / c96af86
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


dynamic_domains_24 / pgsql_mnesia / c96af86
Reports root/ big
OK: 2675 / Failed: 0 / User-skipped: 183 / Auto-skipped: 0


pgsql_mnesia_24 / pgsql_mnesia / c96af86
Reports root/ big
OK: 3063 / Failed: 1 / User-skipped: 211 / Auto-skipped: 0

service_domain_db_SUITE:db:db_keeps_syncing_after_cluster_join
{error,{test_case_failed,{[<<"example1.com">>,<<"example2.com">>,
               <<"example3.com">>],
              [<<"example1.com">>,<<"example2.com">>,
               <<"example3.com">>,<<"example4.com">>]}}}

Report log


dynamic_domains_23 / pgsql_mnesia / c96af86
Reports root/ big
OK: 2675 / Failed: 0 / User-skipped: 183 / Auto-skipped: 0


ldap_mnesia_22 / ldap_mnesia / c96af86
Reports root/ big
OK: 1486 / Failed: 0 / User-skipped: 393 / Auto-skipped: 0


ldap_mnesia_23 / ldap_mnesia / c96af86
Reports root/ big
OK: 1494 / Failed: 1 / User-skipped: 393 / Auto-skipped: 0

connect_SUITE:just_tls:feature_order:auth_bind_compression_session
{error,
  {{badmatch,
     {error,
       {connection_step_failed,
         {{escalus_session,maybe_use_compression},
          {client,
            <<"secure_joe_auth_bind_compression_session_32.773088@localhost/escalus-default-resource">>,
            escalus_tcp,<0.12065.0>,undefined,
            [{username,
               <<"secure_joe_auth_bind_compression_session_32.773088">>},
             {server,<<"localhost">>},
             {password,<<"break_me">>},
             {compression,<<"zlib">>},
             {starttls,required},
             {host,<<"localhost">>},
             {stream_id,<<"6bf13cd56f5cc9d9">>},
             {resource,<<"escalus-default-resource">>}]},
          [{compression,[<<"zlib">>]},
           {starttls,false},
           {stream_management,true},
           {advanced_message_processing,true},
           {client_state_indication,false},
           {sasl_mechanisms,[<<"PLAIN">>]},
           {caps,undefined}]},
         {timeout,stream_start}}}},
   [{connect_SUITE,auth_bind_compression_session,1,
      [{file,"/home/circleci/app/big_tests/tests/connect_SUITE.erl"},
       {line,529}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1784}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1293}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1225}]}]}}

Report log


elasticsearch_and_cassandra_24 / elasticsearch_and_cassandra_mnesia / c96af86
Reports root/ big
OK: 1862 / Failed: 0 / User-skipped: 316 / Auto-skipped: 0


pgsql_mnesia_22 / pgsql_mnesia / c96af86
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


mysql_redis_24 / mysql_redis / c96af86
Reports root/ big
OK: 3053 / Failed: 1 / User-skipped: 228 / Auto-skipped: 0

mam_SUITE:rdbms_cache_prefs_cases:messages_filtered_when_prefs_default_policy_is_roster
{error,{test_case_failed,"ASSERT EQUAL\n\tExpected []\n\tValue [ok]\n"}}

Report log


pgsql_mnesia_23 / pgsql_mnesia / c96af86
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0


mssql_mnesia_24 / odbc_mssql_mnesia / c96af86
Reports root/ big
OK: 3055 / Failed: 9 / User-skipped: 211 / Auto-skipped: 0

inbox_SUITE:muclight:groupchat_reset_stanza_resets_inbox
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"alicE_groupchat_reset_stanza_resets_inbox_20.840583@localhost/res1">>,
          escalus_tcp,<0.17375.0>,
          [{event_manager,<0.17331.0>},
           {server,<<"localhost">>},
           {username,
             <<"alicE_groupchat_reset_stanza_resets_inbox_20.840583">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.17331.0>},
            {server,<<"localhost">>},
            {username,
              <<"alicE_groupchat_reset_stanza_resets_inbox_20.840583">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"alicE_groupchat_reset_stanza_resets_inbox_20.840583">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"alicE_groupchat_reset_stanza_resets_inbox_20.840583">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"81e7d1735ee00d29">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {muc_light_helper,given_muc_light_room,3,
       [{file,"/home/circleci/app/big_tests/tests/muc_light_helper.erl"},
        {line,54}]},
     {inbox_helper,create_...

Report log

inbox_SUITE:muclight:leave_and_remove_conversation
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"alicE_leave_and_remove_conversation_20.846025@localhost/res1">>,
          escalus_tcp,<0.17374.0>,
          [{event_manager,<0.17350.0>},
           {server,<<"localhost">>},
           {username,
             <<"alicE_leave_and_remove_conversation_20.846025">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.17350.0>},
            {server,<<"localhost">>},
            {username,
              <<"alicE_leave_and_remove_conversation_20.846025">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"alicE_leave_and_remove_conversation_20.846025">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"alicE_leave_and_remove_conversation_20.846025">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"8e6146def98365e0">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {muc_light_helper,given_muc_light_room,3,
       [{file,"/home/circleci/app/big_tests/tests/muc_light_helper.erl"},
        {line,54}]},
     {inbox_helper,create_room,3,
       [{file,"/home/c...

Report log

inbox_SUITE:muclight:non_reset_marker_should_not_affect_muclight_inbox
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"alicE_non_reset_marker_should_not_affect_muclight_inbox_20.852048@localhost/res1">>,
          escalus_tcp,<0.17379.0>,
          [{event_manager,<0.17364.0>},
           {server,<<"localhost">>},
           {username,
             <<"alicE_non_reset_marker_should_not_affect_muclight_inbox_20.852048">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.17364.0>},
            {server,<<"localhost">>},
            {username,
              <<"alicE_non_reset_marker_should_not_affect_muclight_inbox_20.852048">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"alicE_non_reset_marker_should_not_affect_muclight_inbox_20.852048">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"alicE_non_reset_marker_should_not_affect_muclight_inbox_20.852048">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"dc096d86dfd46935">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {muc_light_helper,given_muc_light_room,3,
       [{file,"/home/circleci/app/big_tests/tests/m...

Report log

inbox_SUITE:muclight:groupchat_markers_one_reset_room_created
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"alicE_groupchat_markers_one_reset_room_created_20.850797@localhost/res1">>,
          escalus_tcp,<0.17376.0>,
          [{event_manager,<0.17359.0>},
           {server,<<"localhost">>},
           {username,
             <<"alicE_groupchat_markers_one_reset_room_created_20.850797">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.17359.0>},
            {server,<<"localhost">>},
            {username,
              <<"alicE_groupchat_markers_one_reset_room_created_20.850797">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"alicE_groupchat_markers_one_reset_room_created_20.850797">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"alicE_groupchat_markers_one_reset_room_created_20.850797">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"68923636560882be">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {muc_helper,'-foreach_recipient/2-fun-0-',2,
       [{file,"/home/circleci/app/big_tests/tests/muc_helper.erl"},
        {line,45}]},
    ...

Report log

inbox_SUITE:muclight:simple_groupchat_stored_in_all_inbox
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"alicE_simple_groupchat_stored_in_all_inbox_20.845316@localhost/res1">>,
          escalus_tcp,<0.17377.0>,
          [{event_manager,<0.17338.0>},
           {server,<<"localhost">>},
           {username,
             <<"alicE_simple_groupchat_stored_in_all_inbox_20.845316">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.17338.0>},
            {server,<<"localhost">>},
            {username,
              <<"alicE_simple_groupchat_stored_in_all_inbox_20.845316">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"alicE_simple_groupchat_stored_in_all_inbox_20.845316">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"alicE_simple_groupchat_stored_in_all_inbox_20.845316">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"f2a16d07ddd0b67e">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {muc_light_helper,given_muc_light_room,3,
       [{file,"/home/circleci/app/big_tests/tests/muc_light_helper.erl"},
        {line,54}]},
     {inbox_helper,cr...

Report log

inbox_SUITE:muclight:groupchat_markers_all_reset_room_created
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"alicE_groupchat_markers_all_reset_room_created_20.837915@localhost/res1">>,
          escalus_tcp,<0.17378.0>,
          [{event_manager,<0.17324.0>},
           {server,<<"localhost">>},
           {username,
             <<"alicE_groupchat_markers_all_reset_room_created_20.837915">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.17324.0>},
            {server,<<"localhost">>},
            {username,
              <<"alicE_groupchat_markers_all_reset_room_created_20.837915">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"alicE_groupchat_markers_all_reset_room_created_20.837915">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"alicE_groupchat_markers_all_reset_room_created_20.837915">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"c32d8b78e649646e">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {muc_helper,'-foreach_recipient/2-fun-0-',2,
       [{file,"/home/circleci/app/big_tests/tests/muc_helper.erl"},
        {line,45}]},
    ...

Report log

inbox_SUITE:muclight:advanced_groupchat_stored_in_all_inbox
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"alicE_advanced_groupchat_stored_in_all_inbox_20.852160@localhost/res1">>,
          escalus_tcp,<0.17380.0>,
          [{event_manager,<0.17371.0>},
           {server,<<"localhost">>},
           {username,
             <<"alicE_advanced_groupchat_stored_in_all_inbox_20.852160">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.17371.0>},
            {server,<<"localhost">>},
            {username,
              <<"alicE_advanced_groupchat_stored_in_all_inbox_20.852160">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"alicE_advanced_groupchat_stored_in_all_inbox_20.852160">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"alicE_advanced_groupchat_stored_in_all_inbox_20.852160">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"f3fa8198613ac4db">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {muc_light_helper,given_muc_light_room,3,
       [{file,"/home/circleci/app/big_tests/tests/muc_light_helper.erl"},
        {line,54}]},
     {inbox...

Report log

inbox_SUITE:muclight:groupchat_markers_one_reset
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"alicE_groupchat_markers_one_reset_20.836032@localhost/res1">>,
          escalus_tcp,<0.17372.0>,
          [{event_manager,<0.17315.0>},
           {server,<<"localhost">>},
           {username,
             <<"alicE_groupchat_markers_one_reset_20.836032">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.17315.0>},
            {server,<<"localhost">>},
            {username,
              <<"alicE_groupchat_markers_one_reset_20.836032">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"alicE_groupchat_markers_one_reset_20.836032">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"alicE_groupchat_markers_one_reset_20.836032">>},
           {server,<<"localhost">>},
           {password,<<"matygrysa">>},
           {stream_id,<<"f20f81fbe6894baf">>}]},
        5000],
       [{file,
          "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {muc_helper,'-foreach_recipient/2-fun-0-',2,
       [{file,"/home/circleci/app/big_tests/tests/muc_helper.erl"},
        {line,45}]},
     {lists,foreach,2,[{file,"lists.erl"},{line,1342}]},
     {inbox_...

Report log

inbox_SUITE:muclight:create_groupchat
{error,{badarg,[{erlang,binary_to_integer,
            [undefined],
            [{error_info,#{module => erl_erts_errors}}]},
        {inbox_helper,get_result_el,2,
                [{file,"/home/circleci/app/big_tests/tests/inbox_helper.erl"},
                 {line,236}]},
        {inbox_helper,mark_last_muclight_system_message,3,
                [{file,"/home/circleci/app/big_tests/tests/inbox_helper.erl"},
                 {line,580}]},
        {inbox_helper,'-create_room_and_check_inbox/3-lc$^5/1-3-',2,
                [{file,"/home/circleci/app/big_tests/tests/inbox_helper.erl"},
                 {line,534}]},
        {inbox_helper,create_room_and_check_inbox,3,
                [{file,"/home/circleci/app/big_tests/tests/inbox_helper.erl"},
                 {line,535}]},
        {escalus_story,story,4,
                 [{file,"/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
                {line,72}]},
        {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1783}]},
        {test_server,run_test_case_eval1,6,
               [{file,"test_server.erl"},{line,1292}]}]}}

Report log


riak_mnesia_24 / riak_mnesia / c96af86
Reports root/ big
OK: 1727 / Failed: 1 / User-skipped: 319 / Auto-skipped: 0

jingle_SUITE:all:resp_4xx_from_sip_proxy_results_in_session_terminate
{error,
  {{assertion_failed,assert,is_iq_result,
     {xmlel,<<"iq">>,
       [{<<"from">>,<<"error.480@localhost">>},
        {<<"to">>,
         <<"alice_resp_4xx_from_sip_proxy_results_in_session_terminate_98.253179@localhost/res1">>},
        {<<"id">>,<<"584bd94d-1b08-48b9-a67b-ae957191d643">>},
        {<<"type">>,<<"set">>}],
       [{xmlel,<<"jingle">>,
          [{<<"xmlns">>,<<"urn:xmpp:jingle:1">>},
           {<<"action">>,<<"session-terminate">>},
           {<<"sid">>,<<"0018dc1c-f701-4908-b70d-ca674a485c27">>}],
          [{xmlel,<<"reason">>,[],
             [{xmlel,<<"general-error">>,[],[]},
            {xmlel,<<"sip-error">>,
              [{<<"code">>,<<"480">>}],
              [{xmlcdata,<<"Temporarily Unavailable">>}]}]}]}]},
     "<iq from='error.480@localhost' to='alice_resp_4xx_from_sip_proxy_results_in_session_terminate_98.253179@localhost/res1' id='584bd94d-1b08-48b9-a67b-ae957191d643' type='set'><jingle xmlns='urn:xmpp:jingle:1' action='session-terminate' sid='0018dc1c-f701-4908-b70d-ca674a485c27'><reason><general-error/><sip-error code='480'>Temporarily Unavailable</sip-error></reason></jingle></iq>"},
   [{escalus_new_assert,assert_true,2,
      [{file,
         "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"},
       {line,84}]},
    {jingle_SUITE,send_initiate_and_wait_for_first_iq_set,2,
      [{file,"/home/circleci/app/big_tests/tests/jingle_SUITE.erl"},
       {line,395}]},
    {jingle_SUITE,
      '-res...

Report log


pgsql_mnesia_24 / pgsql_mnesia / c96af86
Reports root/ big
OK: 3082 / Failed: 1 / User-skipped: 211 / Auto-skipped: 0

jingle_SUITE:all:jingle_session_is_established_with_a_conference_room
{error,
  {{assertion_failed,assert,is_iq_result,
     {xmlel,<<"iq">>,
       [{<<"from">>,<<"*901@numbers.localhost">>},
        {<<"to">>,
         <<"alice_jingle_session_is_established_with_a_conference_room_66.218561@localhost/res1">>},
        {<<"id">>,<<"7be2f340-6903-4194-bc17-ba9c0c4e7cb1">>},
        {<<"type">>,<<"set">>}],
       [{xmlel,<<"jingle">>,
          [{<<"xmlns">>,<<"urn:xmpp:jingle:1">>},
           {<<"action">>,<<"session-info">>},
           {<<"sid">>,<<"3c137641-5685-4b8b-9d8a-60318b88afaf">>}],
          [{xmlel,<<"ringing">>,
             [{<<"xmlns">>,<<"urn:xmpp:jingle:apps:rtp:info:1">>}],
             []}]}]},
     "<iq from='*901@numbers.localhost' to='alice_jingle_session_is_established_with_a_conference_room_66.218561@localhost/res1' id='7be2f340-6903-4194-bc17-ba9c0c4e7cb1' type='set'><jingle xmlns='urn:xmpp:jingle:1' action='session-info' sid='3c137641-5685-4b8b-9d8a-60318b88afaf'><ringing xmlns='urn:xmpp:jingle:apps:rtp:info:1'/></jingle></iq>"},
   [{escalus_new_assert,assert_true,2,
      [{file,
         "/home/circleci/app/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"},
       {line,84}]},
    {jingle_SUITE,send_initiate_and_wait_for_first_iq_set,2,
      [{file,"/home/circleci/app/big_tests/tests/jingle_SUITE.erl"},
       {line,395}]},
    {jingle_SUITE,
      '-jingle_session_is_established_with_a_conference_room/1-fun-0-',1,
      [{file,"/home/circleci/app/big_tests/tests/jingle_SUITE.erl"},
       {line,1...

Report log


mssql_mnesia_24 / odbc_mssql_mnesia / c96af86
Reports root/ big
OK: 3064 / Failed: 0 / User-skipped: 211 / Auto-skipped: 0

@Premwoik Premwoik merged commit 57bf9ae into master Sep 20, 2021
@Premwoik Premwoik deleted the ct/dynamic_domains-metrics branch September 20, 2021 10:19
@Premwoik Premwoik added this to the 5.0.0 milestone Oct 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants