Report portal don't work correctly with library robotframework 3.1 and higher

[kingages]

Describe the bug
Hi,
I'm using ReportPoratl but I've write simple robotframework tests as example for this issue I have.

*** Settings ***
Library  SeleniumLibrary

Test Teardown  Close browser

*** Test Cases ***
Open google and fill search pass
    Open browser  http://www.seznam.cz  chrome
    Page should contain element  //*[@class="szn-input-with-suggest-list search-form__input input input--hp-search"]



Open google and fill search fail
    Open browser  http://www.seznam.cz  chrome
    Page should contain element  //*[@class="szn-input-with-suggest-list search-form__input input input--hp-search xcxccxxxc"]

First test is passing and second failing but in ReportPortal are both passed.

https://user-images.githubusercontent.com/26042586/62728078-263e2100-ba1b-11e9-9fcc-71ececcfd30e.png

If I open test that should fail I see this:
https://user-images.githubusercontent.com/26042586/62728168-600f2780-ba1b-11e9-8677-d503f9422192.png

But when I open failed step I see this:

https://user-images.githubusercontent.com/26042586/62728247-96e53d80-ba1b-11e9-879b-ef8fa0dc772c.png
Witch is good because it took screenshot but test case have to be failed.

> robot --listener robotframework_reportportal.listener --variable RP_UUID:0fe489c7-7598-4uo7-9uaf-460049jkd54f --variable RP_ENDPOINT:http://localhost:8080 --variable RP_LAUNCH:RF_Test_Run --variable RP_PROJECT:smart testReportPortal.robot 
> ==============================================================================
> testReportPortal                                                              
> ==============================================================================
> Open google and fill search pass                                      | PASS |
> ------------------------------------------------------------------------------
> Open google and fill search fail                                      | FAIL |
> Page should have contained element '//*[@class="szn-input-with-suggest-list search-form__input input input--hp-search xcxccxxxc"]' but did not.
> ------------------------------------------------------------------------------
> testReportPortal                                                      | FAIL |
> 2 critical tests, 1 passed, 1 failed
> 2 tests total, 1 passed, 1 failed
> ==============================================================================
> 

Expected behavior
Test cases will be failed. ReportPortal will correctly represents results of RF. Issue is in robotframework-seleniumlibrary library 3.1 and higher.

For 3.0.0 it works good but we need to use higher version.

Screenshots

Versions:
I use libraries.

robotframework 3.1.2
robotframework-appiumlibrary 1.5.0.4
robotframework-databaselibrary 1.2.4
robotframework-reportportal 3.0.0
robotframework-reportportal-ng 1.0.4.9
robotframework-seleniumlibrary 3.3.1

[DzmitryHumianiuk]

@abotalov can you take a look?

[abotalov]

@DzmitryHumianiuk I'm responsible for a Ruby client. This is related to a Python one.

[kingages]

So may I ask you what does it mean? It won't be fixed?

[DzmitryHumianiuk]

@kingages it will be fixed.
we need to find python contributor for this

[iivanou]

@kingages Let's clarify one moment as the first step. You are saying that robotframework-reportportal version 3.0.0 reports test results correctly and robotframework-reportportal version 3.1.0 does not? Is that correct?

[kingages]

@kingages Let's clarify one moment as the first step. You are saying that robotframework-reportportal version 3.0.0 reports test results correctly and robotframework-reportportal version 3.1.0 does not? Is that correct?

Yes, that’s right but it’s old issue.

[iivanou]

@kingages is that still actual?

[kingages]

I’ve not had a chance to try it yet with the newest RF version or reportportal. I can try to verify when I get a chance.

[kingages]

I've tried it with latest version and it is fixed.