Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Confusing error reporting if API responds with SSL errors #1607

Closed
hoog1511 opened this issue Sep 2, 2022 · 1 comment · Fixed by #1870
Closed

[BUG] Confusing error reporting if API responds with SSL errors #1607

hoog1511 opened this issue Sep 2, 2022 · 1 comment · Fixed by #1870
Assignees
Labels
Difficulty: Intermediate Requires some experience Priority: Medium Planned for regular releases Type: Bug Errors or unexpected behavior UX: Reporting Output readability
Milestone

Comments

@hoog1511
Copy link

hoog1511 commented Sep 2, 2022

Describe the bug
with the current stable version of schemathesis i got a test result which stated "no checks are performed". After some debugging it seems this was caused due to an SSL error. I had to revert the schemathesis version to v3.12.3 and rerun the test to get a clear error response.
The current version of schemathesis does not seem to return this error message, but the older version does (v3.12.3).

example of the error message given in v3.12.3
`errors=[requests.exceptions.SSLError(urllib3.exceptions.MaxRetryError("HTTPSConnectionPool(host='abcd.nl', port=443): Max retries exceeded with url: /v1/test (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1129)')))")),

=================================== SUMMARY ====================================

No checks were performed.

JUnit XML file: /mountedDir/junit.xml

============================== 1 passed in 0.28s ===============================`

@hoog1511 hoog1511 added Status: Needs Triage Requires initial assessment to categorize and prioritize Type: Bug Errors or unexpected behavior labels Sep 2, 2022
@Stranger6667
Copy link
Member

Stranger6667 commented Nov 7, 2022

Hm, interesting. Such things should be reported. What was the exact version you used that did not report it? If the issue is still there, I'd be keen to improve the status quo by reporting it properly to the terminal output.

@Stranger6667 Stranger6667 modified the milestones: Schemathesis 3.20, 3.20, 3.21 Oct 5, 2023
@Stranger6667 Stranger6667 added UX: Reporting Output readability Priority: Medium Planned for regular releases Difficulty: Intermediate Requires some experience and removed Status: Needs Triage Requires initial assessment to categorize and prioritize labels Oct 11, 2023
@Stranger6667 Stranger6667 changed the title [BUG] no checks performed (no SSL error) [BUG] Confusing error reporting if API responds with SSL errors Oct 12, 2023
@Stranger6667 Stranger6667 modified the milestones: 3.22, 3.21 Nov 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Difficulty: Intermediate Requires some experience Priority: Medium Planned for regular releases Type: Bug Errors or unexpected behavior UX: Reporting Output readability
Projects
None yet
2 participants