Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] st --report, generated report on app.schemathesis.io doesn't show errors #1646

Closed
robert-dzikowski opened this issue Dec 17, 2022 · 3 comments
Assignees
Labels
Component: Service SaaS service integration Priority: Medium Planned for regular releases Type: Bug Errors or unexpected behavior UX: Reporting Output readability

Comments

@robert-dzikowski
Copy link

robert-dzikowski commented Dec 17, 2022

Checklist

[x] I checked the FAQ section of the documentation
[x] I looked for similar issues in the issue tracker

Describe the bug
I run
st run -E /api/invalid https://example.schemathesis.io/openapi.json --report

It generated report at https://app.schemathesis.io/r/SPJFZ/,
but the report doesn't show any errors, despite that this run generated one error:

____________________________________________________________ POST /api/invalid _______________
InvalidSchema: Invalid type name

To Reproduce
See Describe the bug

Expected behavior
Report at https://app.schemathesis.io/r/SPJFZ/ should diplay the above error.

Environment (please complete the following information):

  • OS: Windows 10
  • Python version: 3.10.5
  • Schemathesis version: 3.17.5
  • Spec version: Open API 3.0.2
@robert-dzikowski robert-dzikowski added Status: Needs Triage Requires initial assessment to categorize and prioritize Type: Bug Errors or unexpected behavior labels Dec 17, 2022
@robert-dzikowski robert-dzikowski changed the title [BUG] cli --report doesn't show errors [BUG] cli --report doesn't show errors on the website Dec 17, 2022
@robert-dzikowski robert-dzikowski changed the title [BUG] cli --report doesn't show errors on the website [BUG] cli --report, generated report on app.schemathesis.io doesn't show errors Dec 17, 2022
@robert-dzikowski robert-dzikowski changed the title [BUG] cli --report, generated report on app.schemathesis.io doesn't show errors [BUG] st --report, generated report on app.schemathesis.io doesn't show errors Dec 17, 2022
@robert-dzikowski
Copy link
Author

I used Cmder and default Windows Command Prompt.

@Stranger6667 Stranger6667 added UX: Reporting Output readability Priority: Medium Planned for regular releases Component: Service SaaS service integration and removed Status: Needs Triage Requires initial assessment to categorize and prioritize labels Oct 11, 2023
@Stranger6667
Copy link
Member

Long overdue, but thank you for reporting this. It is indeed a problem on the service side - it skips such cases and does not store them. I have it on my TODO list

@Stranger6667
Copy link
Member

Now errors are shown there

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Component: Service SaaS service integration Priority: Medium Planned for regular releases Type: Bug Errors or unexpected behavior UX: Reporting Output readability
Projects
None yet
Development

No branches or pull requests

2 participants