Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Process the execution results #29

Closed
Stranger6667 opened this issue Sep 9, 2019 · 1 comment · Fixed by #120
Closed

Process the execution results #29

Stranger6667 opened this issue Sep 9, 2019 · 1 comment · Fixed by #120
Labels
Priority: High Important but not urgent
Milestone

Comments

@Stranger6667
Copy link
Member

Stranger6667 commented Sep 9, 2019

Given the list of responses / mapping case-response we need to process it and create some summary from it. We can start with a simple report:

  • Number of successful responses
  • Number of failed responses

The output could be a simple dictionary, for now, that could be formatted later into stdout text representation or to some JSON.

We need the summary to measure how many failures are there + if we will provide some additional info (e.g. on what input happened certain error), then it will help to fix the issues itself

@Stranger6667 Stranger6667 created this issue from a note in Schemathesis (To do) Sep 9, 2019
@Stranger6667 Stranger6667 added this to the CLI ready milestone Sep 9, 2019
@Stranger6667
Copy link
Member Author

Stranger6667 commented Oct 2, 2019

Currently, the execution will stop on the first failing test, but it should execute all of them.

Update. Fixed

@Stranger6667 Stranger6667 added Priority: High Important but not urgent Type: Enhancement and removed enhancement labels Oct 2, 2019
@Stranger6667 Stranger6667 modified the milestones: CLI ready, 0.9.0 Oct 4, 2019
paveldedik added a commit that referenced this issue Oct 7, 2019
paveldedik added a commit that referenced this issue Oct 8, 2019
Schemathesis automation moved this from To do to Done Oct 8, 2019
Stranger6667 pushed a commit that referenced this issue Oct 8, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Priority: High Important but not urgent
Projects
No open projects
Schemathesis
  
Done
Development

Successfully merging a pull request may close this issue.

2 participants