-
Notifications
You must be signed in to change notification settings - Fork 46
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Schemathesis #368
Comments
+1 once we move the data from redis to postgres, because now it's slow as hell |
What are the test cases that are tested by this tool? |
Hello folks! :)
At the moment - random data, that fits the API schema + examples specified directly in the schema. The main purpose to check if the app behavior matches the schema spec even though that in practice there are many validation rules outside of the schema From the next version, it will also be random data that does NOT fit the API schema (as a separate test type) + we might add optional instrumentation to have coverage guided random data generator (a hill-climbing algorithm to maximize the number of lines hit by the test) Feel free to let us know if you need any adjustments on the Schemathesis side to fit your use case better :) Feedback is much appreciated |
@Stranger6667 thanks for the info! |
Some update: It can be used to create our tests as well:
|
And there is a episode of Test & Code podcast about property-based testing mentioning hypothesis and schemathesis. |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
I still want to take a look at it...;) |
This issue has been marked as stale because it hasn't seen any Stale issues are closed after 14 days, unless the label is removed This is done in order to ensure that open issues are still relevant. Thank you for your contribution! 🦄 🚀 🤖 (Note: issues labeled with pinned, security, bug or EPIC are |
As a side note, the generated API schema contains strings like "HTTPStatus.OK" inside of the "responses" keyword, which violates the spec. Probably in cases like this one here it should be |
@Stranger6667 thanks for trying that! @IceWreck do you want to take a look at this specific problem @Stranger6667 mentioned above? |
Thanks. Will do. |
@IceWreck thanks! |
This comment has been minimized.
This comment has been minimized.
This issue has been marked as stale because it hasn't seen any Stale issues are closed after 14 days, unless the label is removed This is done in order to ensure that open issues are still relevant. Thank you for your contribution! 🦄 🚀 🤖 (Note: issues labeled with pinned or EPIC are |
Looks like a good Xmas work..;) |
since it's been a year since this was created, is it a real expectation that someone would work on this in coming months? |
This issue has been marked as stale because it hasn't seen any Stale issues are closed after 14 days, unless the label is removed This is done in order to ensure that open issues are still relevant. Thank you for your contribution! 🦄 🚀 🤖 (Note: issues labeled with pinned or EPIC are |
I am going to be the jerk and close this one. Please reopen if anyone is planning to work on this. |
I've tried to use kiwicom/schemathesis to test our api endpoint.
https://prod.packit.dev/api/swagger.json
definition of our API and uses hypothesis to create various inputs to tests the API.The text was updated successfully, but these errors were encountered: