[ K6 Generator ] Support for extracting examples defined at parameter level of Swagger/OpenAPI specification, plus minor fixes #9750

ideas-into-software · 2021-06-11T13:19:11Z

This addresses: #8378

Overview

If the Swagger/OpenAPI specification used as the input spec contains examples at parameter level, those will be extracted and utilized as parameter values.

The handleParamValue custom Mustache lambda, registered for use in the K6 script.mustache template, handles the conditional checks, formatting, and outputting of parameter values.

If a given parameter has value specified – either in example or examples field, defined at the parameter level – that value will be used.

For list (examples), entire list will be output in the generated script and the first element from that list will be assigned as parameter value.

If a given parameter does not have an example defined, a placeholder value with TODO_EDIT_THE_ prefix will be generated for that parameter, and you will have to assign a value before you can run the script.

In other words, you can now generate K6 test scripts which are ready to run, provided the Swagger/OpenAPI specification used as the input spec contains examples for all of the path/query parameters; see modules/openapi-generator/src/test/resources/3_0/examples.yaml for an example of such specification, and https://swagger.io/docs/specification/adding-examples/ for more information about adding examples.

Thanks to these enhancements, OpenAPI / Swagger spec can be utilized as the single source of truth for automated test generation, including extracting of test data from examples embedded in spec.

Data entered once can then be re-used by OpenAPI code generation tools such as the K6 OpenAPI generator. This allows for full round-trip flow and ensures REST API tests are always up to date.

Generate script based on Swagger/OpenAPI specification with examples

Generate script based on the modules/openapi-generator/src/test/resources/3_0/examples.yaml spec:

$ ./mvnw clean install

$ java -jar modules/openapi-generator-cli/target/openapi-generator-cli.jar generate \
  -i modules/openapi-generator/src/test/resources/3_0/examples.yaml \
  -g k6 \
  -o /var/tmp/k6_examples \
  --skip-validate-spec

Minor fixes

Aside from the above mentioned enhancements, following minor fixes were applied:

LoggerFactory.getLogger – logger named after K6ClientCodegen.class, instead of JavascriptClientCodegen.class
Inside org.openapitools.codegen.languages.K6ClientCodegen.preprocessOpenAPI(OpenAPI) method, List<CodegenParameter> formParameters instead of List<CodegenParameter> formParameteres
modules/openapi-generator/src/test/resources/3_0/examples.yaml – fixed problems which caused errors when using as input spec

PR checklist

Read the contribution guidelines.
Pull Request title clearly describes the work in the pull request and Pull Request description provides details about how to validate the work. Missing information here may result in delayed response from the community.
Run the following to build the project and update samples:
```
./mvnw clean package 
./bin/generate-samples.sh
./bin/utils/export_docs_generators.sh
```
Commit all changed files.
This is important, as CI jobs will verify all generator outputs of your HEAD commit as it would merge with master.
These must match the expectations made by your contribution.
You may regenerate an individual generator by passing the relevant config(s) as an argument to the script, for example ./bin/generate-samples.sh bin/configs/java*.
For Windows users, please run the script in Git BASH.
File the PR against the correct branch: master, 5.1.x, 6.0.x
If your PR is targeting a particular programming language, @mention the technical committee members, so they are more likely to review the pull request.

PR checklist: update samples

wing328 · 2021-06-13T02:28:15Z

@ideas-into-software thanks for the PR

cc @mostafa

mostafa

Thanks @ideas-into-software for the PR and well done! I just left a few comments.

mostafa · 2021-06-16T08:29:05Z

modules/openapi-generator/src/main/resources/k6/script.mustache

@@ -16,7 +16,7 @@ export default function() {
    {{#requestGroups}}
    group("{{{groupName}}}", () => {
        {{#variables}}
-        let {{{key}}} = "TODO_EDIT_THE_{{{value}}}";
+		let {{{key}}} = {{#lambda.handleParamValue}}{{value}}{{/lambda.handleParamValue}}


I think this doesn't need the extra indentation.

mostafa · 2021-06-16T08:29:48Z

samples/client/petstore/k6/script.js

@@ -39,7 +39,7 @@ export default function() {
        sleep(SLEEP_DURATION);
    });
    group("/pet/findByStatus", () => {
-        let status = "TODO_EDIT_THE_STATUS";
+		let status = 'TODO_EDIT_THE_STATUS'; // specify value as there is no example value for this parameter in OpenAPI spec


The extra indentation in the template is reflected here, which I think is unnecessary.

mostafa · 2021-06-16T08:31:52Z

samples/client/petstore/k6/script.js

+		let password = 'TODO_EDIT_THE_PASSWORD'; // specify value as there is no example value for this parameter in OpenAPI spec
+		let username = 'TODO_EDIT_THE_USERNAME'; // specify value as there is no example value for this parameter in OpenAPI spec


Correct me if I'm wrong, but I expect these values to be filled with examples? Or is it another example script altogether? If so, please regenerate that example alongside this one.

Hi

Thank you for the feedback. My IDE does not understand mustache (yet), so apologies for the indentation problems; I’ll fix it ASAP.

Regarding the samples/client/petstore/k6/script.js, please keep in mind samples are generated based on whatever is defined in the config, and for K6 generator, the config file https://github.com/OpenAPITools/openapi-generator/blob/master/bin/configs/other/k6.yaml uses modules/openapi-generator/src/test/resources/2_0/petstore.yaml as the input spec; unfortunately, that OpenAPI spec (modules/openapi-generator/src/test/resources/2_0/petstore.yaml) does not have any examples, and since it’s used by many other generators I did not want to introduce any changes in such place; this is also the reason why in the docs for this PR I provided example (“Generate script based on Swagger/OpenAPI specification with examples”) based on modules/openapi-generator/src/test/resources/3_0/examples.yaml.

Whether modules/openapi-generator/src/test/resources/2_0/petstore.yaml itself should be updated with examples – perhaps that’s a good question to ask the OpenAPI maintainers?

@wing328 Any comments?

modules/openapi-generator/src/test/resources/2_0/petstore.yaml

We usually keep it as it's and create a new one based on it with more edge cases per generator.

Fixed indentation

wing328 · 2021-08-22T08:02:43Z

I'll merge this into master and replace all tabs with 4 spaces in the java files.

ideas-into-software · 2021-08-22T10:29:18Z

I'll merge this into master and replace all tabs with 4 spaces in the java files.

@wing328 Hi. I already made the requested changes (i.e. formatting) ~ 2 months ago; please see commit from June 17: c32657a

wing328 · 2021-08-22T14:29:30Z

Please have a look at f7bc2aa that I made in the master.

ideas-into-software added 2 commits June 11, 2021 11:33

K6 Generator - Support for extracting parameter examples & minor fixes

bf6b218

K6 Generator - Support for extracting parameter examples & minor fixes

5ea2dd0

PR checklist: update samples

ideas-into-software mentioned this pull request Jun 11, 2021

[REQ] K6 generator - Use openapi examples values as query parameters & body values #8378

Open

wing328 added Client: k6 Enhancement: General Issue: Bug labels Jun 15, 2021

mostafa suggested changes Jun 16, 2021

View reviewed changes

K6 Generator - Support for extracting parameter examples & minor fixes

c32657a

Fixed indentation

wing328 merged commit 6844737 into OpenAPITools:master Aug 22, 2021

ideas-into-software mentioned this pull request Oct 17, 2021

[ K6 Generator ] Further K6 OpenAPI generator enhancements (request body example data extraction, support for generating scenario tests and load tests out of the box, and much more) #10614

Closed

5 tasks

wing328 added this to the 5.3.0 milestone Oct 23, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[ K6 Generator ] Support for extracting examples defined at parameter level of Swagger/OpenAPI specification, plus minor fixes #9750

[ K6 Generator ] Support for extracting examples defined at parameter level of Swagger/OpenAPI specification, plus minor fixes #9750

ideas-into-software commented Jun 11, 2021

wing328 commented Jun 13, 2021

mostafa left a comment

mostafa Jun 16, 2021

mostafa Jun 16, 2021

mostafa Jun 16, 2021

ideas-into-software Jun 16, 2021

mostafa Jun 16, 2021

wing328 Aug 22, 2021

wing328 commented Aug 22, 2021

ideas-into-software commented Aug 22, 2021

wing328 commented Aug 22, 2021

		let password = 'TODO_EDIT_THE_PASSWORD'; // specify value as there is no example value for this parameter in OpenAPI spec
		let username = 'TODO_EDIT_THE_USERNAME'; // specify value as there is no example value for this parameter in OpenAPI spec

[ K6 Generator ] Support for extracting examples defined at parameter level of Swagger/OpenAPI specification, plus minor fixes #9750

[ K6 Generator ] Support for extracting examples defined at parameter level of Swagger/OpenAPI specification, plus minor fixes #9750

Conversation

ideas-into-software commented Jun 11, 2021

Overview

Generate script based on Swagger/OpenAPI specification with examples

Minor fixes

PR checklist

wing328 commented Jun 13, 2021

mostafa left a comment

Choose a reason for hiding this comment

mostafa Jun 16, 2021

Choose a reason for hiding this comment

mostafa Jun 16, 2021

Choose a reason for hiding this comment

mostafa Jun 16, 2021

Choose a reason for hiding this comment

ideas-into-software Jun 16, 2021

Choose a reason for hiding this comment

mostafa Jun 16, 2021

Choose a reason for hiding this comment

wing328 Aug 22, 2021

Choose a reason for hiding this comment

wing328 commented Aug 22, 2021

ideas-into-software commented Aug 22, 2021

wing328 commented Aug 22, 2021