Multi-format reports

[whyoleg]

• CSV/SCSV/TEXT JMH-similar formatter for JS/Native
• possibility to select format from gradle plugin
• fixes Support CSV result format #34
• printing summary after suite execution on all platforms

[whyoleg]

@qurbonzoda Hey, can you check, if the way it's implemented will fit current state of kx.benchmark?
Also, I see, that there is a PR #32 with better K/N support, which will conflict in several places. Will it be better to rebase it just now over that branch?

There is almost no tests for any of functionality, so what is the best way to test the implementation, only publish to maven-local and use it? Or may be you can suggest me something else?

[whyoleg]

PR is ready for review.
Also, implementing of Text format, allowed to print summary of executed benchmarks after every suite (jvm/js/native/etc).

[whyoleg]

Any news on PR review?

[qurbonzoda]

There is almost no tests for any of functionality, so what is the best way to test the implementation, only publish to maven-local and use it?

There is :examples subproject containing different use cases. You can add a benchmark configuration to :examples:kotlin-multiplatform, e.g.

benchmark {
    configurations {
        ...

        csvReport {
            ...
            reportFormat = "csv"
        }
    }

Currently the project doesn't have a more comprehensive testing infrastructure to test output of a benchmark with given configuration.
But contributions are always welcome.

[qurbonzoda]

Also, I see, that there is a PR #32 with better K/N support, which will conflict in several places. Will it be better to rebase it just now over that branch?

I'm not sure about when that PR will be merged to master. Better to sit on master for now, maybe this PR will get merged first.

[whyoleg]

regarding test infra: why is the plugin being used as an included build? is it required, or can be changed to ordinary module? It will simplify gradle plugin test setup (mainly runtime classpaths resolving)
Nevermind, it should ok with included build

[qurbonzoda]

Great job!
Let's resolve the remained comments and merge it.

[whyoleg]

Currently the project doesn't have a more comprehensive testing infrastructure to test output of a benchmark with given configuration.
But contributions are always welcome.

take a look #37 :)

[qurbonzoda]

Minor: n.toLowerCase() == n is redundant. If prefix already meets p.toLowerCase() == p, and p == n, then n.toLowerCase() == n is true

[OliverO2]

@qurbonzoda Looks like an awesome step forward. Would you mind putting out a new release for this?

[qurbonzoda]

@OliverO2 We will publish a new release in the coming weeks with Kotlin 1.5.

[qurbonzoda]

@OliverO2 A new release with multiple report formats is published. The Kotlin version remains 1.4.30

[OliverO2]

@qurbonzoda Excellent! Thanks for pinging. Will try.

[OliverO2]

Can confirm that reportFormat = "csv" and reportFormat = "text" works with Kotlin version 1.4.32.