version 4.1.0

This release contains several bug fixes and some new features.

Most Significant Changes

• 📜 re-added query templates (formerly known as pattern queries in IGUANA 3.x). You can specify placeholders in your query that will be filled with valid resources based on an endpoint.
• 🔲 ⏺️ 📐 Besides counting the results in SPARQL 1.1 Query Results JSON Format, IGUANA now also supports SPARQL Query Results XML Format and SPARQL 1.1 Query Results CSV and TSV Formats.
• 🧑‍⚖️ License changed from AGPL to permissive MIT & Apache 2.0 dual-licensing

What's Changed

• Fix release version substitution by @nck-mlcnv in #264
• Bump com.github.tomakehurst:wiremock-jre8-standalone from 2.35.0 to 2.35.1 by @dependabot in #262
• Fix the response body processor timeout message by @nck-mlcnv in #267
• Change licenses by @nck-mlcnv in #268
• Add XML, CSV and TSV result counting parser by @nck-mlcnv in #270
• Fix issues with queries that are bigger than 2GB by @nck-mlcnv in #274
• Add template queries by @nck-mlcnv in #273

Full Changelog: v4.0.0...v4.1.0

version 4.0.0

Version 4.0.0 is a complete rework and aims to improve the stability and accuracy of benchmark results.

Most Significant Changes

• 🚄 More consistent & reliable results By using GraalVM to precompile the binaries IGUANA shows persistent performance from the start. Before, the warmup and iterative JIT-compilation of the JVM lead to handling earlier queries slower than later queries. This could be observed in increasing triplestore performance being reported over the course of an evaluation.
• 👑 Rich result formats The results are now available in RDF and CSV making it easy to analize them the tools you prefer. Issues in the ontology were resolved.
• 😤 Even more stress By removing synchronization points between IGUANA's clients it is now able to put triplestores under even more stress when requesting with multiple clients in parallel.
• 👶🏻 Easy & hassle-free configuration The configuration was updated, unused features were removed. Configuration is now easier to understand and more stream lined.
• 🗻 Supports for large queries & responses IGUANA can handle now queries and responses that are larger than 2GB.
• 💎 Native executable For Linux, we offer now a native executable (powered by GraalVM) that works without any dependencies. Just download and run it.

Breaking Changes

As a complete rework, more or less everything changed. In particular:

• Comparison with results from previous version is not valid.
• Command-line interface changed.
• Configuration file layout changed.
• RDF Result file format changed.
• Most internal classes and APIs changed.
• Custom implementations for workers or result processors (we are not aware of any) are not supported anymore.

What's Changed

• fix accepting all 200-299 status codes on http responses by @frensing in #180
• fix encoding in post request body by @frensing in #179
• Rework query handling by @frensing in #184
• Make the testing workflow trigger on pull requests by @nck-mlcnv in #201
• fix testing workflow by @nck-mlcnv in #208
• Fix unit tests by @nck-mlcnv in #202
• Fix for #191 by @nck-mlcnv in #197
• Upgrade to Java 17 by @nck-mlcnv in #212
• Upgrade to junit 5 by @nck-mlcnv in #213
• Change repository structure by @nck-mlcnv in #215
• Add junit 5 back by @nck-mlcnv in #216
• Rework result processing by @nck-mlcnv in #219
• HTTP worker refactoring by @nck-mlcnv in #221
• Fix schema file by @nck-mlcnv in #235
• Fix performance issues by @nck-mlcnv in #241
• Apache HTTP Client 5 implementation by @nck-mlcnv in #243
• Fix request caching by @nck-mlcnv in #245
• Fix storage of completion target information in results by @nck-mlcnv in #247
• Rewrite documentation by @nck-mlcnv in #233
• Remove old docs by @nck-mlcnv in #253
• Add ResponseBodyProcessor timeout by @nck-mlcnv in #250
• Add missing dataset property to example by @nck-mlcnv in #251
• Add support for ahead-of-time compilation by @nck-mlcnv in #248
• Fix github workflow by @nck-mlcnv in #257
• Update result data format by @nck-mlcnv in #254
• Update Documentation Deployment by @nck-mlcnv in #256
• Fix start script by @nck-mlcnv in #259
• Fix example suite by @nck-mlcnv in #260

New Contributors

• @frensing made their first contribution in #180

Full Changelog: v3.3.3...v4.0.0

version 3.3.3

What's Changed

• Fix the calculation of the penalized metrics by @nck-mlcnv in #224

Full Changelog: v3.3.2...v3.3.3

version 3.3.2

What's Changed

• Fixed dev's name

Full Changelog: v3.3.1...v3.3.2

version 3.3.1

What's Changed

• Bump log4j-api from 2.13.3 to 2.17.0 in /iguana.commons by @dependabot in #152
• Bump log4j-core from 2.13.3 to 2.17.0 in /iguana.commons by @dependabot in #153
• Bump log4j-core from 2.17.0 to 2.17.1 in /iguana.commons by @dependabot in #155
• Bump log4j-api from 2.17.0 to 2.17.1 in /iguana.commons by @dependabot in #154
• Bump junit from 4.11 to 4.13.1 in /iguana.commons by @dependabot in #146
• Bump junit from 4.11 to 4.13.1 in /iguana.corecontroller by @dependabot in #144
• Bump junit from 4.11 to 4.13.1 in /iguana.resultprocessor by @dependabot in #145
• Bump jena-core from 3.16.0 to 4.2.0 in /iguana.resultprocessor by @dependabot in #148
• fixed deployment and some glitches in javadoc html by @bigerl in #171

Full Changelog: v3.3.0...v3.3.1

Iguana v3.3.0

#127 - Adding timeOutMS to the results for each worker
#139 - Adding an optional version to the Connection
#140 - Adding average Penalized QPS as a metric

Iguana v3.2.1

Fixes:

• There was a 0.5-0.7ms overhead added by IGUANA to every query execution time. This affected mainly very fast queries with +1000 QpS. All versions since IGUANA v3.2.0-rc1 are affected.
• With noOfQueryMixes sometimes some queries were executed a bit more often.

Iguana v3.2.0

• Added a lang.SIMPLE as a new language, which basically just uses contentLength as the result size and works with results >=2GB
• Minor Bug Fixes
• Fixing Bug where Iguana won't close some threads and thus won't stop.
• fixed high CPU usage (#134)
• EachQuery fixes/enhancements

Release is same as 3.2.0 RC4.

Iguana v3.2.0 RC4

• fixed high CPU usage (#134)
• removed Big BAOS
• lang.SIMPLE (Throwaway language processor, correct resultSize (content length) in results file)
• EachQuery fixes/enhancements

Iguana v3.2.0 RC1

• Added a lang.SIMPLE as a new language, which basically just uses contentLength as the result size and works with results >=2GB
• Minor Bug Fixes
• Fixing Bug where Iguana won't close some threads and thus won't stop.