Releases: artilleryio/artillery
Releases · artilleryio/artillery
Artillery v2.0.26
Artillery v2.0.25
What's Changed
New features
- Stash API is now available. Stash API provides a persistent key-value store for use in your Artillery tests to share data between VUs, and offers Redis-compatible features like working with key-value pairs, lists, counters, and more. docs
Playwright
- Upgrade to Playwright v1.55.0 #3617
Fixes & Improvements
- Fix: Prioritize dependencies set via
package.jsonover automatically-detected dependencies. This fixes issues wherelatestversions of dependencies could be installed rather than those specified inpackage.json#3616 - Fix: Avoid promisifying async "function" steps. This removes Node.js warnings when when an
asyncfunction is used for afunctionstep #3552 - Fix: Use China partition-aware ARNs and principals for tests on AWS Lambda/Fargate #3618
- Routine updates to dependencies to address security reports #3612
- Remove dependency on PostHog SDK #3615
- Migrate to AWS SDK v3. This is an internal change that does not affect any user-visible functionality
Artillery v2.0.24
- Upgrade to Playwright v1.54.2 (#3593)
- Fix for Apdex scores not always shown at the end of test run (#3579)
- Fix duration and status not always being reported correctly by the Slack plugin (#3555)
- Fix for arrival phases not being distributed correctly across worker threads in TypeScript tests (#3548)
- Decrease reporting lag for large tests on Azure ACI (#3542)
- Remove outdated Lightstep integration via
lightstep-tracerlibrary. Lightstep reporting is OTel-only now. (#3575)
Contributors: @manfromanotherland @hassy
Artillery v2.0.23
What's Changed
Playwright
- Upgrade to Playwright v1.52.0 (#3523)
- Increase
maxConcurrentRecordingsfrom 3 to 5 to increase the probability of capturing traces for failed VUs (#3533) - Increase upload timeout for traces to help make sure large trace recordings are uploaded to Artillery Cloud (#3533)
Azure ACI
- Client ID and client secret must be provided via
AZURE_CLIENT_IDandAZURE_CLIENT_SECRETenvironment variables rather than CLI flags. This brings Artillery CLI in line with Azure SDK'sDefaultAzureCredentialcredential chain. (#3525) - Add support for overriding worker startup timeout via
WORKER_WAIT_TIMEOUT_SECenvironment variable (#3527) - Fix issue that caused tests comprised of a single TypeScript file to fail to run (#3528)
AWS Fargate
- Add more supported regions:
us-gov-east-1&us-gov-east-2(AWS GovCloud),il-central-1(Israel),cn-north-1&cn-northwest-1(China) (#3522) - Add support for overriding worker startup timeout via
WORKER_WAIT_TIMEOUT_SECenvironment variable (#3527) - Fix issue with
--task-role-nameflag not being taken into account (#3469) - Fix issue that caused tests comprised of a single TypeScript file to fail to run (#3528)
- Fix issue that could lead to metric reports from workers to be processed with a lag in large tests (#3472)
Other improvements & fixes
- Improve layout of Slack test summaries posted by the
slackplugin (#3499) - Fix issue in tests written in TypeScript that led to the generated load being higher than expected (#3495)
New Contributors
- @aryasaatvik made their first contribution in #3469
- @manfromanotherland made their first contribution in #3499
Artillery v2.0.22
Highlights
- Add support for writing Artillery scripts in TypeScript (#3436 #3439). - Hello World example.
- The
reportcommand has ben removed. As an alternative consider setting up Artillery Cloud for visualizing test metrics, or setting up an OpenTelemetry integration with an external monitoring system with thepublish-metricsplugin. (#3431) - Node.js v22.13.0 (current active LTS) is the recommended version of Node.js for running Artillery now
- Artillery's official Docker image (https://hub.docker.com/r/artilleryio/artillery) includes Chromium for Playwright now (#3449 #3445)
- The Docker image is now based on Debian rather than Alpine (#3449)
- Upgrade to Playwright v1.49.1 (#3427)
Fixes & improvements
- Fix issue where
config.targetcould not be set to the value of a remote environment variable (#3430) - Fix issues that led to more tasks being launched on Fargate than requested in scenarios where Fargate is temporarily out of capacity (#3432)
- Make sure that stopping Playwright tracing is failsafe (#3443)
- Routine dependency upgrades
with thanks to @dirkluijk @andrewvc
Artillery v2.0.21
Core
- Add
--env-fileflag as an alternative for--dotenvflag. This makes it consistent with the Node.js--env-fileflag. The--dotenvflag will be deprecated in a future release (#3376) - Add tracking of response times by HTTP status code. A new set of metrics (e.g.
http.response_time.2xxorhttp.response_time.5xx) is now reported to provide more granular view of response times in a test (#3326) - Fix an issue that caused incorrect "multiple batches of metics" warnings when running tests with
pausephases (#3331)
Playwright
- Upgrade Playwright to v1.48.0
Azure
- Fix: Make values loaded from an env file with
--dotenv/--env-fileflag available to workers containers (rather than just the Artillery process running inside the worker) (#3376) - Stagger startup of containers in large load tests to prevent rate limit errors from Azure services (#3371)
OpenTelemetry
- Add support for setting resource-level attributes (#3335)
Artillery Cloud
- Send CI related information to Artillery Cloud. This makes the following information available in Artillery Cloud:
- Whether a test run was triggered in CI or not, and which CI service was used
- For tests triggered in GitHub Actions - provide a link back to the job run on GitHub Actions
Dependencies
- Upgrade
json-plusto address a critical security vulnerability (#3369)
With contributions from @hassy @Archangelza1 @dirkluijk
Artillery v2.0.20
Core & CLI
- New: add ability to set a custom content type for
multipart/form-dataform fields (#3316) — docs - Fix: don't print an unnecessary warning when
loadAllis not set by @hassy in (#3303) - Remove legacy Artillery Pro integration (#3320)
Artillery Cloud
- New: add
--nameoption to set the name of the test to be shown in Artillery Cloud dashboard (#3317) — docs - Improve pre-flight checks when recording reports to Artillery Cloud to detect potential firewall/proxy issues (#3314)
- Fix: include organization IDs in the test report URLs
Azure
- Fix: bundle separate config files provided with
--configoption correctly (#3312) - Fix: bundle dotenv files provided with
--dotenvcorrectly (#3313) - Fix: bundle custom
.npmrcand other dotfiles correctly (#3312) - Improve error handling and reporting for container provisioning errors (#3313)
Artillery v2.0.19
CLI
- Fix bug preventing custom code using ES modules from loading on Windows (#2662)
- Prevent setting individual CSV rows in context when using
loadAll(#3277)
Fargate
- Add ability to set DNS servers using the
--container-dns-serversflag when running on ECS/EC2 (#3301) - Add ability to override the ephemeral storage amount for each task via the
--task-ephemeral-storageflag (#3301)
Playwright
- Upgrade Playwright to v1.45.3 (#3294)
With contributions from @bernardobridge, @hassy and @thrandale
Artillery v2.0.18
Artillery v2.0.17
HTTP
Playwright
- Upgrade Playwright to v1.45.0 (#3245)
With contributions from @bernardobridge @InesNi