Add Arker to the sandbox benchmarks - #271
Merged
Merged
Conversation
Contributor License AgreementAll contributors are covered by a CLA. |
![devin-ai-integration[bot]](https://avatars.githubusercontent.com/in/811515?s=60&v=4){kind=small}
Forks `ubuntu-small` for the regular benchmark; dax overrides it to `ubuntu-full-8` via DAX_RESOURCE_OPTIONS for the standardized 8 vCPU / 16 GiB profile. Arker selects hardware via `platforms` on the provider factory rather than a sandbox.create() option, so like lightning's instanceType it is set from the dax workflow env (ARKER_PLATFORMS=graviton4); elsewhere the platform is automatic. The runner skips a provider whose requiredEnvVars are unset, so this is inert until the ARKER_API_KEY secret is added. Measured against production: regular ubuntu-small 1 vCPU / 397572 kB TTI 413 ms dax ubuntu-full-8 8 vCPU / 16607368 kB 57.8 s, 8/8 phases parsed Needs @computesdk/arker >= 0.1.2; 0.1.1's runCommand throws against the current @arker-ai/sdk. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Tpwz2hqd4mnWU5AF5P9TpD
aatishparson-arker
force-pushed
the
add-arker-provider
branch
from
July 31, 2026 23:06
a42ed2d to
9c08ccf
Compare
Contributor
Storage Benchmark Results1MB Files
View full run · SVGs available as build artifacts |
Contributor
Snapshot/Fork Benchmark Resultssmall dataset
|
Contributor
Browser Benchmark Results
View full run · SVG available as build artifact |
Contributor
Sandbox Benchmark ResultsSequential
Staggered
Burst
View full run · SVGs available as build artifacts |
Contributor
Browser Throughput Benchmark Results
View full run · SVG available as build artifact |
Contributor
Sandbox Dax Benchmark Results
|
Contributor
AI Gateway Benchmark Results
View full run · SVG available as a build artifact |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds Arker to the sandbox benchmarks.
Forks
ubuntu-smallfor the TTI benchmark; dax overrides it toubuntu-full-8viaDAX_RESOURCE_OPTIONSfor the standardized 8 vCPU / 16 GiB profile.Arker selects hardware via
platformson the provider factory rather than asandbox.create()option, so — like lightning'sinstanceType— it is set from the dax workflow env (ARKER_PLATFORMS=graviton4); elsewhere the platform is chosen automatically.The runner skips a provider whose
requiredEnvVarsare unset, so this stays inert until anARKER_API_KEYsecret is added. The key is read throughload-vault-secrets.shlike every other provider's.Requires
@computesdk/arker>= 0.1.2 (now published) — 0.1.1'srunCommandthrew against the current@arker-ai/sdk. Fixed in computesdk/computesdk#683.Measured against production, driven from us-east-1:
ubuntu-smallubuntu-full-8Notes for reviewers
create({ snapshotId })branches an existing VM by id;create({ templateId })forks a golden by name.