Skip to content

feat(config): support engine type in eval config#10

Merged
jwx0925 merged 4 commits into
mainfrom
docs/simplify-quickstart-install
May 15, 2026
Merged

feat(config): support engine type in eval config#10
jwx0925 merged 4 commits into
mainfrom
docs/simplify-quickstart-install

Conversation

@jwx0925
Copy link
Copy Markdown
Collaborator

@jwx0925 jwx0925 commented May 15, 2026

Summary

  • add a release-binary install script and update installation docs
  • simplify Quick Start examples and remove README project structure sections
  • add engine.type support while keeping engine.name backward compatible
  • add README context on how skill-up operationalizes the official Agent Skills evaluation workflow

Tests

  • bash -n install.sh
  • env -u ANTHROPIC_BASE_URL make test
  • env -u ANTHROPIC_BASE_URL make verify

@jwx0925 jwx0925 requested review from lbfsc and zpzjzj May 15, 2026 01:48
@zpzjzj
Copy link
Copy Markdown
Collaborator

zpzjzj commented May 15, 2026

The eval.yaml under examples/ and e2e/ may also need rename from name to type

Copy link
Copy Markdown
Collaborator

@lbfsc lbfsc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes to the installation method and the streamlined documentation are excellent. However, too many new design elements were added, which does not align with expectations. Currently, the Name field better meets the design requirements.

Comment thread docs/guide/getting-started.md
Comment thread docs/guide/getting-started.md Outdated
Comment thread docs/guide/getting-started.md
Comment thread docs/guide/writing-evals.md
Comment thread internal/cli/run.go Outdated
Copy link
Copy Markdown
Collaborator

@lbfsc lbfsc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jwx0925 jwx0925 merged commit 939890a into main May 15, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants