Skip to content

feat(issues): add examples propose subcommand [LSEN-119]#136

Merged
Andy Young (ayoung19) merged 1 commit into
mainfrom
feat/issues-propose-example
May 23, 2026
Merged

feat(issues): add examples propose subcommand [LSEN-119]#136
Andy Young (ayoung19) merged 1 commit into
mainfrom
feat/issues-propose-example

Conversation

@Palashio
Copy link
Copy Markdown
Contributor

Summary

Adds langsmith project issues examples propose <issue-id> — a CLI command that proposes a run as a regression example for an issue by calling POST /v1/platform/issues/{issue_id}/proposed-examples.

This mirrors the propose_regression_example tool from smith-issues-agent, making the same operation available to users and automation scripts outside the agent context.

Usage:

langsmith project issues examples propose <issue-id> \
  --run-id <run-id> \
  --assertion correctness="Response must cite sources" \
  --assertion format="Output must be valid JSON"

Each --assertion flag takes a key=comment pair. Client-side validation enforces:

  • At least one assertion required
  • At most 10 assertions
  • Unique non-empty keys
  • Non-empty comments

The body sent to the API is {"run_id": "...", "assertions": [{"key": "...", "comment": "..."}, ...]}.

Test Plan

  • 6 unit tests added in issues_test.go: command structure, flag presence, parseAssertion valid/invalid cases
  • go test ./internal/cmd/ passes (full suite)
  • go build ./... succeeds

Release Note

none

Adds `langsmith project issues examples propose <issue-id>` which calls
POST /v1/platform/issues/{issue_id}/proposed-examples, mirroring the
propose_regression_example tool from smith-issues-agent.

Co-Authored-By: Palash Shah <palash@langchain.dev>
@Palashio Palash Shah (Palashio) changed the title feat(issues): add examples propose subcommand feat(issues): add examples propose subcommand [LSEN-119] May 20, 2026
@ayoung19 Andy Young (ayoung19) merged commit 9571063 into main May 23, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants