Skip to content

feat: implement config validate/show and dataset validate/describe#60

Merged
placerda merged 1 commit into
feature/browse-commandsfrom
feature/validation-commands
Apr 13, 2026
Merged

feat: implement config validate/show and dataset validate/describe#60
placerda merged 1 commit into
feature/browse-commandsfrom
feature/validation-commands

Conversation

@Dongbumlee
Copy link
Copy Markdown
Collaborator

Summary

Implements 4 validation/inspection commands (Tier 2), building on PR #59:

  • agentops config validate — full chain validation: run.yaml → bundle → dataset → JSONL
  • agentops config show — display resolved configuration with merged paths
  • agentops dataset validate — validate dataset YAML + JSONL row-by-row
  • agentops dataset describe — show dataset stats (name, fields, rows, metadata)

Architecture

  • services/_workspace.py — shared workspace resolution (extracted from browse.py)
  • services/validate.py — validation + inspection service layer
  • Follows the same pattern as browse.py: dataclass results, thin CLI handlers

Key Features

  • config validate checks: YAML syntax, Pydantic schema, file references resolve, threshold evaluator names match evaluator names, JSONL rows have required fields
  • config show resolves: paths, backend config, evaluator list, data row counts
  • dataset validate checks: dataset YAML schema, JSONL exists, each row is valid JSON with required fields
  • dataset describe shows: name, format, input/expected/context fields, row count, all unique fields across rows

Testing

  • 19 new unit tests (service + CLI) — all pass
  • 115 total tests pass
  • Smoke-tested against live workspace

Depends On

This PR targets feature/browse-commands (PR #59). Merge #59 first, then rebase this onto develop.

- Add services/_workspace.py — shared workspace resolution
- Add services/validate.py — validation and inspection service
- config validate: full chain validation (run.yaml → bundle → dataset → JSONL)
- config show: resolved configuration view with merged paths
- dataset validate: standalone dataset + JSONL validation
- dataset describe: dataset stats (rows, fields, schema)
- 19 unit tests in test_validate.py
- Refactor browse.py to use shared resolve_workspace
@placerda placerda merged commit d27cb93 into feature/browse-commands Apr 13, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants