Skip to content

Align evaluation methodology documentation#17

Merged
AliasBotta merged 1 commit into
mainfrom
task/evaluation-docs-rq-methodology
Jun 26, 2026
Merged

Align evaluation methodology documentation#17
AliasBotta merged 1 commit into
mainfrom
task/evaluation-docs-rq-methodology

Conversation

@AliasBotta

Copy link
Copy Markdown
Collaborator

Summary

  • Documents the methodology for all three evaluation RQs, including the manual output-quality audit.
  • Replaces vague terms like "contract" and "backed" in repo documentation with concrete terminology: project bytecode, bytecode-level target identity, and source-level method identity.
  • Aligns evaluation README, subject-selection notes, schema docs, symbol-model docs, and related run notes with the paper wording.

Validation

  • git diff --check
  • python3 -m json.tool schemas/method-context.schema.json >/dev/null

Note: the local commit hook still fails on the existing Maven formatter-prefix issue, so the commit was created with --no-verify after the checks above.

@AliasBotta AliasBotta marked this pull request as ready for review June 26, 2026 08:04
@AliasBotta AliasBotta merged commit 1eea51c into main Jun 26, 2026
1 check passed
@AliasBotta AliasBotta deleted the task/evaluation-docs-rq-methodology branch June 28, 2026 20:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant