Skip to content

docs: add evaluation instructions to README#3

Merged
Vishu26 merged 5 commits intomainfrom
copilot/update-readme-evaluation-scripts
Apr 27, 2026
Merged

docs: add evaluation instructions to README#3
Vishu26 merged 5 commits intomainfrom
copilot/update-readme-evaluation-scripts

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 27, 2026

  • Understand existing evaluation code in rcme/eval/order_metrics.py
  • Fix model path inconsistency in order_metrics.py (Srikumar26MVRL)
  • Update README.md ## ✅ Evaluation section with full documentation
  • Fix CI failure: update actions/setup-python@v1@v5 and python-version: 3.12.11"3.12" to resolve "Version 3.12.11 with arch x64 not found"

Copilot AI linked an issue Apr 27, 2026 that may be closed by this pull request
…der_metrics.py

Agent-Logs-Url: https://github.com/mvrl/RCME/sessions/d4b545b4-f691-46fd-84ef-2071b7acc49c

Co-authored-by: jacobsn <984784+jacobsn@users.noreply.github.com>
Copilot AI changed the title [WIP] Update README to include evaluation scripts instructions docs: add evaluation instructions to README Apr 27, 2026
Copilot AI requested a review from jacobsn April 27, 2026 21:25
@jacobsn jacobsn marked this pull request as ready for review April 27, 2026 21:43
@jacobsn jacobsn requested review from Vishu26 and removed request for jacobsn April 27, 2026 21:43
@jacobsn
Copy link
Copy Markdown
Member

jacobsn commented Apr 27, 2026

@copilot fix "Error: Version 3.12.11 with arch x64 not found"

Copy link
Copy Markdown
Contributor Author

Copilot AI commented Apr 27, 2026

@copilot fix "Error: Version 3.12.11 with arch x64 not found"

Fixed in 4856ab2. The issue was actions/setup-python@v1 with python-version: 3.12.11 — that exact patch wasn't available on the runner. Updated to actions/setup-python@v5 and python-version: "3.12" (no patch pin).

@jacobsn
Copy link
Copy Markdown
Member

jacobsn commented Apr 27, 2026

@Vishu26 I'm trying to address #2 with copilot. would love for you to verify. one of us can merge when it's ready.

Copilot AI requested a review from jacobsn April 27, 2026 21:46
Removed example output from the README.
Copy link
Copy Markdown
Member

@Vishu26 Vishu26 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just removed the example output. The metrics shown in the example are not correct. Otherwise fine.

@Vishu26 Vishu26 merged commit 220487d into main Apr 27, 2026
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

The scripts and documenta

3 participants