Skip to content

test: make Proof Pack runnable (harness pipeline tests)#33

Closed
mlik-sudo wants to merge 12 commits into
mainfrom
chore/proof-pack-tests
Closed

test: make Proof Pack runnable (harness pipeline tests)#33
mlik-sudo wants to merge 12 commits into
mainfrom
chore/proof-pack-tests

Conversation

@mlik-sudo

Copy link
Copy Markdown
Owner

Summary

  • Adds an end-to-end pytest that exercises the benchmark harness pipeline: run → aggregate → guard → badge.
  • Makes harness scripts configurable via env vars so tests/CI can write into temp dirs:
    • BENCH_RESULTS_JSONL
    • BENCH_METRICS_DIR
    • BENCH_SUMMARY_JSON
    • BENCH_BADGES_DIR

Why

This turns the "Proof Pack" from a purely narrative requirement into a runnable, CI-verifiable pipeline, even before application code exists.

@mlik-sudo

Copy link
Copy Markdown
Owner Author

J’ai poussé des commits supplémentaires pour faire passer les checks qui échouaient :

  • link-check: ajout de .lychee.toml + exclusion des liens ../../actions/workflows/* (routes GitHub, pas des fichiers) + exclusion de archive/.
  • pre-commit: suppression du content_b64 par défaut (base64 high-entropy) dans .github/workflows/apply-patch.yml.
  • Bootstrap Proof Pack: ajout de scripts/proof.sh, scripts/run-tests.sh, benchmarks/compare.sh, benchmarks/results/.gitkeep.
  • Sécurité: hub/tools/dispatch.py n’utilise plus shell=True.

Ces commits sont sur la branche chore/proof-pack-tests, donc intégrés à cette PR.

@mlik-sudo

Copy link
Copy Markdown
Owner Author

Nouveau commit pour fiabiliser les 2 checks restants :

  • link-check: .lychee.toml exclut aussi https://console.cloud.google.com/* (lien auth-only, souvent bloqué en CI).
  • pre-commit: .gitkeep contient désormais # keep (évite que end-of-file-fixer touche des fichiers vides).

Commit HEAD: c1d5f1f.

@mlik-sudo

Copy link
Copy Markdown
Owner Author

Nouveau commit pour corriger link-check:

  • .lychee.toml: suppression de verbose = true (source du parse error) + config minimale.
  • .github/workflows/link-check.yml: passage aux flags CLI explicites (pas de --config), avec exclusions ../../actions/workflows/*, https://console.cloud.google.com/* et archive/.

Commit HEAD: 2397aba.

Removed broken workflow badge links that were causing link-check failures:
- secret-scan.yml badge
- link-check.yml badge
Fixed broken MCP Server Gmail link causing link-check failure.

Changed from:
- https://github.com/anthropics/mcp-servers (404)

To:
- https://github.com/modelcontextprotocol/servers (correct repo)
@mlik-sudo

Copy link
Copy Markdown
Owner Author

J’ai committé le fix end-of-file-fixer mentionné : ajout du newline final dans project-space/a2a/router/README.md.

Commit HEAD: b3fbd71 (relance aussi le workflow pre-commit).

@mlik-sudo

Copy link
Copy Markdown
Owner Author

Fix appliqué : section ## 🔗 Liens Utiles dans docs/GMAIL-SETUP.md (ajout du saut de ligne entre les 2 liens, + liste en bullets correcte).

Commit HEAD: 9e7ac18.

mlik-sudo and others added 2 commits December 15, 2025 12:57
Resolves merge conflict with main by:
- Restoring CI badges with absolute URLs (fixes link-check)
- Adding missing opening ``` for ASCII art block

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
mlik-sudo added a commit that referenced this pull request Dec 15, 2025
- Adds end-to-end pytest for benchmark harness pipeline
- Makes harness scripts configurable via env vars
- Adds proof-pack.yml workflow
- Adds .lychee.toml config
- Adds benchmarks/compare.sh script
- Adds scripts/proof.sh and scripts/run-tests.sh

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@mlik-sudo mlik-sudo closed this Dec 15, 2025
@mlik-sudo

Copy link
Copy Markdown
Owner Author

✅ Merged manually

Les changements de cette PR ont été intégrés manuellement sur main via commit 00750758314f81a81b14fb06965927c529c8e59c pour résoudre les conflits de merge.

Fichiers intégrés:

  • .github/workflows/proof-pack.yml
  • .lychee.toml
  • benchmarks/compare.sh
  • benchmarks/results/.gitkeep
  • scripts/proof.sh
  • scripts/run-tests.sh
  • tests/unit/test_proof_pack_harness_pipeline.py
  • project-space/benchmarks/harness/aggregate_metrics.py
  • project-space/benchmarks/harness/make_badges.py
  • project-space/benchmarks/harness/regression_guard.py

🤖 Generated with Claude Code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant