Skip to content

[Examples][CI] Ensure functionality of examples #518

@chr-hertel

Description

@chr-hertel

Currently the examples are only executed locally, which leads to them being broken and needing fix-ups once in a while - but that's what we have pipelines for :)

There are a few challenges here tho:

  • the examples focus on simple executable code snippets instead of PHPUnit test cases
  • A ton of secrets for paid services is needed, so we need to be careful how often we execute them - due to rate limits and costs
  • Some of them are flaky, especially HuggingFace (unavailable models) and Anthropic (blocking parallel requests)

Is there a solution, that would still enable us to leverage the examples as part of our pipeline?

Sub-issues

Metadata

Metadata

Assignees

No one assigned

    Labels

    Hackathon 2025This issue or pull request was part of the Symfony AI Hackathon 2025RFCRFC = Request For Comments (proposals about features that you want to be discussed)Run examplesIssues & PRs about the example scripts

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions