Skip to content

Report states no files has been generated, although they are present #266

@GregOnNet

Description

@GregOnNet

Hi,

after running an evaluation the report states that no sufficient files have been generated

Image

If I have a look at the screenshot in the report or on the workspace/llm-output-directories, I see generated files.

Image

I tried with these models

  • gemini-2.5-flash
  • gemini-2.5-flash-lite
  • claude-sonnet-4.5-no-thinking
  • gpt-5.1-thinkin-low

Reproduction

export GEMENI_API_KEY="..." && web-codegen-scorer eval --env=./config.mjs --model gemini-2.5-flash --prompt-filter=goal-tracker

The configuration can be found here: https://github.com/GregOnNet/web-codegen-scorer-playground

I am glad to give more information, if needed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions