Skip to content

Conversation

@mldangelo
Copy link
Member

No description provided.


```yaml
```yaml title="promptfooconfig.yaml"
# yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this change just pollutes the examples. Not sure we should do this

Comment on lines +5 to +6
prompts:
- '{{prompt}}'
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
prompts:
- '{{prompt}}'

# Conflicts:
#	examples/redteam-deepseek/README.md
#	site/docs/configuration/chat.md
#	site/docs/configuration/expected-outputs/index.md
#	site/docs/configuration/guide.md
#	site/docs/configuration/parameters.md
#	site/docs/getting-started.md
#	site/docs/guides/evaluate-rag.md
#	site/docs/guides/llama2-uncensored-benchmark-ollama.md
#	site/docs/usage/web-ui.md
#	site/docusaurus.config.js
#	site/sidebars.js
@use-tusk
Copy link
Contributor

use-tusk bot commented Jun 30, 2025

⏩ No test execution environment matched (80a6bbe) View output ↗

View output in GitHub ↗

Tip

New to Tusk? Learn more here.

View check history

Commit Status Output Created (UTC)
59ea5ee ⏩ No test execution environment matched Output Jun 30, 2025 2:43AM
b38a348 ⏩ No test execution environment matched Output Jun 30, 2025 2:54AM
56b49ca ⏩ No test execution environment matched Output Jun 30, 2025 3:21AM
80a6bbe ⏩ No test execution environment matched Output Jun 30, 2025 3:56AM

…hema comments

- Remove all merge conflict artifacts (<<<<<<< HEAD, =======, >>>>>>> main)
- Update model names to latest 2025 versions:
  * gpt-4.1-mini → o3-mini
  * gpt-4.1 → gpt-4o
  * claude-3-haiku → claude-3-7-sonnet-20250219
- Add YAML schema comments consistently across all examples
- Fix formatting and structure issues in documentation
Critical fixes:
- Fix Google Sheets redirect from /docs/configuration/datasets/google-sheets to /docs/configuration/tests/google-sheets
- Update model names to 2025 standards (claude-3-7-sonnet-20250219, o3-mini)

Content improvements:
- Trim HuggingFace guide from 516 to 399 lines (23% reduction)
- Remove specialized datasets (MMVU, Medical, Code, AgentBench, MT-Bench)
- Remove redundant math datasets (kept MATH-500 as the primary example)
- Add tip about finding additional specialized datasets
- Add YAML schema comments for IDE support

Quality improvements:
- Keep focus on most commonly used datasets (MMLU, ARC, HellaSwag, TruthfulQA, GSM8K, SQuAD)
- Maintain comprehensive examples and troubleshooting
- Preserve all core functionality while improving readability
@mldangelo mldangelo closed this Jul 5, 2025
@mldangelo mldangelo deleted the dataset-docs branch September 7, 2025 18:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants