[dataflow-dataset] DataFlow Dataset Build Report (mixed) — 2026-10-02

[github-actions[bot]]

Summary

Built a cleaned, deduplicated dataset from GitHub discussions and PRs.

Metric	Value
Execution mode	mixed
Input records	600
After length filter	597
After alpha-ratio filter	597
Output (clean) records	597
Retention rate	99.5%
Average text length	3,116 chars
Operators used	CharNumberFilter, HashDeduplicateFilter, python_alpha_ratio_filter

DataFlow 1.0.10 handled length filtering and hash deduplication; the alpha-ratio (≥0.25) filter ran as deterministic Python (AlphaWordsFilter skipped to avoid NLTK downloads).

Records by Source

Source	Count
discussion	97
pull_request	500

Pipeline

1. Normalise discussions + PRs into unified JSONL (id, source, text, url, author, created_at)
2. CharNumberFilter (≥50 chars) + Python upper bound 100,000 chars
3. Python alpha-ratio filter (≥0.25)
4. HashDeduplicateFilter

Artifact

The upload_artifact safe-output tool was not available in this run, so dataset_clean.jsonl was not uploaded (generated at /tmp/gh-aw/agent/dataflow/output/dataset_clean.jsonl).

---

Generated by DataFlow PR & Discussion Dataset Builder — Run #36957682184 on 2026-10-02

🌊 Dataset built by DataFlow PR & Discussion Dataset Builder · copilot · auto · 29.9 AIC · ⌖ 10.9 AIC · ⊞ 15.3K · ◷

• expires on Oct 8, 2026, 6:59 PM UTC-08:00

[github-actions[bot]]

This discussion has been marked as outdated by DataFlow PR & Discussion Dataset Builder.

A newer discussion is available at Discussion #67090.