Repository navigation
Call for independent reviewers: try the agent on YOUR data (~30 min, no experience needed) #69
Unanswered
Jackxiaozhiren
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
We are looking for a few independent reviewers to try Data Science Agent on their own CSV and tell us what broke. No project knowledge needed — everything is in one kit.
What is this? An evidence-grounded data science agent (natural language in, analysis + evidence + reproducible report out). We just finished honest external benchmarking (DataSciBench GT lane: 0/44 passed, mean CR 0.026 — published as-is in research/external/DATASCIBENCH_REPORT.md §9), and now we need the human half: does it actually help on real questions?
What we ask (≈30 min, blind — please don't read our internal reports first):
pip install jack-data-science-agent, rundsa doctor+dsa demoKit (self-contained):
external-validation/in the repo — README, INSTALL, TASKS, RUBRIC, FEEDBACK_TEMPLATE, RESULTS_SCHEMA.json.Ground rules: raw feedback archived verbatim, never edited or cherry-picked; anonymous/pseudonymous OK; partial feedback welcome; environment failures are results, not noise. Current status: no independent review conducted yet — you would be the first, and that will be recorded honestly either way.
Questions welcome below. Thank you!
All reactions