Repository navigation
Releases: NVIDIA-NeMo/UserSim
Release list
v0.2.0
馃幁 NeMo User Sim 0.2.0 is the first stable release. Since 0.2.0rc1 it adds UK and Germany locales, financial services banks for France, the UK and Germany, and checks that stop a run before any model call when its inputs are missing.
Highlights
- UK and Germany:
en_GBandde_DEare supported locales, with personas from Nemotron-Personas-UK and Nemotron-Personas-Germany; every probe runs in both. #70, #72, #73 - Financial services: banks for France, the UK and Germany, in each locale's language, notation and tools. #63, #65, #66, #67, #68, #71
- Checks before any model call: a run stops before calling a model when a locale's persona dataset or a probe's bank is missing. #60, #64
- Evaluation: a row fails when its probe's protocol check fails, and report cells count placeholder and machine-translated rows. The evaluator scores the tool calls a
safety_agenticrow recorded, and reports show when a chat-pressure conversation stopped on capitulation. #76, #78 - Review flags: a row that draws on an unreviewed bank entry records a warning naming the task, bank and bank version, with SME verification recommended. The fact, safety and multilingual-parity banks name who wrote or reviewed each entry. #81
- Model facades outside a pipeline: build a models file's model facades for runs outside a Data Designer pipeline. #62
- CLI: longer default timeouts for the bundled judge, summary and tool-response models, and corrected command help. #75
- Fewer dependencies: drop the unused
seaborn,matplotlibandlangdetectdependencies. #44 - Documentation: updated README, guides and diagrams. #59, #77, #80
Security
- Require Data Designer 0.9.7 or later, whose
data-designer-configrequirescertifi>=2026.10.19, a CA bundle without theemSign ECC Root CA - G3root. #82 - Require uv 0.13.4 or newer for development, since its bundled certificates also leave out that root, and lock certifi 2026.10.19. #79
- New installs on Python 3.11 and later get Pillow 13 and its security fixes. Python 3.10 resolves Pillow 12.3.0, since Pillow 13 requires Python 3.11. #82
Upgrade guidance
Update your installer and usersim:
python -m pip install --upgrade "pip>=26.2.2"
python -m pip install --upgrade "usersim>=0.2.0"In a uv project, upgrade uv to 0.13.4 or newer (uv self update for a standalone install), then run uv add "usersim>=0.2.0". Existing environments and lockfiles keep their installed Pillow until you upgrade it: python -m pip install --upgrade pillow, or uv lock --upgrade-package pillow in a uv project.
Endpoints whose certificate chains rely on the removed root may need updated chains; see the upstream advisory.
Python 3.10 is supported through the 0.2 releases. Use Python 3.11 or later for Pillow 13.
Full changelog: v0.2.0rc1...v0.2.0
v0.2.0rc1
What's Changed
- chore: complete Apache-2.0 notices and embed the DCO text by @3mei in #1
- Yev/chore/pre release hardening by @3mei in #2
- style: format the codebase and widen the lint rule set by @3mei in #3
- ci: add continuous integration, live provider checks and community files by @3mei in #4
- docs: correct published documentation and position for agents by @3mei in #7
- ci: Bump the all-actions group with 2 updates by @dependabot[bot] in #6
- chore: update license for early access by @3mei in #8
- feat!: run the simulator and evaluator on the async engine by @3mei in #9
- ci: Bump astral-sh/setup-uv from 10.1.0 to 10.2.0 in the all-actions group by @dependabot[bot] in #11
- feat(probes): add the identity_disclosure probe by @3mei in #12
- fix(engine): declare the guarded health_* columns by @isarasua in #13
- feat(engine): add external probe episode runtime by @ffrujeri in #15
- fix(evaluator): normalize strict response schemas by @ffrujeri in #14
- fix: show judges their rubric and send reasoning settings models accept by @3mei in #17
- chore: license the project under Apache-2.0 by @3mei in #18
- ci: Bump NVIDIA-NeMo/FW-CI-templates/.github/workflows/_semantic_pull_request.yml from 1.10.1 to 1.12.0 in the all-actions group by @dependabot[bot] in #19
- feat: mark Data Designer usage events as User Sim's by @3mei in #20
- ci: Bump NVIDIA-NeMo/FW-CI-templates/.github/workflows/_semantic_pull_request.yml from 1.12.0 to 1.12.2 in the all-actions group by @dependabot[bot] in #27
- fix!: support pandas 3 by @3mei in #28
- fix: label sampled evaluations, write reopenable panels, tidy notebooks by @3mei in #29
- fix(runtime): accept a simulated user's tool calls in hosted episodes by @isarasua in #25
- fix(engine): warn when a probe returns a column the run will drop by @isarasua in #26
- build: support Python 3.10 to 3.14 by @3mei in #32
- build!: publish the distribution as usersim by @3mei in #37
- refactor(engine)!: remove the never-called should_continue_after_turn hook by @isarasua in #33
- fix(storage): write simulation runs under a lock and publish them whole by @isarasua in #34
- fix(cli): record the command in plain simulate's run manifest by @isarasua in #36
- feat(cli): run stored episode rows with simulate --inputs by @isarasua in #30
- feat: opt-in replay of the assistant's own earlier reasoning by @isarasua in #31
- ci: create a GitHub release from a version tag by @3mei in #38
- build: set the version to 0.2.0rc1 by @3mei in #39
- feat(eval): warn when a trajectory_id appears more than once in a run by @isarasua in #41
- build(deps): require data-designer 0.9.5 and rely on its extra_body merge by @3mei in #42
New Contributors
- @3mei made their first contribution in #1
- @dependabot[bot] made their first contribution in #6
- @isarasua made their first contribution in #13
- @ffrujeri made their first contribution in #15
Full Changelog: https://github.com/NVIDIA-NeMo/UserSim/commits/v0.2.0rc1