De-prioritize InjectJsScript in UIA target workflows - #133
Closed
danmunteanu1 wants to merge 1 commit into
Closed
Conversation
…configured targets
danmunteanu1
requested review from
AlvinStanescu,
RaduAna-Maria,
dmetzgar,
gabrielavaduva,
marius-bughiu and
uipreliga
as code owners
April 3, 2026 07:21
danmunteanu1
marked this pull request as draft
April 3, 2026 08:58
Contributor
Author
|
Closing this one, will open a larger pr |
CarlesUIPath
added a commit
that referenced
this pull request
Aug 21, 2026
…t_summary, #133 anthropic 1.0.0/httpx2)
akshaylive
pushed a commit
that referenced
this pull request
Aug 24, 2026
…ences (#2707) * chore(coder-eval): bump to 0.11.0 and migrate to directory-only references coder-eval 0.11.0 makes task.reference directory-only; the removed `reference: {file: ...}` shape now raises a load-time migration error. All 297 uipath-troubleshoot tasks used `reference: {file: RESOLUTION.md}`, so they must migrate before the pin bump lands. - tests/.coder-eval-version: 0.9.6 -> 0.11.0 - 297 tasks: move RESOLUTION.md into a per-task reference/ subdir and change `reference: {file: RESOLUTION.md}` -> `reference: {directory: reference}`. RESOLUTION.md is consumed only by each task's llm_judge via include_reference; no grader / $TASK_DIR path reads it, so the move is behavior-preserving at load. - _shared/scripts/generate_scenario.py: emit the new shape (write reference/RESOLUTION.md, stamp `directory: reference`) so new scenarios are born migrated. - uipath-troubleshoot/CLAUDE.md: update the scenario-layout tree and the judge-context note. The `$TASK_DIR/check_*.py` graders are deliberately left as $TASK_DIR: TASK_DIR is still exposed to run_command criteria in 0.11.0 (the anti-cheat shield only masks the task dir from the agent during turns; grading runs after). $REFERENCE_DIR only ever points at the reference/ solution directory. Verified: `coder-eval plan` passes on all 297 migrated tasks under 0.11.0. * ci(smoke): widen ~/.uipath perms so container-root can read credentials under coder-eval 0.11's dropped DAC caps * Revert the ~/.uipath chmod smoke fix * ci: widen ~/.uipath perms (recursive) so container-root reads credentials under coder-eval 0.11's dropped DAC caps (smoke + nightly Linux) * test(troubleshoot): pin the llm_judge to reference/RESOLUTION.md explicitly Follow-up to the directory-only reference migration. With `reference: {directory: reference}` + `include_reference: true`, coder-eval inlines the WHOLE reference/ directory into the judge as a separate block, so anything added there later would silently reach the judge (and it does not dedupe against a files: entry). Switch every troubleshoot llm_judge to the explicit, future-proof shape: include_reference: false files: - $REFERENCE_DIR/RESOLUTION.md This passes exactly RESOLUTION.md (once), keeps the judge input in sync with the file the block is meant to grade against, and restores the pre-0.11 single-file prompt shape (better score comparability). - 297 tasks: include_reference: true -> false + explicit files entry - generate_scenario.py: emit the new shape for new scenarios - uipath-troubleshoot/CLAUDE.md: canonical block + prose updated Verified: `coder-eval plan` still loads the migrated tasks under 0.11.0. * ci: stage group _shared/ into task dirs so 0.11 graders can import it coder-eval 0.11 stages $TASK_DIR as an isolated copy of just the leaf task folder, so the ~215 graders that import the group-level tests/tasks/<group>/ _shared/ package by walking up the tree fail with ModuleNotFoundError in the container. Adds tests/scripts/stage_shared.sh — a before-execution step that copies each group's _shared/ INTO every task dir whose grader imports it. `python3 $TASK_DIR/check.py` puts the script's own dir on sys.path[0], so a co-located _shared/ resolves the import with NO grader changes (a symlink would not — the copytree ignores symlinks). Idempotent; mutates only the CI checkout. Wired before `coder-eval run` in smoke-skills.yml and run-coder-eval.yml (Linux). Verified on a worktree: stages 194 task dirs, fork_join gets _shared/bpmn_check.py, ixp (no importer) left untouched. * chore(coder-eval): bump pin 0.11.0 -> 0.11.1 (patch: #127 codex result_summary, #133 anthropic 1.0.0/httpx2) * ci: exempt anthropic from safe-chain age gate (coder-eval 0.11.1 pins anthropic>=1.0.0, a fresh major)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
uia-configure-target-workflows.mdde-prioritizingInjectJsScriptin favor of standard UI activities (GetText, Click, TypeInto, ExtractTableData) with configured targetsuipath-coded-workflowsanduipath-rpa-workflowsreference this shared file, so both skills pick up the guidanceTest plan