Skip to content

Conversation

@mjnovice
Copy link
Contributor

@mjnovice mjnovice commented Dec 20, 2025

Summary

Fixes the extraction of inputSchema and outputSchema when reporting eval runs to Studio Web, ensuring proper schema population for both coded and low-code agents.

Changes

  • Enhanced _extract_agent_snapshot() to support low-code agents by reading schemas directly from agent JSON files (e.g., agent.json)
  • Maintained existing behavior for coded agents that read from entry-points.json
  • Added comprehensive logging throughout the progress reporter for better debugging of eval run reporting
  • Improved error handling for missing or invalid entrypoints

Technical Details

The method now follows this logic:

  1. If entrypoint is a JSON file (low-code agent), read inputSchema and outputSchema from the agent file
  2. Otherwise, fall back to reading from entry-points.json for coded agents
  3. Return empty schemas if neither source is available

Testing

Added comprehensive test suite for agent snapshot extraction covering:

  • Reading schemas from entry-points.json for coded agents
  • Handling missing files and entrypoints
  • Proper warning when entrypoint is None or empty
  • Correct camelCase serialization for API payloads

Development Package

  • Use uipath pack --nolock to get the latest dev build from this PR (requires version range).
  • Add this package as a dependency in your pyproject.toml:
[project]
dependencies = [
  # Exact version:
  "uipath==2.2.38.dev1010423494",

  # Any version from PR
  "uipath>=2.2.38.dev1010420000,<2.2.38.dev1010430000"
]

[[tool.uv.index]]
name = "testpypi"
url = "https://test.pypi.org/simple/"
publish-url = "https://test.pypi.org/legacy/"
explicit = true

[tool.uv.sources]
uipath = { index = "testpypi" }

[tool.uv]
override-dependencies = [
    "uipath>=2.2.38.dev1010420000,<2.2.38.dev1010430000",
]

@github-actions github-actions bot added test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository labels Dec 20, 2025
@mjnovice mjnovice force-pushed the mj/fix-progress-reporting branch from 17d4ea9 to cb165af Compare December 20, 2025 02:32
@mjnovice mjnovice added the build:dev Create a dev build from the pr label Dec 20, 2025
@mjnovice mjnovice force-pushed the mj/fix-progress-reporting branch from cb165af to af335ce Compare December 20, 2025 02:34
@mjnovice mjnovice merged commit 9a13b50 into main Dec 20, 2025
80 checks passed
@mjnovice mjnovice deleted the mj/fix-progress-reporting branch December 20, 2025 02:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

build:dev Create a dev build from the pr test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants