Skip to content

Scale tabular row orchestration exports - #1145

Merged
paullizer merged 38 commits into
Developmentfrom
fix/1031-tabular-row-orchestration-scale
Aug 4, 2026
Merged

Scale tabular row orchestration exports#1145
paullizer merged 38 commits into
Developmentfrom
fix/1031-tabular-row-orchestration-scale

Conversation

@paullizer

Copy link
Copy Markdown
Contributor

Summary

  • Fixes Scale per-row tabular analysis and generated CSV exports to 30,000+ rows #1031 by scaling per-row tabular analysis and generated CSV exports across paginated tabular results and large source windows.
  • Adds durable replayable source/query orchestration, ordered checkpoint validation, bounded final artifact assembly, and post-run summary handling.
  • Suppresses misleading assistant-table fallback exports while exhaustive tabular generation is queued, running, completed, or explicitly failed.
  • Removes generated migration state artifacts from the branch before PR creation.

Validation

  • git -c core.whitespace=blank-at-eol,blank-at-eof,space-before-tab,cr-at-eol diff --check origin/Development...HEAD
  • python -m py_compile for changed Python files
  • node --check for changed JavaScript files
  • python scripts/check_swagger_routes.py application/single_app/app.py application/single_app/route_backend_chats.py application/single_app/route_backend_collaboration.py application/single_app/route_backend_conversations.py application/single_app/route_backend_data_management.py
  • python functional_tests/route_tests/test_route_blueprint_policy_inventory.py
  • python functional_tests/route_tests/test_route_unauthenticated_policy_contract.py
  • python functional_tests/route_tests/test_route_policy_test_coverage.py
  • python functional_tests/test_tabular_row_orchestration_scale.py
  • python scripts/check_xss_sinks.py --base-sha origin/Development --head-sha HEAD <changed application files>
  • python scripts/check_broken_access_control.py --base-sha origin/Development --head-sha HEAD <changed Python application files>

Notes

  • Target branch: Development
  • Source branch: fix/1031-tabular-row-orchestration-scale
  • Version, docs, release notes, and functional coverage are included in the branch.

paullizer added 27 commits July 22, 2026 07:39
…e-manifest-pr

Phase 1: add authorized mixed-source manifest contracts
…d-source-consistency

Phase 2: honor explicit mixed-source Chat selections
…-csv-artifacts

Fix CSV artifacts for non-tabular documents
…lyze

Phase 3: mixed-source combined Analyze
…rmat-compare

Phase 4: cross-format Compare orchestration
…tinuity

Phase 5: preserve mixed-source context across follow-up turns
Implement Phase 6 terminal coverage, cancellation, finalization, bounded Analyze All, telemetry, and compatibility hardening.\n\nImprove durable CSV export throughput and timeout recovery.\n\nRefs #1061\nRefs #1071
…dening

Harden mixed-source orchestration and CSV exports
Unify CSV artifact finalization across chat, document actions, and workflows; add durable schema clarification and authorized background export handling. Remove the mixed-source Analyze availability gate and update validation, documentation, and release notes.

Refs #1071

Refs #1058
…tion

Add universal CSV generation across response paths
Promote current-turn structured function results into a format-neutral CSV, DOCX, and PDF artifact pipeline across chat, agents, document actions, and workflows. Preserve durable CSV handling and coverage-aware tabular exports.\n\nRefs #1071
Increase bounded search, metadata, directory, workflow, assigned-knowledge, and mixed-source candidate retrieval limits while preserving authorization and existing maximum constraints. Update affected functional coverage and release notes.
…tion

Add generated file export framework
…ar-row-orchestration-scale

# Conflicts:
#	application/single_app/config.py
#	docs/explanation/release_notes.md
Comment thread application/single_app/functions_assistant_table_exports.py Fixed
Comment thread application/single_app/functions_assistant_table_exports.py Fixed
Comment thread functional_tests/test_document_action_token_usage_aggregation.py Fixed
Comment thread functional_tests/test_document_action_token_usage_aggregation.py Fixed
Comment thread application/single_app/functions_tabular_generated_exports.py Dismissed
Comment thread functional_tests/test_mixed_source_chat_search_consistency.py Dismissed
Comment thread functional_tests/test_mixed_source_chat_search_consistency.py Dismissed
Comment thread functional_tests/test_mixed_source_chat_search_consistency.py Dismissed
Comment thread functional_tests/test_tabular_document_actions_workflow.py Dismissed
Comment thread functional_tests/test_tabular_row_orchestration_scale.py Dismissed
@paullizer

Copy link
Copy Markdown
Contributor Author

CodeQL remediation update for alert 30 / plan item 10: removed the duplicate local \json\ import from \chat_stream_api, relying on the existing module-level import. Bumped app version to \

@paullizer

Copy link
Copy Markdown
Contributor Author

Resolved the PR branch conflicts by merging latest \Development\ into \ ix/1031-tabular-row-orchestration-scale\ and pushed merge commit \

Comment thread functional_tests/test_chat_semantic_kernel_return_contract.py Dismissed
@paullizer
paullizer merged commit 2390e11 into Development Aug 4, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants