Skip to content

[fix](regression) Use local HTTP resources in TVF test#65299

Merged
Gabriel39 merged 1 commit into
apache:masterfrom
Gabriel39:codex/local-http-tvf
Jul 7, 2026
Merged

[fix](regression) Use local HTTP resources in TVF test#65299
Gabriel39 merged 1 commit into
apache:masterfrom
Gabriel39:codex/local-http-tvf

Conversation

@Gabriel39

@Gabriel39 Gabriel39 commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

fix Use local HTTP resources in TVF test

What problem does this PR solve?

Issue Number: None

Related PR: None

Problem Summary: The HTTP TVF regression test depended on hard-coded GitHub raw URLs for checked-in test data, making the P0 case sensitive to external network availability. This change serves regression data from a temporary local HTTP server during the suite and points HTTP/file TVF URLs at that server, while preserving HuggingFace-specific URI coverage. In distributed test environments, the local HTTP server host can be set through httpTvfHost to an address that every BE can reach.

Release note

None

Check List (For Author)

  • Test: Regression test
    • ./run-regression-test.sh --run -d external_table_p0/tvf -s test_http_tvf -jdbc "jdbc:mysql://127.0.0.1:59030/?useLocalSessionState=true&allowLoadLocalInfile=true&zeroDateTimeBehavior=round" -ha 127.0.0.1:58030 -conf httpTvfHost=10.26.20.3 (on gabriel@10.26.20.3:/mnt/disk3/gabriel/Workspace/dev2/doris, passed; local HTTP URLs used 10.26.20.3)
  • Behavior changed: No
  • Does this need documentation: No

@hello-stephen

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Gabriel39 Gabriel39 marked this pull request as ready for review July 7, 2026 03:34
@Gabriel39

Copy link
Copy Markdown
Contributor Author

run buildall

### What problem does this PR solve?

Issue Number: None

Related PR: None

Problem Summary: The HTTP TVF regression test depended on hard-coded GitHub raw URLs for checked-in test data, making the P0 case sensitive to external network availability. This change serves regression data from a temporary local HTTP server during the suite and points HTTP/file TVF URLs at that server, while preserving HuggingFace-specific URI coverage. In distributed test environments, the local HTTP server host can be set through httpTvfHost to an address that every BE can reach.

### Release note

None

### Check List (For Author)

- Test: Regression test
    - ./run-regression-test.sh --run -d external_table_p0/tvf -s test_http_tvf -jdbc "jdbc:mysql://127.0.0.1:59030/?useLocalSessionState=true&allowLoadLocalInfile=true&zeroDateTimeBehavior=round" -ha 127.0.0.1:58030 -conf httpTvfHost=10.26.20.3 (on gabriel@10.26.20.3:/mnt/disk3/gabriel/Workspace/dev2/doris, passed; local HTTP URLs used 10.26.20.3)
- Behavior changed: No
- Does this need documentation: No
@Gabriel39 Gabriel39 force-pushed the codex/local-http-tvf branch from e1e3d36 to a59a310 Compare July 7, 2026 03:41
@Gabriel39

Copy link
Copy Markdown
Contributor Author

run buildall

@Gabriel39

Copy link
Copy Markdown
Contributor Author

/review

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review summary for PR 65299:

I reviewed the single changed regression suite and the related HTTP TVF FE/BE paths. I did not find a substantiated blocking issue, so I am leaving this as a comment-only review with no inline comments.

Critical checkpoint conclusions:

  • Goal and test proof: the change replaces raw GitHub data URLs in test_http_tvf with a per-suite local HTTP server while preserving HuggingFace URI coverage. The referenced local data files exist, and the local blobs match the original GitHub refs, including the previously pinned 4.0.2-rc02 CSV. The existing .out file does not include the substituted URLs.
  • Scope: the PR is focused on one regression test file and does not alter product code paths.
  • Concurrency and lifecycle: the only new lifecycle is the per-suite HttpServer; the SQL checks are synchronous and the server is stopped in finally.
  • Config/session propagation: httpTvfHost is accepted through the existing -conf key=value path into otherConfigs; fallback to externalEnvIp matches existing regression conventions.
  • Parallel paths and compatibility: http(...) and file(... fs.http.support=true) still flow through the same FE TVF property handling and BE HTTP reader. FE HEAD size discovery and BE range/non-range reads are covered by the local server behavior.
  • Test outputs: no generated output change was needed; added patch lines have no trailing whitespace.
  • Validation limit: I did not run the full regression suite in this checkout because .worktree_initialized, thirdparty/installed, and thirdparty/installed/bin/protoc are missing. The PR body reports a successful targeted regression run by the author.

Subagent conclusions:

  • optimizer-rewrite: no optimizer/rewrite candidate; convergence round 1 replied NO_NEW_VALUABLE_FINDINGS.
  • tests-session-config: no tests/session/config candidate; convergence round 1 replied NO_NEW_VALUABLE_FINDINGS.
  • No subagent candidate became an inline comment, and no duplicate candidate needed merging.

User focus: no additional user-provided review focus was supplied.

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Jul 7, 2026
@github-actions

github-actions Bot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actions Bot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@Gabriel39 Gabriel39 merged commit 553c23d into apache:master Jul 7, 2026
31 checks passed
Gabriel39 added a commit to Gabriel39/incubator-doris that referenced this pull request Jul 7, 2026
morningman pushed a commit that referenced this pull request Jul 7, 2026
yiguolei pushed a commit that referenced this pull request Jul 8, 2026
…65313)

## Proposed changes

Backport #65299 to branch-4.1.

This updates the HTTP TVF regression test to serve local
`regression-test/data` files through an in-process HTTP server instead
of fetching raw GitHub-hosted URLs.

## Notes

Resolved the suite-tag conflict by preserving branch-4.1's existing `p2`
classification.

## Validation

- `git diff --check origin/branch-4.1..codex/backport-65299-branch-4.1`
- Verified all local `regression-test/data` files referenced by
`httpUrl(...)` exist on the backport branch.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/4.0.7-merged dev/4.1.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants