Skip to content

[fix](test) pin insert visible timeout case to master FE#65340

Open
shuke987 wants to merge 3 commits into
apache:branch-4.1from
shuke987:fix-branch41-insert-visible-master-fe
Open

[fix](test) pin insert visible timeout case to master FE#65340
shuke987 wants to merge 3 commits into
apache:branch-4.1from
shuke987:fix-branch41-insert-visible-master-fe

Conversation

@shuke987

@shuke987 shuke987 commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Pin test_insert_visible_timeout_return_mode to the master FE before running the INSERT checks.
  • Use the same master FE for the session connection and PublishVersionDaemon.stop_publish debug point.
  • Avoid targeting a non-master FE in master-observers branch-4.1 regression deployments, where publish is driven by the master FE.

Testing

  • git diff --check
  • Not run locally: no confirmed branch-4.1 regression cluster was available in this local context.

Failure evidence:

  • Branch-4.1 NonConcurrent build 201293, occurrence 2000000222
  • Failed runs returned too quickly and did not enter the expected visible-timeout path.

@shuke987 shuke987 requested a review from yiguolei as a code owner July 7, 2026 12:53
@hello-stephen

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@shuke987

shuke987 commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator Author

run buildall

@shuke987

shuke987 commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator Author

/review

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review found one blocking regression in the test change.

Critical checkpoints:

  • Scope: reviewed the single changed file and related regression framework helpers (getMasterIp, getMasterPort, connectTo, Config.buildUrlWithDb, DebugPoint) plus PublishVersionDaemon.
  • Existing review context: no existing inline review threads/comments; no duplicate suppression needed.
  • User focus: no additional user-provided review focus.
  • Validation: GitHub PR patch/head verified at b544a8e5842b2659664f934d9e904fed09d7adf6; scoped git show --check on the changed file passed. I did not run the regression suite because no matching branch-4.1/master-observers cluster is available in this runner.
  • AGENTS: the review prompt reported no required AGENTS.md files for changed ancestors. The repo-local code-review skill was not present after hidden-path search, so I followed the available Doris review workflow instructions.

Subagent conclusions:

  • optimizer-rewrite reported no optimizer/rewrite candidate.
  • tests-session-config proposed TSC-001; I accepted it as MRG-001 and submitted it inline.
  • Final convergence round 1: both live subagents returned NO_NEW_VALUABLE_FINDINGS for the current ledger/comment set.

def feHost = feHttpAddress.split(":")[0]
def feHttpPort = Integer.parseInt(feHttpAddress.split(":")[1])
// PublishVersionDaemon runs on the master FE, so keep both the session and debug point on master.
def feHost = getMasterIp()

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This reintroduces the endpoint problem that the removed block was guarding against. getMasterIp() returns Host from frontends(), and this value is now used both for DebugPoint.enableDebugPoint(...) and for the rebuilt JDBC URL. In the pipeline configs the runner-facing endpoints are carried separately, for example jdbcUrl = jdbc:mysql://172.19.0.2:9131/... and feHttpAddress = 172.19.0.2:8131, while the old comment explicitly avoided SHOW FRONTENDS because it can expose loopback/internal addresses. On those deployments the test will fail before reaching the visible-timeout path even though the configured endpoints are reachable. Please keep the master pinning, but resolve it through runner-reachable regression/cluster metadata or preserve the configured host when switching to the master's query/http ports instead of using raw frontends().Host.

@shuke987

shuke987 commented Jul 8, 2026

Copy link
Copy Markdown
Collaborator Author

Addressed review: keep master pinning by using master FE query/http ports, but preserve the configured runner-reachable FE host instead of using raw frontends().Host. New commit: 40e1569.

@shuke987

shuke987 commented Jul 8, 2026

Copy link
Copy Markdown
Collaborator Author

run buildall

@shuke987

shuke987 commented Jul 8, 2026

Copy link
Copy Markdown
Collaborator Author

/review

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

Codex automated review failed and did not complete.

Error: You've hit your usage limit. Visit https://chatgpt.com/codex/settings/usage to purchase more credits or try again at Jul 10th, 2026 6:44 AM.
Workflow run: https://github.com/apache/doris/actions/runs/28928709433

Please inspect the workflow logs and rerun the review after the underlying issue is resolved.

@shuke987

shuke987 commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator Author

/review

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review found one current-head blocking issue.

Critical checkpoints:

  • Scope: reviewed the single changed file and related regression framework helpers (getMasterPort, connectTo, Config.buildUrlWithDb, DebugPoint) plus the nonConcurrent/p0 pipeline configs that define the runner-facing endpoints.
  • Existing review context: read the existing inline thread discussion_r3536645563; the submitted comment is distinct because the prior thread covered the raw frontends().Host regression, while current head fixed the host but still uses raw frontends() ports.
  • User focus: no additional user-provided review focus.
  • Validation: verified the GitHub PR patch at head 40e1569de407209b2728d3e2ab70e6bdefa01565; the patch reverse-applies cleanly against this checkout. I did not run the regression suite because no live Doris regression cluster is available in this runner.
  • AGENTS/skill: the prompt reported no required AGENTS.md files. No in-repository SKILL.md was present after hidden-path and full-tree searches, so I followed the explicit review prompt rules.

Subagent conclusions:

  • optimizer-rewrite reported no optimizer/rewrite candidates in the initial pass and returned NO_NEW_VALUABLE_FINDINGS in convergence round 1.
  • tests-session-config reported no candidates in the initial pass and returned NO_NEW_VALUABLE_FINDINGS in convergence round 1.
  • Main-agent candidate M1 was accepted and submitted inline; convergence round 1 ended with all live subagents reporting NO_NEW_VALUABLE_FINDINGS for this ledger/comment set.

// PublishVersionDaemon runs on the master FE. Use the configured runner-reachable host and master FE ports,
// because SHOW FRONTENDS can expose loopback or internal addresses in regression deployments.
def feHost = context.config.feHttpAddress.split(":")[0]
def feHttpPort = getMasterPort()

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The host part is now runner-reachable, but this still swaps in ports from frontends(). In the static nonConcurrent/p0 pipeline configs the reachable endpoints are jdbcUrl = jdbc:mysql://172.19.0.2:9131/... and feHttpAddress = 172.19.0.2:8131, while the FE config does not override query_port/http_port, so getMasterPort() reads the FE-advertised defaults 9030/8030. That rebuilds the JDBC URL as 172.19.0.2:9030 and sends the debug-point request to 172.19.0.2:8030, which are not the configured runner-facing endpoints. Please resolve the master FE through runner-reachable cluster metadata, or keep the configured JDBC/HTTP ports when the discovered master corresponds to the configured FE.

@shuke987

shuke987 commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator Author

Addressed current-head review: removed raw frontends() port usage. The test now preserves the configured runner-facing JDBC endpoint via context.getJdbcUrl() and the configured FE HTTP endpoint via context.config.feHttpAddress, so it no longer rebuilds targets with FE-internal 9030/8030 ports. New commit: 1b2b2a6.

@shuke987

shuke987 commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator Author

/review

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review found no new blocking issue at current head.

Critical checkpoints:

  • Scope: reviewed the single changed file and related regression helpers/configuration: SuiteContext.getJdbcUrl, connectTo, and closeThreadLocal; Config.buildUrlWithDb; DebugPoint; PublishVersionDaemon.stop_publish; OlapInsertExecutor timeout handling; and the static nonConcurrent pipeline endpoints.
  • Existing review context: read existing inline threads discussion_r3536645563 and discussion_r3551549565. Current head no longer uses raw frontends() host or port values in this test and preserves the configured runner-facing JDBC/HTTP endpoints, so I found no distinct non-duplicate endpoint issue to submit.
  • User focus: no additional user-provided review focus.
  • Validation: verified GitHub PR metadata/patch at head 1b2b2a6f89a153e9181d2cc32f2ad9883022ff8c, fetched exact base ee46005a0423b5f72e691899874274b40dd2e2eb, and git diff --check ee46005a0423b5f72e691899874274b40dd2e2eb..HEAD -- regression-test/suites/insert_p0/test_insert_visible_timeout_return_mode.groovy passed. I did not run the regression suite because no live Doris regression cluster is available in this runner.
  • AGENTS/skill: the prompt reported no required AGENTS.md files for changed ancestors. No in-repository SKILL.md was present after hidden-path and full-tree searches, so I followed the explicit review prompt rules.

Subagent conclusions:

  • optimizer-rewrite proposed no candidate IDs.
  • tests-session-config proposed no candidate IDs.
  • Final convergence round 1 ended with both live subagents reporting NO_NEW_VALUABLE_FINDINGS for this ledger/comment set.

@shuke987

shuke987 commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator Author

run buildall

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants