Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix long queries that exceed 24 hours #12899

Merged
merged 2 commits into from
Nov 22, 2023

Conversation

daviszhen
Copy link
Contributor

@daviszhen daviszhen commented Nov 22, 2023

What type of PR is this?

  • API-change
  • BUG
  • Improvement
  • Documentation
  • Feature
  • Test and CI
  • Code Refactoring

Which issue(s) this PR fixes:

issue #1817 https://github.com/matrixorigin/MO-Cloud/issues/1817

What this PR does / why we need it:

如线下沟通,做下面的修改:

1,应用端修改

SetConnMaxLifetime 设置超时。
sqlDb.Exec(loadSQL) 用超时版本

2,goetty 修改
增加超时
msg, err := rs.Read(ReadOptions{超时时间})

3,frontend 打印新conn日志
只打印一条。
目前goroutineid 与 session ip port 无法关联。

@matrix-meow matrix-meow added the size/S Denotes a PR that changes [10,99] lines label Nov 22, 2023
@daviszhen daviszhen changed the title add read time fix long queries that exceed 24 hours Nov 22, 2023
@mergify mergify bot requested a review from sukki37 November 22, 2023 10:40
@@ -240,7 +242,7 @@ func bulkInsert(ctx context.Context, sqlDb *sql.DB, records [][]string, tbl *tab

// Use the transaction to execute the SQL command

_, execErr := sqlDb.Exec(loadSQL)
_, execErr := sqlDb.ExecContext(ctx, loadSQL)
Copy link
Contributor

@xzxiong xzxiong Nov 22, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里要先看看 ctx deadline后,MO对应的 tcp没有的断开的问题,是有可能导致loadSQL 正常完成。SQL执行处于未决状态。

@mergify mergify bot merged commit dd341d9 into matrixorigin:1.0-dev Nov 22, 2023
18 checks passed
daviszhen added a commit to daviszhen/matrixone that referenced this pull request Nov 27, 2023
如线下沟通,做下面的修改:

1,应用端修改

SetConnMaxLifetime 设置超时。
sqlDb.Exec(loadSQL) 用超时版本

2,goetty 修改
增加超时
msg, err := rs.Read(ReadOptions{超时时间})

3,frontend 打印新conn日志
只打印一条。
目前goroutineid 与 session ip port 无法关联。

Approved by: @qingxinhome, @zhangxu19830126
daviszhen added a commit to daviszhen/matrixone that referenced this pull request Nov 27, 2023
如线下沟通,做下面的修改:

1,应用端修改

SetConnMaxLifetime 设置超时。
sqlDb.Exec(loadSQL) 用超时版本

2,goetty 修改
增加超时
msg, err := rs.Read(ReadOptions{超时时间})

3,frontend 打印新conn日志
只打印一条。
目前goroutineid 与 session ip port 无法关联。

Approved by: @qingxinhome, @zhangxu19830126
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size/S Denotes a PR that changes [10,99] lines
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants