Support using temporary files for queries that require a lot of memory

[dayuanyuan1989]

Question

Before asking a question, make sure you have:

I run a sql statement in tidb, the sql statement has some join.

I set the tidb oom=cancel in tidb configuration

The query always be cancelled as it use a large memroy

---

Are there any way to control the memory of single sql query? But not to kill it

• Searched existing Stack Overflow questions.
• Googled your question.
• Searched open and closed GitHub issues
• Read the documentation:
  • TiDB Readme
  • TiDB Doc

[alivxxx]

@dayuanyuan1989 Sorry I don't understand what do you expect to see and what you see instead?

[zz-jason]

Are there any way to control the memory of single sql query? But not to kill it

@dayuanyuan1989 Do you mean to spill the data to disk to allow the query to be executed successfully?

[dayuanyuan1989]

@zz-jason yes

[ghost]

@zz-jason Should this be considered a duplicate of #11607 ?

[zz-jason]

@zz-jason Should this be considered a duplicate of #11607 ?

I think so. But if the join in this issue is merge join, #11607 can not cover that.

[jebter]

Please refer: https://docs.pingcap.com/tidb/stable/configure-memory-usage#disk-spill. I will close this issue. If there are any updates, you can reopen it.