-
Notifications
You must be signed in to change notification settings - Fork 657
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
benchmark: add TPC-H benchmark result #443
Merged
Merged
Changes from all commits
Commits
Show all changes
14 commits
Select commit
Hold shift + click to select a range
1fad67f
benchmark: create tpch document
CaitinChen 7e2caaf
benchmark: update test result
CaitinChen 76d44fa
Update tpch.md
CaitinChen 75896ce
Add files via upload
CaitinChen d4c3f75
Update tpch.md
CaitinChen e264df0
Update tpch.md
CaitinChen 875cf6d
Update tpch.md
CaitinChen 157c47b
Update tpch.md
CaitinChen 0eca3f7
Update tpch.md
CaitinChen 3c8e9a9
Update tpch.md
CaitinChen 38314d0
Update tpch.md
CaitinChen f21a24c
Update tpch.md
CaitinChen 73813f3
Update tpch.md
CaitinChen 8761f68
Update tpch.md
CaitinChen File filter
Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,106 @@ | ||
--- | ||
title: TiDB TPC-H 50G Performance Test Report V2.0 | ||
category: benchmark | ||
--- | ||
|
||
# TiDB TPC-H 50G Performance Test Report | ||
|
||
## Test purpose | ||
|
||
This test aims to compare the performances of TiDB 1.0 and TiDB 2.0 in the OLAP scenario. | ||
|
||
> **Note**: Different test environments might lead to different test results. | ||
|
||
## Test environment | ||
|
||
### Machine information | ||
|
||
System information: | ||
|
||
| Machine IP | Operation system | Kernel version | File system type | | ||
|--------------|------------------------|------------------------------|--------------| | ||
| 172.16.31.2 | Ubuntu 17.10 64bit | 4.13.0-16-generic | ext4 | | ||
| 172.16.31.3 | Ubuntu 17.10 64bit | 4.13.0-16-generic | ext4 | | ||
| 172.16.31.4 | Ubuntu 17.10 64bit | 4.13.0-16-generic | ext4 | | ||
| 172.16.31.6 | CentOS 7.4.1708 64bit | 3.10.0-693.11.6.el7.x86\_64 | ext4 | | ||
| 172.16.31.8 | CentOS 7.4.1708 64bit | 3.10.0-693.11.6.el7.x86\_64 | ext4 | | ||
| 172.16.31.10 | CentOS 7.4.1708 64bit | 3.10.0-693.11.6.el7.x86\_64 | ext4 | | ||
|
||
Hardware information: | ||
|
||
| Type | Name | | ||
|------------|------------------------------------------------------| | ||
| CPU | 40 vCPUs, Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz | | ||
| RAM | 128GB, 16GB RDIMM * 8, 2400MT/s, dual channel, x8 bitwidth | | ||
| DISK | Intel P4500 4T SSD * 2 | | ||
| Network Card | 10 Gigabit Ethernet | | ||
|
||
### TPC-H | ||
|
||
[tidb-bench/tpch](https://github.com/pingcap/tidb-bench/tree/master/tpch) | ||
|
||
### Cluster topology | ||
|
||
| Machine IP | Deployment Instance | | ||
|--------------|---------------------| | ||
| 172.16.31.2 | TiKV \* 2 | | ||
| 172.16.31.3 | TiKV \* 2 | | ||
| 172.16.31.6 | TiKV \* 2 | | ||
| 172.16.31.8 | TiKV \* 2 | | ||
| 172.16.31.10 | TiKV \* 2 | | ||
| 172.16.31.10 | PD \* 1 | | ||
| 172.16.31.4 | TiDB \* 1 | | ||
|
||
### Corresponding TiDB version information | ||
|
||
TiDB 1.0: | ||
|
||
| Component | Version | Commit Hash | | ||
|--------|-------------|--------------------------------------------| | ||
| TiDB | v1.0.9 | 4c7ee3580cd0a69319b2c0c08abdc59900df7344 | | ||
| TiKV | v1.0.8 | 2bb923a4cd23dbf68f0d16169fd526dc5c1a9f4a | | ||
| PD | v1.0.8 | 137fa734472a76c509fbfd9cb9bc6d0dc804a3b7 | | ||
|
||
TiDB 2.0: | ||
|
||
| Component | Version | Commit Hash | | ||
|--------|-------------|--------------------------------------------| | ||
| TiDB | v2.0.0-rc.6 | 82d35f1b7f9047c478f4e1e82aa0002abc8107e7 | | ||
| TiKV | v2.0.0-rc.6 | 8bd5c54966c6ef42578a27519bce4915c5b0c81f | | ||
| PD | v2.0.0-rc.6 | 9b824d288126173a61ce7d51a71fc4cb12360201 | | ||
|
||
## Test result | ||
|
||
| Query ID | TiDB 2.0 | TiDB 1.0 | | ||
|-----------|--------------------|------------------| | ||
| 1 | 33.915s | 215.305s | | ||
| 2 | 25.575s | Nan | | ||
| 3 | 59.631s | 196.003s | | ||
| 4 | 30.234s | 249.919s | | ||
| 5 | 31.666s | OOM | | ||
| 6 | 13.111s | 118.709s | | ||
| 7 | 31.710s | OOM | | ||
| 8 | 31.734s | 800.546s | | ||
| 9 | 34.211s | 630.639s | | ||
| 10 | 30.774s | 133.547s | | ||
| 11 | 27.692s | 78.026s | | ||
| 12 | 27.962s | 124.641s | | ||
| 13 | 27.676s | 174.695s | | ||
| 14 | 19.676s | 110.602s | | ||
| 15 | NaN | Nan | | ||
| 16 | 24.890s | 40.529s | | ||
| 17 | 245.796s | NaN | | ||
| 18 | 91.256s | OOM | | ||
| 19 | 37.615s | NaN | | ||
| 20 | 44.167s | 212.201s | | ||
| 21 | 31.466s | OOM | | ||
| 22 | 31.539s | 125.471s | | ||
|
||
![TPC-H Query Result](../media/tpch-query-result.png) | ||
|
||
It should be notified that: | ||
|
||
- In the diagram above, the orange bars represent the query result of Release 1.0 and the blue bars represent the query rersult of Release 2.0. The ordinate represents the processing time of queries, the shorter the better. | ||
- Query 15 is tagged with "NaN" because VIEW is not supported in both TiDB 1.0 and 2.0 releases. | ||
- Queries 2, 17, and 19 in the TiDB 1.0 column are tagged with "NaN" because TiDB 1.0 does not return a result for long. | ||
- Queries 5, 7, 18, and 21 in the TiDB 1.0 column are tagged with "OOM" because the memory consumption is too high and tidb-server is killed by oom-killer. |
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi guys, IMHO Q15 does not need a
VIEW
. It is more about a subquery support.There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There is a view in query 15: https://github.com/pingcap/tidb-bench/blob/master/tpch/queries/15.sql
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Try this rewritten query 15: