Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

benchmark: add tpc-h benchmark #896

Merged
merged 4 commits into from
Sep 26, 2018
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
102 changes: 102 additions & 0 deletions benchmark/tpch-v2.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,102 @@
---
title: TiDB TPC-H 50G 性能测试报告
category: benchmark
---

# TiDB TPC-H 50G 性能测试报告

## 测试目的

测试 TiDB 在 OLAP 场景下 2.0 和 2.1 版本的性能对比。

> **注意**:不同的测试环境可能使测试结果发生改变。

## 测试环境

### 测试机器信息

1. 系统信息

| 机器 IP | 操作系统 | 内核版本 | 文件系统类型 |
|--------------|------------------------|------------------------------|--------------|
| 10.0.1.4 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.5 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.6 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.7 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.8 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.9 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |

2. 硬件信息

| 类别 | 10.0.1.4 | 10.0.1.5, 10.0.1.6, 10.0.1.7, 10.0.1.8, 10.0.1.9 |
|------------|------------------------------------------------------|------------------------------------------------------|
| CPU | 16 vCPUs, Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz | 8 vCPUs, Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz |
| 内存 | 110G | 55G |
| 磁盘 | 221G SSD | 111G SSD |
| 网卡 | 万兆网卡, 10000Mb/s | 万兆网卡, 10000Mb/s |

### TPC-H

[tidb-bench/tpch](https://github.com/pingcap/tidb-bench/tree/master/tpch)

### 集群拓扑

| 机器 IP | 部署的实例 |
|----------|------------|
| 10.0.1.5 | TiKV \* 1 |
| 10.0.1.6 | TiKV \* 1 |
| 10.0.1.7 | TiKV \* 1 |
| 10.0.1.8 | TiKV \* 1 |
| 10.0.1.9 | TiKV \* 1 |
| 10.0.1.4 | PD \* 1 |
| 10.0.1.4 | TiDB \* 1 |

### TiDB 版本信息

TiDB 2.0:

| 组件名 | 版本号 | commit hash |
|--------|-------------|--------------------------------------------|
| TiDB | v2.0.7 | 29ec059cb3b7d14b6f52c2f219f94a89570162bc |
| TiKV | v2.0.7 | d0b8cd7c7f62f06e7ef456837bd32a47da1ca4cd |
| PD | v2.0.5 | b64716707b7279a4ae822be767085ff17b5f3fea |

TiDB 2.1:

| 组件名 | 版本号 | commit hash |
|--------|-------------|--------------------------------------------|
| TiDB | v2.1.0-rc.2 | 16864f95b47f859ed6104555ccff0387abdc2429 |
| TiKV | v2.1.0-rc.2 | 8458ce53ebbd434c48baac6373fe0f0a43a54005 |
| PD | v2.1.0-rc.2 | 55db505e8f35e8ab4e00efd202beb27a8ecc40fb |

## 测试结果

| Query ID | TiDB 2.0 | TiDB 2.1 |
|-----------|----------------|----------------|
| 1 | 121.550595999s | 91.4755480289s |
| 2 | 53.0638680458s | 23.1186130047s |
| 3 | 75.7236940861s | 61.790802002s |
| 4 | 30.2647120953s | 26.3483440876s |
| 6 | 51.4850790501s | 34.6432199478s |
| 7 | 216.787364006s | 94.9856910706s |
| 8 | 188.717588902s | 181.852752209s |
| 9 | 546.438174009s | 414.462754965s |
| 10 | 109.978317022s | 37.0369961262s |
| 11 | 42.9398438931s | 37.6951580048s |
| 12 | 60.455039978s | 40.2236878872s |
| 13 | 230.278712988s | 70.2887151241s |
| 14 | 61.2673521042s | 35.8372960091s |
| 16 | 30.2539310455s | 18.5897550583s |
| 17 | 3200.70173788s | 263.095014811s |
| 18 | 1035.59847498s | 296.360667944s |
| 19 | 54.3732938766s | 40.4523630142s |
| 20 | 105.094577074s | 53.2429068089s |
| 21 | 389.883709908s | 361.034544945s |
| 22 | 64.0494630337s | 65.7153418064s |

![TPC-H Query Result](../media/tpch-query-result-v2.png)

说明:
- 图中橙色为 Release 2.1,蓝色为 Release 2.0,纵坐标是 Query 的处理时间,越低越好
- Query 15 因为 2.1 和 2.0 都还未支持视图,所以未列出结果
- Query 5 因为 Join Order 问题长时间未跑出结果来,所以未列出结果
Binary file added media/tpch-query-result-v2.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.