Skip to content

Commit

Permalink
benchmark: add tpc-h benchmark
Browse files Browse the repository at this point in the history
  • Loading branch information
@zz-jason
zz-jason committed Sep 26, 2018
2 parents c258747 + 405397d commit 450521d
Show file tree
Hide file tree
Showing 2 changed files with 102 additions and 0 deletions.
102 changes: 102 additions & 0 deletions benchmark/tpch-v2.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,102 @@
---
title: TiDB TPC-H 50G 性能测试报告
category: benchmark
---

# TiDB TPC-H 50G 性能测试报告

## 测试目的

测试 TiDB 在 OLAP 场景下 2.0 和 2.1 版本的性能对比。

> **注意**：不同的测试环境可能使测试结果发生改变。
## 测试环境

### 测试机器信息

1. 系统信息

| 机器 IP | 操作系统 | 内核版本 | 文件系统类型 |
|--------------|------------------------|------------------------------|--------------|
| 10.0.1.4 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.5 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.6 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.7 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.8 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |
| 10.0.1.9 | CentOS 7.5.1804 64bit | 3.10.0-862.3.3.el7.x86\_64 | ext4 |

2. 硬件信息

| 类别 | 10.0.1.4 | 10.0.1.5, 10.0.1.6, 10.0.1.7, 10.0.1.8, 10.0.1.9 |
|------------|------------------------------------------------------|------------------------------------------------------|
| CPU | 16 vCPUs, Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz | 8 vCPUs, Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz |
| 内存 | 110G | 55G |
| 磁盘 | 221G SSD | 111G SSD |
| 网卡 | 万兆网卡, 10000Mb/s | 万兆网卡, 10000Mb/s |

### TPC-H

[tidb-bench/tpch](https://github.com/pingcap/tidb-bench/tree/master/tpch)

### 集群拓扑

| 机器 IP | 部署的实例 |
|----------|------------|
| 10.0.1.5 | TiKV \* 1 |
| 10.0.1.6 | TiKV \* 1 |
| 10.0.1.7 | TiKV \* 1 |
| 10.0.1.8 | TiKV \* 1 |
| 10.0.1.9 | TiKV \* 1 |
| 10.0.1.4 | PD \* 1 |
| 10.0.1.4 | TiDB \* 1 |

### TiDB 版本信息

TiDB 2.0：

| 组件名 | 版本号 | commit hash |
|--------|-------------|--------------------------------------------|
| TiDB | v2.0.7 | 29ec059cb3b7d14b6f52c2f219f94a89570162bc |
| TiKV | v2.0.7 | d0b8cd7c7f62f06e7ef456837bd32a47da1ca4cd |
| PD | v2.0.5 | b64716707b7279a4ae822be767085ff17b5f3fea |

TiDB 2.1：

| 组件名 | 版本号 | commit hash |
|--------|-------------|--------------------------------------------|
| TiDB | v2.1.0-rc.2 | 16864f95b47f859ed6104555ccff0387abdc2429 |
| TiKV | v2.1.0-rc.2 | 8458ce53ebbd434c48baac6373fe0f0a43a54005 |
| PD | v2.1.0-rc.2 | 55db505e8f35e8ab4e00efd202beb27a8ecc40fb |

## 测试结果

| Query ID | TiDB 2.0 | TiDB 2.1 |
|-----------|----------------|----------------|
| 1 | 121.550595999s | 91.4755480289s |
| 2 | 53.0638680458s | 23.1186130047s |
| 3 | 75.7236940861s | 61.790802002s |
| 4 | 30.2647120953s | 26.3483440876s |
| 6 | 51.4850790501s | 34.6432199478s |
| 7 | 216.787364006s | 94.9856910706s |
| 8 | 188.717588902s | 181.852752209s |
| 9 | 546.438174009s | 414.462754965s |
| 10 | 109.978317022s | 37.0369961262s |
| 11 | 42.9398438931s | 37.6951580048s |
| 12 | 60.455039978s | 40.2236878872s |
| 13 | 230.278712988s | 70.2887151241s |
| 14 | 61.2673521042s | 35.8372960091s |
| 16 | 30.2539310455s | 18.5897550583s |
| 17 | 3200.70173788s | 263.095014811s |
| 18 | 1035.59847498s | 296.360667944s |
| 19 | 54.3732938766s | 40.4523630142s |
| 20 | 105.094577074s | 53.2429068089s |
| 21 | 389.883709908s | 361.034544945s |
| 22 | 64.0494630337s | 65.7153418064s |

![TPC-H Query Result](../media/tpch-query-result-v2.png)

说明：
- 图中橙色为 Release 2.1，蓝色为 Release 2.0，纵坐标是 Query 的处理时间，越低越好
- Query 15 因为 2.1 和 2.0 都还未支持视图，所以未列出结果
- Query 5 因为 Join Order 问题长时间未跑出结果来，所以未列出结果
Binary file added media/tpch-query-result-v2.png
View file
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 450521d

Please sign in to comment.