-
Notifications
You must be signed in to change notification settings - Fork 16
/
Copy pathqdigest.html
137 lines (121 loc) · 6.65 KB
/
qdigest.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>7.21. Quantile Digest Functions — Presto 323 Documentation</title>
<link rel="stylesheet" href="../_static/presto.css" type="text/css" />
<link rel="stylesheet" href="../_static/pygments.css" type="text/css" />
<script type="text/javascript">
var DOCUMENTATION_OPTIONS = {
URL_ROOT: '../',
VERSION: '323',
COLLAPSE_INDEX: false,
FILE_SUFFIX: '.html',
HAS_SOURCE: true,
SOURCELINK_SUFFIX: '.txt'
};
</script>
<script type="text/javascript" src="../_static/jquery.js"></script>
<script type="text/javascript" src="../_static/underscore.js"></script>
<script type="text/javascript" src="../_static/doctools.js"></script>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
<link rel="next" title="7.22. UUID Functions" href="uuid.html" />
<link rel="prev" title="7.20. HyperLogLog Functions" href="hyperloglog.html" />
<script async src="https://www.googletagmanager.com/gtag/js?id=UA-133457846-1"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'UA-133457846-1');
</script>
</head>
<body>
<div class="header">
<h1 class="heading"><a href="../index.html">
<span>Presto 323 Documentation</span></a></h1>
<h2 class="heading"><span>7.21. Quantile Digest Functions</span></h2>
</div>
<div class="topnav">
<p class="nav">
<span class="left">
« <a href="hyperloglog.html">7.20. HyperLogLog Functions</a>
</span>
<span class="right">
<a href="uuid.html">7.22. UUID Functions</a> »
</span>
</p>
</div>
<div class="content">
<div class="section" id="quantile-digest-functions">
<h1>7.21. Quantile Digest Functions</h1>
<p>Presto implements the <code class="docutils literal"><span class="pre">approx_percentile</span></code> function with the quantile digest
data structure. The underlying data structure, <a class="reference internal" href="../language/types.html#qdigest-type"><span class="std std-ref">qdigest</span></a>,
is exposed as a data type in Presto, and can be created, queried and stored
separately from <code class="docutils literal"><span class="pre">approx_percentile</span></code>.</p>
<div class="section" id="data-structures">
<h2>Data Structures</h2>
<p>A quantile digest is a data sketch which stores approximate percentile
information. The presto type for this data structure is called <code class="docutils literal"><span class="pre">qdigest</span></code>,
and it takes a parameter which must be one of <code class="docutils literal"><span class="pre">bigint</span></code>, <code class="docutils literal"><span class="pre">double</span></code> or
<code class="docutils literal"><span class="pre">real</span></code> which represent the set of numbers that may be ingested by the
<code class="docutils literal"><span class="pre">qdigest</span></code>. They may be merged without losing precision, and for storage
and retrieval they may be cast to/from <code class="docutils literal"><span class="pre">VARBINARY</span></code>.</p>
</div>
<div class="section" id="functions">
<h2>Functions</h2>
<dl class="function">
<dt>
<code class="descname">merge</code><span class="sig-paren">(</span><em>qdigest</em><span class="sig-paren">)</span> → qdigest</dt>
<dd><p>Merges all input <code class="docutils literal"><span class="pre">qdigest</span></code>s into a single <code class="docutils literal"><span class="pre">qdigest</span></code>.</p>
</dd></dl>
<dl class="function">
<dt id="value_at_quantile">
<code class="descname">value_at_quantile</code><span class="sig-paren">(</span><em>qdigest(T)</em>, <em>quantile</em><span class="sig-paren">)</span> → T</dt>
<dd><p>Returns the approximate percentile values from the quantile digest given
the number <code class="docutils literal"><span class="pre">quantile</span></code> between 0 and 1.</p>
</dd></dl>
<dl class="function">
<dt id="values_at_quantiles">
<code class="descname">values_at_quantiles</code><span class="sig-paren">(</span><em>qdigest(T)</em>, <em>quantiles</em><span class="sig-paren">)</span> → T</dt>
<dd><p>Returns the approximate percentile values as an array given the input
quantile digest and array of values between 0 and 1 which
represent the quantiles to return.</p>
</dd></dl>
<dl class="function">
<dt id="qdigest_agg">
<code class="descname">qdigest_agg</code><span class="sig-paren">(</span><em>x</em><span class="sig-paren">)</span> → qdigest<[same as x]></dt>
<dd><p>Returns the <code class="docutils literal"><span class="pre">qdigest</span></code> which is composed of all input values of <code class="docutils literal"><span class="pre">x</span></code>.</p>
</dd></dl>
<dl class="function">
<dt>
<code class="descname">qdigest_agg</code><span class="sig-paren">(</span><em>x</em>, <em>w</em><span class="sig-paren">)</span> → qdigest<[same as x]></dt>
<dd><p>Returns the <code class="docutils literal"><span class="pre">qdigest</span></code> which is composed of all input values of <code class="docutils literal"><span class="pre">x</span></code> using
the per-item weight <code class="docutils literal"><span class="pre">w</span></code>.</p>
</dd></dl>
<dl class="function">
<dt>
<code class="descname">qdigest_agg</code><span class="sig-paren">(</span><em>x</em>, <em>w</em>, <em>accuracy</em><span class="sig-paren">)</span> → qdigest<[same as x]></dt>
<dd><p>Returns the <code class="docutils literal"><span class="pre">qdigest</span></code> which is composed of all input values of <code class="docutils literal"><span class="pre">x</span></code> using
the per-item weight <code class="docutils literal"><span class="pre">w</span></code> and maximum error of <code class="docutils literal"><span class="pre">accuracy</span></code>. <code class="docutils literal"><span class="pre">accuracy</span></code>
must be a value greater than zero and less than one, and it must be constant
for all input rows.</p>
</dd></dl>
</div>
</div>
</div>
<div class="bottomnav">
<p class="nav">
<span class="left">
« <a href="hyperloglog.html">7.20. HyperLogLog Functions</a>
</span>
<span class="right">
<a href="uuid.html">7.22. UUID Functions</a> »
</span>
</p>
</div>
<div class="footer" role="contentinfo">
</div>
</body>
</html>