[Fix](function) fix random_bytes return same data for multi rows #39891

zclllyybb · 2024-08-24T16:48:51Z

Proposed changes

Issue Number: close #xxx

before:

mysql [optest]>SELECT random_bytes(10) a FROM numbers("number" = "10");
+------------------------+
| a                      |
+------------------------+
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
| 0x7b4e5727024bc5b59e2c |
+------------------------+

now:

mysql [optest]>SELECT random_bytes(10) a FROM numbers("number" = "10");
+------------------------+
| a                      |
+------------------------+
| 0xd82cf60825b29ef2a0fd |
| 0x6f8c808415bdbaa6d257 |
| 0x7c26b5214297a151c25c |
| 0x43f02c77293063900437 |
| 0x5e5727569dec5e24f96b |
| 0x434f20bf74d7759640b7 |
| 0x087ed96b739750c733a6 |
| 0xdf05f6d7ede4972eb846 |
| 0xcefab471912264b5c54f |
| 0x1bddc019409d1926aa10 |
+------------------------+

doris-robot · 2024-08-24T16:48:56Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

zclllyybb · 2024-08-24T16:48:59Z

run buildall

github-actions · 2024-08-24T16:55:31Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-08-24T17:35:12Z

TPC-H: Total hot run time: 37874 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 69dd962a051c8bdab89d02e16e08cc0e61e29990, data reload: false

------ Round 1 ----------------------------------
q1	17645	4697	4282	4282
q2	2033	182	179	179
q3	11463	1012	1136	1012
q4	10517	759	675	675
q5	7747	2895	2823	2823
q6	226	136	136	136
q7	945	605	600	600
q8	9315	2105	2079	2079
q9	7008	6529	6557	6529
q10	7049	2230	2183	2183
q11	489	245	253	245
q12	392	221	221	221
q13	17778	3006	3034	3006
q14	284	245	238	238
q15	527	489	499	489
q16	513	390	384	384
q17	991	688	724	688
q18	7294	6808	7026	6808
q19	1504	966	956	956
q20	675	342	320	320
q21	4331	3148	3020	3020
q22	1127	1004	1001	1001
Total cold run time: 109853 ms
Total hot run time: 37874 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4429	4349	4263	4263
q2	368	278	264	264
q3	2873	2659	2662	2659
q4	1920	1665	1649	1649
q5	5609	5692	5748	5692
q6	240	145	139	139
q7	2335	1836	1786	1786
q8	3314	3420	3424	3420
q9	8804	8824	8759	8759
q10	3565	3403	3375	3375
q11	609	492	514	492
q12	838	662	663	662
q13	14547	3129	3215	3129
q14	319	283	297	283
q15	548	486	477	477
q16	481	472	448	448
q17	1829	1545	1551	1545
q18	8125	7678	8015	7678
q19	1758	1585	1599	1585
q20	2157	1917	1884	1884
q21	5770	5473	5498	5473
q22	1112	1051	1016	1016
Total cold run time: 71550 ms
Total hot run time: 56678 ms

doris-robot · 2024-08-24T17:47:20Z

TPC-DS: Total hot run time: 192272 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 69dd962a051c8bdab89d02e16e08cc0e61e29990, data reload: false

query1	1276	899	880	880
query2	6351	1948	1856	1856
query3	10614	3804	4020	3804
query4	60015	23858	23615	23615
query5	5616	506	512	506
query6	429	167	167	167
query7	5777	304	291	291
query8	294	208	214	208
query9	8829	2490	2486	2486
query10	479	269	266	266
query11	18085	15157	15612	15157
query12	163	101	106	101
query13	1538	396	397	396
query14	11099	7065	7108	7065
query15	227	178	180	178
query16	7436	493	486	486
query17	1131	571	568	568
query18	1939	294	287	287
query19	270	146	141	141
query20	116	114	113	113
query21	204	103	105	103
query22	4867	4528	4546	4528
query23	34629	33566	33567	33566
query24	5988	2839	2872	2839
query25	543	397	400	397
query26	689	162	159	159
query27	1774	290	292	290
query28	3480	2046	2038	2038
query29	697	432	428	428
query30	241	157	151	151
query31	916	778	725	725
query32	76	55	58	55
query33	448	313	321	313
query34	846	484	479	479
query35	856	711	722	711
query36	1019	941	924	924
query37	140	82	82	82
query38	3975	3873	3889	3873
query39	1459	1384	1454	1384
query40	194	117	118	117
query41	48	48	46	46
query42	115	97	97	97
query43	470	460	476	460
query44	1125	759	744	744
query45	201	171	167	167
query46	1093	775	747	747
query47	1916	1867	1778	1778
query48	382	308	313	308
query49	771	443	446	443
query50	835	417	419	417
query51	7179	7104	7020	7020
query52	94	88	89	88
query53	247	183	180	180
query54	569	457	463	457
query55	77	75	77	75
query56	277	265	255	255
query57	1189	1048	1053	1048
query58	233	229	249	229
query59	3072	2703	2804	2703
query60	288	265	266	265
query61	98	95	121	95
query62	739	663	657	657
query63	221	179	184	179
query64	3339	1752	1727	1727
query65	3196	3175	3175	3175
query66	676	326	350	326
query67	15565	15160	15478	15160
query68	3209	574	579	574
query69	397	280	278	278
query70	1119	1112	1021	1021
query71	347	271	272	271
query72	2719	2141	2038	2038
query73	711	325	330	325
query74	9226	8788	8910	8788
query75	3350	2670	2688	2670
query76	1520	1021	942	942
query77	539	323	322	322
query78	9657	9074	9187	9074
query79	1035	546	545	545
query80	691	502	550	502
query81	455	231	227	227
query82	297	137	133	133
query83	166	144	145	144
query84	256	71	73	71
query85	670	286	278	278
query86	310	263	276	263
query87	4380	4284	4344	4284
query88	3039	2385	2386	2385
query89	378	296	284	284
query90	1953	191	196	191
query91	123	100	100	100
query92	61	55	51	51
query93	1056	536	538	536
query94	690	312	351	312
query95	354	260	265	260
query96	592	269	267	267
query97	3228	3073	3088	3073
query98	220	198	200	198
query99	1514	1290	1286	1286
Total cold run time: 303002 ms
Total hot run time: 192272 ms

doris-robot · 2024-08-24T17:52:52Z

ClickBench: Total hot run time: 30.65 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 69dd962a051c8bdab89d02e16e08cc0e61e29990, data reload: false

query1	0.05	0.04	0.04
query2	0.09	0.04	0.04
query3	0.23	0.04	0.04
query4	1.69	0.07	0.07
query5	0.50	0.50	0.49
query6	1.14	0.73	0.73
query7	0.02	0.01	0.01
query8	0.05	0.05	0.04
query9	0.53	0.50	0.49
query10	0.56	0.54	0.54
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.61	0.58	0.59
query14	0.77	0.78	0.79
query15	0.90	0.82	0.80
query16	0.40	0.36	0.36
query17	1.05	0.99	1.07
query18	0.21	0.21	0.20
query19	1.92	1.86	1.88
query20	0.01	0.01	0.01
query21	15.42	0.67	0.65
query22	4.37	7.85	1.71
query23	18.29	1.27	1.28
query24	2.04	0.23	0.22
query25	0.15	0.08	0.09
query26	0.26	0.18	0.17
query27	0.08	0.07	0.08
query28	13.34	1.00	1.00
query29	12.63	3.40	3.41
query30	0.24	0.06	0.05
query31	2.88	0.40	0.39
query32	3.25	0.48	0.48
query33	2.96	3.08	3.00
query34	16.85	4.42	4.38
query35	4.46	4.41	4.43
query36	0.65	0.46	0.48
query37	0.19	0.17	0.16
query38	0.17	0.16	0.15
query39	0.04	0.03	0.04
query40	0.16	0.13	0.13
query41	0.09	0.04	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.66 s
Total hot run time: 30.65 s

zclllyybb · 2024-08-25T07:04:37Z

run buildall

github-actions · 2024-08-25T07:11:17Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-08-25T07:46:30Z

TPC-H: Total hot run time: 37784 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f5918ce5ee24a53f747936e35d33da163fc3d22e, data reload: false

------ Round 1 ----------------------------------
q1	17620	4346	4313	4313
q2	2024	183	174	174
q3	11689	962	1107	962
q4	10512	773	742	742
q5	7755	2899	2825	2825
q6	223	137	138	137
q7	988	620	613	613
q8	9342	2069	2052	2052
q9	7220	6506	6534	6506
q10	7005	2198	2217	2198
q11	442	241	237	237
q12	392	220	218	218
q13	17955	3017	3035	3017
q14	272	239	228	228
q15	530	489	490	489
q16	486	401	395	395
q17	978	768	662	662
q18	7421	6842	6800	6800
q19	1380	986	1043	986
q20	670	322	338	322
q21	3889	2894	3089	2894
q22	1119	1032	1014	1014
Total cold run time: 109912 ms
Total hot run time: 37784 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4373	4276	4224	4224
q2	371	272	274	272
q3	2878	2657	2658	2657
q4	1935	1594	1645	1594
q5	5510	5716	5738	5716
q6	240	142	139	139
q7	2246	1789	1782	1782
q8	3335	3379	3455	3379
q9	8817	8843	8755	8755
q10	3528	3365	3342	3342
q11	625	507	516	507
q12	820	675	654	654
q13	13065	3250	3157	3157
q14	321	295	293	293
q15	537	489	498	489
q16	504	454	439	439
q17	1849	1623	1521	1521
q18	8063	7664	7810	7664
q19	1737	1632	1609	1609
q20	2141	1880	1897	1880
q21	5639	5499	5465	5465
q22	1192	1098	1031	1031
Total cold run time: 69726 ms
Total hot run time: 56569 ms

doris-robot · 2024-08-25T07:58:44Z

TPC-DS: Total hot run time: 191586 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f5918ce5ee24a53f747936e35d33da163fc3d22e, data reload: false

query1	1250	875	853	853
query2	6269	1983	1931	1931
query3	10604	3951	3781	3781
query4	59388	27256	23073	23073
query5	5557	509	508	508
query6	419	157	152	152
query7	5831	301	304	301
query8	293	218	220	218
query9	9101	2484	2477	2477
query10	491	268	254	254
query11	16148	14952	15239	14952
query12	156	104	108	104
query13	1568	400	393	393
query14	11403	7596	7459	7459
query15	261	175	183	175
query16	7254	511	548	511
query17	1150	573	579	573
query18	1963	309	310	309
query19	299	156	154	154
query20	124	113	111	111
query21	212	107	102	102
query22	4637	4460	4420	4420
query23	34295	33463	33331	33331
query24	5892	2804	2878	2804
query25	556	417	404	404
query26	684	162	161	161
query27	1787	278	280	278
query28	3464	2058	2028	2028
query29	681	422	429	422
query30	240	154	155	154
query31	927	779	755	755
query32	83	57	56	56
query33	485	301	299	299
query34	864	474	469	469
query35	825	713	739	713
query36	1071	937	902	902
query37	147	84	88	84
query38	4011	3874	3898	3874
query39	1430	1380	1400	1380
query40	196	121	120	120
query41	49	47	47	47
query42	119	97	97	97
query43	518	466	471	466
query44	1102	756	743	743
query45	197	166	167	166
query46	1097	771	735	735
query47	1892	1782	1795	1782
query48	373	307	303	303
query49	771	427	454	427
query50	817	413	425	413
query51	7181	7055	7068	7055
query52	97	86	88	86
query53	251	180	180	180
query54	556	468	468	468
query55	170	76	78	76
query56	265	248	254	248
query57	1180	1088	1038	1038
query58	216	230	223	223
query59	3049	2788	2660	2660
query60	293	261	267	261
query61	101	112	99	99
query62	739	650	652	650
query63	208	184	179	179
query64	3587	2035	1784	1784
query65	3241	3197	3141	3141
query66	650	326	331	326
query67	15365	15164	15226	15164
query68	4353	580	561	561
query69	430	276	279	276
query70	1104	1168	1054	1054
query71	360	274	277	274
query72	6411	2289	2066	2066
query73	779	332	326	326
query74	9223	8865	8859	8859
query75	3341	2663	2690	2663
query76	1861	982	996	982
query77	526	319	324	319
query78	9747	9096	8979	8979
query79	1078	545	530	530
query80	885	505	496	496
query81	554	229	220	220
query82	231	134	132	132
query83	222	197	148	148
query84	261	76	81	76
query85	919	288	288	288
query86	354	287	291	287
query87	4549	4271	4302	4271
query88	3095	2377	2480	2377
query89	391	279	287	279
query90	1911	214	197	197
query91	124	118	112	112
query92	62	52	52	52
query93	1096	529	538	529
query94	789	302	307	302
query95	344	256	258	256
query96	592	272	267	267
query97	3194	3071	3067	3067
query98	215	204	199	199
query99	1936	1281	1280	1280
Total cold run time: 307037 ms
Total hot run time: 191586 ms

doris-robot · 2024-08-25T08:04:15Z

ClickBench: Total hot run time: 30.94 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f5918ce5ee24a53f747936e35d33da163fc3d22e, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.04
query4	1.67	0.07	0.08
query5	0.51	0.48	0.50
query6	1.13	0.73	0.72
query7	0.01	0.01	0.02
query8	0.05	0.04	0.05
query9	0.55	0.48	0.48
query10	0.55	0.52	0.54
query11	0.16	0.11	0.11
query12	0.16	0.12	0.12
query13	0.62	0.59	0.58
query14	0.76	0.80	0.77
query15	0.84	0.82	0.81
query16	0.36	0.35	0.38
query17	1.03	1.03	1.02
query18	0.21	0.20	0.21
query19	1.96	1.70	1.79
query20	0.01	0.01	0.01
query21	15.42	0.68	0.67
query22	4.56	6.39	2.35
query23	18.31	1.39	1.24
query24	2.09	0.24	0.22
query25	0.16	0.07	0.07
query26	0.26	0.17	0.18
query27	0.07	0.08	0.07
query28	13.26	1.02	0.99
query29	12.67	3.31	3.30
query30	0.24	0.05	0.05
query31	2.87	0.40	0.37
query32	3.29	0.47	0.48
query33	2.93	3.00	3.02
query34	17.20	4.36	4.39
query35	4.41	4.44	4.45
query36	0.65	0.46	0.49
query37	0.19	0.16	0.16
query38	0.16	0.15	0.16
query39	0.04	0.03	0.04
query40	0.16	0.13	0.12
query41	0.10	0.06	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.05
Total cold run time: 110.08 s
Total hot run time: 30.94 s

github-actions · 2024-08-26T03:09:26Z

PR approved by anyone and no changes requested.

github-actions · 2024-08-26T03:16:03Z

PR approved by at least one committer and no changes requested.

…m_bytes foldable properties (#39944) ## Proposed changes fix the conflict between #39801 and #39891

…m_bytes foldable properties (apache#39944) ## Proposed changes fix the conflict between apache#39801 and apache#39891

…m_bytes foldable properties (#39944) ## Proposed changes fix the conflict between #39801 and #39891

1

69dd962

foldFE

f5918ce

Mryange approved these changes Aug 26, 2024

View reviewed changes

github-actions bot added the reviewed label Aug 26, 2024

BiteTheDDDDt approved these changes Aug 26, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 26, 2024

BiteTheDDDDt merged commit 3c8cc0f into apache:master Aug 26, 2024
26 of 28 checks passed

zclllyybb deleted the random_bytes branch August 26, 2024 03:16

924060929 mentioned this pull request Aug 27, 2024

[Fix](nereids) remove interface Nondeterministic and fix random/random_bytes foldable properties #39944

Merged

BiteTheDDDDt pushed a commit that referenced this pull request Aug 27, 2024

[Fix](nereids) remove interface Nondeterministic and fix random/rando…

a9f0962

…m_bytes foldable properties (#39944) ## Proposed changes fix the conflict between #39801 and #39891

morrySnow added p0_w dev/2.1.x dev/3.0.x labels Aug 28, 2024

zclllyybb mentioned this pull request Aug 29, 2024

[branch-2.1](function) fix random_bytes return same data for multi rows (#39891) #40137

Merged

yiguolei added dev/2.1.6-merged and removed dev/2.1.x labels Aug 30, 2024

dataroaring added dev/3.0.2-merged and removed dev/3.0.x labels Sep 3, 2024

zclllyybb added a commit to zclllyybb/doris that referenced this pull request Sep 11, 2024

[Fix](nereids) remove interface Nondeterministic and fix random/rando…

922aaf7

…m_bytes foldable properties (apache#39944) ## Proposed changes fix the conflict between apache#39801 and apache#39891

gavinchou added dev/3.0.x dev/3.0.x-conflict and removed dev/3.0.2-merged dev/3.0.x labels Sep 12, 2024

zclllyybb mentioned this pull request Sep 18, 2024

[branch-3.0](function) fix random_bytes return same data for multi rows (#39891) #40892

Closed

dataroaring pushed a commit that referenced this pull request Oct 9, 2024

[Fix](nereids) remove interface Nondeterministic and fix random/rando…

4e74656

…m_bytes foldable properties (#39944) ## Proposed changes fix the conflict between #39801 and #39891

dataroaring added the dev/3.0.3-merged label Oct 12, 2024

zhangstar333 removed the dev/3.0.x-conflict label Oct 22, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Fix](function) fix random_bytes return same data for multi rows #39891

[Fix](function) fix random_bytes return same data for multi rows #39891

zclllyybb commented Aug 24, 2024

doris-robot commented Aug 24, 2024

zclllyybb commented Aug 24, 2024

github-actions bot commented Aug 24, 2024

doris-robot commented Aug 24, 2024

doris-robot commented Aug 24, 2024

doris-robot commented Aug 24, 2024

zclllyybb commented Aug 25, 2024

github-actions bot commented Aug 25, 2024

doris-robot commented Aug 25, 2024

doris-robot commented Aug 25, 2024

doris-robot commented Aug 25, 2024

github-actions bot commented Aug 26, 2024

github-actions bot commented Aug 26, 2024

[Fix](function) fix random_bytes return same data for multi rows #39891

[Fix](function) fix random_bytes return same data for multi rows #39891

Conversation

zclllyybb commented Aug 24, 2024

Proposed changes

doris-robot commented Aug 24, 2024

zclllyybb commented Aug 24, 2024

github-actions bot commented Aug 24, 2024

doris-robot commented Aug 24, 2024

doris-robot commented Aug 24, 2024

doris-robot commented Aug 24, 2024

zclllyybb commented Aug 25, 2024

github-actions bot commented Aug 25, 2024

doris-robot commented Aug 25, 2024

doris-robot commented Aug 25, 2024

doris-robot commented Aug 25, 2024

github-actions bot commented Aug 26, 2024

github-actions bot commented Aug 26, 2024