Skip to content

[Enhancement](pyudf) add helper command to show more py info#60751

Open
linrrzqqq wants to merge 1 commit intoapache:masterfrom
linrrzqqq:pyudf-helper-func
Open

[Enhancement](pyudf) add helper command to show more py info#60751
linrrzqqq wants to merge 1 commit intoapache:masterfrom
linrrzqqq:pyudf-helper-func

Conversation

@linrrzqqq
Copy link
Contributor

@linrrzqqq linrrzqqq commented Feb 13, 2026

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

doc: apache/doris-website#3402

Add the auxiliary commands SHOW PYTHON VERSIONS and SHOW PYTHON PACKAGES IN '<VERSION>' to display more PythonUDF-related information.

Doris> show python versions;
+---------+---------+---------+---------------------------------------------+--------------------------------------------------------+
| Version | EnvName | EnvType | BasePath                                    | ExecutablePath                                         |
+---------+---------+---------+---------------------------------------------+--------------------------------------------------------+
| 3.9.18  | py39    | conda   | /mnt/disk7/linzhenqi/miniconda3/envs/py39   | /mnt/disk7/linzhenqi/miniconda3/envs/py39/bin/python   |
| 3.8.10  | py3810  | conda   | /mnt/disk7/linzhenqi/miniconda3/envs/py3810 | /mnt/disk7/linzhenqi/miniconda3/envs/py3810/bin/python |
| 3.12.11 | py312   | conda   | /mnt/disk7/linzhenqi/miniconda3/envs/py312  | /mnt/disk7/linzhenqi/miniconda3/envs/py312/bin/python  |
+---------+---------+---------+---------------------------------------------+--------------------------------------------------------+
3 rows in set (0.02 sec)

Doris> show python packages in '3.9.18';
+-----------------+-------------+
| Package         | Version     |
+-----------------+-------------+
| pyarrow         | 21.0.0      |
| Bottleneck      | 1.4.2       |
| jieba           | 0.42.1      |
| six             | 1.17.0      |
| wheel           | 0.45.1      |
| python-dateutil | 2.9.0.post0 |
| tzdata          | 2025.3      |
| setuptools      | 80.9.0      |
| numpy           | 2.0.1       |
| psutil          | 7.0.0       |
| pandas          | 2.3.3       |
| mkl_random      | 1.2.8       |
| pip             | 25.3        |
| snownlp         | 0.12.3      |
| pytz            | 2025.2      |
| mkl_fft         | 1.3.11      |
| mkl-service     | 2.4.0       |
| numexpr         | 2.10.1      |
+-----------------+-------------+

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Feb 13, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@linrrzqqq
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.33% (1796/2264)
Line Coverage 64.79% (31986/49372)
Region Coverage 65.46% (15958/24378)
Branch Coverage 55.96% (8486/15164)

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 0.00% (0/35) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.72% (19536/37054)
Line Coverage 36.27% (182179/502283)
Region Coverage 32.61% (141240/433154)
Branch Coverage 33.67% (61266/181975)

@linrrzqqq
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.33% (1796/2264)
Line Coverage 64.79% (31986/49372)
Region Coverage 65.45% (15956/24378)
Branch Coverage 55.95% (8485/15164)

@doris-robot
Copy link

TPC-H: Total hot run time: 29678 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 061fc3f82d44fa8da0a2981fd4afab3bfe6df485, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17622	4570	4413	4413
q2	q3	10728	826	518	518
q4	4724	358	255	255
q5	8062	1212	1058	1058
q6	199	181	153	153
q7	845	865	698	698
q8	10492	1515	1349	1349
q9	6762	4827	4791	4791
q10	6882	1888	1653	1653
q11	453	281	249	249
q12	765	590	474	474
q13	17823	4191	3450	3450
q14	233	228	203	203
q15	950	794	783	783
q16	763	716	684	684
q17	735	856	455	455
q18	6161	5346	5319	5319
q19	1162	979	1043	979
q20	588	551	448	448
q21	4694	1932	1496	1496
q22	388	313	250	250
Total cold run time: 101031 ms
Total hot run time: 29678 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4754	4624	4526	4526
q2	q3	1814	2225	1747	1747
q4	861	1179	772	772
q5	4068	4383	4350	4350
q6	198	177	147	147
q7	1789	1660	1578	1578
q8	2527	2726	2551	2551
q9	7585	7430	7437	7430
q10	2757	2869	2425	2425
q11	506	539	424	424
q12	500	621	459	459
q13	3999	4426	3527	3527
q14	272	292	281	281
q15	848	836	803	803
q16	716	745	685	685
q17	1194	1572	1332	1332
q18	7211	6865	6705	6705
q19	964	890	930	890
q20	2320	2159	2000	2000
q21	4086	3530	3432	3432
q22	509	477	424	424
Total cold run time: 49478 ms
Total hot run time: 46488 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183191 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 061fc3f82d44fa8da0a2981fd4afab3bfe6df485, data reload: false

query5	4756	627	526	526
query6	322	211	194	194
query7	4219	466	277	277
query8	353	235	232	232
query9	8734	2741	2761	2741
query10	527	406	346	346
query11	16945	17871	17259	17259
query12	217	133	124	124
query13	1347	487	359	359
query14	7129	3297	3065	3065
query14_1	2920	2918	2927	2918
query15	221	206	183	183
query16	1054	502	403	403
query17	1367	812	638	638
query18	3552	479	366	366
query19	219	210	190	190
query20	144	133	136	133
query21	215	139	122	122
query22	6067	5529	4848	4848
query23	17213	16812	16530	16530
query23_1	16657	16607	16711	16607
query24	7040	1599	1212	1212
query24_1	1236	1228	1220	1220
query25	569	484	416	416
query26	1247	254	153	153
query27	2758	465	285	285
query28	4453	1894	1874	1874
query29	831	569	463	463
query30	312	249	212	212
query31	850	739	636	636
query32	78	72	69	69
query33	508	314	273	273
query34	917	910	574	574
query35	625	658	596	596
query36	1056	1080	986	986
query37	137	95	80	80
query38	2963	2943	2828	2828
query39	907	863	848	848
query39_1	855	824	821	821
query40	227	152	132	132
query41	62	58	59	58
query42	103	100	99	99
query43	378	383	358	358
query44	
query45	197	187	183	183
query46	874	975	598	598
query47	2136	2115	2058	2058
query48	306	321	233	233
query49	619	460	395	395
query50	665	271	215	215
query51	4057	4090	4075	4075
query52	108	106	94	94
query53	287	345	282	282
query54	299	262	251	251
query55	87	84	79	79
query56	302	300	297	297
query57	1366	1326	1296	1296
query58	281	262	266	262
query59	2567	2714	2529	2529
query60	327	323	326	323
query61	145	145	143	143
query62	626	594	541	541
query63	312	273	278	273
query64	4852	1260	987	987
query65	
query66	1384	445	345	345
query67	16423	16463	16334	16334
query68	
query69	404	290	288	288
query70	973	1004	953	953
query71	329	304	312	304
query72	2766	2641	2366	2366
query73	531	555	325	325
query74	9971	9909	9750	9750
query75	2867	2721	2448	2448
query76	2292	1034	663	663
query77	354	410	296	296
query78	11287	11391	10685	10685
query79	2348	789	603	603
query80	1728	606	519	519
query81	564	278	248	248
query82	968	150	113	113
query83	336	260	240	240
query84	253	116	99	99
query85	898	467	422	422
query86	406	300	296	296
query87	3147	3082	2955	2955
query88	3625	2678	2671	2671
query89	422	372	358	358
query90	2022	163	166	163
query91	163	154	132	132
query92	74	73	74	73
query93	1012	829	500	500
query94	658	321	250	250
query95	577	383	311	311
query96	639	512	222	222
query97	2490	2461	2368	2368
query98	225	224	209	209
query99	1008	1016	913	913
Total cold run time: 257352 ms
Total hot run time: 183191 ms

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 0.00% (0/35) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.70% (19536/37072)
Line Coverage 36.25% (182161/502477)
Region Coverage 32.57% (141199/433506)
Branch Coverage 33.64% (61245/182082)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 82.61% (57/69) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.78% (26076/36327)
Line Coverage 54.48% (273086/501262)
Region Coverage 51.85% (227037/437902)
Branch Coverage 53.35% (97530/182802)

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 59.70% (80/134) 🎉
Increment coverage report
Complete coverage report

@linrrzqqq
Copy link
Contributor Author

run p0

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 82.61% (57/69) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.78% (26074/36327)
Line Coverage 54.47% (273044/501262)
Region Coverage 51.81% (226892/437902)
Branch Coverage 53.34% (97503/182802)

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 59.70% (80/134) 🎉
Increment coverage report
Complete coverage report

@linrrzqqq
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.33% (1796/2264)
Line Coverage 64.79% (32004/49393)
Region Coverage 65.48% (15965/24383)
Branch Coverage 56.00% (8494/15168)

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 1.44% (2/139) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

TPC-H: Total hot run time: 28826 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2fbd02f3d5639f9404f28eb50db438574b5ec7cb, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17640	4450	4332	4332
q2	q3	10724	770	523	523
q4	4723	366	258	258
q5	8109	1228	1029	1029
q6	252	175	145	145
q7	813	861	672	672
q8	10847	1491	1338	1338
q9	6732	4792	4827	4792
q10	6855	1893	1618	1618
q11	450	264	249	249
q12	752	562	477	477
q13	17769	4210	3408	3408
q14	222	229	216	216
q15	979	795	790	790
q16	727	715	673	673
q17	727	926	415	415
q18	6027	5428	5258	5258
q19	1145	979	629	629
q20	532	508	385	385
q21	4474	1855	1376	1376
q22	345	292	243	243
Total cold run time: 100844 ms
Total hot run time: 28826 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4470	4389	4362	4362
q2	q3	1766	2178	1719	1719
q4	822	1140	764	764
q5	4023	4348	4349	4348
q6	178	169	139	139
q7	1731	1602	1487	1487
q8	2422	2680	2544	2544
q9	7831	7491	7449	7449
q10	2602	2831	2463	2463
q11	542	480	421	421
q12	512	591	454	454
q13	3962	4436	3668	3668
q14	284	319	299	299
q15	873	840	806	806
q16	718	777	713	713
q17	1210	1518	1303	1303
q18	7146	6920	6530	6530
q19	908	896	924	896
q20	2094	2186	1990	1990
q21	4106	3469	3299	3299
q22	486	447	419	419
Total cold run time: 48686 ms
Total hot run time: 46073 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183957 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2fbd02f3d5639f9404f28eb50db438574b5ec7cb, data reload: false

query5	4807	674	521	521
query6	352	229	212	212
query7	4237	489	274	274
query8	361	248	242	242
query9	8761	2759	2757	2757
query10	545	380	347	347
query11	17098	17505	17566	17505
query12	201	148	148	148
query13	1290	505	360	360
query14	6747	3467	3158	3158
query14_1	3010	3000	3007	3000
query15	207	199	194	194
query16	1142	503	515	503
query17	1638	791	629	629
query18	3025	461	355	355
query19	233	217	191	191
query20	151	136	138	136
query21	218	146	124	124
query22	5524	5053	4798	4798
query23	17384	16891	16444	16444
query23_1	16740	16677	16701	16677
query24	7157	1669	1224	1224
query24_1	1222	1231	1236	1231
query25	569	488	423	423
query26	1240	279	163	163
query27	2727	491	325	325
query28	4418	1877	1871	1871
query29	811	546	467	467
query30	313	247	209	209
query31	878	728	643	643
query32	75	73	70	70
query33	534	362	283	283
query34	942	897	540	540
query35	644	665	599	599
query36	1148	1098	935	935
query37	138	93	84	84
query38	2948	2875	2849	2849
query39	888	879	822	822
query39_1	829	829	939	829
query40	229	157	139	139
query41	64	61	59	59
query42	102	101	106	101
query43	392	390	354	354
query44	
query45	196	196	185	185
query46	880	999	615	615
query47	2059	2131	2049	2049
query48	325	315	236	236
query49	625	451	373	373
query50	702	283	222	222
query51	4112	4127	4057	4057
query52	105	108	94	94
query53	297	343	281	281
query54	332	268	259	259
query55	88	87	79	79
query56	323	290	303	290
query57	1340	1321	1279	1279
query58	284	273	272	272
query59	2647	2701	2557	2557
query60	335	345	324	324
query61	155	147	146	146
query62	660	568	551	551
query63	330	282	277	277
query64	4862	1253	982	982
query65	
query66	1415	470	347	347
query67	16253	16447	16193	16193
query68	
query69	402	311	297	297
query70	1013	1024	967	967
query71	338	311	304	304
query72	2752	2715	2339	2339
query73	547	576	328	328
query74	9988	9895	9726	9726
query75	2891	2732	2460	2460
query76	2330	1028	704	704
query77	370	410	304	304
query78	11243	11279	10710	10710
query79	3423	809	585	585
query80	1781	638	544	544
query81	598	282	255	255
query82	759	153	116	116
query83	340	258	243	243
query84	256	111	105	105
query85	884	490	421	421
query86	500	333	295	295
query87	3120	3090	3007	3007
query88	4741	2660	2646	2646
query89	437	379	342	342
query90	2103	180	175	175
query91	165	160	134	134
query92	85	79	69	69
query93	2690	837	498	498
query94	648	304	275	275
query95	592	343	311	311
query96	643	524	228	228
query97	2440	2474	2406	2406
query98	233	211	215	211
query99	1021	991	902	902
Total cold run time: 261374 ms
Total hot run time: 183957 ms

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 0.00% (0/35) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.70% (19548/37094)
Line Coverage 36.25% (182233/502700)
Region Coverage 32.60% (141418/433825)
Branch Coverage 33.63% (61292/182268)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants