Skip to content

Conversation

@kaka11chen
Copy link
Contributor

What problem does this PR solve?

Problem Summary:

Release note

Cherry-pick #51248

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

…teTime, LazyReadFilteredRows profile metrics in parquet orc profiles.

Cherry-pick apache#51248
@kaka11chen kaka11chen requested a review from dataroaring as a code owner July 21, 2025 02:30
@Thearas
Copy link
Contributor

Thearas commented Jul 21, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@kaka11chen
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39891 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e25ddfd7d11ad0b9734b0e3d03bc04bb53782b47, data reload: false

------ Round 1 ----------------------------------
q1	17590	7009	6579	6579
q2	2078	193	197	193
q3	11263	1149	1204	1149
q4	10233	759	693	693
q5	7726	2907	2856	2856
q6	218	135	137	135
q7	971	628	606	606
q8	9378	2003	2062	2003
q9	6654	6388	6432	6388
q10	6958	2235	2321	2235
q11	453	269	264	264
q12	395	218	221	218
q13	17796	2993	2989	2989
q14	234	207	207	207
q15	522	474	470	470
q16	467	381	373	373
q17	996	602	615	602
q18	7208	6686	6615	6615
q19	1409	1116	1143	1116
q20	504	208	204	204
q21	4150	3256	3014	3014
q22	1129	982	1003	982
Total cold run time: 108332 ms
Total hot run time: 39891 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6630	6561	6686	6561
q2	341	232	243	232
q3	2927	3003	3106	3003
q4	2023	1812	1840	1812
q5	5687	5673	5747	5673
q6	209	130	130	130
q7	2239	1783	1813	1783
q8	3289	3527	3531	3527
q9	8861	8863	8908	8863
q10	3575	3501	3499	3499
q11	593	498	504	498
q12	864	592	626	592
q13	7463	3160	3136	3136
q14	305	265	265	265
q15	527	479	453	453
q16	485	435	431	431
q17	1848	1633	1591	1591
q18	8105	7704	7829	7704
q19	1711	1610	1589	1589
q20	2061	1823	1802	1802
q21	5073	4833	4901	4833
q22	1117	1029	991	991
Total cold run time: 65933 ms
Total hot run time: 58968 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189619 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e25ddfd7d11ad0b9734b0e3d03bc04bb53782b47, data reload: false

query1	970	368	362	362
query2	6509	2000	1986	1986
query3	6709	217	222	217
query4	34419	23825	23503	23503
query5	4304	451	450	450
query6	266	166	170	166
query7	4626	314	315	314
query8	282	210	212	210
query9	9735	2597	2580	2580
query10	488	261	268	261
query11	18868	15214	15626	15214
query12	151	102	103	102
query13	1657	411	404	404
query14	9857	6607	7017	6607
query15	265	172	183	172
query16	8106	489	456	456
query17	1631	563	572	563
query18	2139	297	297	297
query19	283	158	152	152
query20	111	105	104	104
query21	206	101	102	101
query22	4425	4177	4140	4140
query23	34530	33681	33371	33371
query24	11237	2903	2883	2883
query25	674	389	392	389
query26	1298	165	171	165
query27	2935	355	332	332
query28	7898	2124	2105	2105
query29	805	436	412	412
query30	315	168	158	158
query31	1006	799	789	789
query32	90	57	57	57
query33	783	299	296	296
query34	938	489	521	489
query35	870	724	705	705
query36	1103	928	958	928
query37	127	67	66	66
query38	3963	3795	3854	3795
query39	1474	1405	1443	1405
query40	290	101	98	98
query41	51	50	48	48
query42	120	102	98	98
query43	528	462	475	462
query44	1274	799	792	792
query45	185	166	168	166
query46	1123	696	710	696
query47	1913	1805	1836	1805
query48	470	389	387	387
query49	1189	403	407	403
query50	805	401	415	401
query51	7222	7080	7012	7012
query52	101	97	93	93
query53	261	187	186	186
query54	1189	471	479	471
query55	78	82	81	81
query56	279	267	247	247
query57	1267	1167	1144	1144
query58	251	219	216	216
query59	3160	2851	2886	2851
query60	295	262	265	262
query61	137	143	135	135
query62	856	665	683	665
query63	216	190	188	188
query64	5511	766	739	739
query65	3289	3189	3192	3189
query66	1352	319	319	319
query67	15980	15445	15466	15445
query68	4017	607	578	578
query69	415	273	283	273
query70	1152	1131	1095	1095
query71	323	260	261	260
query72	6332	4101	4009	4009
query73	757	352	347	347
query74	9949	8931	8947	8931
query75	3365	2643	2651	2643
query76	2764	992	1046	992
query77	400	279	280	279
query78	10405	9564	9481	9481
query79	2376	610	610	610
query80	1128	447	423	423
query81	531	221	229	221
query82	688	89	97	89
query83	230	146	146	146
query84	237	84	88	84
query85	1419	298	300	298
query86	467	281	299	281
query87	4342	4205	4243	4205
query88	3866	2426	2387	2387
query89	405	296	293	293
query90	1970	191	191	191
query91	188	151	149	149
query92	65	51	53	51
query93	1383	568	560	560
query94	795	302	299	299
query95	358	271	256	256
query96	620	281	285	281
query97	3245	3122	3108	3108
query98	217	197	193	193
query99	1501	1301	1346	1301
Total cold run time: 301355 ms
Total hot run time: 189619 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e25ddfd7d11ad0b9734b0e3d03bc04bb53782b47, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.54	0.51	0.51
query6	1.12	0.73	0.73
query7	0.02	0.01	0.02
query8	0.03	0.03	0.03
query9	0.57	0.51	0.50
query10	0.56	0.57	0.56
query11	0.14	0.11	0.10
query12	0.15	0.11	0.11
query13	0.60	0.60	0.59
query14	0.79	0.78	0.81
query15	0.84	0.83	0.82
query16	0.39	0.38	0.39
query17	1.06	1.02	1.04
query18	0.24	0.23	0.22
query19	1.94	1.87	1.89
query20	0.01	0.01	0.01
query21	15.39	0.58	0.58
query22	2.24	1.57	2.12
query23	16.87	0.99	0.88
query24	3.48	1.21	1.12
query25	0.21	0.11	0.08
query26	0.45	0.13	0.14
query27	0.06	0.05	0.04
query28	10.04	0.53	0.46
query29	12.59	3.30	3.26
query30	0.25	0.07	0.06
query31	2.85	0.39	0.39
query32	3.24	0.46	0.48
query33	3.00	3.02	3.01
query34	16.76	4.50	4.49
query35	4.61	4.55	4.50
query36	0.71	0.48	0.48
query37	0.08	0.06	0.07
query38	0.06	0.03	0.03
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.04	0.02	0.03
Total cold run time: 104.18 s
Total hot run time: 30.28 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 9.21% (14/152) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 41.90% (11136/26580)
Line Coverage 32.44% (95407/294124)
Region Coverage 31.57% (49264/156065)
Branch Coverage 27.99% (25242/90182)

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 2b2677c into apache:branch-3.0 Jul 22, 2025
23 of 25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants