Merging CBO into stable-24-3-8-analytics by pavelvelikhov · Pull Request #8819 · ydb-platform/ydb

pavelvelikhov · 2024-09-05T15:39:19Z

Changelog entry

...

Changelog category

New feature

Additional information

...

Co-authored-by: Pavel Ivanov <pudge1000-7@ydb.tech>

…es (ydb-platform#6982)

…db-platform#7550)

…form#8536)

github-actions · 2024-09-05T16:58:31Z

⚪ 2024-09-05 16:58:30 UTC Pre-commit check for 414bb60 has started.
⚪ 2024-09-05 17:01:24 UTC Build linux-x86_64-release-clang14 is running...
🔴 2024-09-05 17:28:40 UTC Build failed. see the build logs.

github-actions · 2024-09-05T17:00:23Z

⚪ 2024-09-05 17:00:22 UTC Pre-commit check for 414bb60 has started.
⚪ 2024-09-05 17:03:49 UTC Build linux-x86_64-relwithdebinfo is running...
🔴 2024-09-05 17:37:09 UTC Build failed. see the build logs.
🔴 2024-09-05 17:37:11 UTC Tests run skipped.

github-actions · 2024-09-06T05:44:27Z

⚪ 2024-09-06 05:44:27 UTC Pre-commit check for 1c41581 has started.
⚪ 2024-09-06 05:47:25 UTC Build linux-x86_64-release-asan is running...
🟢 2024-09-06 06:27:11 UTC Build successful.
⚪ 2024-09-06 06:27:24 UTC Tests are running...
🔴 2024-09-06 08:30:11 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15493	15358	0	51	52	32

🔴 2024-09-06 08:30:52 UTC ydbd size 5.5 GiB changed* by +3.5 MiB, which is >= 2.0 MiB vs stable-24-3-8-analytics: Alert

ydbd size dash	stable-24-3-8-analytics: `1b9be9f`	merge: `1c41581`	diff	diff %
ydbd size	5 948 410 576 Bytes	5 952 053 320 Bytes	+3.5 MiB	+0.061%
ydbd stripped size	1 490 567 712 Bytes	1 491 158 784 Bytes	+577.2 KiB	+0.040%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-06T09:06:51Z

⚪ 2024-09-06 09:06:51 UTC Pre-commit check for b5d5d41 has started.
⚪ 2024-09-06 09:09:43 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-09-06 09:15:05 UTC Build successful.

github-actions · 2024-09-06T09:06:57Z

⚪ 2024-09-06 09:06:56 UTC Pre-commit check for b5d5d41 has started.
⚪ 2024-09-06 09:09:57 UTC Build linux-x86_64-relwithdebinfo is running...
⚫ 2024-09-06 09:31:16 UTC Check cancelled

github-actions · 2024-09-06T09:07:38Z

⚪ 2024-09-06 09:07:38 UTC Pre-commit check for b5d5d41 has started.
⚪ 2024-09-06 09:10:43 UTC Build linux-x86_64-release-asan is running...
⚫ 2024-09-06 09:31:22 UTC Check cancelled

github-actions · 2024-09-06T09:33:09Z

⚪ 2024-09-06 09:33:08 UTC Pre-commit check for 83ca09b has started.
⚪ 2024-09-06 09:36:10 UTC Build linux-x86_64-release-asan is running...
⚫ 2024-09-06 09:39:54 UTC Check cancelled

github-actions · 2024-09-06T09:33:32Z

⚪ 2024-09-06 09:33:31 UTC Pre-commit check for 83ca09b has started.
⚪ 2024-09-06 09:36:34 UTC Build linux-x86_64-relwithdebinfo is running...
⚫ 2024-09-06 09:39:25 UTC Check cancelled

github-actions · 2024-09-06T09:34:41Z

⚪ 2024-09-06 09:34:41 UTC Pre-commit check for 83ca09b has started.
⚪ 2024-09-06 09:37:34 UTC Build linux-x86_64-release-clang14 is running...
⚫ 2024-09-06 09:39:16 UTC Check cancelled

github-actions · 2024-09-06T09:42:04Z

⚪ 2024-09-06 09:42:04 UTC Pre-commit check for 2b2417f has started.
⚪ 2024-09-06 09:45:00 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-09-06 10:25:21 UTC Build successful.
⚪ 2024-09-06 10:25:35 UTC Tests are running...
🔴 2024-09-06 12:32:10 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
76579	63122	0	2	13423	32

🔴 2024-09-06 12:32:57 UTC ydbd size 8.2 GiB changed* by +4.8 MiB, which is >= 2.0 MiB vs stable-24-3-8-analytics: Alert

ydbd size dash	stable-24-3-8-analytics: `1b9be9f`	merge: `2b2417f`	diff	diff %
ydbd size	8 781 707 408 Bytes	8 786 759 488 Bytes	+4.8 MiB	+0.058%
ydbd stripped size	479 727 080 Bytes	479 891 752 Bytes	+160.8 KiB	+0.034%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-06T09:43:10Z

⚪ 2024-09-06 09:43:10 UTC Pre-commit check for 2b2417f has started.
⚪ 2024-09-06 09:46:07 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-09-06 09:51:39 UTC Build successful.

github-actions · 2024-09-06T09:43:51Z

⚪ 2024-09-06 09:43:50 UTC Pre-commit check for 2b2417f has started.
⚪ 2024-09-06 09:46:47 UTC Build linux-x86_64-release-asan is running...
🟢 2024-09-06 10:11:19 UTC Build successful.
⚪ 2024-09-06 10:11:36 UTC Tests are running...
🔴 2024-09-06 12:14:52 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15492	15371	0	29	56	36

🔴 2024-09-06 12:15:37 UTC ydbd size 5.5 GiB changed* by +3.5 MiB, which is >= 2.0 MiB vs stable-24-3-8-analytics: Alert

ydbd size dash	stable-24-3-8-analytics: `1b9be9f`	merge: `2b2417f`	diff	diff %
ydbd size	5 948 410 576 Bytes	5 952 053 320 Bytes	+3.5 MiB	+0.061%
ydbd stripped size	1 490 567 712 Bytes	1 491 158 784 Bytes	+577.2 KiB	+0.040%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-06T12:51:57Z

⚪ 2024-09-06 12:51:57 UTC Pre-commit check for 7cb68e6 has started.
⚪ 2024-09-06 12:55:24 UTC Build linux-x86_64-release-asan is running...
🟢 2024-09-06 13:19:56 UTC Build successful.
⚪ 2024-09-06 13:20:14 UTC Tests are running...
🔴 2024-09-06 15:28:29 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15490	15377	0	28	52	33

🔴 2024-09-06 15:29:06 UTC ydbd size 5.5 GiB changed* by +3.5 MiB, which is >= 2.0 MiB vs stable-24-3-8-analytics: Alert

ydbd size dash	stable-24-3-8-analytics: `1b9be9f`	merge: `7cb68e6`	diff	diff %
ydbd size	5 948 410 576 Bytes	5 952 053 320 Bytes	+3.5 MiB	+0.061%
ydbd stripped size	1 490 567 712 Bytes	1 491 158 784 Bytes	+577.2 KiB	+0.040%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-06T13:02:48Z

⚪ 2024-09-06 13:02:48 UTC Pre-commit check for 7cb68e6 has started.
⚪ 2024-09-06 13:06:11 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-09-06 13:45:46 UTC Build successful.
⚪ 2024-09-06 13:46:00 UTC Tests are running...
🔴 2024-09-06 15:59:27 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
76580	63120	0	3	13425	32

🔴 2024-09-06 16:00:09 UTC ydbd size 8.2 GiB changed* by +4.8 MiB, which is >= 2.0 MiB vs stable-24-3-8-analytics: Alert

ydbd size dash	stable-24-3-8-analytics: `1b9be9f`	merge: `7cb68e6`	diff	diff %
ydbd size	8 781 707 408 Bytes	8 786 759 488 Bytes	+4.8 MiB	+0.058%
ydbd stripped size	479 727 080 Bytes	479 891 752 Bytes	+160.8 KiB	+0.034%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-06T13:06:02Z

⚪ 2024-09-06 13:06:02 UTC Pre-commit check for 7cb68e6 has started.
⚪ 2024-09-06 13:09:28 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-09-06 13:16:01 UTC Build successful.

Co-authored-by: Pavel Ivanov <pudge1000-7@ydb.tech> Co-authored-by: Tony-Romanov <150126326+Tony-Romanov@users.noreply.github.com>

pavelvelikhov and others added 27 commits September 5, 2024 15:04

Enabled CBO (ydb-platform#5780)

bd7d66a

Co-authored-by: Pavel Ivanov <pudge1000-7@ydb.tech>

Added table service flag for CBO (ydb-platform#6493)

b2ab2e5

Fixed bugs in CBO statistics calculation (ydb-platform#6537)

dc1eae0

Enabled constant folding by default (ydb-platform#6509)

37dfe2c

Fixed statistics calculation for index read (ydb-platform#6629)

3246373

[CBO] Fix Selectivity (ydb-platform#6645)

bf51dd2

Cached overriden statistics for CBO (ydb-platform#6791)

9b7069e

Added parameter selectivity and boosted LookupJoin (ydb-platform#6874)

033c22d

[CBO] Logging level fixed (ydb-platform#6911)

8551fdb

[] Added query action check. (ydb-platform#7017)

b01b3b3

Fixed a problem in RBO in MapJoin implementation (ydb-platform#7044)

e509c5e

Reenabled grace join pragma (ydb-platform#7160)

7d434fb

Don't run CBO if statistics is not avaliable (ydb-platform#7089)

63105ce

Removed a rule that turned Shuffle into Map breaking some TPCDS queri…

6d7ab43

…es (ydb-platform#6982)

Switched off GraceSelfJoinCore (ydb-platform#7308)

66a2d2d

Added Query Hints for the Optimizer (ydb-platform#7629)

0761181

Cleaned up code that removes aliases from attributes (ydb-platform#7745)

c0282dd

[CBO] Make optimizer get only columns stats that are used in request (y…

95a0484

…db-platform#7550)

[CBO] Column shards tests added (ydb-platform#7972)

325affb

Fixed a subtle bug in removing aliases (ydb-platform#8003)

74698ad

Lowered threshold for MapJoin (ydb-platform#8147)

2a796d0

[CBO] Join order hints added (ydb-platform#8106)

4eb4a9b

Added another cost based optimization level (ydb-platform#8348)

f91d492

Stopped pushing null as arguments to TCoIf in column shards (ydb-plat…

b621242

…form#8536)

[KQP] Make KqpOlapFilter be shown in a query plan (ydb-platform#8504)

140c037

[CBO] Make hints process many trees. (ydb-platform#8554)

5b755d9

[CBO] Join Order test improvement (ydb-platform#8602)

5cf466f

pavelvelikhov requested a review from a team as a code owner September 5, 2024 15:39

pavelvelikhov and others added 4 commits September 6, 2024 08:20

Muted QueryService test

0966da4

Fix pushdown logical ops with scalar argument. (ydb-platform#6142)

839709d

Fix test of exotic XOR. (ydb-platform#6317)

efee80f

Updated unit tests

58ecfb4

Cannonized dq_file tests

b304730

Canonized suite tests

b5ab6fd

Canonized clickbench

16e7046

pavelvelikhov enabled auto-merge (squash) September 6, 2024 12:38

fomichev3000 approved these changes Sep 6, 2024

View reviewed changes

pavelvelikhov merged commit 8ffabfb into ydb-platform:stable-24-3-8-analytics Sep 6, 2024

uzhastik pushed a commit to uzhastik/ydb that referenced this pull request Sep 17, 2024

Merging CBO into stable-24-3-8-analytics (ydb-platform#8819)

8b012a9

Co-authored-by: Pavel Ivanov <pudge1000-7@ydb.tech> Co-authored-by: Tony-Romanov <150126326+Tony-Romanov@users.noreply.github.com>

StekPerepolnen mentioned this pull request Oct 29, 2024

viewer healthcheck pathmerge stable 24 #11044

Closed

GrigoriyPA mentioned this pull request Feb 21, 2025

merge to ydb stable YQ-4070 supported insert values for s3 #14914

Closed

This was referenced Jun 3, 2025

Enable kafka port for local ydb container #19218

Closed

Enable kafka port for local ydb container #19220

Closed

StekPerepolnen mentioned this pull request Jul 28, 2025

audit extra merge stream nb 24 4 #21776

Closed

StekPerepolnen mentioned this pull request Jan 9, 2026

CORS mon #31715

Closed

Conversation

pavelvelikhov commented Sep 5, 2024

Changelog entry

Changelog category

Additional information

Uh oh!

github-actions bot commented Sep 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 6, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

github-actions bot commented Sep 5, 2024 •

edited

Loading

github-actions bot commented Sep 5, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading

github-actions bot commented Sep 6, 2024 •

edited

Loading