Skip to content

Print long request history to log#8131

Merged
serbel324 merged 21 commits intoydb-platform:mainfrom
serbel324:bs/dsproxy/long-reqeuests-log
Sep 9, 2024
Merged

Print long request history to log#8131
serbel324 merged 21 commits intoydb-platform:mainfrom
serbel324:bs/dsproxy/long-reqeuests-log

Conversation

@serbel324
Copy link
Copy Markdown
Collaborator

@serbel324 serbel324 commented Aug 21, 2024 •
edited by Evgenik2
Loading

  • Intermediate
  • Add Request Reporting throttler
  • Wrap ctor args in structs
  • Merge mistake fixed
  • Print LogAccumulator output on long requests
  • Add more information to RootCause tracker
  • Register VPuts in RootCause tracker

Changelog entry

Print long request history to log

Changelog category

  • Improvement

Additional information

...

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 21, 2024 •
edited
Loading

⚪ 2024-08-21 17:40:12 UTC Pre-commit check for 882617a has started.
⚪ 2024-08-21 17:43:08 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-21 18:00:08 UTC Build successful.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 21, 2024 •
edited
Loading

⚪ 2024-08-21 17:40:12 UTC Pre-commit check for 882617a has started.
⚪ 2024-08-21 17:43:05 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-08-21 19:13:01 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15751 14382 0 11 1342 16

⚪ 2024-08-21 19:14:22 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟡 2024-08-21 19:24:05 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
25 (only retried tests) 16 0 1 0 8

⚪ 2024-08-21 19:24:13 UTC Failed tests rerun (try 3) linux-x86_64-relwithdebinfo is running...
🔴 2024-08-21 19:31:21 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14 (only retried tests) 5 0 1 0 8

🟢 2024-08-21 19:31:28 UTC Build successful.
🟡 2024-08-21 19:32:09 UTC ydbd size 8.1 GiB changed* by +397.5 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 8e44a97 merge: 882617a diff diff %
ydbd size 8 749 629 152 Bytes 8 750 036 176 Bytes +397.5 KiB +0.005%
ydbd stripped size 475 887 432 Bytes 475 902 792 Bytes +15.0 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 21, 2024 •
edited
Loading

⚪ 2024-08-21 17:40:25 UTC Pre-commit check for 882617a has started.
⚪ 2024-08-21 17:43:21 UTC Check linux-x86_64-release-asan is running...
🔴 2024-08-21 19:39:42 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
11169 11054 0 45 44 26

🟢 2024-08-21 19:40:40 UTC Build successful.
🟡 2024-08-21 19:41:12 UTC ydbd size 5.5 GiB changed* by +264.3 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 8e44a97 merge: 882617a diff diff %
ydbd size 5 888 643 904 Bytes 5 888 914 528 Bytes +264.3 KiB +0.005%
ydbd stripped size 1 478 666 608 Bytes 1 478 717 072 Bytes +49.3 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 22, 2024 •
edited
Loading

⚪ 2024-08-22 13:43:57 UTC Pre-commit check for ddf702e has started.
⚪ 2024-08-22 13:46:53 UTC Check linux-x86_64-release-asan is running...
🔴 2024-08-22 15:29:10 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
11179 11109 0 29 27 14

🟢 2024-08-22 15:30:08 UTC Build successful.
🟡 2024-08-22 15:30:42 UTC ydbd size 5.5 GiB changed* by +254.8 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 331c965 merge: ddf702e diff diff %
ydbd size 5 890 308 336 Bytes 5 890 569 216 Bytes +254.8 KiB +0.004%
ydbd stripped size 1 479 110 800 Bytes 1 479 159 984 Bytes +48.0 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 22, 2024 •
edited
Loading

⚪ 2024-08-22 13:44:00 UTC Pre-commit check for ddf702e has started.
⚪ 2024-08-22 13:46:49 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-22 14:03:00 UTC Build successful.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 22, 2024 •
edited
Loading

⚪ 2024-08-22 13:47:55 UTC Pre-commit check for ddf702e has started.
⚪ 2024-08-22 13:51:57 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-08-22 15:17:33 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15768 14396 0 8 1343 21

⚪ 2024-08-22 15:18:54 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟢 2024-08-22 15:27:53 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
33 (only retried tests) 22 0 0 1 10

🟢 2024-08-22 15:28:01 UTC Build successful.
🟡 2024-08-22 15:28:44 UTC ydbd size 8.2 GiB changed* by +394.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 331c965 merge: ddf702e diff diff %
ydbd size 8 752 126 216 Bytes 8 752 530 040 Bytes +394.4 KiB +0.005%
ydbd stripped size 476 005 064 Bytes 476 016 328 Bytes +11.0 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@serbel324 serbel324 changed the title Print long-lasting request history to log Print long request history to log Aug 22, 2024
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 23, 2024 •
edited
Loading

⚪ 2024-08-23 10:25:39 UTC Pre-commit check for 8cb8ce8 has started.
⚪ 2024-08-23 10:28:23 UTC Check linux-x86_64-release-asan is running...
⚫ 2024-08-23 11:50:37 UTC Check cancelled

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 23, 2024 •
edited
Loading

⚪ 2024-08-23 10:25:39 UTC Pre-commit check for 8cb8ce8 has started.
⚪ 2024-08-23 10:28:22 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-08-23 11:33:52 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15774 14406 0 8 1342 18

⚪ 2024-08-23 11:35:24 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟢 2024-08-23 11:43:58 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
26 (only retried tests) 16 0 0 0 10

🟢 2024-08-23 11:44:07 UTC Build successful.
🟡 2024-08-23 11:44:40 UTC ydbd size 8.2 GiB changed* by +371.8 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: e128490 merge: 8cb8ce8 diff diff %
ydbd size 8 759 113 104 Bytes 8 759 493 800 Bytes +371.8 KiB +0.004%
ydbd stripped size 476 301 064 Bytes 476 314 184 Bytes +12.8 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Aug 23, 2024 •
edited
Loading

⚪ 2024-08-23 10:25:41 UTC Pre-commit check for 8cb8ce8 has started.
⚪ 2024-08-23 10:28:28 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-23 10:45:02 UTC Build successful.

alexvru
alexvru requested changes Aug 23, 2024
View reviewed changes
Comment thread ydb/core/blobstorage/dsproxy/dsproxy_request_reporting.cpp Outdated
va-kuznecov
va-kuznecov requested changes Aug 23, 2024
View reviewed changes
Comment thread ydb/core/blobstorage/dsproxy/dsproxy_request_reporting.cpp Outdated
Comment thread ydb/core/blobstorage/dsproxy/dsproxy_request_reporting.cpp Outdated
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Sep 5, 2024 •
edited
Loading

⚪ 2024-09-05 11:36:18 UTC Pre-commit check linux-x86_64-relwithdebinfo for 67df150 has started.
⚪ 2024-09-05 11:40:58 UTC ya make is running...
🔴 2024-09-05 11:49:42 UTC Build failed. see the logs.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Sep 5, 2024 •
edited
Loading

⚪ 2024-09-05 11:54:54 UTC Pre-commit check linux-x86_64-release-asan for 67df150 has started.
⚪ 2024-09-05 11:59:15 UTC ya make is running...
🔴 2024-09-05 12:07:04 UTC Build failed. see the logs.

@serbel324 serbel324 force-pushed the bs/dsproxy/long-reqeuests-log branch from 47a5ec4 to 81282a2 Compare September 6, 2024 07:44
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Sep 6, 2024 •
edited
Loading

⚪ 2024-09-06 07:47:39 UTC Pre-commit check linux-x86_64-release-asan for daf008b has started.
⚪ 2024-09-06 07:50:54 UTC ya make is running...
🔴 2024-09-06 08:16:50 UTC Build failed. see the logs.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Sep 6, 2024 •
edited
Loading

⚪ 2024-09-06 07:47:45 UTC Pre-commit check linux-x86_64-relwithdebinfo for daf008b has started.
⚪ 2024-09-06 07:50:49 UTC ya make is running...
🔴 2024-09-06 08:17:42 UTC Build failed. see the logs.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Sep 6, 2024 •
edited
Loading

⚪ 2024-09-06 07:47:51 UTC Pre-commit check linux-x86_64-release-clang14 for daf008b has started.
⚪ 2024-09-06 07:51:00 UTC ya make is running...
🔴 2024-09-06 08:19:14 UTC Build failed. see the logs.

@serbel324 serbel324 force-pushed the bs/dsproxy/long-reqeuests-log branch from 81282a2 to 342b8a0 Compare September 6, 2024 15:14
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Sep 6, 2024 •
edited
Loading

⚪ 2024-09-06 15:16:46 UTC Pre-commit check linux-x86_64-release-clang14 for 244d765 has started.
⚪ 2024-09-06 15:20:15 UTC ya make is running...
🟢 2024-09-06 16:02:10 UTC Build successful.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Sep 6, 2024 •
edited
Loading

⚪ 2024-09-06 15:19:05 UTC Pre-commit check linux-x86_64-release-asan for 244d765 has started.
⚪ 2024-09-06 15:22:16 UTC ya make is running...
🔴 2024-09-06 17:42:23 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
11539 11413 0 39 53 34

🟢 2024-09-06 17:43:29 UTC Build successful.
🟡 2024-09-06 17:44:03 UTC ydbd size 5.6 GiB changed* by +900.8 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: e10ef55 merge: 244d765 diff diff %
ydbd size 6 029 479 688 Bytes 6 030 402 056 Bytes +900.8 KiB +0.015%
ydbd stripped size 1 509 734 544 Bytes 1 509 887 184 Bytes +149.1 KiB +0.010%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Sep 6, 2024 •
edited
Loading

⚪ 2024-09-06 15:36:15 UTC Pre-commit check linux-x86_64-relwithdebinfo for 244d765 has started.
⚪ 2024-09-06 15:39:14 UTC ya make is running...
🟡 2024-09-06 17:12:17 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40802 35308 0 42 5425 27

⚪ 2024-09-06 17:16:06 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-09-06 17:26:25 UTC Some tests failed, follow the links below. Going to retry failed tests...

Details

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
79 (only retried tests) 54 0 5 0 20

⚪ 2024-09-06 17:26:33 UTC ya make is running... (failed tests rerun, try 3)
🟢 2024-09-06 17:35:09 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
31 (only retried tests) 13 0 0 0 18

🟢 2024-09-06 17:35:16 UTC Build successful.
🟡 2024-09-06 17:35:55 UTC ydbd size 8.4 GiB changed* by +1.5 MiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: e10ef55 merge: 244d765 diff diff %
ydbd size 9 013 808 808 Bytes 9 015 422 504 Bytes +1.5 MiB +0.018%
ydbd stripped size 487 307 816 Bytes 487 349 736 Bytes +40.9 KiB +0.009%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@serbel324 serbel324 merged commit 7dd3f4d into ydb-platform:main Sep 9, 2024
This was referenced Sep 10, 2024
Merged
Merged
@shnikd shnikd mentioned this pull request Sep 11, 2024
Closed
@StekPerepolnen StekPerepolnen mentioned this pull request Sep 17, 2024
Merged
VPolka added a commit to VPolka/ydb that referenced this pull request Nov 5, 2024
@VPolka
Print long request history to log ydb-platform#8131
4345b4f
VPolka added a commit to VPolka/ydb that referenced this pull request Nov 5, 2024
@VPolka
Print long request history to log ydb-platform#8131
5408146
VPolka added a commit to VPolka/ydb that referenced this pull request Nov 6, 2024
@VPolka
Print long request history to log ydb-platform#8131
32b7120
VPolka added a commit to VPolka/ydb that referenced this pull request Nov 6, 2024
@VPolka
Print long request history to log ydb-platform#8131
ed192d2
VPolka added a commit to VPolka/ydb that referenced this pull request Nov 7, 2024
@VPolka
Print long request history to log ydb-platform#8131
908fa33
VPolka added a commit to VPolka/ydb that referenced this pull request Nov 7, 2024
@VPolka
Print long request history to log ydb-platform#8131
15bc5d2
VPolka added a commit to VPolka/ydb that referenced this pull request Nov 7, 2024
@VPolka
Print long request history to log ydb-platform#8131
af781a8
VPolka added a commit to VPolka/ydb that referenced this pull request Nov 7, 2024
@VPolka
Print long request history to log ydb-platform#8131
2ef1de0
VPolka added a commit to VPolka/ydb that referenced this pull request Dec 12, 2024
@VPolka
Print long request history to log ydb-platform#8131
a7619cc
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 25, 2025

🟢 2025-04-25 15:46:21 UTC The validation of the Pull Request description is successful.

@serbel324 serbel324 linked an issue Sep 17, 2025 that may be closed by this pull request
Report long dsproxy request history to process log #7841
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@alexvru alexvru alexvru approved these changes

@va-kuznecov va-kuznecov va-kuznecov left review comments

Assignees

No one assigned

Labels

improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Report long dsproxy request history to process log

3 participants

@serbel324 @va-kuznecov @alexvru