YDB FQ: Support Greenplum as an external data source by skywalker-jpg · Pull Request #4907 · ydb-platform/ydb

skywalker-jpg · 2024-05-27T19:58:41Z

Changelog entry

Add Greenplum as new connect to YDB

Changelog category

New feature

github-actions · 2024-05-27T20:01:52Z

⚪ 2024-05-27 20:01:52 UTC Pre-commit check for cef8626 has started.
⚪ 2024-05-27 20:04:23 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-27 20:15:54 UTC Build successful.
⚪ 2024-05-27 20:16:06 UTC Tests are running...
🔴 2024-05-27 22:10:25 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
10778	10699	0	29	39	11

github-actions · 2024-05-27T20:02:03Z

⚪ 2024-05-27 20:02:03 UTC Pre-commit check for cef8626 has started.
⚪ 2024-05-27 20:04:34 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-27 20:14:49 UTC Build successful.

github-actions · 2024-05-27T20:02:09Z

⚪ 2024-05-27 20:02:09 UTC Pre-commit check for cef8626 has started.
⚪ 2024-05-27 20:04:41 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-27 20:15:46 UTC Build successful.
⚪ 2024-05-27 20:16:02 UTC Tests are running...
🔴 2024-05-27 21:50:55 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
38309	33519	0	3	4782	5

github-actions · 2024-05-28T08:02:00Z

⚪ 2024-05-28 08:01:59 UTC Pre-commit check for 76f3814 has started.
⚪ 2024-05-28 08:04:41 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-28 08:16:12 UTC Build successful.

github-actions · 2024-05-28T08:02:04Z

⚪ 2024-05-28 08:02:03 UTC Pre-commit check for 76f3814 has started.
⚪ 2024-05-28 08:04:42 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-28 08:17:51 UTC Build successful.
⚪ 2024-05-28 08:18:03 UTC Tests are running...
🔴 2024-05-28 10:24:36 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
10783	10681	0	51	36	15

github-actions · 2024-05-28T08:02:22Z

⚪ 2024-05-28 08:02:22 UTC Pre-commit check for 76f3814 has started.
⚪ 2024-05-28 08:05:03 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-28 08:16:55 UTC Build successful.
⚪ 2024-05-28 08:17:09 UTC Tests are running...
🔴 2024-05-28 09:53:34 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
38312	33521	0	4	4782	5

ydb/core/external_sources/external_source_factory.cpp

ydb/library/yql/providers/generic/provider/yql_generic_load_meta.cpp

ydb/tests/tools/kqprun/app_conf.txt

github-actions · 2024-05-29T09:51:07Z

⚪ 2024-05-29 09:51:06 UTC Pre-commit check for 760af36 has started.
⚫ 2024-05-29 09:52:28 UTC Check cancelled

github-actions · 2024-05-29T09:51:18Z

⚪ 2024-05-29 09:51:18 UTC Pre-commit check for 760af36 has started.
⚫ 2024-05-29 09:52:26 UTC Check cancelled

github-actions · 2024-05-29T09:53:55Z

⚪ 2024-05-29 09:53:54 UTC Pre-commit check for 760af36 has started.
⚪ 2024-05-29 09:56:35 UTC Build linux-x86_64-release-asan is running...
⚫ 2024-05-29 10:06:02 UTC Check cancelled

github-actions · 2024-05-29T09:55:33Z

⚪ 2024-05-29 09:55:32 UTC Pre-commit check for 760af36 has started.
⚪ 2024-05-29 09:58:32 UTC Build linux-x86_64-release-clang14 is running...
⚫ 2024-05-29 10:06:10 UTC Check cancelled

github-actions · 2024-05-29T09:57:02Z

⚪ 2024-05-29 09:57:02 UTC Pre-commit check for 760af36 has started.
⚪ 2024-05-29 09:59:53 UTC Build linux-x86_64-relwithdebinfo is running...
⚫ 2024-05-29 10:06:10 UTC Check cancelled

github-actions · 2024-05-29T10:07:29Z

⚪ 2024-05-29 10:07:28 UTC Pre-commit check for 999d4ce has started.
⚪ 2024-05-29 10:10:10 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-29 10:42:39 UTC Build successful.
⚪ 2024-05-29 10:42:52 UTC Tests are running...
🔴 2024-05-29 10:50:26 UTC Test run completed, no test results found for commit 528badc. Please check build logs.
⚫ 2024-05-29 10:50:49 UTC Check cancelled

github-actions · 2024-05-29T10:07:29Z

⚪ 2024-05-29 10:07:29 UTC Pre-commit check for 999d4ce has started.
⚪ 2024-05-29 10:10:14 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-29 10:43:37 UTC Build successful.

github-actions · 2024-05-29T10:09:10Z

⚪ 2024-05-29 10:09:10 UTC Pre-commit check for 999d4ce has started.
⚪ 2024-05-29 10:12:02 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-29 10:49:18 UTC Build successful.
⚪ 2024-05-29 10:49:30 UTC Tests are running...
🔴 2024-05-29 10:50:12 UTC Test run completed, no test results found for commit 528badc. Please check build logs.
⚫ 2024-05-29 10:50:16 UTC Check cancelled

ydb/library/yql/providers/generic/connector/api/common/data_source.proto

github-actions · 2024-05-29T10:54:30Z

⚪ 2024-05-29 10:54:30 UTC Pre-commit check for 31b7c23 has started.
⚪ 2024-05-29 10:57:20 UTC Build linux-x86_64-release-clang14 is running...
⚫ 2024-05-29 11:30:49 UTC Check cancelled

github-actions · 2024-05-29T10:54:40Z

⚪ 2024-05-29 10:54:39 UTC Pre-commit check for 31b7c23 has started.
⚪ 2024-05-29 10:57:42 UTC Build linux-x86_64-release-asan is running...
⚫ 2024-05-29 11:30:50 UTC Check cancelled

github-actions · 2024-05-29T10:54:45Z

⚪ 2024-05-29 10:54:44 UTC Pre-commit check for 31b7c23 has started.
⚪ 2024-05-29 10:57:47 UTC Build linux-x86_64-relwithdebinfo is running...
⚫ 2024-05-29 11:30:50 UTC Check cancelled

ydb/library/yql/providers/generic/provider/yql_generic_cluster_config.cpp

github-actions · 2024-05-29T15:46:46Z

⚪ 2024-05-29 15:46:46 UTC Pre-commit check for 73c0487 has started.
⚪ 2024-05-29 15:49:43 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-29 16:30:02 UTC Build successful.
⚪ 2024-05-29 16:30:11 UTC Tests are running...
🔴 2024-05-29 18:35:06 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
14723	14609	0	43	56	15

github-actions · 2024-05-29T15:56:41Z

⚪ 2024-05-29 15:56:40 UTC Pre-commit check for 73c0487 has started.
⚪ 2024-05-29 15:59:32 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-29 16:33:01 UTC Build successful.

github-actions · 2024-05-29T16:05:50Z

⚪ 2024-05-29 16:05:50 UTC Pre-commit check for 73c0487 has started.
⚪ 2024-05-29 16:08:38 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-29 16:48:09 UTC Build successful.
⚪ 2024-05-29 16:48:26 UTC Tests are running...
🔴 2024-05-29 18:48:25 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
73864	61148	0	3	12705	8

Co-authored-by: Timur Sufiianov <sufiianovtim@ydb.tech>

skywalker-jpg requested review from a team as code owners May 27, 2024 19:58

github-actions bot added the new-feature label May 27, 2024

skywalker-jpg changed the title ~~Yq 3224: Add Greenplum connector to YDB~~ YQ:3224: Add Greenplum connector to YDB May 27, 2024

skywalker-jpg changed the title ~~YQ:3224: Add Greenplum connector to YDB~~ YQ-3224: Add Greenplum connector to YDB May 28, 2024

vitalyisaev2 suggested changes May 28, 2024

View reviewed changes

ydb/core/external_sources/external_source_factory.cpp Outdated Show resolved Hide resolved

ydb/library/yql/providers/generic/provider/yql_generic_load_meta.cpp Outdated Show resolved Hide resolved

ydb/tests/tools/kqprun/app_conf.txt Outdated Show resolved Hide resolved

vitalyisaev2 changed the title ~~YQ-3224: Add Greenplum connector to YDB~~ YDB FQ: Support Greenplum as an external data source May 29, 2024

vitalyisaev2 added the ok-to-test Special label used to approve a PR for testing on our infrastructure label May 29, 2024

github-actions bot removed the ok-to-test Special label used to approve a PR for testing on our infrastructure label May 29, 2024

vitalyisaev2 suggested changes May 29, 2024

View reviewed changes

ydb/library/yql/providers/generic/connector/api/common/data_source.proto Outdated Show resolved Hide resolved

skywalker-jpg force-pushed the YQ-3224 branch from 528badc to 39fe828 Compare May 29, 2024 10:49

vitalyisaev2 approved these changes May 29, 2024

View reviewed changes

vitalyisaev2 suggested changes May 29, 2024

View reviewed changes

ydb/library/yql/providers/generic/provider/yql_generic_cluster_config.cpp Outdated Show resolved Hide resolved

vitalyisaev2 approved these changes May 29, 2024

View reviewed changes

rvu1024 approved these changes May 29, 2024

View reviewed changes

vitalyisaev2 merged commit 7c85bb1 into ydb-platform:main May 29, 2024

This was referenced May 30, 2024

Added ExecutionId for script execution logs #5014

Merged

Fixed build error in TForgetScriptExecutionOperationQueryActor #5084

Merged

StekPerepolnen mentioned this pull request May 31, 2024

vdisk evict #5093

Merged

GrigoriyPA mentioned this pull request Jun 3, 2024

Fixed backward compatibility in fq-proxy result_writer_actor #5111

Merged

This was referenced Jun 6, 2024

Mute split by load ut #5264

Closed

Mute split by load ut #5267

Closed

Mute split by load ut #5272

Merged

Fix build #5310

Merged

serbel324 mentioned this pull request Jun 7, 2024

Don't mark slow disks if there is only one #5340

Merged

GrigoriyPA mentioned this pull request Jun 10, 2024

KqpRun fixed performance and backtrace printing #5368

Merged

niksaveliev mentioned this pull request Jun 10, 2024

Fix split by load ut #5383

Merged

This was referenced Jun 11, 2024

metadata cache keeps merged issues #5461

Merged

json_hc metadata cache #5465

Merged

GrigoriyPA mentioned this pull request Jun 13, 2024

YQ-3333 added yql syntax for creating resource pools #5498

Merged

This was referenced Jun 14, 2024

json tenantinfo status metadata cache #5543

Merged

json query transaction mode #5574

Merged

niksaveliev mentioned this pull request Jun 17, 2024

Fix win build #5622

Closed

StekPerepolnen mentioned this pull request Jun 19, 2024

hc api doc #5703

Merged

This was referenced Jun 19, 2024

WM passed resource pool settings to user request context #5734

Merged

YQ splitted fq/s3/test_s3.py tests #5798

Merged

This was referenced Jun 23, 2024

move time difference issue under database level #5859

Merged

metadata requests flags fix #5860

Merged

skywalker-jpg added a commit to skywalker-jpg/ydb that referenced this pull request Jun 25, 2024

YDB FQ: Support Greenplum as an external data source (ydb-platform#4907)

8c7b67b

Co-authored-by: Timur Sufiianov <sufiianovtim@ydb.tech>

StekPerepolnen mentioned this pull request Jun 28, 2024

oidc-proxy new iam 2 #6059

Merged

Conversation

skywalker-jpg commented May 27, 2024

Changelog entry

Changelog category

Uh oh!

github-actions bot commented May 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented May 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

github-actions bot commented May 27, 2024 •

edited

Loading

github-actions bot commented May 27, 2024 •

edited

Loading

github-actions bot commented May 27, 2024 •

edited

Loading

github-actions bot commented May 28, 2024 •

edited

Loading

github-actions bot commented May 28, 2024 •

edited

Loading

github-actions bot commented May 28, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading