Skip to content

feat(duckdb): Map type support (experimental) - #1105

Merged
graphite-app[bot] merged 1 commit into
mainfrom
03-27-feat_duckdb_map_type_support
Mar 27, 2026
Merged

graphite-app[bot] merged 1 commit into
mainfrom
03-27-feat_duckdb_map_type_support

Conversation

@danielgafni

@danielgafni danielgafni commented Mar 27, 2026 •

Copy link
Copy Markdown
Collaborator

danielgafni commented Mar 27, 2026 •

Copy link
Copy Markdown
Collaborator Author

How to use the Graphite Merge Queue

Add either label to this PR to merge it via the merge queue:

  • graphite:merge - adds this PR to the back of the merge queue
  • graphite:hotfix - for urgent changes, fast-track this PR to the front of the merge queue

You must have a Graphite account in order to use the merge queue. Sign up using this link.

An organization admin has enabled the Graphite Merge Queue in this repository.

Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.

This stack of pull requests is managed by Graphite. Learn more about stacking.

@codecov

codecov Bot commented Mar 27, 2026 •

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 79.68750% with 13 lines in your changes missing coverage. Please review.
✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
src/metaxy/metadata_store/ibis.py 83.33% 5 Missing and 4 partials ⚠️
src/metaxy/ext/metadata_stores/clickhouse.py 60.00% 3 Missing and 1 partial ⚠️

📢 Thoughts on this report? Let us know!

@danielgafni
danielgafni changed the base branch from 03-27-feat_experimental_support_for_polars_map.map_datatype to graphite-base/1105 March 27, 2026 13:42
@danielgafni danielgafni changed the title feat(duckdb): Map type support feat(duckdb): Map type support (experimental) Mar 27, 2026
@danielgafni
danielgafni force-pushed the 03-27-feat_duckdb_map_type_support branch from 30aaf8b to 4ab5106 Compare March 27, 2026 13:43
@danielgafni
danielgafni changed the base branch from graphite-base/1105 to 03-27-feat_experimental_support_for_polars_map.map_datatype March 27, 2026 13:44
@danielgafni
danielgafni changed the base branch from 03-27-feat_experimental_support_for_polars_map.map_datatype to graphite-base/1105 March 27, 2026 14:00
@danielgafni
danielgafni force-pushed the 03-27-feat_duckdb_map_type_support branch from 4ab5106 to 21bcd11 Compare March 27, 2026 15:11
@danielgafni
danielgafni changed the base branch from graphite-base/1105 to 03-27-feat_experimental_support_for_polars_map.map_datatype March 27, 2026 15:11
@danielgafni
danielgafni force-pushed the 03-27-feat_duckdb_map_type_support branch from 21bcd11 to 47ed063 Compare March 27, 2026 15:59
@danielgafni
danielgafni force-pushed the 03-27-feat_duckdb_map_type_support branch 2 times, most recently from a9edd35 to 5872aa4 Compare March 27, 2026 16:25
@danielgafni
danielgafni force-pushed the 03-27-feat_experimental_support_for_polars_map.map_datatype branch from 787008b to b6a76f4 Compare March 27, 2026 16:25

return self._handle_polars_map_columns(df, map_columns)

def _handle_ibis_map_columns(

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in practice this is only applied to versioning columns and keys are guaranteed to be strings

@danielgafni
danielgafni force-pushed the 03-27-feat_experimental_support_for_polars_map.map_datatype branch from b6a76f4 to 06ccd1d Compare March 27, 2026 16:36
@danielgafni
danielgafni force-pushed the 03-27-feat_duckdb_map_type_support branch from 5872aa4 to 8a23d51 Compare March 27, 2026 16:36
assert result is not None
table = _collect_to_arrow(result)

assert table.num_rows == 1

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

better assertions needed

Comment on lines +99 to +100
assert "frames" in row_0_keys
assert "audio" in row_0_keys

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

better assertions needed

@danielgafni
danielgafni force-pushed the 03-27-feat_duckdb_map_type_support branch from 8a23d51 to 69c43c6 Compare March 27, 2026 16:54
@danielgafni
danielgafni force-pushed the 03-27-feat_experimental_support_for_polars_map.map_datatype branch from 06ccd1d to 0872359 Compare March 27, 2026 16:54
@graphite-app

graphite-app Bot commented Mar 27, 2026 •

Copy link
Copy Markdown

Merge activity

@graphite-app
graphite-app Bot force-pushed the 03-27-feat_experimental_support_for_polars_map.map_datatype branch from 0872359 to 66ee494 Compare March 27, 2026 17:04
@graphite-app
graphite-app Bot force-pushed the 03-27-feat_duckdb_map_type_support branch from 69c43c6 to 07ceea3 Compare March 27, 2026 17:06
@graphite-app
graphite-app Bot changed the base branch from 03-27-feat_experimental_support_for_polars_map.map_datatype to 03-27-feat_iceberg_support_map_datatype_experimental__split March 27, 2026 17:07
@graphite-app
graphite-app Bot force-pushed the 03-27-feat_iceberg_support_map_datatype_experimental__split branch from 0ff3df4 to 09a6dd4 Compare March 27, 2026 17:31
Base automatically changed from 03-27-feat_iceberg_support_map_datatype_experimental__split to main March 27, 2026 17:38
@graphite-app
graphite-app Bot force-pushed the 03-27-feat_duckdb_map_type_support branch from 07ceea3 to 0748322 Compare March 27, 2026 17:39
@graphite-app
graphite-app Bot merged commit 0748322 into main Mar 27, 2026
28 of 29 checks passed
@graphite-app
graphite-app Bot deleted the 03-27-feat_duckdb_map_type_support branch March 27, 2026 17:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant