Skip to content

[BLAZE-1100] Fallback shuffle exchange when RoundRobinPartitioning with unsupported MapType#1101

Merged
richox merged 2 commits intoapache:masterfrom
work-space-station:fallback-map
Aug 5, 2025
Merged

[BLAZE-1100] Fallback shuffle exchange when RoundRobinPartitioning with unsupported MapType#1101
richox merged 2 commits intoapache:masterfrom
work-space-station:fallback-map

Conversation

@merrily01
Copy link
Member

Which issue does this PR close?

Closes #1100

Rationale for this change

Fallback shuffle exchange when RoundRobinPartitioning with unsupported MapType

What changes are included in this PR?

  • Added a check in convertShuffleExchangeExec to detect unsupported output types in RoundRobinPartitioning (currently MapType).
  • Added test cases for various nested structures involving MapType, such as:
    • Top-level MapType
    • MapType with ArrayType
    • Struct with a MapType field
    • Array of Maps
    • Nested Map within Map
    • Map with Struct value
    • Array of Structs containing Maps

Are there any user-facing changes?

No

@merrily01 merrily01 changed the title [BLAZE-1100] Fallback shuffle exchange when RoundRobinPartitioning with unsupported map type [BLAZE-1100] Fallback shuffle exchange when RoundRobinPartitioning with unsupported MapType Aug 5, 2025
@richox
Copy link
Contributor

richox commented Aug 5, 2025

this is a temporary solution, we should fix arrow-row and support converting map types in the future.

@merrily01
Copy link
Member Author

this is a temporary solution, we should fix arrow-row and support converting map types in the future.

Gotcha!

@wForget
Copy link
Member

wForget commented Aug 5, 2025

this is a temporary solution, we should fix arrow-row and support converting map types in the future.

@merrily01 Could you add an issue to track this?

@richox richox merged commit 107874c into apache:master Aug 5, 2025
619 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Unsupported MapType in RoundRobinPartitioning leads to shuffle execution failure

3 participants