-
Notifications
You must be signed in to change notification settings - Fork 210
Closed
Description
Is your feature request related to a problem? Please describe.
Spark3.5 introduced a new operator called WindowGroupLimitExec for faster window + topK query (see https://issues.apache.org/jira/browse/SPARK-37099). currently blaze does not support this new operator and needs to fallback it.
an example of query including WindowGroupLimit operator:
Describe the solution you'd like
implement native WindowGroupLimitExec.
Describe alternatives you've considered
Implement a window_group_limit param in SortExec, so that we can also reduce the amount of sorted output data.
Additional context
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels
