-
Notifications
You must be signed in to change notification settings - Fork 10
Labels
APICI/CDContinuous integration and continuous deliveryContinuous integration and continuous deliverydependenciesPull requests that update a dependency filePull requests that update a dependency filedocumentationImprovements or additions to documentationImprovements or additions to documentationenhancementNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomersspark_3.4PR changes to spark 3.4PR changes to spark 3.4
Description
Feature suggestion
Spark 3.4.0 has been released. We should:
- Update sbt to be this version the default version Added spark 3.4 to the project #346
- Update CI Added spark 3.4 to the project #346
- Update docs Added spark 3.4 to the project #346
- Add new type Timestamp without timezone
- Add new sql functions:
- From functions
- def mode(e: Column): Column
- def median(e: Column): Column
- def window_time(windowColumn: Column): Column
- def array_append(column: Column, element: Any): Column
- def get(column: Column, index: Column): Column
- def array_sort(e: Column, comparator: (Column, Column) => Column): Column feat: [+] #270 array_sort functions working with lambdas #275
- def array_compact(column: Column): Column
- def array_insert(arr: Column, pos: Column, value: Column): Column
- def inline(e: Column): Column
- def inline_outer(e: Column): Column
- def unwrap_udt(column: Column): Column
- From column
- It seems no new column functions were added
- From functions
- Close ScalaSteward: Update spark-sql from 3.3.2 to 3.4.0 #344 as "won't do" and relate this PR with the new one
Take a look at #307 or #323 if you need help, as it seems to be very similar
Current behaviour
N/A
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
APICI/CDContinuous integration and continuous deliveryContinuous integration and continuous deliverydependenciesPull requests that update a dependency filePull requests that update a dependency filedocumentationImprovements or additions to documentationImprovements or additions to documentationenhancementNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomersspark_3.4PR changes to spark 3.4PR changes to spark 3.4
Type
Projects
Status
In Progress