-
Notifications
You must be signed in to change notification settings - Fork 210
Proposal: split auron-core module #1263
Copy link
Copy link
Closed
Labels
Description
Is your feature request related to a problem? Please describe.
currently, Auron's code is tightly coupled to Spark. since we are planning to support more engines like Flink, we need an auron-core module to support a minimal working set of the native execution abilities.
Describe the solution you'd like
- decouple native engine code to Spark. for example,
SparkUDFWrappershould be renamed toUDFWrapper. - add
auron-coremaven module, which has JNI bridge, native execution wrapper, and a set of interfaces required by JNI. specified deps like Spark or Scala should be removed. -
auron-spark-extensionmodule should be derived onauron-corewith all interfaces implemented.
after all these task finished, we can support more engines from auron-core like auron-flink-extension.
Describe alternatives you've considered
Additional context
Reactions are currently unavailable