[AURON-1332] Introduce JniBridge and AuronAdaptor for auron-core module#1333
[AURON-1332] Introduce JniBridge and AuronAdaptor for auron-core module#1333richox merged 6 commits intoapache:masterfrom
Conversation
|
@richox please take a moment to look at it. thanks |
richox
left a comment
richox
left a comment
There was a problem hiding this comment.
we can create a new module auron-core. in the future, we might have the following architecture:
auron-native-engine <- auron-core <- auron-spark/auron-flink
| @SuppressWarnings("unused") | ||
| public enum AuronConf { | ||
| /// suggested batch size for arrow batches. | ||
| BATCH_SIZE("spark.auron.batchSize", 10000), |
There was a problem hiding this comment.
spark. prefix is not needed, we can derive a AuronSparkConf in auron-spark and add the prefix there.
| * Auron boxed configuration. | ||
| * It is used to get the config from the real engine configuration, such as spark, flink etc. | ||
| */ | ||
| public interface AuronBoxedConfiguration { |
There was a problem hiding this comment.
this interface is likely not used
There was a problem hiding this comment.
We reuse the config object from the upper-level engine, so we need an abstraction layer within the core module to help retrieve the configuration required by Auron. Each engine should inherit this interface and implement the relevant methods.
Tartarus0zm
changed the title
github-actions
bot
added
documentation
Tartarus0zm
force-pushed
the
spark_decoupling
branch
from
8723531 to
d4fd814
Compare
github-actions
bot
removed
documentation
Tartarus0zm
force-pushed
the
spark_decoupling
branch
from
d4fd814 to
cc5c28a
Compare
2 participants
Which issue does this PR close?
Closes #1332
Rationale for this change
What changes are included in this PR?
Introduce JniBridge and AuronAdaptor for auron-core module
Are there any user-facing changes?
How was this patch tested?