Proposal: Flink support

[Tartarus0zm]

Auron just support Spark(for batch) now. But in terms of capability, it can be used to support Flink (for streaming).

For many user scenarios in Flink, processing at the second or even minute level is perfectly acceptable. Examples include mini-batch processing for unbounded aggregates or minute-level window aggregations.

Auron will build Flink capabilities in three phases.
Phase One: Stateless Operator Support(Calc Operator)

• Support for various operator expressions: such as + - * /
• Support for Flink built-in functions
• Support for user-defined Flink functions

Phase Two: Stateful Operator Support(Agg Operator)

• Support for Flink built-in agg functions
• Support for user-defined Flink agg functions
• Support for flink count distinct

Phase Three: Stateful Operator Support(Join Operator)

• Support Regular Join
• Support Window Join

Supporting Flink in Auron is a massive and complex undertaking. We welcome community members to collaborate and discuss together.

[x-tong]

I want to follow up on this feature.

[Tartarus0zm]

I want to follow up on this feature.

We warmly welcome you! We will start building the foundational framework in the next week or two, and there will be a lot of work ahead that we will need to collaborate on with community partners.

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[Tartarus0zm]

Phase 1 Implementation Plan for Flink SQL on Auron We welcome everyone to share their insights and suggestions.
https://docs.google.com/document/d/1z3Noy4C9Lv54zEuL9MfGXohrDsIUh9zBpxOkmulRM6s/edit?usp=sharing

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.