-
Notifications
You must be signed in to change notification settings - Fork 279
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Description
When Spark's ConstantFolding optimizer rule is disabled, an all-literal RLIKE expression reaches the native engine, which crashes with:
non scalar regexp patterns are not supported.
The error message is misleading — the issue is that both the input string and the pattern are scalar literals.
How to Reproduce
SET spark.sql.optimizer.excludedRules=org.apache.spark.sql.catalyst.optimizer.ConstantFolding;
SET spark.comet.regexp.allowIncompatible=true;
SELECT 'hello' RLIKE '^[a-z]+$';Expected Behavior
The native engine should handle all-scalar RLIKE inputs gracefully — either by computing the correct result or by falling back to Spark.
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working