wary opened a new pull request, #317: URL: https://github.com/apache/doris-spark-connector/pull/317
## Problem Summary: fix push filter bugs: Spark SQL Condition: ` WHERE dt between '2025-03-01' AND '2025-05-30' AND income_type not in (4, 26) AND NOT(dt < '2025-04-01' AND data_type in (2, -2) AND income_type = 1) ` WRONG Condition Pushed to Doris [BUGS]: ` WHERE `dt` IS NOT NULL AND `dt` >= '2025-03-01 00:00:00.0' AND `dt` <= '2025-05-30 00:00:00.0' AND `income_type` NOT IN (4,26) AND ((`dt` >= '2025-04-01 00:00:00.0') OR (`data_type` NOT IN (2,-2))) OR (`income_type` != 1) ` Because of the wrong condition "OR (`income_type` != 1)", a full table scan operation was caused. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
