wary opened a new pull request, #317:
URL: https://github.com/apache/doris-spark-connector/pull/317

   ## Problem Summary:
   
   fix push filter bugs:
   
   Spark SQL Condition:
   `
   WHERE dt between '2025-03-01' AND '2025-05-30'
   AND income_type not in (4, 26) AND NOT(dt < '2025-04-01' AND data_type in 
(2, -2) AND income_type = 1)
   `
   
   WRONG Condition Pushed to Doris [BUGS]:
   
   `
   WHERE `dt` IS NOT NULL AND `dt` >= '2025-03-01 00:00:00.0' AND `dt` <= 
'2025-05-30 00:00:00.0' AND `income_type` NOT IN (4,26) AND ((`dt` >= 
'2025-04-01 00:00:00.0') OR (`data_type` NOT IN (2,-2))) OR (`income_type` != 1)
   `
   Because of the wrong condition "OR (`income_type` != 1)", a full table scan 
operation was caused.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to