github-actions[bot] closed issue #8911: Pushdown SUBSTRING filter when
equivalent to STARTSWITH
URL: https://github.com/apache/iceberg/issues/8911
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
github-actions[bot] commented on issue #8911:
URL: https://github.com/apache/iceberg/issues/8911#issuecomment-2403653776
This issue has been closed because it has not received any activity in the
last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Gi
github-actions[bot] commented on issue #8911:
URL: https://github.com/apache/iceberg/issues/8911#issuecomment-2372612443
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity occurs.
tombarti commented on issue #8911:
URL: https://github.com/apache/iceberg/issues/8911#issuecomment-1775911356
Thanks for taking the time to explain, that all makes sense now!
I can see that #7886 in Iceberg 1.4.0 could be handful for the other avenue
you are suggesting!
--
This is
RussellSpitzer commented on issue #8911:
URL: https://github.com/apache/iceberg/issues/8911#issuecomment-1775880284
Iceberg uses the Datasource API from Spark, so we only see filters and
expressions that Spark decides to pass through to us. In this case "substring"
is just not an expression
tombarti commented on issue #8911:
URL: https://github.com/apache/iceberg/issues/8911#issuecomment-1775871158
Thanks for the quick reply @RussellSpitzer, so what you are saying is that
this really should be implemented in Spark and once it is, there is nothing
much to do on the Iceberg side
RussellSpitzer commented on issue #8911:
URL: https://github.com/apache/iceberg/issues/8911#issuecomment-1775822458
I think this could be done but the fix would have to be in Spark I believe.
Spark needs to be able to convert Substring => StartsWith on their end
--
This is an automated me
