mrabisf commented on issue #6422: URL: https://github.com/apache/iceberg/issues/6422#issuecomment-1518979122
Real thanks for the detailed explanation @ChristinaTech. So, since incremental read doesn't use compacted files but the old files, would you suggest using incremental read only on rather small batches? Otherwise you suggest querying on partition time column with something like BETWEEN / > statement? Would that be of better performance since those queries use the compacted files. I'm just trying to understand the best practice for doing a hopping window on an Iceberg table. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
