Fokko commented on issue #1637: URL: https://github.com/apache/iceberg-python/issues/1637#issuecomment-2654723140
Keep in mind that the sort order is not a global sort-order but on a file level. This is very nice if you do joins (using the [sort-merge strategy](https://en.wikipedia.org/wiki/Sort-merge_join)) and can avoid an additional sort. Also, this plays a huge role in compression since if you use [run-length encoding](https://nl.wikipedia.org/wiki/Run-length_encoding), you can very efficiently encode the values. Since we have all the transforms in, I think it would be a good time to check if we can implement sort-order on the write side of things. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
