jackye1995 commented on issue #7465: URL: https://github.com/apache/iceberg/issues/7465#issuecomment-1529077839
Yeah this would also be very helpful for Trino because it can consume a large number of splits, most of the time the scan node does not fully utilize the cluster. If the cluster size can be accessed, what would be a good default behavior? For example for a 30 node cluster, are we saying we should generate at least 30 splits? Or would it be even more optimal to generate a multiple of that like 60 or 90 splits? What would be a good criteria? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
