Re: [I] Improve Memory Use in SparkScanBuilder [iceberg]

2024-10-15 Thread via GitHub
nastra commented on issue #11245: URL: https://github.com/apache/iceberg/issues/11245#issuecomment-2413444074 fixed by https://github.com/apache/iceberg/pull/11319 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] Improve Memory Use in SparkScanBuilder [iceberg]

2024-10-14 Thread via GitHub
huaxingao commented on issue #11245: URL: https://github.com/apache/iceberg/issues/11245#issuecomment-2411990576 cc @szehon-ho Could you approve this for upstream? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] Improve Memory Use in SparkScanBuilder [iceberg]

2024-10-14 Thread via GitHub
huaxingao commented on issue #11245: URL: https://github.com/apache/iceberg/issues/11245#issuecomment-2411940449 @trohwer Thanks for reporting this. `fileScanTasks` should be used directly. I will have a PR to fix this. -- This is an automated message from the Apache Git Service. To resp