FANNG1 commented on issue #9180: URL: https://github.com/apache/iceberg/issues/9180#issuecomment-1835550418
There're there types of tasks: 1. prefer NODE_LOCAL with executor IP, like 192.168.xx 2. prefer NODE_LOCAL with hdfs IP, 127.0.0.1 3. prefer NO_PREF the task request NODE_LOCAL with hdfs IP is not scheduled, If I disable node delay scheduling by set `spark.locality.wait.node` to 0, every thing is ok, seems a SPAKR task scheduler bug in local mode. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
