Re: [I] Spark Rewrite Write Performance [iceberg]

2025-01-15 Thread via GitHub
github-actions[bot] commented on issue #9293: URL: https://github.com/apache/iceberg/issues/9293#issuecomment-2594192525 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Spark Rewrite Write Performance [iceberg]

2025-01-15 Thread via GitHub
github-actions[bot] closed issue #9293: Spark Rewrite Write Performance URL: https://github.com/apache/iceberg/issues/9293 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[I] Spark Rewrite Write Performance [iceberg]

2023-12-13 Thread via GitHub
W-I-D-EE opened a new issue, #9293: URL: https://github.com/apache/iceberg/issues/9293 ### Query engine Spark 3.2.3 ### Question When compacting small parquet files i noticed it seems slow. Writing a single ~256mb parquet file to HDFS is taking 4-5 mins (total time inclu