[I] How to improve write speed for data in the same partition? [iceberg]

[via GitHub]

xuchang-66 opened a new issue, #9330:
URL: https://github.com/apache/iceberg/issues/9330

   ### Query engine
   
   
   spark v3.3
   iceberg v1.2.2
   
   ### Question
   
   When using Spark SQL to write to Iceberg table, only one task is used to 
write to each partition. However, when dealing with significantly large 
partition data (e.g., 20GB in a single partition), the write speed becomes very 
slow. What settings can be configured to increase concurrency and improve write 
speed in such scenarios?
   
   
![screenshot-20231218-164250](https://github.com/apache/iceberg/assets/55316777/e0da749b-0df2-43af-816e-d02c76930cfc)
   
![screenshot-20231218-164315](https://github.com/apache/iceberg/assets/55316777/34af1765-fdab-4e66-a2fc-bb2578540bd6)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org