aokolnychyi opened a new pull request, #11029:
URL: https://github.com/apache/iceberg/pull/11029

   This PR adds a benchmark for `FastAppend`. As shown below, Iceberg is 
currently very slow when an operation contains many new data files. I'll follow 
up with a fix separately.
   
   ```
   Benchmark                              (numFiles)  Mode  Cnt   Score   Error 
 Units
   FastAppendBenchmark.appendFiles            500000    ss    5   7.421 ± 0.300 
  s/op
   FastAppendBenchmark.appendFiles           1000000    ss    5  14.863 ± 0.690 
  s/op
   FastAppendBenchmark.appendFiles           2500000    ss    5  36.914 ± 2.008 
  s/op
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to