siddharthteotia edited a comment on pull request #7797: URL: https://github.com/apache/pinot/pull/7797#issuecomment-974510937
Nice. When we had added support for ZSTD and LZ4 compression types in https://github.com/apache/pinot/issues/6804, our perf testing also had similar results. LZ4 gives nearly same (and even better sometimes) the compression ratio compared to SNAPPY and the time to compress is much faster. ZSTD on the other hand as highest compression ratio (from our tests) but compression/decompression time was higher as well Here are the results for reference (I think these were addd to JMH benchmarks as well) https://docs.google.com/document/d/1ie4JmVofk2o6ryCX7T4aD7GsRPKS651mroXhDk41wys/edit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
