andimiller opened a new pull request, #11835: URL: https://github.com/apache/pinot/pull/11835
[UltraLogLog](https://arxiv.org/abs/2308.16862) is a variant of HyperLogLog from dynatrace, with an implementation available in [hash4j](https://github.com/dynatrace-oss/hash4j) under the apache license. This adds support for using it in the ways you'd use HLL in Pinot. When using it against normal java types, wyhash 4 is used as the default hashing algorithm, when bringing your own serialized sketches you can use any. * supports `UltraLogLog` as a data type * the serialization format includes serializing the P value as the first byte in the data stream, so the width is known in streams * adds `DistinctCountULL` and `DistinctCountRawULL` for use in SQL * raw outputs Base64 encoded bytes that can be fed into `UltraLogLog.wrap` in other services * adds startree support * adds merge rollup support * new transformaction functions added * `toULL` allows turning data into a ULL * `fromULL` lets you import ULLs encoded as byte arrays outside pinot -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
