yupeng9 opened a new pull request #7246: URL: https://github.com/apache/pinot/pull/7246
Add an upsert config `hashFunction` to store the hash value instead of the primary key in the upsert metadata manager for tracking. This is an optimization for memory usage when the given primary key is complex or contains large values (e.g. a composite primary key consisting of multple UUIDs). Currently the available hash functions are Murmur3 and MD5, both return a 128-bit hash value. https://softwareengineering.stackexchange.com/questions/49550/which-hashing-algorithm-is-best-for-uniqueness-and-speed is a good post to read about the hash functions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
