davecromberge commented on issue #12111:
URL: https://github.com/apache/pinot/issues/12111#issuecomment-1850111531

   Instead of de-duplication, I have decided to extend the configuration so 
that the user can associate one or more "virtual" aggregation functions with 
each aggregation spec.  When encoded in metadata, this would look as follows:
   
   ```
   segment.index.version = v3
   startree.v2.count = 1
   startree.v2.0.total.docs = 2
   startree.v2.0.split.order = workspace_id
   startree.v2.0.split.order = cohort_code
   startree.v2.0.function.column.pairs = distinctCountThetaSketch__impressions
   startree.v2.0.aggregation.count = 1
   startree.v2.0.aggregation.0.function.type = distinctCountThetaSketch
   startree.v2.0.aggregation.0.column.name = impressions
   startree.v2.0.aggregation.0.compression.codec = LZ4
   startree.v2.0.aggregation.0.virtual.aggregation.count = 1
   startree.v2.0.aggregation.0.virtual.aggregation.0.function.type = 
distinctCountRawThetaSketch
   startree.v2.0.max.leaf.records = 10000
   ```
   
   When absent or missing, this can be encoded as:
   ```
   segment.index.version = v3
   startree.v2.count = 1
   startree.v2.0.total.docs = 2
   startree.v2.0.split.order = workspace_id
   startree.v2.0.split.order = cohort_code
   startree.v2.0.function.column.pairs = distinctCountThetaSketch__impressions
   startree.v2.0.aggregation.count = 1
   startree.v2.0.aggregation.0.function.type = distinctCountThetaSketch
   startree.v2.0.aggregation.0.column.name = impressions
   startree.v2.0.aggregation.0.compression.codec = LZ4
   startree.v2.0.aggregation.0.virtual.aggregation.count = 0
   startree.v2.0.max.leaf.records = 10000
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org

Reply via email to