This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch exact-distinct-count in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 8f2dff4 addressing review comments discard e5fd3a0 Removing code from another PR discard 3c531f3 Fix tests discard ef30e07 Fixing serde for bytesset discard 2808c58 Deleting file unrelated to this PR discard ee6e541 Support for exact distinct count for non int data types add da1fe59 [TE] frontend - harleyjj/rca - fix heatmap click bug (#5880) add 81e858b Adding integration test for null handling from realtime source (#5870) add 2d94cb9 Support post-aggregation in ORDER-BY (#5856) add bae21bf [TE] anomaly search - hide child anomaly unless queried with anomaly ids (#5865) add 7eff806 [TE] merge time series snapshot when merging anomalies (#5861) add 3173983 [TE] change dimension explore early stop to be 10% of top k (#5882) add aab087c Fixing backward-compatible issue of schema fetch call (#5885) add ed2daaa Change group key delimiter from '\t' to '\0' (#5858) add 87b5b77 Fix race condition in MetricsHelper (#5887) add 41dc432 Bump up swagger ui version to 3.18.2 (#5888) add a7f7f46 Fix gcsFS copyToLocal to precreate local destination directory (#5890) add 7a30a80 Roundup decimal points when compressing AnomalyTimelinesView (#5869) add e9ad1e0 Update swagger ui path (#5896) add 89cd958 Support post-aggregation in SELECT (#5867) add 3e794ca Fixing segment push uri ingestion jobs (#5897) add 4fd70fe Add RANGE FilterKind to support merging ranges for SQL (#5898) add 1810550 Support exact distinct count This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (8f2dff4) \ N -- N -- N refs/heads/exact-distinct-count (1810550) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: LICENSE-binary | 2 +- .../broker/broker/BrokerAdminApiApplication.java | 2 +- .../pinot/common/metadata/ZKMetadataProvider.java | 5 +- .../pinot/common/metrics/AbstractMetrics.java | 2 + ...eporterMetricsRegistryRegistrationListener.java | 6 + .../apache/pinot/common/metrics/MetricsHelper.java | 15 +- .../pinot/pql/parsers/pql2/ast/FilterKind.java | 5 +- .../api/ControllerAdminApiApplication.java | 2 +- .../apache/pinot/core/common/ObjectSerDeUtils.java | 162 ++++--- .../apache/pinot/core/data/table/BaseTable.java | 47 +-- .../core/data/table/ConcurrentIndexedTable.java | 26 +- .../apache/pinot/core/data/table/IndexedTable.java | 76 ++-- .../pinot/core/data/table/SimpleIndexedTable.java | 22 +- .../org/apache/pinot/core/data/table/Table.java | 9 +- .../apache/pinot/core/data/table/TableResizer.java | 234 ++++++---- .../operator/combine/GroupByCombineOperator.java | 2 +- .../combine/GroupByOrderByCombineOperator.java | 72 ++-- .../query/DictionaryBasedAggregationOperator.java | 36 +- .../function/DistinctCountAggregationFunction.java | 304 ++++++------- .../DistinctCountMVAggregationFunction.java | 83 ++-- .../groupby/AggregationGroupByTrimmingService.java | 81 ++-- .../aggregation/groupby/GroupKeyGenerator.java | 14 +- .../query/reduce/AggregationDataTableReducer.java | 79 ++-- .../core/query/reduce/GroupByDataTableReducer.java | 208 +++++---- .../core/query/reduce/PostAggregationHandler.java | 243 +++++++++++ .../core/query/reduce/ResultReducerFactory.java | 4 +- .../request/context/predicate/RangePredicate.java | 9 +- .../context/utils/QueryContextConverterUtils.java | 3 + .../core/requesthandler/RangeMergeOptimizer.java | 3 +- .../pinot/core/data/table/IndexedTableTest.java | 85 ++-- .../pinot/core/data/table/TableResizerTest.java | 469 ++++++++------------- .../query/reduce/PostAggregationHandlerTest.java | 120 ++++++ .../pinot/queries/DistinctCountQueriesTest.java | 56 ++- ...nerSegmentAggregationMultiValueQueriesTest.java | 19 +- ...erSegmentAggregationSingleValueQueriesTest.java | 17 +- .../AggregationGroupByTrimmingServiceTest.java | 15 +- .../query/aggregation/groupby/GroupKeyTest.java | 17 +- .../tests/BaseClusterIntegrationTest.java | 10 +- .../tests/BaseClusterIntegrationTestSet.java | 16 + .../tests/NullHandlingIntegrationTest.java | 145 +++++++ .../src/test/resources/avro_data_with_nulls.tar.gz | Bin 0 -> 2973 bytes .../src/test/resources/test_null_handling.schema | 33 ++ .../apache/pinot/perf/BenchmarkCombineGroupBy.java | 17 +- .../apache/pinot/perf/BenchmarkIndexedTable.java | 21 +- .../ingestion/batch/common/SegmentPushUtils.java | 27 ++ ...nUtils.java => SegmentGenerationUtilsTest.java} | 2 +- .../batch/common/SegmentPushUtilsTest.java | 79 ++++ .../hadoop/HadoopSegmentUriPushJobRunner.java | 6 +- .../batch/spark/SparkSegmentUriPushJobRunner.java | 6 +- .../batch/standalone/SegmentUriPushJobRunner.java | 6 +- .../apache/pinot/plugin/filesystem/GcsPinotFS.java | 2 + .../apache/pinot/plugin/filesystem/S3PinotFS.java | 2 + .../pinot/plugin/filesystem/S3PinotFSTest.java | 2 +- .../server/starter/helix/AdminApiApplication.java | 2 +- .../spi/utils/builder/TableConfigBuilder.java | 7 + .../PinotServiceManagerAdminApiApplication.java | 2 +- pom.xml | 4 +- .../app/pods/components/heatmap-chart/component.js | 8 +- .../views/CondensedAnomalyTimelinesView.java | 30 +- .../resources/v2/anomalies/AnomalySearcher.java | 8 +- .../datalayer/dto/MergedAnomalyResultDTO.java | 1 + .../detection/algorithm/DimensionWrapper.java | 5 +- .../apache/pinot/thirdeye/util/ThirdEyeUtils.java | 89 +++- .../views/TestCondensedAnomalyTimelinesView.java | 94 ++++- .../v2/anomalies/AnomalySearcherTest.java | 22 +- .../pinot/thirdeye/util/ThirdEyeUtilsTest.java | 68 +++ 66 files changed, 2126 insertions(+), 1142 deletions(-) create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/reduce/PostAggregationHandler.java create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/query/reduce/PostAggregationHandlerTest.java create mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/NullHandlingIntegrationTest.java create mode 100644 pinot-integration-tests/src/test/resources/avro_data_with_nulls.tar.gz create mode 100644 pinot-integration-tests/src/test/resources/test_null_handling.schema rename pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/test/java/org/apache/pinot/plugin/ingestion/batch/common/{TestSegmentGenerationUtils.java => SegmentGenerationUtilsTest.java} (97%) create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/test/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtilsTest.java --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org