This is an automated email from the ASF dual-hosted git repository.
rongr pushed a change to branch multi_stage_query_engine
in repository https://gitbox.apache.org/repos/asf/pinot.git
omit fa2b2fa7cf [hotfix] multi stage engine serde (#8689)
omit 2c07cb04e2 row/columnar compatible block (#8583)
omit 4d77924e59 [hotfix] fix server discovery (#8664)
omit 30bc434343 fix rebase issue after PQL deprecation (#8652)
omit 3b01b2dec8 add support for project/filter pushdown (#8558)
omit c06bbfbaf3 Use proto for query plan serialization (#8479)
omit dacd28187a add pinot-query-runtime (#8412)
omit 8c8380005b Add pinot-query-planner module (#8340)
omit 90e722a6b0 make github action trigger on multi_stage_query_engine
branch (#8342)
add d2396dd983 Fix dimension table load when server restart or reload
table (#8721)
add ae02ecefa4 Ingestion Aggregation Feature (#8611)
add 1b3819e787 add primitive indexOf overloads to Dictionary interface
(#8719)
add 1009159feb gitignore should include helm generated files (#8728)
add b4c4585813 Improve the range evaluation for raw values without range
index (#8722)
add 96a02910f3 Cache polygon h3 cells as it is expensive (#8725)
add c739f423ee Use groups to annotate tests for controller (#8706)
add c50b3c4bb4 [Test] Add star-tree test for unsupported filters (#8733)
add 5cd6a7dc05 Groovy transform function should evaluate the script when
arguments are null (#8732)
add bf48b59c41 Add support for indexes during offline segment creation
(#8601)
add 167fa9476c Handle partial update for comparison columns (#8688)
add 7cb1473b8f fix regression where case order was reversed, add
regression test (#8748)
add d1de3a0008 Add noServerFoundExceptions metric to broker.yaml (#8754)
add 6ad7973971 Make max consecutive idle count before recreating stream
configurable (#8740)
add 047daadd23 Indexes on segment page (#8749)
add 821976610e Improve the Explain Plan accuracy (#8738)
add 2e32ec2577 Add metric for replication count from config (#8761)
add 80db1657ab remove static ControllerTestUtils and use singleton
instance ControllerTest instead (#8744)
new e812672ef6 make github action trigger on multi_stage_query_engine
branch (#8342)
new 5d64dea7d1 Add pinot-query-planner module (#8340)
new b4889f1206 add pinot-query-runtime (#8412)
new a219bd256b Use proto for query plan serialization (#8479)
new cbe5727dc6 add support for project/filter pushdown (#8558)
new b6377295f8 fix rebase issue after PQL deprecation (#8652)
new 36a91abbd7 [hotfix] fix server discovery (#8664)
new 59ee852637 row/columnar compatible block (#8583)
new ffedb2d574 [hotfix] multi stage engine serde (#8689)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (fa2b2fa7cf)
\
N -- N -- N refs/heads/multi_stage_query_engine (ffedb2d574)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 9 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 7 +-
.../jmx_prometheus_javaagent/configs/broker.yml | 7 +-
.../configs/controller.yml | 6 +
kubernetes/helm/pinot/charts/zookeeper-7.0.0.tgz | Bin 34028 -> 0 bytes
kubernetes/helm/thirdeye/Chart.lock | 6 -
.../requesthandler/BaseBrokerRequestHandler.java | 27 +-
.../pinot/broker/routing/BrokerRoutingManager.java | 12 +-
.../routing/instanceselector/InstanceSelector.java | 21 +
.../pinot/common/metrics/ControllerGauge.java | 1 +
.../pinot/common/response/BrokerResponse.java | 40 +
.../response/broker/BrokerResponseNative.java | 52 +
.../org/apache/pinot/common/utils/DataTable.java | 5 +-
.../common/utils/config/TableConfigUtils.java | 2 +-
.../common/utils/config/TableConfigSerDeTest.java | 5 +-
.../java/org/apache/pinot/compat/StreamOp.java | 4 +-
.../connector/flink/http/PinotConnectionUtils.java | 6 +-
.../flink/sink/PinotSinkIntegrationTest.java | 2 +-
.../api/resources/PinotSegmentRestletResource.java | 34 +-
.../controller/helix/SegmentStatusChecker.java | 22 +
.../helix/core/PinotHelixResourceManager.java | 15 +
.../pinot/controller/util/FileIngestionHelper.java | 2 +-
.../pinot/controller/util/TableMetadataReader.java | 33 +
.../main/resources/app/pages/SegmentDetails.tsx | 18 +
.../src/main/resources/app/requests/index.ts | 2 +-
.../main/resources/app/utils/PinotMethodUtils.ts | 20 +-
.../controller/ControllerStarterStatelessTest.java | 1 +
.../pinot/controller/ControllerTestSetup.java | 27 +-
.../pinot/controller/ControllerTestUtils.java | 789 --------
.../pinot/controller/api/AccessControlTest.java | 9 +-
.../PinotAccessControlUserRestletResourceTest.java | 34 +-
.../PinotBrokerRestletResourceStatelessTest.java | 3 +-
.../api/PinotControllerAppConfigsTest.java | 12 +-
.../pinot/controller/api/PinotFileUploadTest.java | 11 +-
...PinotIngestionRestletResourceStatelessTest.java | 1 +
...PinotInstanceAssignmentRestletResourceTest.java | 75 +-
.../api/PinotInstanceRestletResourceTest.java | 48 +-
.../api/PinotSchemaRestletResourceTest.java | 77 +-
.../api/PinotSegmentRestletResourceTest.java | 27 +-
.../api/PinotTableRestletResourceTest.java | 208 +-
.../api/PinotTenantRestletResourceTest.java | 15 +-
.../api/PinotUpsertRestletResourceTest.java | 12 +-
.../api/TableConfigsRestletResourceTest.java | 215 +-
.../pinot/controller/api/TableViewsTest.java | 39 +-
.../PinotDummyExtraRestletResourceTest.java | 11 +-
.../api/resources/ZookeeperResourceTest.java | 25 +-
.../controller/api/upload/ZKOperatorTest.java | 19 +-
.../helix/ControllerInstanceToggleTest.java | 63 +-
...ControllerPeriodicTaskStarterStatelessTest.java | 2 +-
.../controller/helix/ControllerSentinelTestV2.java | 52 +-
.../helix/ControllerTenantStatelessTest.java | 1 +
.../pinot/controller/helix/ControllerTest.java | 438 +++-
.../pinot/controller/helix/HelixHelperTest.java | 18 +-
.../helix/PinotControllerModeStatelessTest.java | 1 +
.../controller/helix/PinotResourceManagerTest.java | 68 +-
.../controller/helix/SegmentStatusCheckerTest.java | 13 +
.../pinot/controller/helix/TableCacheTest.java | 20 +-
.../PinotHelixResourceManagerStatelessTest.java | 1 +
.../helix/core/PinotHelixResourceManagerTest.java | 449 ++---
.../MinionInstancesCleanupTaskStatelessTest.java | 1 +
.../core/minion/PinotTaskManagerStatelessTest.java | 1 +
.../TableRebalancerClusterStatelessTest.java | 1 +
.../core/retention/SegmentLineageCleanupTest.java | 61 +-
.../validation/ValidationManagerStatelessTest.java | 1 +
.../validation/ValidationManagerTest.java | 21 +-
pinot-controller/testng-statefull.xml | 67 +-
pinot-controller/testng-stateless.xml | 22 +-
.../pinot/core/common/ExplainPlanRowData.java | 39 +-
.../apache/pinot/core/common/ExplainPlanRows.java | 117 ++
.../manager/offline/DimensionTableDataManager.java | 73 +-
.../realtime/LLRealtimeSegmentDataManager.java | 38 +-
.../core/operator/filter/EmptyFilterOperator.java | 2 +-
.../filter/H3InclusionIndexFilterOperator.java | 13 +-
.../operator/filter/MatchAllFilterOperator.java | 2 +-
.../filter/RangeIndexBasedFilterOperator.java | 20 +-
.../predicate/RangePredicateEvaluatorFactory.java | 271 +--
.../transform/function/CaseTransformFunction.java | 15 +-
.../org/apache/pinot/core/plan/FilterPlanNode.java | 2 +-
.../query/executor/ServerQueryExecutorV1Impl.java | 182 +-
.../pinot/core/query/reduce/BaseReduceService.java | 23 +
.../core/query/reduce/BrokerReduceService.java | 4 +-
.../query/reduce/ExplainPlanDataTableReducer.java | 213 +-
.../apache/pinot/core/routing/RoutingTable.java | 9 +-
.../apache/pinot/core/util/QueryOptionsUtils.java | 4 +
.../data/function/GroovyFunctionEvaluatorTest.java | 17 +
.../offline/DimensionTableDataManagerTest.java | 188 +-
.../function/CaseTransformFunctionTest.java | 68 +-
.../pinot/core/startree/v2/BaseStarTreeV2Test.java | 92 +-
.../apache/pinot/core/util/SchemaUtilsTest.java | 7 +-
.../pinot/queries/ExplainPlanQueriesTest.java | 2128 +++++++++++++++++---
.../org/apache/pinot/queries/RangeQueriesTest.java | 8 +-
.../apache/pinot/queries/TransformQueriesTest.java | 38 +-
.../tests/HybridClusterIntegrationTest.java | 4 +-
.../IngestionConfigHybridIntegrationTest.java | 3 +-
.../tests/JsonPathClusterIntegrationTest.java | 2 +-
.../tests/MapTypeClusterIntegrationTest.java | 2 +-
.../tests/OfflineClusterIntegrationTest.java | 13 +-
.../SegmentWriterUploaderIntegrationTest.java | 2 +-
.../integration/tests/TlsIntegrationTest.java | 6 +-
.../tests/UrlAuthRealtimeIntegrationTest.java | 6 +-
.../preprocess/DataPreprocessingHelperTest.java | 2 +-
.../mergerollup/MergeRollupTaskGeneratorTest.java | 2 +-
.../RealtimeToOfflineSegmentsTaskExecutorTest.java | 7 +-
.../filebased/FileBasedSegmentWriterTest.java | 20 +-
.../local/function/GroovyFunctionEvaluator.java | 14 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 245 ++-
.../local/realtime/impl/RealtimeSegmentConfig.java | 18 +-
.../creator/impl/SegmentColumnarIndexCreator.java | 79 +-
.../converter/SegmentV1V2ToV3FormatConverter.java | 3 +
.../index/readers/BaseImmutableDictionary.java | 5 +-
.../segment/index/readers/DoubleDictionary.java | 5 +
.../segment/index/readers/FloatDictionary.java | 5 +
.../local/segment/index/readers/IntDictionary.java | 5 +
.../segment/index/readers/LongDictionary.java | 5 +
.../readers/geospatial/ImmutableH3IndexReader.java | 2 +-
.../pinot/segment/local/utils/IngestionUtils.java | 11 +
.../segment/local/utils/TableConfigUtils.java | 95 +-
...MutableSegmentImplIngestionAggregationTest.java | 230 +++
.../mutable/MutableSegmentImplTestUtils.java | 24 +-
.../ExpressionTransformerTest.java | 16 +-
.../recordtransformer/RecordTransformerTest.java | 40 +-
.../local/segment/creator/DictionariesTest.java | 19 +
.../SegmentGenerationWithFilterRecordsTest.java | 3 +-
.../index/loader/SegmentPreProcessorTest.java | 6 +-
.../segment/local/utils/IngestionUtilsTest.java | 43 +-
.../segment/local/utils/TableConfigUtilsTest.java | 276 ++-
.../spi/creator/SegmentGeneratorConfig.java | 22 +
.../pinot/segment/spi/index/reader/Dictionary.java | 32 +
...TransformConfig.java => AggregationConfig.java} | 21 +-
.../config/table/ingestion/IngestionConfig.java | 17 +-
.../org/apache/pinot/spi/stream/StreamConfig.java | 58 +-
.../pinot/spi/stream/StreamConfigProperties.java | 1 +
.../apache/pinot/spi/utils/CommonConstants.java | 1 +
.../pinot/spi/utils/IngestionConfigUtils.java | 16 +-
.../spi/utils/builder/TableConfigBuilder.java | 7 +
.../pinot/spi/utils/IngestionConfigUtilsTest.java | 10 +-
135 files changed, 5589 insertions(+), 2695 deletions(-)
delete mode 100644 kubernetes/helm/pinot/charts/zookeeper-7.0.0.tgz
delete mode 100644 kubernetes/helm/thirdeye/Chart.lock
delete mode 100644
pinot-controller/src/test/java/org/apache/pinot/controller/ControllerTestUtils.java
copy pinot-spi/src/main/java/org/apache/pinot/spi/plugin/Plugin.java =>
pinot-core/src/main/java/org/apache/pinot/core/common/ExplainPlanRowData.java
(55%)
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/common/ExplainPlanRows.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/indexsegment/mutable/MutableSegmentImplIngestionAggregationTest.java
copy
pinot-spi/src/main/java/org/apache/pinot/spi/config/table/ingestion/{TransformConfig.java
=> AggregationConfig.java} (69%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
