This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/com.google.cloud-libraries-bom-26.38.0 in repository https://gitbox.apache.org/repos/asf/pinot.git
discard 871042aa33 Bump com.google.cloud:libraries-bom from 26.37.0 to 26.38.0 add ad7068619a Enhancement: Sketch value aggregator performance (#13020) add 0f28a5cc6f fix merging null multi value in partial upsert (#13031) add c8b223f1fc Upgrade lucene to 9.10.0 and compatibility changes to code. (#12866) add 5d1dc73cc6 log the log rate limiter rate for dropped broker logs (#13041) add 076cd404c4 Cleanup deprecated query options (#13040) add 21bc2414f5 Use separate action for /tasks/scheduler/jobDetails API (#13054) add 30c6770a7c Bump org.checkerframework:checker-qual from 3.42.0 to 3.43.0 (#13051) add 6ca8654753 Bump com.google.errorprone:error_prone_annotations from 2.27.0 to 2.27.1 (#13053) add 027e7cf6f8 Try to amend kafka common package with pinot shaded package prefix (#13056) add b9140715b0 Bigfix. Added missing paramName (#13060) add 50dae34b7c Fix JavaEE related dependencies (#13058) add 31ae6a32aa dynamic chunk sizing for v4 raw forward index (#12945) add fb9e6c51e4 Multi stage stats (#12704) add 84a92bc912 Bump com.azure:azure-core from 1.48.0 to 1.49.0 (#13066) add f6f83ab6d2 Bump org.apache.commons:commons-csv from 1.10.0 to 1.11.0 (#13068) add 39954ad2f1 Bump com.azure:azure-identity from 1.12.0 to 1.12.1 (#13070) add 4771f3b667 Bump com.azure:azure-core-http-netty from 1.14.2 to 1.15.0 (#13067) add 6fb315dc9c prevent background merges on the realtime lucene index (#13050) add 81ec69dec1 Bump aws.sdk.version from 2.25.40 to 2.25.44 (#13063) add 27b920e85c Bump com.google.cloud:libraries-bom from 26.37.0 to 26.38.0 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (871042aa33) \ N -- N -- N refs/heads/dependabot/maven/com.google.cloud-libraries-bom-26.38.0 (27b920e85c) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .../broker/api/resources/PinotClientRequest.java | 4 - .../apache/pinot/broker/querylog/QueryLogger.java | 2 +- .../requesthandler/BaseBrokerRequestHandler.java | 28 +- .../BrokerRequestHandlerDelegate.java | 19 +- .../MultiStageBrokerRequestHandler.java | 99 ++-- .../SingleConnectionBrokerRequestHandler.java | 3 +- .../requesthandler/BrokerRequestOptionsTest.java | 75 +-- pinot-common/pom.xml | 52 +- .../pinot/common/datablock/BaseDataBlock.java | 52 +- .../pinot/common/datablock/ColumnarDataBlock.java | 26 +- .../apache/pinot/common/datablock/DataBlock.java | 4 - .../pinot/common/datablock/DataBlockUtils.java | 38 +- .../pinot/common/datablock/MetadataBlock.java | 212 ++++--- .../pinot/common/datablock/RowDataBlock.java | 31 +- .../apache/pinot/common/datatable/DataTable.java | 3 + .../org/apache/pinot/common/datatable/StatMap.java | 498 ++++++++++++++++ .../apache/pinot/common/request/BrokerRequest.java | 2 +- .../apache/pinot/common/request/DataSource.java | 2 +- .../apache/pinot/common/request/Expression.java | 2 +- .../pinot/common/request/ExpressionType.java | 2 +- .../org/apache/pinot/common/request/Function.java | 38 +- .../apache/pinot/common/request/Identifier.java | 2 +- .../pinot/common/request/InstanceRequest.java | 2 +- .../java/org/apache/pinot/common/request/Join.java | 2 +- .../org/apache/pinot/common/request/JoinType.java | 2 +- .../org/apache/pinot/common/request/Literal.java | 162 ++--- .../apache/pinot/common/request/PinotQuery.java | 328 +++-------- .../apache/pinot/common/request/QuerySource.java | 2 +- .../pinot/common/response/BrokerResponse.java | 116 +--- .../pinot/common/response/ProcessingException.java | 2 +- .../response/broker/BrokerResponseNative.java | 59 +- .../response/broker/BrokerResponseNativeV2.java | 383 +++++++++++- .../response/broker/BrokerResponseStats.java | 7 - .../pinot/common/utils/request/RequestUtils.java | 32 +- .../apache/pinot/sql/parsers/CalciteSqlParser.java | 10 +- .../common/datablock/BaseDataBlockContract.java | 30 +- .../pinot/common/datablock/MetadataBlockTest.java | 187 +++++- .../pinot/common/datablock/RowDataBlockTest.java | 33 +- .../pinot/common/datablock/V1MetadataBlock.java} | 51 +- .../apache/pinot/common/datatable/StatMapTest.java | 209 +++++++ .../pinot/sql/parsers/CalciteSqlCompilerTest.java | 19 +- pinot-common/src/thrift/query.thrift | 2 +- .../api/resources/PinotTaskRestletResource.java | 4 +- .../java/org/apache/pinot/core/auth/Actions.java | 1 + .../core/operator/InstanceResponseOperator.java | 34 +- .../StreamingInstanceResponseOperator.java | 20 +- .../query/reduce/ExecutionStatsAggregator.java | 28 +- .../core/query/request/context/QueryContext.java | 1 - .../org/apache/pinot/core/util/GapfillUtils.java | 4 +- .../v2/DistinctCountCPCSketchStarTreeV2Test.java | 24 +- ...ctCountIntegerSumTupleSketchStarTreeV2Test.java | 25 +- .../v2/DistinctCountThetaSketchStarTreeV2Test.java | 23 +- .../tests/BaseClusterIntegrationTestSet.java | 2 +- .../tests/HybridClusterIntegrationTest.java | 3 +- pinot-plugins/pinot-file-system/pinot-adls/pom.xml | 6 +- .../KafkaConfigBackwardCompatibleUtils.java | 63 ++ .../stream/kafka20/KafkaConsumerFactory.java | 1 + .../KafkaPartitionLevelStreamConfigTest.java | 27 +- .../rel/rules/PinotJoinToDynamicBroadcastRule.java | 15 +- .../pinot/query/mailbox/GrpcSendingMailbox.java | 36 +- .../query/mailbox/InMemorySendingMailbox.java | 9 +- .../apache/pinot/query/mailbox/MailboxService.java | 9 +- .../pinot/query/mailbox/ReceivingMailbox.java | 89 ++- .../mailbox/channel/MailboxContentObserver.java | 25 +- .../query/runtime/InStageStatsTreeBuilder.java | 207 +++++++ .../query/runtime/MultiStageStatsTreeBuilder.java | 41 +- .../apache/pinot/query/runtime/QueryRunner.java | 5 +- .../query/runtime/blocks/TransferableBlock.java | 94 ++- .../runtime/blocks/TransferableBlockUtils.java | 12 +- .../runtime/executor/OpChainSchedulerService.java | 7 +- .../query/runtime/operator/AggregateOperator.java | 72 ++- .../operator/BaseMailboxReceiveOperator.java | 104 +++- .../query/runtime/operator/FilterOperator.java | 52 +- .../query/runtime/operator/HashJoinOperator.java | 77 ++- .../query/runtime/operator/IntersectOperator.java | 16 +- .../LeafStageTransferableBlockOperator.java | 303 ++++++++-- .../runtime/operator/LiteralValueOperator.java | 41 +- .../runtime/operator/MailboxReceiveOperator.java | 11 + .../runtime/operator/MailboxSendOperator.java | 142 ++++- .../query/runtime/operator/MinusOperator.java | 13 + .../query/runtime/operator/MultiStageOperator.java | 252 +++++++- .../pinot/query/runtime/operator/OpChain.java | 7 - .../pinot/query/runtime/operator/OpChainStats.java | 109 ---- .../query/runtime/operator/OperatorStats.java | 119 ---- .../pinot/query/runtime/operator/SetOperator.java | 53 +- .../pinot/query/runtime/operator/SortOperator.java | 70 ++- .../operator/SortedMailboxReceiveOperator.java | 13 +- .../query/runtime/operator/TransformOperator.java | 47 +- .../query/runtime/operator/UnionOperator.java | 52 +- .../runtime/operator/WindowAggregateOperator.java | 52 +- .../runtime/operator/exchange/BlockExchange.java | 1 + .../utils/BlockingMultiStreamConsumer.java | 28 +- .../runtime/operator/utils/OperatorUtils.java | 77 --- .../query/runtime/plan/MultiStageQueryStats.java | 651 +++++++++++++++++++++ .../runtime/plan/OpChainExecutionContext.java | 15 +- .../plan/pipeline/PipelineBreakerExecutor.java | 2 +- .../plan/pipeline/PipelineBreakerOperator.java | 69 ++- .../plan/pipeline/PipelineBreakerResult.java | 12 +- .../plan/server/ServerPlanRequestContext.java | 5 +- .../query/service/dispatch/QueryDispatcher.java | 79 +-- .../pinot/query/mailbox/MailboxServiceTest.java | 60 +- .../runtime/blocks/TransferableBlockTest.java | 44 ++ .../runtime/blocks/TransferableBlockTestUtils.java | 45 ++ .../runtime/blocks/TransferableBlockUtilsTest.java | 2 +- .../executor/OpChainSchedulerServiceTest.java | 7 +- .../runtime/operator/AggregateOperatorTest.java | 45 +- .../query/runtime/operator/FilterOperatorTest.java | 32 +- .../runtime/operator/HashJoinOperatorTest.java | 125 ++-- .../runtime/operator/IntersectOperatorTest.java | 14 +- .../LeafStageTransferableBlockOperatorTest.java | 12 +- .../runtime/operator/LiteralValueOperatorTest.java | 4 +- .../operator/MailboxReceiveOperatorTest.java | 19 +- .../runtime/operator/MailboxSendOperatorTest.java | 19 +- .../query/runtime/operator/MinusOperatorTest.java | 14 +- .../pinot/query/runtime/operator/OpChainTest.java | 217 +++---- .../query/runtime/operator/OperatorTestUtil.java | 51 +- .../query/runtime/operator/SortOperatorTest.java | 92 +-- .../operator/SortedMailboxReceiveOperatorTest.java | 22 +- .../runtime/operator/TransformOperatorTest.java | 16 +- .../query/runtime/operator/UnionOperatorTest.java | 8 +- .../operator/WindowAggregateOperatorTest.java | 69 +-- .../operator/exchange/BlockExchangeTest.java | 4 +- .../runtime/plan/MultiStageQueryStatsTest.java | 100 ++++ .../plan/pipeline/PipelineBreakerExecutorTest.java | 34 +- .../query/runtime/queries/QueryRunnerTest.java | 6 +- .../query/runtime/queries/QueryRunnerTestBase.java | 16 +- .../runtime/queries/ResourceBasedQueriesTest.java | 110 ++-- .../service/dispatch/QueryDispatcherTest.java | 4 +- .../testutils/MockDataBlockOperatorFactory.java | 4 +- .../DistinctCountCPCSketchValueAggregator.java | 88 +-- .../DistinctCountThetaSketchValueAggregator.java | 133 +++-- .../IntegerTupleSketchValueAggregator.java | 90 ++- .../realtime/impl/vector/MutableVectorIndex.java | 2 +- .../creator/impl/fwd/ForwardIndexUtils.java | 42 ++ .../fwd/MultiValueFixedByteRawIndexCreator.java | 44 +- .../impl/fwd/MultiValueVarByteRawIndexCreator.java | 14 +- .../fwd/SingleValueFixedByteRawIndexCreator.java | 9 +- .../fwd/SingleValueVarByteRawIndexCreator.java | 25 +- .../impl/inv/text/LuceneFSTIndexCreator.java | 2 +- .../creator/impl/text/LuceneTextIndexCreator.java | 14 +- .../impl/vector/HnswVectorIndexCreator.java | 3 +- .../vector/{lucene95 => lucene99}/HnswCodec.java | 14 +- .../{lucene95 => lucene99}/HnswVectorsFormat.java | 10 +- .../converter/SegmentV1V2ToV3FormatConverter.java | 8 +- .../index/forward/ForwardIndexCreatorFactory.java | 21 +- .../local/segment/index/fst/FstIndexType.java | 3 +- .../loader/invertedindex/FSTIndexHandler.java | 4 +- .../loader/invertedindex/VectorIndexHandler.java | 5 +- .../index/readers/LuceneFSTIndexReader.java | 3 +- .../local/segment/index/text/TextIndexType.java | 3 +- .../segment/index/vector/VectorIndexType.java | 3 +- .../local/segment/store/TextIndexUtils.java | 5 +- .../local/segment/store/VectorIndexUtils.java | 24 +- .../segment/local/upsert/PartialUpsertHandler.java | 16 +- .../pinot/segment/local/utils/fst/FSTBuilder.java | 13 +- .../utils/nativefst/NativeFSTIndexCreator.java | 2 +- .../DistinctCountCPCSketchValueAggregatorTest.java | 64 +- ...istinctCountThetaSketchValueAggregatorTest.java | 89 +-- .../IntegerTupleSketchValueAggregatorTest.java | 27 +- .../index/creator/LuceneFSTIndexCreatorTest.java | 4 +- .../MultiValueFixedByteRawIndexCreatorTest.java | 2 +- .../MultiValueVarByteRawIndexCreatorTest.java | 4 +- .../index/creator/NativeFSTIndexCreatorTest.java | 4 +- .../index/forward/ForwardIndexTypeTest.java | 6 +- .../index/forward/ForwardIndexUtilsTest.java | 47 ++ .../forward/VarByteChunkSVForwardIndexTest.java | 2 +- .../local/segment/index/loader/LoaderTest.java | 36 +- .../index/loader/SegmentPreProcessorTest.java | 4 +- .../segment/store/FilePerIndexDirectoryTest.java | 4 +- .../store/SingleFileIndexDirectoryTest.java | 4 +- .../local/upsert/PartialUpsertHandlerTest.java | 9 +- .../segment/local/utils/fst/FSTBuilderTest.java | 2 - .../org/apache/pinot/segment/spi/V1Constants.java | 4 + .../segment/spi/index/ForwardIndexConfig.java | 66 ++- .../segment/spi/store/SegmentDirectoryPaths.java | 26 +- .../segment/spi/index/ForwardIndexConfigTest.java | 15 +- pinot-server/pom.xml | 4 - pinot-spi/pom.xml | 26 - .../apache/pinot/spi/utils/CommonConstants.java | 13 +- .../pinot/tools/MultistageEngineQuickStart.java | 8 + .../org/apache/pinot/tools/RealtimeQuickStart.java | 10 + .../converter/DictionaryToRawIndexConverter.java | 7 +- pom.xml | 108 ++-- 183 files changed, 5978 insertions(+), 2603 deletions(-) create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/datatable/StatMap.java copy pinot-segment-spi/src/test/java/org/apache/pinot/segment/spi/index/FieldIndexConfigsTest.java => pinot-common/src/test/java/org/apache/pinot/common/datablock/BaseDataBlockContract.java (55%) copy pinot-segment-local/src/main/java/org/apache/pinot/segment/local/customobject/IntLongPair.java => pinot-common/src/test/java/org/apache/pinot/common/datablock/RowDataBlockTest.java (61%) copy pinot-common/src/{main/java/org/apache/pinot/common/datablock/MetadataBlock.java => test/java/org/apache/pinot/common/datablock/V1MetadataBlock.java} (77%) create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/datatable/StatMapTest.java create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaConfigBackwardCompatibleUtils.java create mode 100644 pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/InStageStatsTreeBuilder.java copy pinot-query-planner/src/main/java/org/apache/pinot/query/planner/PlanFragment.java => pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/MultiStageStatsTreeBuilder.java (52%) delete mode 100644 pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/operator/OpChainStats.java delete mode 100644 pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/operator/OperatorStats.java create mode 100644 pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/plan/MultiStageQueryStats.java create mode 100644 pinot-query-runtime/src/test/java/org/apache/pinot/query/runtime/blocks/TransferableBlockTest.java create mode 100644 pinot-query-runtime/src/test/java/org/apache/pinot/query/runtime/blocks/TransferableBlockTestUtils.java create mode 100644 pinot-query-runtime/src/test/java/org/apache/pinot/query/runtime/plan/MultiStageQueryStatsTest.java create mode 100644 pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/fwd/ForwardIndexUtils.java rename pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/vector/{lucene95 => lucene99}/HnswCodec.java (92%) rename pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/vector/{lucene95 => lucene99}/HnswVectorsFormat.java (92%) create mode 100644 pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/forward/ForwardIndexUtilsTest.java --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org