This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/maven/calcite.version-1.41.0
in repository https://gitbox.apache.org/repos/asf/pinot.git
discard c959711235c Bump calcite.version from 1.40.0 to 1.41.0
add 467b01f2ce4 Include record when filter transform throws exception
(#17218)
add 9fe57291ce2 Bump software.amazon.awssdk:bom from 2.38.8 to 2.38.9
(#17236)
add 38e6b88ab1e Bump com.google.cloud:libraries-bom from 26.71.0 to
26.72.0 (#17237)
add 5961a593547 Bump scala.version from 2.13.16 to 2.13.18 (#17224)
add 61edb7af8e9 MergeRollupTask config behaviour fix for
`output.segment.dir.uri` (#17015)
add 0d21654dfc8 Disable JOIN_PUSH_TRANSITIVE_PREDICATES optimization rule
by default (#17181)
add a54853279bd [timeseries] End-to-end query execution statistics
propagation for timeseries queries (#17170)
add 325446cabb5 Fix non-daemon threads blocking JVM shutdown in
RenewableTlsUtils (#17221)
add 5eb2dd7e37f Rename SSE aggregation function override for MV columns
(#17056)
add 8d0a22406a3 Bump software.amazon.awssdk:bom from 2.38.9 to 2.39.0
(#17245)
add 0fa5c1a10f0 Bump org.apache.kerby:kerby-bom from 2.1.0 to 2.1.1
(#17246)
add 27d981297db remove unnecessary sys out from the parquet reader (#17250)
add 462b4b96b99 support TIMESTAMP as dedupTimeColumn (#17200)
add 687770ee3e1 [Timeseries-Storage] add Delta and DeltaDelta storage
encoding (#15258)
add 1f80b5ea9da Add new /uploadFromServerToDeepstore endpoint (#17197)
add 96d7a1218ad Bump io.github.hakky54:ayza-bom from 10.0.1 to 10.0.2
(#17256)
add 96ab14e4b7d Bump software.amazon.awssdk:bom from 2.39.0 to 2.39.1
(#17257)
add b918196a222 Add segment-level failure details capture to reload status
tracking (#17234)
add 9f8877d521c Donot allow reload/Force commit on a consuming segment for
a Upsert Table with dropOutOfOrderRecord=true (#17251)
add c39cf40fd5c [Upsert] add xxhash for PrimaryKey compression (#17253)
add f9a32e4550d Bump org.codehaus.mojo:versions-maven-plugin from 2.19.1
to 2.20.0 (#17265)
add 0da67bea2c9 Bump software.amazon.awssdk:bom from 2.39.1 to 2.39.2
(#17266)
add fd68b78cdb9 [Minor] Fix log for response serialization error (#17259)
add 82db60076a5 [bugfix] Fixing flaky test in
TableRebalancePauselessIntegrationTest (#17240)
add f8432c37165 Remove duplicate function name from annotation for
ArraysOverlap (#17255)
add 883bfd2d7fd Always use segment partition id as stream partition id for
single stream (second time) (#17261)
add 48fcf0023e6 Add window value aggregator for AVG function (#17268)
add f72b6702fa2 Bump software.amazon.awssdk:bom from 2.39.2 to 2.39.3
(#17271)
add 67aa2ea806b Bump org.codehaus.mojo:versions-maven-plugin from 2.20.0
to 2.20.1 (#17272)
add d78b39b6ca8 [ingestion] Add rate-limited exception logging for
transformers (#17239)
add 150ce24dcad Bump software.amazon.awssdk:bom from 2.39.3 to 2.39.4
(#17274)
add e084b5defa1 Fix Pinot JDBC driver metadata version retrieval (#17275)
add 26af959d663 Backward compatibility test for AVG window function
(#17270)
add 9bb30d540bd Combine MV aggregations into regular SV aggregations
(#17109)
add 01b809226ff Bump node-forge in /pinot-controller/src/main/resources
(#17277)
add 0b7ead68122 Fix pool based assignment enforcement (#17276)
add 57f94f3a7ec Add broker config to support configuring planner rules
disabled by default (#17258)
add a15ffbd4c0f Bump software.amazon.awssdk:bom from 2.39.4 to 2.39.5
(#17283)
add 17b35d53042 Bump org.apache.commons:commons-configuration2 from 2.12.0
to 2.13.0 (#17282)
add 0f1db956502 [spi] Add Parquet record reader config to input format map
(#17280)
add 4e3599ceabd Add subtask timing metrics for minion tasks (#17190)
add dad20849263 Bump com.azure:azure-sdk-bom from 1.3.2 to 1.3.3 (#17290)
add 8b884ffb5bf Bump com.google.errorprone:error_prone_annotations from
2.44.0 to 2.45.0 (#17288)
add 1d71d56e472 make server segment predownload configurable (#17287)
add d64d7c7f3ba Bump org.webjars:swagger-ui from 5.30.2 to 5.30.3 (#17289)
add 812955d7b4a Force colocated join when 'is_colocated_by_join_keys' is
provided for semi-join (#17273)
add f08856003ee Bump express in /pinot-controller/src/main/resources
(#17297)
add a03a8701fa3 Fix flaky RenewableTlsUtilsTest reload wait (#17285)
add 9d08eca40f6 Bump org.quartz-scheduler:quartz from 2.5.1 to 2.5.2
(#17303)
add 772acc88fff Bump net.openhft:chronicle-bom from 2.27ea90 to 2.27ea91
(#17302)
add 8bfb907db9e Bump software.amazon.awssdk:bom from 2.39.5 to 2.39.6
(#17301)
add 5446bad8554 Bump calcite.version from 1.40.0 to 1.41.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (c959711235c)
\
N -- N -- N refs/heads/dependabot/maven/calcite.version-1.41.0
(5446bad8554)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.gitignore | 4 +-
.../queries/feature-test-multi-stage.queries | 2 +-
.../query-results/feature-test-multi-stage.results | 2 +-
.../BaseSingleStageBrokerRequestHandler.java | 27 +-
.../MultiStageBrokerRequestHandler.java | 6 +
.../broker/requesthandler/QueryOverrideTest.java | 4 +-
.../pinot/client/PinotConnectionMetaData.java | 4 +-
.../apache/pinot/client/PinotConnectionTest.java | 2 +
.../scalar/array/ArraysOverlapScalarFunction.java | 2 +-
.../common/function/sql/PinotSqlAggFunction.java | 5 +
.../pinot/common/metrics/ControllerTimer.java | 5 +-
.../apache/pinot/common/metrics/ServerMeter.java | 1 +
.../response/mapper/TimeSeriesResponseMapper.java | 41 +++
.../common/response/server/ApiErrorResponse.java | 38 ++-
.../server/SegmentReloadFailureResponse.java | 69 +++++
.../server/ServerReloadStatusResponse.java | 52 +++-
.../pinot/common/utils/NamedThreadFactory.java | 16 +-
.../org/apache/pinot/common/utils/RateLimiter.java | 93 +++++++
.../apache/pinot/common/utils/ThrottledLogger.java | 97 +++++++
.../pinot/common/utils/tls/RenewableTlsUtils.java | 11 +-
.../mapper/TimeSeriesResponseMapperTest.java | 2 +-
.../apache/pinot/common/utils/RateLimiterTest.java | 148 +++++++++++
.../pinot/common/utils/ThrottledLoggerTest.java | 150 +++++++++++
.../common/utils/tls/RenewableTlsUtilsTest.java | 55 ++--
.../api/dto/PinotTableReloadStatusResponse.java | 17 ++
.../api/resources/PinotSegmentRestletResource.java | 83 ++++++
.../core/minion/PinotHelixTaskResourceManager.java | 121 +++++++--
.../helix/core/minion/TaskMetricsEmitter.java | 44 ++--
.../realtime/PinotLLCRealtimeSegmentManager.java | 71 +++--
.../services/PinotTableReloadStatusReporter.java | 35 ++-
.../src/main/resources/package-lock.json | 100 +++++---
.../minion/PinotHelixTaskResourceManagerTest.java | 218 +++++++++++++++-
.../helix/core/minion/TaskMetricsEmitterTest.java | 115 +++++----
.../PinotLLCRealtimeSegmentManagerTest.java | 42 ++-
.../core/data/manager/BaseTableDataManager.java | 19 +-
.../manager/provider/TableDataManagerProvider.java | 2 +-
.../realtime/RealtimeSegmentDataManager.java | 24 +-
.../timeseries/TimeSeriesOperatorUtils.java | 8 +-
.../function/AvgAggregationFunction.java | 187 ++++++++++----
.../function/AvgMVAggregationFunction.java | 61 +----
.../BaseDistinctAggregateAggregationFunction.java | 280 +++++++++++---------
.../function/DistinctAvgAggregationFunction.java | 24 +-
.../function/DistinctAvgMVAggregationFunction.java | 6 +-
.../function/DistinctCountAggregationFunction.java | 24 +-
.../DistinctCountMVAggregationFunction.java | 6 +-
.../function/DistinctSumAggregationFunction.java | 24 +-
.../function/DistinctSumMVAggregationFunction.java | 6 +-
.../function/MaxAggregationFunction.java | 115 +++++++++
.../function/MaxMVAggregationFunction.java | 82 +-----
.../function/MinAggregationFunction.java | 115 +++++++++
.../function/MinMVAggregationFunction.java | 82 +-----
.../function/MinMaxRangeAggregationFunction.java | 201 +++++++++++----
.../function/MinMaxRangeMVAggregationFunction.java | 51 +---
.../function/SumAggregationFunction.java | 111 ++++++++
.../function/SumMVAggregationFunction.java | 90 +------
.../pinot/core/query/scheduler/QueryScheduler.java | 8 +-
.../function/AvgAggregationFunctionTest.java | 124 +++++++++
.../DistinctAvgAggregationFunctionTest.java | 211 +++++++++++++++
.../DistinctCountAggregationFunctionTest.java | 210 +++++++++++++++
.../DistinctSumAggregationFunctionTest.java | 211 +++++++++++++++
.../function/MaxAggregationFunctionTest.java | 138 ++++++++++
.../function/MinAggregationFunctionTest.java | 145 +++++++++++
.../MinMaxRangeAggregationFunctionTest.java | 142 ++++++++++
.../function/SumAggregationFunctionTest.java | 149 +++++++++++
.../core/query/executor/QueryExecutorTest.java | 7 +-
...reeV2Test.java => AvgWithMVStarTreeV2Test.java} | 7 +-
...reeV2Test.java => MaxWithMVStarTreeV2Test.java} | 7 +-
...t.java => MinMaxRangeWithMVStarTreeV2Test.java} | 7 +-
...reeV2Test.java => MinWithMVStarTreeV2Test.java} | 7 +-
...reeV2Test.java => SumWithMVStarTreeV2Test.java} | 7 +-
.../tests/ExplainIntegrationTestTrait.java | 2 +-
.../MultiStageEngineExplainIntegrationTest.java | 41 ++-
.../TableRebalancePauselessIntegrationTest.java | 1 +
.../tests/TimeSeriesIntegrationTest.java | 7 +
.../perf/BenchmarkDimensionTableOverhead.java | 2 +-
.../parquet/ParquetNativeRecordReader.java | 2 -
.../pinot/plugin/minion/tasks/MinionTaskUtils.java | 60 +++--
.../plugin/minion/tasks/MinionTaskUtilsTest.java | 91 +++++++
.../calcite/rel/logical/PinotLogicalExchange.java | 7 +-
.../rules/PinotAggregateFunctionRewriteRule.java | 3 +-
.../rel/rules/PinotJoinToDynamicBroadcastRule.java | 24 +-
.../pinot/calcite/rel/rules/PinotRuleUtils.java | 6 +-
.../pinot/calcite/sql/fun/PinotOperatorTable.java | 105 +++++++-
.../org/apache/pinot/query/QueryEnvironment.java | 68 +++--
.../apache/pinot/query/routing/WorkerManager.java | 17 +-
.../org/apache/pinot/query/type/TypeSystem.java | 2 -
.../apache/pinot/query/QueryCompilationTest.java | 2 +-
.../resources/queries/ExplainPhysicalPlans.json | 76 +++++-
.../src/test/resources/queries/JoinPlans.json | 11 +-
.../resources/queries/PhysicalOptimizerPlans.json | 7 +-
.../test/resources/queries/PinotHintablePlans.json | 4 +-
.../apache/pinot/query/runtime/QueryRunner.java | 4 +-
...gregator.java => AvgWindowValueAggregator.java} | 6 +-
.../aggregate/WindowValueAggregatorFactory.java | 2 +
.../runtime/timeseries/LeafTimeSeriesOperator.java | 5 +-
.../TimeSeriesExchangeReceiveOperator.java | 45 +++-
.../timeseries/serde/TimeSeriesBlockSerde.java | 5 +-
.../timeseries/TimeSeriesDispatchObserver.java | 3 +-
.../timeseries/serde/TimeSeriesBlockSerdeTest.java | 3 +-
.../local/aggregator/AvgMVValueAggregator.java | 44 ----
.../local/aggregator/AvgValueAggregator.java | 35 ++-
.../local/aggregator/MaxValueAggregator.java | 19 +-
.../aggregator/MinMaxRangeValueAggregator.java | 31 ++-
.../local/aggregator/MinValueAggregator.java | 19 +-
.../local/aggregator/SumMVValueAggregator.java | 36 ---
.../local/aggregator/SumValueAggregator.java | 22 +-
.../io/compression/ChunkCompressorFactory.java | 14 +-
.../local/io/compression/DeltaCompressor.java | 199 ++++++++++++++
.../local/io/compression/DeltaDecompressor.java | 151 +++++++++++
.../local/io/compression/DeltaDeltaCompressor.java | 231 +++++++++++++++++
.../io/compression/DeltaDeltaDecompressor.java | 169 ++++++++++++
.../recordtransformer/ComplexTypeTransformer.java | 8 +-
.../recordtransformer/DataTypeTransformer.java | 5 +-
.../recordtransformer/ExpressionTransformer.java | 5 +-
.../local/recordtransformer/FilterTransformer.java | 11 +-
.../SchemaConformingTransformer.java | 5 +-
.../TimeValidationTransformer.java | 7 +-
.../forward/BaseChunkForwardIndexReader.java | 10 +-
.../upsert/BasePartitionUpsertMetadataManager.java | 18 +-
.../pinot/segment/local/utils/HashUtils.java | 30 +++
.../pinot/segment/local/utils/ReloadJobStatus.java | 19 +-
.../local/utils/ServerReloadJobStatusCache.java | 44 +++-
.../utils/ServerReloadJobStatusCacheConfig.java | 15 +-
.../segment/local/utils/TableConfigUtils.java | 53 +++-
.../local/dedup/DedupWithTimestampColumnTest.java | 264 +++++++++++++++++++
.../local/io/compression/DeltaCompressionTest.java | 228 +++++++++++++++++
.../io/compression/DeltaDeltaCompressionTest.java | 200 +++++++++++++++
.../impl/VarByteChunkSVForwardIndexWriterTest.java | 4 +-
.../recordtransformer/RecordTransformerTest.java | 14 +
.../MultiValueFixedByteRawIndexCreatorTest.java | 1 +
.../MultiValueVarByteRawIndexCreatorTest.java | 1 +
.../forward/FixedByteChunkSVForwardIndexTest.java | 1 +
.../pinot/segment/local/utils/HashUtilsTest.java | 4 +
.../utils/ServerReloadJobStatusCacheTest.java | 285 ++++++++++++++++-----
.../segment/local/utils/TableConfigUtilsTest.java | 117 +++++----
.../pinot/segment/spi/AggregationFunctionType.java | 30 ++-
.../spi/compression/ChunkCompressionType.java | 2 +-
.../segment/spi/index/ForwardIndexConfig.java | 12 +
.../api/resources/ControllerJobStatusResource.java | 25 +-
.../server/predownload/PredownloadScheduler.java | 22 +-
.../predownload/PredownloadStatusRecorder.java | 2 +-
.../server/starter/helix/BaseServerStarter.java | 2 +-
.../starter/helix/HelixInstanceDataManager.java | 19 +-
.../predownload/PredownloadSchedulerTest.java | 59 +++++
.../apache/pinot/spi/config/table/FieldConfig.java | 5 +-
.../pinot/spi/config/table/HashFunction.java | 2 +-
.../apache/pinot/spi/config/table/TableConfig.java | 1 +
.../config/table/ingestion/IngestionConfig.java | 13 +
.../org/apache/pinot/spi/plugin/PluginManager.java | 1 +
.../apache/pinot/spi/utils/CommonConstants.java | 13 +-
.../pinot/spi/utils/IngestionConfigUtils.java | 30 ++-
.../pinot/tsdb/spi/series/TimeSeriesBlock.java | 15 ++
pom.xml | 24 +-
153 files changed, 6498 insertions(+), 1289 deletions(-)
copy pinot-spi/src/main/java/org/apache/pinot/spi/plugin/Plugin.java =>
pinot-common/src/main/java/org/apache/pinot/common/response/server/ApiErrorResponse.java
(60%)
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/response/server/SegmentReloadFailureResponse.java
rename
pinot-server/src/main/java/org/apache/pinot/server/starter/helix/SegmentReloadStatusValue.java
=>
pinot-common/src/main/java/org/apache/pinot/common/response/server/ServerReloadStatusResponse.java
(50%)
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/utils/RateLimiter.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/utils/ThrottledLogger.java
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/utils/RateLimiterTest.java
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/utils/ThrottledLoggerTest.java
create mode 100644
pinot-core/src/test/java/org/apache/pinot/core/query/aggregation/function/DistinctAvgAggregationFunctionTest.java
create mode 100644
pinot-core/src/test/java/org/apache/pinot/core/query/aggregation/function/DistinctCountAggregationFunctionTest.java
create mode 100644
pinot-core/src/test/java/org/apache/pinot/core/query/aggregation/function/DistinctSumAggregationFunctionTest.java
copy
pinot-core/src/test/java/org/apache/pinot/core/startree/v2/{AvgStarTreeV2Test.java
=> AvgWithMVStarTreeV2Test.java} (91%)
copy
pinot-core/src/test/java/org/apache/pinot/core/startree/v2/{MaxStarTreeV2Test.java
=> MaxWithMVStarTreeV2Test.java} (90%)
copy
pinot-core/src/test/java/org/apache/pinot/core/startree/v2/{MinMaxRangeStarTreeV2Test.java
=> MinMaxRangeWithMVStarTreeV2Test.java} (90%)
copy
pinot-core/src/test/java/org/apache/pinot/core/startree/v2/{MinStarTreeV2Test.java
=> MinWithMVStarTreeV2Test.java} (90%)
copy
pinot-core/src/test/java/org/apache/pinot/core/startree/v2/{SumStarTreeV2Test.java
=> SumWithMVStarTreeV2Test.java} (90%)
copy
pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/operator/window/aggregate/{SumWindowValueAggregator.java
=> AvgWindowValueAggregator.java} (91%)
create mode 100644
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/compression/DeltaCompressor.java
create mode 100644
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/compression/DeltaDecompressor.java
create mode 100644
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/compression/DeltaDeltaCompressor.java
create mode 100644
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/compression/DeltaDeltaDecompressor.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/dedup/DedupWithTimestampColumnTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/io/compression/DeltaCompressionTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/io/compression/DeltaDeltaCompressionTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
