This is an automated email from the ASF dual-hosted git repository.
xiangfu0 pushed a change to branch
data-2616-disallow-nondeterministic-transforms
in repository https://gitbox.apache.org/repos/asf/pinot.git
discard 65a9fd185b4 Disallow non-deterministic ingestion transform configs
add f37bbe5980f Map recommender Avro schema by original data type, not
stored type (#18970)
add e0210aaf253 Report NOT_CALCULATED for uncomputable consuming-segment
lag (#18836) (#18971)
add a2a27a1e514 Fix flaky SelectionCombineOperatorTest by waiting for
workers before reading stats (#18946)
add 33c8a45632f Bump bouncycastle.version from 1.84 to 1.85 (#18981)
add 9acb4348717 Bump software.amazon.awssdk:bom from 2.47.4 to 2.47.5
(#18982)
add bf56bec552a Bump org.apache.thrift:libthrift from 0.23.0 to 0.24.0
(#18983)
add d59403e7441 Support binary JSON payload formats (PostgreSQL jsonb,
SQLite JSONB, Smile, CBOR) in the JSON stream decoder (#18953)
add ecb288d666d Add server-level consumption rate limit observability
metrics and fix byte-mode overflow (#18942)
add 2cd8ae8bb38 Fix compat-test Kafka setup: upgrade to 4.2.1 (KRaft)
after 3.9.2 removal from downloads.apache.org (#18985)
add 9a93618392c Add compression statistics tracking and table APIs (#18185)
add 36be41ba283 Add unit tests for RangeIndexHandler version-change
detection (#18958)
add f20642ce475 Bump software.amazon.awssdk:bom from 2.47.5 to 2.47.6
(#18988)
add b240bda9f6a Bump actions/setup-node from 6 to 7 (#18989)
add a91a03345cf Bump org.jetbrains.kotlin:kotlin-bom from 2.4.0 to 2.4.10
(#18990)
add 068b458883d Add optional metadata map to FieldSpec (#18984)
add 6bdd2328092 Bump software.amazon.awssdk:bom from 2.47.6 to 2.48.0
(#18994)
add fd772eedd5f Add regression test for unsatisfiable map-key predicates
collapsing the scan to empty Values (#18995)
add f865accd778 Support forcing colocated set operations to avoid data
shuffle using query hint (#18804)
add 8984d8c589e Include stage/worker/server provenance in MSE error block
logs (#19002)
add 00e5d7e33c9 Bump software.amazon.awssdk:bom from 2.48.0 to 2.48.1
(#19001)
add 0270103952a Bump org.apache.ivy:ivy from 2.5.3 to 2.6.0 (#19000)
add f9348300540 Bump spark3.version from 3.5.8 to 3.5.9 (#18999)
add 3790129aa15 Generate UUID sample data in the schema recommender
(#18973)
add 11eb00c9eb6 improve messages when resource utilization exceed (#18993)
add f054a9073fa Update sortedness in metadata if disagree with
ColumnStatistics (#18998)
add 1216618848e Fix FSDirectory resource leak when IndexWriter
construction fails in HNSW vector index (#18964)
add 371582a0d09 Add support for window function EXCLUDE clause (#18482)
add 1c3ad4b8b86 Add unit tests for JsonIndexHandler index lifecycle
(#18962)
add 00d1c88763d Expose authorization header in Swagger API docs (#18974)
add 6a15b9a2b22 Bump software.amazon.awssdk:bom from 2.48.1 to 2.48.2
(#19005)
add 944ef22d1aa Bump com.google.cloud:libraries-bom from 26.85.0 to
26.85.1 (#19006)
add f216ed25ac2 Add tests for chaining colocated joins, window functions
and set operations without shuffle (#18997)
add 41ee76b7ba6 Fix UnsupportedOperationException when RLS filter combines
with expression override (#19008)
add de2f596815f Add skipUpsertDelete query option to view valid docs
instead of queryable docs (#19009)
add 54fdacede32 Fix docker-compose demo so cluster state and data survive
restarts (#19004)
add b2d1de621ee Disallow non-deterministic ingestion transform configs
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (65a9fd185b4)
\
N -- N -- N
refs/heads/data-2616-disallow-nondeterministic-transforms (b2d1de621ee)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/pinot_compatibility_checks.yml | 4 +-
.github/workflows/pinot_compatibility_tests.yml | 2 +-
...ulti_stage_query_engine_compatibility_tests.yml | 2 +-
LICENSE-binary | 2 +
compatibility-verifier/compCheck.sh | 34 +-
docker/images/pinot/docker-compose.yml | 10 +-
.../BaseSingleStageBrokerRequestHandlerTest.java | 144 +++
.../ColumnCompressionStatsAccumulator.java | 174 +++
.../apache/pinot/common/http/MultiHttpRequest.java | 166 ++-
.../http/MultiHttpRequestBufferedResponse.java | 64 ++
.../pinot/common/metrics/ControllerGauge.java | 9 +
.../apache/pinot/common/metrics/ServerGauge.java | 8 +
.../ColumnCompressionStatsContribution.java | 144 +++
.../resources/ColumnCompressionStatsInfo.java | 212 ++++
.../restlet/resources/CompressionStatsSummary.java | 103 ++
.../SegmentCompressionStatsContribution.java | 82 ++
.../common/restlet/resources/SegmentSizeInfo.java | 66 +-
.../resources/ServerCompressionStatsResponse.java | 59 +
.../restlet/resources/ServerTableMetadataInfo.java | 197 ++++
.../restlet/resources/TableMetadataInfo.java | 56 +-
.../common/restlet/resources/TableSizeInfo.java | 20 +-
.../pinot/common/swagger/SwaggerSetupUtils.java | 44 +-
.../common/utils/config/QueryOptionsUtils.java | 4 +
.../pinot/common/utils/request/RequestUtils.java | 9 +-
.../sql/parsers/rewriter/RlsFiltersRewriter.java | 3 +-
pinot-common/src/main/proto/plan.proto | 10 +
.../ColumnCompressionStatsAccumulatorTest.java | 57 +
.../pinot/common/http/MultiHttpRequestTest.java | 96 ++
.../pinot/common/metrics/ControllerGaugeTest.java | 22 +-
.../resources/ColumnCompressionStatsInfoTest.java | 135 +++
.../resources/CompressionStatsSummaryTest.java | 82 ++
.../restlet/resources/SegmentSizeInfoTest.java | 101 ++
.../ServerTransportCompatibilityTest.java | 141 +++
.../TableMetadataInfoCompressionTest.java | 157 +++
.../common/swagger/SwaggerSetupUtilsTest.java | 61 ++
.../common/utils/request/RequestUtilsTest.java | 29 +
.../api/resources/PinotTableRestletResource.java | 25 +-
.../api/resources/ServerTableSizeReader.java | 46 +-
.../pinot/controller/api/resources/TableSize.java | 4 +-
.../controller/helix/SegmentStatusChecker.java | 34 +-
.../data/generator/GeneratorFactory.java | 3 +
.../recommender/data/generator/UuidGenerator.java | 76 ++
.../recommender/data/writer/AvroWriter.java | 45 +-
.../controller/util/CompletionServiceHelper.java | 152 ++-
.../util/ServerCompressionStatsReader.java | 648 +++++++++++
.../util/ServerSegmentMetadataReader.java | 70 +-
.../pinot/controller/util/TableMetadataReader.java | 19 +-
.../pinot/controller/util/TableSizeReader.java | 242 ++++-
.../RealtimeSegmentValidationManager.java | 6 +-
.../validation/ResourceUtilizationManager.java | 18 +-
.../ServerTableSizeReaderCompressionStatsTest.java | 224 ++++
.../controller/api/ServerTableSizeReaderTest.java | 51 +-
.../api/TableMetadataReaderCompressionTest.java | 1128 ++++++++++++++++++++
.../api/TableSizeReaderCompressionStatsTest.java | 682 ++++++++++++
.../pinot/controller/api/TableSizeReaderTest.java | 3 +-
.../controller/helix/SegmentStatusCheckerTest.java | 75 +-
.../data/generator/UuidGeneratorTest.java | 87 ++
.../recommender/data/writer/AvroWriterTest.java | 185 ++++
.../realtime/RealtimeConsumptionRateManager.java | 84 +-
.../combine/BaseSingleBlockCombineOperator.java | 24 +-
.../org/apache/pinot/core/plan/FilterPlanNode.java | 10 +-
.../core/query/pruner/SegmentPrunerService.java | 19 +-
.../RealtimeConsumptionRateManagerTest.java | 161 ++-
.../ServerRateLimitConfigChangeListenerTest.java | 17 +
.../combine/CombineErrorOperatorsTest.java | 21 +
.../apache/pinot/core/plan/FilterPlanNodeTest.java | 2 +-
...adataAndDictionaryAggregationPlanMakerTest.java | 2 +-
.../query/pruner/SegmentPrunerServiceTest.java | 36 +
...essionStatsOfflineIngestionIntegrationTest.java | 402 +++++++
...ssionStatsRealtimeIngestionIntegrationTest.java | 231 ++++
.../integration/tests/custom/MapFieldTypeTest.java | 37 +
.../plugin/inputformat/avro/AvroSchemaUtil.java | 41 +-
.../inputformat/avro/AvroSchemaUtilTest.java | 84 ++
.../pinot-input-format/pinot-json/README.md | 170 +++
.../pinot-input-format/pinot-json/pom.xml | 12 +
.../inputformat/json/JSONMessageDecoder.java | 73 +-
.../json/format/AutoDetectPayloadParser.java | 28 +-
.../json/format/CborJsonPayloadParser.java | 49 +
.../json/format/JacksonPayloadParser.java | 32 +-
.../inputformat/json/format/JsonPayloadFormat.java | 89 ++
.../inputformat/json/format/JsonPayloadParser.java | 54 +
.../json/format/PostgresJsonbPayloadParser.java | 58 +
.../json/format/SmileJsonPayloadParser.java | 44 +
.../json/format/SqliteJsonbPayloadParser.java | 508 +++++++++
.../json/format/TextJsonPayloadParser.java | 55 +
.../json/JSONMessageDecoderBinaryTest.java | 263 +++++
.../json/format/JsonPayloadFormatTest.java | 670 ++++++++++++
.../kafka30/KafkaStreamMetadataProvider.java | 12 +-
.../kafka30/KafkaStreamMetadataProviderTest.java | 65 ++
.../kafka40/KafkaStreamMetadataProvider.java | 12 +-
.../kafka40/KafkaStreamMetadataProviderTest.java | 65 ++
.../kinesis/KinesisStreamMetadataProvider.java | 10 +-
.../kinesis/KinesisStreamMetadataProviderTest.java | 48 +
.../pinot/calcite/rel/hint/PinotHintOptions.java | 28 +
.../calcite/rel/hint/PinotHintStrategyTable.java | 1 +
.../rules/PinotSetOpExchangeNodeInsertRule.java | 32 +-
.../query/planner/explain/PlanNodeMerger.java | 3 +
.../planner/logical/PlanNodeToRelConverter.java | 17 +-
.../planner/logical/RelToPlanNodeConverter.java | 19 +-
.../physical/v2/PRelToPlanNodeConverter.java | 4 +-
.../pinot/query/planner/plannode/WindowNode.java | 29 +-
.../query/planner/serde/PlanNodeDeserializer.java | 18 +-
.../query/planner/serde/PlanNodeSerializer.java | 16 +
.../apache/pinot/query/QueryCompilationTest.java | 199 +++-
.../resources/queries/ExplainPhysicalPlans.json | 42 +
.../apache/pinot/query/runtime/QueryRunner.java | 4 +-
.../pinot/query/runtime/blocks/ErrorMseBlock.java | 6 +
.../runtime/executor/OpChainSchedulerService.java | 5 +-
.../runtime/operator/WindowAggregateOperator.java | 3 +-
.../query/runtime/operator/window/WindowFrame.java | 19 +-
.../runtime/operator/window/WindowFunction.java | 131 +++
.../window/aggregate/AggregateWindowFunction.java | 213 +++-
.../SortedMultisetMinMaxWindowValueAggregator.java | 86 ++
.../aggregate/WindowValueAggregatorFactory.java | 17 +-
.../window/value/FirstValueWindowFunction.java | 37 +
.../window/value/LastValueWindowFunction.java | 37 +
.../query/runtime/blocks/ErrorMseBlockTest.java | 62 ++
.../operator/WindowAggregateOperatorTest.java | 2 +-
.../aggregate/WindowValueAggregatorTest.java | 51 +
.../src/test/resources/queries/QueryHints.json | 33 +
.../test/resources/queries/WindowFunctions.json | 246 +++++
.../immutable/ImmutableSegmentImpl.java | 6 +
.../indexsegment/mutable/MutableSegmentImpl.java | 6 +
.../writer/impl/BaseChunkForwardIndexWriter.java | 16 +
.../impl/FixedByteChunkForwardIndexWriter.java | 10 +
.../impl/VarByteChunkForwardIndexWriter.java | 8 +
.../impl/VarByteChunkForwardIndexWriterV4.java | 25 +
.../local/io/writer/impl/VarByteChunkWriter.java | 6 +
.../realtime/impl/vector/MutableVectorIndex.java | 33 +-
.../segment/creator/impl/BaseSegmentCreator.java | 46 +-
.../segment/creator/impl/ColumnIndexCreators.java | 12 +
.../creator/impl/SameValueForwardIndexCreator.java | 13 +
.../creator/impl/SegmentDictionaryCreator.java | 150 ++-
.../creator/impl/fwd/CLPForwardIndexCreatorV1.java | 23 +-
.../creator/impl/fwd/CLPForwardIndexCreatorV2.java | 35 +-
...mpressionStatsTrackingForwardIndexCreator.java} | 40 +-
.../fwd/MultiValueFixedByteRawIndexCreator.java | 20 +-
.../impl/fwd/MultiValueVarByteRawIndexCreator.java | 20 +-
.../fwd/SingleValueFixedByteRawIndexCreator.java | 20 +-
.../fwd/SingleValueVarByteRawIndexCreator.java | 20 +-
.../impl/vector/HnswVectorIndexCreator.java | 17 +-
.../index/dictionary/DictionaryIndexType.java | 2 +-
.../index/forward/CompressionStatsMetadata.java | 100 ++
.../index/forward/ForwardIndexCreatorFactory.java | 59 +-
.../segment/index/loader/ForwardIndexHandler.java | 372 ++++++-
...IndexAndDictionaryBasedForwardIndexCreator.java | 56 +-
.../defaultcolumn/BaseDefaultColumnHandler.java | 44 +-
.../ConcurrentMapTableUpsertMetadataManager.java | 12 +-
.../pinot/segment/local/upsert/UpsertUtils.java | 30 +
.../segment/local/upsert/UpsertViewManager.java | 74 +-
.../SegmentGeneratorConfigPropagationTest.java | 70 ++
.../impl/SameValueForwardIndexCreatorTest.java | 29 +-
.../index/creator/CLPForwardIndexCreatorTest.java | 64 +-
.../creator/CLPForwardIndexCreatorV2Test.java | 45 +
.../creator/CompressionStatsCornerCaseTest.java | 294 +++++
.../CompressionStatsSegmentCreationTest.java | 281 +++++
...orwardIndexWriterUncompressedValueSizeTest.java | 448 ++++++++
.../MultiValueFixedByteRawIndexCreatorTest.java | 30 +
.../MultiValueVarByteRawIndexCreatorTest.java | 31 +
...DictionaryCreatorUncompressedValueSizeTest.java | 440 ++++++++
.../forward/CompressionStatsMetadataTest.java | 59 +
.../forward/ForwardIndexCreatorFactoryTest.java | 35 +
.../forward/VarByteChunkSVForwardIndexTest.java | 32 +
.../ForwardIndexHandlerCompressionStatsTest.java | 607 +++++++++++
.../index/loader/ForwardIndexHandlerTest.java | 174 ++-
.../index/loader/SegmentPreProcessorTest.java | 43 +-
.../loader/invertedindex/JsonIndexHandlerTest.java | 160 +++
.../invertedindex/RangeIndexHandlerTest.java | 237 ++++
.../BasePartitionUpsertMetadataManagerTest.java | 40 +-
...oncurrentMapTableUpsertMetadataManagerTest.java | 130 +++
.../segment/local/upsert/UpsertUtilsTest.java | 105 ++
.../local/upsert/UpsertViewManagerTest.java | 73 +-
.../apache/pinot/segment/spi/ColumnMetadata.java | 21 +
.../org/apache/pinot/segment/spi/IndexSegment.java | 5 +
.../apache/pinot/segment/spi/SegmentContext.java | 20 +-
.../org/apache/pinot/segment/spi/V1Constants.java | 8 +
.../segment/spi/creator/IndexCreationContext.java | 27 +
.../spi/creator/SegmentGeneratorConfig.java | 12 +
.../spi/index/creator/ForwardIndexCreator.java | 13 +
.../spi/index/metadata/ColumnMetadataImpl.java | 134 ++-
.../spi/index/metadata/ColumnMetadataImplTest.java | 85 ++
.../spi/utils/SegmentMetadataUtilsTest.java | 80 ++
.../resources/SegmentCompressionStatsReader.java | 168 +++
.../server/api/resources/TableSizeResource.java | 79 +-
.../pinot/server/api/resources/TablesResource.java | 112 +-
.../apache/pinot/server/api/BaseResourceTest.java | 7 +
.../pinot/server/api/TableSizeResourceTest.java | 90 +-
.../pinot/server/api/TablesResourceTest.java | 221 ++++
.../SegmentCompressionStatsReaderTest.java | 143 +++
.../pinot/spi/config/table/IndexingConfig.java | 17 +
.../java/org/apache/pinot/spi/data/FieldSpec.java | 36 +-
.../apache/pinot/spi/utils/CommonConstants.java | 3 +
.../java/org/apache/pinot/spi/utils/Utf8Utils.java | 25 +
.../spi/utils/builder/TableConfigBuilder.java | 8 +
.../table/IndexingConfigCompressionFlagTest.java | 70 ++
.../org/apache/pinot/spi/data/FieldSpecTest.java | 96 ++
.../org/apache/pinot/spi/utils/Utf8UtilsTest.java | 20 +-
.../pinot/sql/ddl/compile/PropertyMapping.java | 4 +
.../pinot/sql/ddl/reverse/PropertyExtractor.java | 3 +
.../pinot/sql/ddl/roundtrip/RoundTripTest.java | 1 +
.../resources/examples/compression-stats/README.md | 104 ++
.../compressionStats_offline_table_config.json | 26 +
pom.xml | 14 +-
203 files changed, 16913 insertions(+), 621 deletions(-)
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/compression/ColumnCompressionStatsAccumulator.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/http/MultiHttpRequestBufferedResponse.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/restlet/resources/ColumnCompressionStatsContribution.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/restlet/resources/ColumnCompressionStatsInfo.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/restlet/resources/CompressionStatsSummary.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/restlet/resources/SegmentCompressionStatsContribution.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/restlet/resources/ServerCompressionStatsResponse.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/restlet/resources/ServerTableMetadataInfo.java
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/compression/ColumnCompressionStatsAccumulatorTest.java
copy
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/utils/HyperLogLogUtilsTest.java
=>
pinot-common/src/test/java/org/apache/pinot/common/metrics/ControllerGaugeTest.java
(62%)
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/restlet/resources/ColumnCompressionStatsInfoTest.java
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/restlet/resources/CompressionStatsSummaryTest.java
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/restlet/resources/SegmentSizeInfoTest.java
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/restlet/resources/ServerTransportCompatibilityTest.java
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/restlet/resources/TableMetadataInfoCompressionTest.java
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/swagger/SwaggerSetupUtilsTest.java
create mode 100644
pinot-controller/src/main/java/org/apache/pinot/controller/recommender/data/generator/UuidGenerator.java
create mode 100644
pinot-controller/src/main/java/org/apache/pinot/controller/util/ServerCompressionStatsReader.java
create mode 100644
pinot-controller/src/test/java/org/apache/pinot/controller/api/ServerTableSizeReaderCompressionStatsTest.java
create mode 100644
pinot-controller/src/test/java/org/apache/pinot/controller/api/TableMetadataReaderCompressionTest.java
create mode 100644
pinot-controller/src/test/java/org/apache/pinot/controller/api/TableSizeReaderCompressionStatsTest.java
create mode 100644
pinot-controller/src/test/java/org/apache/pinot/controller/recommender/data/generator/UuidGeneratorTest.java
create mode 100644
pinot-controller/src/test/java/org/apache/pinot/controller/recommender/data/writer/AvroWriterTest.java
create mode 100644
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/custom/CompressionStatsOfflineIngestionIntegrationTest.java
create mode 100644
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/custom/CompressionStatsRealtimeIngestionIntegrationTest.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroSchemaUtilTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-json/README.md
copy
pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/IsNotFalseTransformFunction.java
=>
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/format/AutoDetectPayloadParser.java
(53%)
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/format/CborJsonPayloadParser.java
copy
pinot-controller/src/main/java/org/apache/pinot/controller/recommender/data/writer/JsonWriter.java
=>
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/format/JacksonPayloadParser.java
(50%)
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/format/JsonPayloadFormat.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/format/JsonPayloadParser.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/format/PostgresJsonbPayloadParser.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/format/SmileJsonPayloadParser.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/format/SqliteJsonbPayloadParser.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/format/TextJsonPayloadParser.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/test/java/org/apache/pinot/plugin/inputformat/json/JSONMessageDecoderBinaryTest.java
create mode 100644
pinot-plugins/pinot-input-format/pinot-json/src/test/java/org/apache/pinot/plugin/inputformat/json/format/JsonPayloadFormatTest.java
create mode 100644
pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/operator/window/aggregate/SortedMultisetMinMaxWindowValueAggregator.java
create mode 100644
pinot-query-runtime/src/test/java/org/apache/pinot/query/runtime/blocks/ErrorMseBlockTest.java
copy
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/{io/compression/SnappyCompressor.java
=> segment/creator/impl/fwd/CompressionStatsTrackingForwardIndexCreator.java}
(50%)
create mode 100644
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/forward/CompressionStatsMetadata.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/creator/SegmentGeneratorConfigPropagationTest.java
copy
pinot-controller/src/test/java/org/apache/pinot/controller/recommender/data/generator/MultiValueGeneratorHelperTest.java
=>
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/creator/impl/SameValueForwardIndexCreatorTest.java
(55%)
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/creator/CompressionStatsCornerCaseTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/creator/CompressionStatsSegmentCreationTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/creator/ForwardIndexWriterUncompressedValueSizeTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/creator/SegmentDictionaryCreatorUncompressedValueSizeTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/forward/CompressionStatsMetadataTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/loader/ForwardIndexHandlerCompressionStatsTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/loader/invertedindex/JsonIndexHandlerTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/segment/index/loader/invertedindex/RangeIndexHandlerTest.java
create mode 100644
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/upsert/ConcurrentMapTableUpsertMetadataManagerTest.java
create mode 100644
pinot-segment-spi/src/test/java/org/apache/pinot/segment/spi/utils/SegmentMetadataUtilsTest.java
create mode 100644
pinot-server/src/main/java/org/apache/pinot/server/api/resources/SegmentCompressionStatsReader.java
create mode 100644
pinot-server/src/test/java/org/apache/pinot/server/api/resources/SegmentCompressionStatsReaderTest.java
create mode 100644
pinot-spi/src/test/java/org/apache/pinot/spi/config/table/IndexingConfigCompressionFlagTest.java
copy
pinot-segment-local/src/test/java/org/apache/pinot/segment/local/utils/HyperLogLogUtilsTest.java
=> pinot-spi/src/test/java/org/apache/pinot/spi/utils/Utf8UtilsTest.java (62%)
create mode 100644
pinot-tools/src/main/resources/examples/compression-stats/README.md
create mode 100644
pinot-tools/src/main/resources/examples/compression-stats/compressionStats_offline_table_config.json
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
