This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch fix-max-burst-qps
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 1f49d14 Move maxBurstQps broker metric in createRateLimiter method
add 6c43af7 Modify the SanitizationTransformer String casting to support
mixed type for MV string input (#6863)
add 23c3d24 Add server tenant to request statistics (#6861)
add 34bb823 Revert commit 76edc5d4: "Add reason of creation to
StreamMetadataProvider name." (#6866)
add ae2ff6f add optional connection scheme flag (#6871)
add d033b3f Normalize LHS and RHS numerical types for = and != operator.
(#6811)
add 1c09b78 add a metirc of ideal state size after gzip (#6870)
add d63b806 Update helm chart - Include securityContext, gracePeriod and
remove duplicates in helm (#6839)
add fe10fc1 Fix validation logic for DISTINCT queries (#6880)
add fe596b6 Make zookeeper, kafka, controller, broker use random port for
integration tests (#6872)
add 73426bc Add Zstandard compression support with JMH
benchmarking(#6804) (#6876)
add 4f0a7d2 Allow empty string in MV column (#6879)
add d0c678f Updating QueryRunner to return object of report summary
(#6885)
add bb25194 Update helm to override zk url when zk is disabled (#6888)
add 3c40c78 add shell-script for quickstart auth (#6892)
add 2d86114 filter out javaagent from generator.sh JAVA_OPTS (#6884)
add 9b87787 Fix flaky test (#6893)
add 32e055b Validate DISTINCT query when convert Calcite tree into
PinotQuery (#6883)
add d6f4415 fix integration tests for kafka ports (#6889)
add bd4239f JSON column datatype support. (#6878)
add d2961e7 [fix] update table config show error msg on exception (#6895)
add d83f188 Allow multiple alias for the same selection column. (#6891)
add f09600d Remove realtime segment metrics if it's destroyed (#6887)
add ff8700f Add debug endpoint for tables. (#6897)
add f064811 TableConfigs toJsonObject fix (#6900)
add 185b249 Enhance JSON index to support nested array (#6877)
add 5c7f12a Move maxBurstQps broker metric in createRateLimiter method
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (1f49d14)
\
N -- N -- N refs/heads/fix-max-burst-qps (5c7f12a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/pinot_tests.yml | 2 +
docker/images/pinot/bin/generator.sh | 30 +-
.../etc/jmx_prometheus_javaagent/configs/pinot.yml | 5 +
kubernetes/helm/pinot/README.md | 22 +-
kubernetes/helm/pinot/requirements.lock | 2 +-
kubernetes/helm/pinot/templates/_helpers.tpl | 139 ++++++--
.../pinot/templates/broker/service-external.yaml | 15 +-
.../pinot/templates/broker/service-headless.yaml | 13 +-
.../helm/pinot/templates/broker/service.yaml | 20 +-
.../helm/pinot/templates/broker/statefulset.yml | 49 +--
.../templates/controller/service-external.yaml | 15 +-
.../templates/controller/service-headless.yaml | 13 +-
.../helm/pinot/templates/controller/service.yaml | 20 +-
.../pinot/templates/controller/statefulset.yaml | 47 ++-
.../pinot/templates/minion/service-headless.yaml | 13 +-
.../helm/pinot/templates/minion/service.yaml | 20 +-
.../helm/pinot/templates/minion/statefulset.yml | 47 ++-
.../helm/pinot/templates/server/configmap.yaml | 6 +-
.../pinot/templates/server/service-headless.yaml | 18 +-
.../helm/pinot/templates/server/service.yaml | 25 +-
.../helm/pinot/templates/server/statefulset.yml | 54 ++-
.../helm/pinot/templates/serviceaccount.yaml | 12 +
kubernetes/helm/pinot/values.yaml | 122 +++++--
.../apache/pinot/broker/api/RequestStatistics.java | 18 +
.../requesthandler/BaseBrokerRequestHandler.java | 102 ++++--
.../broker/broker/HelixBrokerStarterTest.java | 3 +-
...elixExternalViewBasedQueryQuotaManagerTest.java | 4 +-
.../broker/requesthandler/QueryValidationTest.java | 9 -
.../routing/segmentpruner/SegmentPrunerTest.java | 2 +-
.../timeboundary/TimeBoundaryManagerTest.java | 2 +-
pinot-common/pom.xml | 4 +
.../pinot/common/metrics/AbstractMetrics.java | 58 +++-
.../pinot/common/metrics/ControllerGauge.java | 1 +
.../org/apache/pinot/common/utils/DataSchema.java | 9 +
.../apache/pinot/common/utils/PinotDataType.java | 86 ++++-
.../org/apache/pinot/common/utils/ZkStarter.java | 18 +-
.../pinot/common/utils/request/RequestUtils.java | 6 +
.../apache/pinot/sql/parsers/CalciteSqlParser.java | 35 ++
.../apache/pinot/common/data/FieldSpecTest.java | 12 +
.../pinot/common/http/MultiGetRequestTest.java | 4 +
.../pinot/common/utils/PinotDataTypeTest.java | 98 ++++--
.../common/utils/config/TableConfigSerDeTest.java | 4 +-
.../pinot/sql/parsers/CalciteSqlCompilerTest.java | 64 ++++
.../pinot/controller/api/debug/TableDebugInfo.java | 207 ++++++++++++
.../api/resources/PinotTableRestletResource.java | 2 +-
.../api/resources/TableDebugResource.java | 256 ++++++++++++++
.../controller/helix/SegmentStatusChecker.java | 4 +
.../helix/core/PinotTableIdealStateBuilder.java | 5 +-
.../realtime/PinotLLCRealtimeSegmentManager.java | 17 +-
.../pinot/controller/ControllerTestUtils.java | 6 +-
...ControllerPeriodicTaskStarterStatelessTest.java | 3 +-
.../pinot/controller/helix/ControllerTest.java | 19 +-
.../helix/PinotControllerModeStatelessTest.java | 9 +-
.../PinotLLCRealtimeSegmentManagerTest.java | 9 +-
.../core/util/SegmentDeletionManagerTest.java | 3 +
.../realtime/LLRealtimeSegmentDataManager.java | 12 +
.../transform/function/BaseTransformFunction.java | 2 +
.../transform/function/CastTransformFunction.java | 3 +
.../pinot/core/query/optimizer/QueryOptimizer.java | 3 +-
.../optimizer/filter/MergeEqInFilterOptimizer.java | 3 +-
.../filter/MergeRangeFilterOptimizer.java | 2 +-
.../optimizer/filter/NumericalFilterOptimizer.java | 277 +++++++++++++++
.../core/query/reduce/BrokerReduceService.java | 6 +-
.../query/reduce/SelectionDataTableReducer.java | 2 +-
.../core/query/request/context/QueryContext.java | 22 +-
.../BrokerRequestToQueryContextConverter.java | 12 +-
.../query/selection/SelectionOperatorUtils.java | 34 +-
.../core/query/optimizer/QueryOptimizerTest.java | 8 +-
.../filter/NumericalFilterOptimizerTest.java | 316 +++++++++++++++++
.../BrokerRequestToQueryContextConverterTest.java | 38 ++-
.../framework/SegmentProcessingFrameworkTest.java | 18 +-
.../pinot/core/transport/QueryRoutingTest.java | 11 +-
.../pinot/core/util/TableConfigUtilsTest.java | 38 ++-
.../queries/FSTBasedRegexpLikeQueriesTest.java | 4 +-
.../apache/pinot/queries/H3IndexQueriesTest.java | 2 +-
...icateTest.java => JsonDataTypeQueriesTest.java} | 63 ++--
.../apache/pinot/queries/JsonMatchQueriesTest.java | 209 ++++++++++++
.../NoDictionaryCompressionQueriesTest.java | 375 +++++++++++++++++++++
.../pinot/queries/TextSearchQueriesTest.java | 4 +-
.../tests/BaseClusterIntegrationTest.java | 35 +-
.../tests/BasicAuthBatchIntegrationTest.java | 18 +-
.../tests/BasicAuthRealtimeIntegrationTest.java | 5 +-
.../pinot/integration/tests/ClusterTest.java | 32 +-
...tlyOnceKafkaRealtimeClusterIntegrationTest.java | 4 +-
...ridClusterIntegrationTestCommandLineRunner.java | 4 +-
.../tests/LLCRealtimeClusterIntegrationTest.java | 9 +
.../LuceneRealtimeClusterIntegrationTest.java | 2 +-
.../tests/NullHandlingIntegrationTest.java | 18 +
.../tests/OfflineClusterIntegrationTest.java | 58 +++-
...rDownloadLLCRealtimeClusterIntegrationTest.java | 8 +
.../tests/SegmentCompletionIntegrationTest.java | 12 +-
.../tests/ServerStarterIntegrationTest.java | 3 +-
.../UpsertTableSegmentUploadIntegrationTest.java | 16 +
.../ControllerLeaderLocatorIntegrationTest.java | 3 +-
.../BenchmarkNoDictionaryIntegerCompression.java | 168 +++++++++
.../perf/BenchmarkNoDictionaryLongCompression.java | 169 ++++++++++
.../BenchmarkNoDictionaryStringCompression.java | 181 ++++++++++
.../protobuf/ProtoBufRecordExtractor.java | 22 +-
.../kafka09/server/KafkaDataServerStartable.java | 35 +-
.../kafka20/server/KafkaDataServerStartable.java | 5 +
.../io/compression/ChunkCompressorFactory.java | 6 +
...ughCompressor.java => ZstandardCompressor.java} | 20 +-
...ecompressor.java => ZstandardDecompressor.java} | 17 +-
.../local/realtime/impl/json/MutableJsonIndex.java | 63 ++--
.../recordtransformer/SanitizationTransformer.java | 2 +-
.../impl/inv/json/BaseJsonIndexCreator.java | 8 +-
.../ColumnMinMaxValueGenerator.java | 8 +-
.../readers/json/ImmutableJsonIndexReader.java | 119 +++++--
.../segment/local/utils/TableConfigUtils.java | 3 +
.../recordtransformer/RecordTransformerTest.java | 26 +-
.../segment/local/segment/index/JsonIndexTest.java | 37 +-
.../forward/FixedByteChunkSVForwardIndexTest.java | 10 +
.../forward/VarByteChunkSVForwardIndexTest.java | 14 +
.../spi/compression/ChunkCompressionType.java | 2 +-
.../spi/creator/SegmentGeneratorConfig.java | 14 +
.../org/apache/pinot/spi/config/TableConfigs.java | 25 +-
.../apache/pinot/spi/config/table/FieldConfig.java | 12 +
.../java/org/apache/pinot/spi/data/FieldSpec.java | 9 +
.../java/org/apache/pinot/spi/data/Schema.java | 1 +
.../spi/data/readers/BaseRecordExtractor.java | 4 +-
.../pinot/spi/metrics/PinotMetricsRegistry.java | 1 +
.../spi/stream/PartitionGroupMetadataFetcher.java | 17 +-
.../spi/stream/StreamDataServerStartable.java | 5 +
.../java/org/apache/pinot/spi/utils/JsonUtils.java | 204 ++++++-----
.../java/org/apache/pinot/spi/utils/NetUtils.java | 56 +++
.../org/apache/pinot/spi/utils/JsonUtilsTest.java | 233 +++++++++----
pinot-tools/pom.xml | 10 +
.../org/apache/pinot/tools/GenericQuickstart.java | 2 +-
.../apache/pinot/tools/GitHubEventsQuickstart.java | 2 +-
.../org/apache/pinot/tools/HybridQuickstart.java | 2 +-
.../apache/pinot/tools/JsonIndexQuickStart.java | 12 +-
.../pinot/tools/RealtimeJsonIndexQuickStart.java | 6 +-
.../org/apache/pinot/tools/RealtimeQuickStart.java | 3 +-
.../org/apache/pinot/tools/UpsertQuickStart.java | 2 +-
.../tools/admin/command/StartKafkaCommand.java | 2 +-
.../org/apache/pinot/tools/perf/QueryRunner.java | 134 +++++---
.../pinot/tools/utils/KafkaStarterUtils.java | 23 +-
pom.xml | 6 +
138 files changed, 4302 insertions(+), 877 deletions(-)
create mode 100644 kubernetes/helm/pinot/templates/serviceaccount.yaml
create mode 100644
pinot-controller/src/main/java/org/apache/pinot/controller/api/debug/TableDebugInfo.java
create mode 100644
pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/TableDebugResource.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/query/optimizer/filter/NumericalFilterOptimizer.java
create mode 100644
pinot-core/src/test/java/org/apache/pinot/core/query/optimizer/filter/NumericalFilterOptimizerTest.java
rename
pinot-core/src/test/java/org/apache/pinot/queries/{JsonMatchPredicateTest.java
=> JsonDataTypeQueriesTest.java} (83%)
create mode 100644
pinot-core/src/test/java/org/apache/pinot/queries/JsonMatchQueriesTest.java
create mode 100644
pinot-core/src/test/java/org/apache/pinot/queries/NoDictionaryCompressionQueriesTest.java
create mode 100644
pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkNoDictionaryIntegerCompression.java
create mode 100644
pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkNoDictionaryLongCompression.java
create mode 100644
pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkNoDictionaryStringCompression.java
copy
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/compression/{PassThroughCompressor.java
=> ZstandardCompressor.java} (63%)
copy
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/compression/{SnappyDecompressor.java
=> ZstandardDecompressor.java} (58%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
