This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch create-lead-controller-resource in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard e091ac6 Separate Helix cluster creation logic omit 02cd55b Create leadControllerResource in Helix cluster add 447f7fc [TE] frontend - harleyjj/edit-alert - use new yaml components in edit-alert (#4237) add a22bf9c [TE] Destroy PhantomJS process after 3 minutes timeout (#4247) add 1ca1436 [TE] make holter winters rule to return the current timeseries (#4249) add 106c5a0 Make ControllerLeadershipManager thread-safe and register it to PARTICIPANT HelixManager (#4245) add 8c8c0ae Add config to disable HLC realtime segment completion (#4235) add be62932 [TE] Change process timeout to 2 minutes (#4255) add 3ce335a [TE] frontend - harleyjj/application - redirect http to https (#4238) add 951a781 Unify controller base url in integration test (#4257) add 7abfb12 SoC - Separate out Tuning from Translator (#4250) add 62ce57f Add RealtimeConsumptionCatchupServiceCallback (#4218) add 3b9ebea [TE] add padding to baseline endpoints (#4260) add e768195 [TE] add current time series if it's unavailable in predicted baseline endpoint (#4262) add 27b61a1 [TE] add padding to graphs in email and Anomalies route (#4263) add d540d95 Change ControllerTest default prot to 18998 (#4259) add f5c19f6 [TE] frontend - remove unnecessary flag for noExistingSubscriptionGroup (#4256) add 0c7a20f [TE] frontend - harleyjj/preview - ensure zoom buttons are over shaded region (#4254) add 22b56ed Update the documentation for FASTHLL (#4251) add 00c2204 pinot-connector-kafka-0.9 module (#4252) add 5b4454b Create leadControllerResource in Helix cluster add eb9ec2c Separate Helix cluster creation logic This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (e091ac6) \ N -- N -- N refs/heads/create-lead-controller-resource (eb9ec2c) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .gitignore | 6 - docs/pql_examples.rst | 6 +- .../broker/broker/helix/HelixBrokerStarter.java | 34 +- pinot-common/pom.xml | 18 - .../pinot/common/config/TableNameBuilder.java | 7 + .../apache/pinot/common/utils/CommonConstants.java | 3 + .../apache/pinot/common/utils/ServiceStatus.java | 107 ++-- {docs => pinot-connectors}/README.md | 9 +- .../pinot-connector-kafka-0.9}/README.md | 10 +- .../pinot-connector-kafka-0.9}/pom.xml | 58 +-- .../realtime/impl/kafka/ConsumerAndIterator.java | 0 .../impl/kafka/KafkaAvroMessageDecoder.java | 0 .../realtime/impl/kafka/KafkaBrokerWrapper.java | 0 .../impl/kafka/KafkaConnectionHandler.java | 0 .../realtime/impl/kafka/KafkaConsumerFactory.java | 0 .../realtime/impl/kafka/KafkaConsumerManager.java | 0 .../impl/kafka/KafkaHighLevelStreamConfig.java | 0 .../impl/kafka/KafkaJSONMessageDecoder.java | 0 .../impl/kafka/KafkaLowLevelStreamConfig.java | 0 .../impl/kafka/KafkaPartitionLevelConsumer.java | 0 .../impl/kafka/KafkaSimpleConsumerFactory.java | 0 .../impl/kafka/KafkaSimpleConsumerFactoryImpl.java | 0 .../realtime/impl/kafka}/KafkaStarterUtils.java | 3 +- .../impl/kafka/KafkaStreamConfigProperties.java | 0 .../impl/kafka/KafkaStreamLevelConsumer.java | 0 .../impl/kafka/KafkaStreamMetadataProvider.java | 0 .../realtime/impl/kafka/SimpleConsumerFactory.java | 0 .../impl/kafka/SimpleConsumerMessageBatch.java | 0 .../impl/kafka/KafkaLowLevelStreamConfigTest.java | 0 .../kafka/KafkaPartitionLevelConsumerTest.java | 0 .../pom.xml | 41 +- .../apache/pinot/controller/ControllerConf.java | 14 +- .../controller/ControllerLeadershipManager.java | 83 ++- .../apache/pinot/controller/ControllerStarter.java | 33 +- .../helix/core/PinotHelixResourceManager.java | 25 +- .../pinot/controller/helix/ControllerTest.java | 2 +- .../controller/helix/PinotControllerModeTest.java | 5 +- pinot-core/pom.xml | 16 - .../AvroRecordToPinotRowGenerator.java | 0 .../kafka => stream}/SimpleAvroMessageDecoder.java | 0 .../pinot/core/realtime/stream/StreamConfig.java | 4 +- .../AvroRecordToPinotRowGeneratorTest.java | 0 pinot-integration-tests/pom.xml | 6 + .../tests/BaseClusterIntegrationTest.java | 2 +- .../ControllerPeriodicTasksIntegrationTests.java | 2 +- .../tests/HybridClusterIntegrationTest.java | 3 +- ...ridClusterIntegrationTestCommandLineRunner.java | 2 +- .../tests/LLCRealtimeClusterIntegrationTest.java | 40 ++ .../tests/NewConfigApplyIntegrationTest.java | 12 +- .../tests/OfflineClusterIntegrationTest.java | 38 +- .../tests/PinotURIUploadIntegrationTest.java | 2 +- .../tests/RealtimeClusterIntegrationTest.java | 3 +- pinot-perf/pom.xml | 6 + .../perf/BenchmarkRealtimeConsumptionSpeed.java | 2 +- .../org/apache/pinot/perf/RealtimeStressTest.java | 2 +- .../server/starter/helix/HelixServerStarter.java | 73 ++- pinot-tools/pom.xml | 6 + .../org/apache/pinot/tools/HybridQuickstart.java | 2 +- .../org/apache/pinot/tools/RealtimeQuickStart.java | 2 +- .../tools/admin/command/StartKafkaCommand.java | 2 +- .../admin/command/StreamAvroIntoKafkaCommand.java | 2 +- .../pinot/tools/streams/AirlineDataStream.java | 2 +- .../pinot/tools/streams/MeetupRsvpStream.java | 2 +- pom.xml | 16 +- .../app/pods/application/route.js | 8 +- .../app/pods/components/alert-details/component.js | 59 +-- .../app/pods/components/alert-details/template.hbs | 576 +++++++++++---------- .../pods/components/anomaly-summary/component.js | 28 +- .../pods/components/detection-yaml/component.js | 24 +- .../pods/components/detection-yaml/template.hbs | 2 +- .../pods/components/subscription-yaml/component.js | 205 +------- .../pods/components/subscription-yaml/template.hbs | 15 +- .../pods/components/timeseries-chart/component.js | 57 +- .../app/pods/manage/yaml/controller.js | 135 ++++- .../app/pods/manage/yaml/route.js | 51 +- .../app/pods/manage/yaml/template.hbs | 66 ++- .../app/pods/screenshot/controller.js | 21 +- .../thirdeye-frontend/app/pods/screenshot/route.js | 7 +- .../app/pods/self-serve/create-alert/controller.js | 12 + .../app/pods/self-serve/create-alert/route.js | 52 +- .../app/pods/self-serve/create-alert/template.hbs | 4 + .../anomaly/alert/util/EmailScreenshotHelper.java | 7 +- .../api/application/ApplicationResource.java | 2 +- .../thirdeye/detection/DetectionPipeline.java | 17 +- .../thirdeye/detection/DetectionResource.java | 41 +- .../pinot/thirdeye/detection/DetectionUtils.java | 18 +- .../annotation/registry/DetectionRegistry.java | 4 +- .../components/AbsoluteChangeRuleDetector.java | 5 +- .../detection/components/HoltWintersDetector.java | 2 +- .../components/PercentageChangeRuleDetector.java | 5 +- .../detection/components/RuleBaselineProvider.java | 13 +- .../components/ThresholdRuleDetector.java | 1 - .../onboard/YamlOnboardingTaskRunner.java | 18 +- .../detection/validators/ConfigValidator.java | 2 +- .../validators/SubscriptionConfigValidator.java | 2 +- .../detection/wrapper/AnomalyDetectorWrapper.java | 2 +- .../detection/wrapper/AnomalyFilterWrapper.java | 2 +- .../wrapper/BaselineFillingMergeWrapper.java | 12 +- .../thirdeye/detection/wrapper/GrouperWrapper.java | 2 +- .../detection/yaml/DetectionConfigTuner.java | 178 +++++++ .../thirdeye/detection/yaml/YamlResource.java | 36 +- .../detection/yaml/YamlTranslationResult.java | 87 ---- .../CompositePipelineConfigTranslator.java | 113 ++-- .../yaml/translator/ConfigTranslator.java | 55 ++ .../YamlDetectionAlertConfigTranslator.java | 48 +- .../YamlDetectionConfigTranslator.java | 57 +- .../YamlDetectionTranslatorLoader.java | 2 +- .../thirdeye/rootcause/impl/MetricEntity.java | 13 + .../thirdeye/detection/DetectionUtilsTest.java | 43 +- .../components/RuleBaselineProviderTest.java | 6 +- .../yaml/MockYamlDetectionConfigTranslator.java | 21 - .../yaml/YamlDetectionConfigTranslatorTest.java | 60 --- .../CompositePipelineConfigTranslatorTest.java | 38 +- .../YamlDetectionAlertConfigTranslatorTest.java | 13 +- .../yaml/translator/YamlTranslationResult.java} | 36 +- .../compositePipelineTranslatorTestResult-1.json | 6 +- .../compositePipelineTranslatorTestResult-2.json | 0 .../yaml/{ => translator}/pipeline-config-1.yaml | 2 +- .../yaml/{ => translator}/pipeline-config-2.yaml | 0 .../yaml/{ => translator}/pipeline-config-3.yaml | 0 120 files changed, 1684 insertions(+), 1318 deletions(-) copy {docs => pinot-connectors}/README.md (67%) copy {docs => pinot-connectors/pinot-connector-kafka-0.9}/README.md (60%) copy {pinot-orc => pinot-connectors/pinot-connector-kafka-0.9}/pom.xml (59%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/ConsumerAndIterator.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaAvroMessageDecoder.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaBrokerWrapper.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConnectionHandler.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerFactory.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerManager.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaHighLevelStreamConfig.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaJSONMessageDecoder.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfig.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaPartitionLevelConsumer.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactory.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactoryImpl.java (100%) rename {pinot-common/src/main/java/org/apache/pinot/common/utils => pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka}/KafkaStarterUtils.java (98%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamConfigProperties.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamLevelConsumer.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamMetadataProvider.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerFactory.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerMessageBatch.java (100%) rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/test/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfigTest.java (100%) rename {pinot-core/src/test/java/org/apache/pinot/core/realtime => pinot-connectors/pinot-connector-kafka-0.9/src/test/java/org/apache/pinot/core/realtime/impl}/kafka/KafkaPartitionLevelConsumerTest.java (100%) copy {pinot-azure-filesystem => pinot-connectors}/pom.xml (74%) rename pinot-core/src/main/java/org/apache/pinot/core/realtime/{impl/kafka => stream}/AvroRecordToPinotRowGenerator.java (100%) rename pinot-core/src/main/java/org/apache/pinot/core/realtime/{impl/kafka => stream}/SimpleAvroMessageDecoder.java (100%) rename pinot-core/src/test/java/org/apache/pinot/core/realtime/{impl/kafka => stream}/AvroRecordToPinotRowGeneratorTest.java (100%) create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/DetectionConfigTuner.java delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/YamlTranslationResult.java rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/CompositePipelineConfigTranslator.java (79%) create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/translator/ConfigTranslator.java rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionAlertConfigTranslator.java (84%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionConfigTranslator.java (54%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionTranslatorLoader.java (96%) copy pinot-common/src/test/java/org/apache/pinot/common/utils/DataSizeTest.java => thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/DetectionUtilsTest.java (55%) delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/MockYamlDetectionConfigTranslator.java delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/YamlDetectionConfigTranslatorTest.java rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/CompositePipelineConfigTranslatorTest.java (78%) rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionAlertConfigTranslatorTest.java (88%) copy thirdeye/thirdeye-pinot/src/{main/java/org/apache/pinot/thirdeye/anomaly/onboard/ReplayTaskInfo.java => test/java/org/apache/pinot/thirdeye/detection/yaml/translator/YamlTranslationResult.java} (60%) rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/compositePipelineTranslatorTestResult-1.json (96%) rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/compositePipelineTranslatorTestResult-2.json (100%) rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/pipeline-config-1.yaml (97%) rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/pipeline-config-2.yaml (100%) rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/pipeline-config-3.yaml (100%) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org