This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch create-lead-controller-resource in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 4495688 Create leadControllerResource in Helix cluster new 2b25dd9 [TE] revert early termination in detection loop (#4056) new dad8773 skip .swp files for vim users (#4052) new e9a49ec Fix the race condition for real-time inverted index reader (#4051) new 7b61bfc [TE] disable anomalies endpoint padding for minute level alerts (#4058) new 35f5e15 Add wait_time flag for Travis config (#4057) new 69db491 add support for parquet reader (#3852) new 402e5ad In ServiceStatus, replace Apache math Pair with inner StatusDescriptionPair class (#4062) new c8d2f7f Fix minute speedup (#4060) new 8121927 [TE] frontend - harleyjj/alert-overview - display dash and n/a when value is undefined (#4046) new 8c3edbb [TE] Clean up logging messages; remove default ref links (#4059) new fdd9b92 [TE] Disable thirdeye-hadoop (#4064) new f66c342 [TE] frontend - harleyjj/yaml-editor - surface error message in put (#4068) new 8036bff Move Parquet related classes to the new package (#4073) new a102ee0 [TE] frontend - harleyjj/yaml-editor - if there is no existing subscription group, the user can create one on edit-alert (#4071) new 0655993 [TE] frontend - harleyjj/anomalies - prototype anomalies route replacement (#4066) new 3a9625b Introduce interface stability and audience annotations (#4063) new 08ad552 [TE] SQL connector, with support for Presto, MySQL, H2. With a front end for onboarding dataset (#3830) new 972472e Fix travis-wait (#4077) new b08eccc [TE] detection - handle day light savings time in moving windows (#4072) new 641e401 Exit 1 when caught exception in Pinot Admin command. (#4065) new 6cb2ffa Remove stale test RealtimeTableDataManagerTest (#4075) new 2d860d2 Always enable default column feature, remove the configuration (#4074) new 78bfe3e Fix 500 issue with 'GET /tenants' API call (#4061) new 23adfcd [TE] Email template - Truncate long names; Make links more intuitive to click new 58a926e Reduce logging in controller (#4078) new a2c8d37 Support legacy time type in SegmentValidationAndRetentionConfig (#4081) new af62e20 Revert travis-wait config (#4084) new e115bc9 In TimeUtils.timeUnitFromString(), return null if input is null or empty (#4088) new 0ee5a1d [TE] Minor correction to #4079 (#4083) new 4003155 [TE] frontend - harleyjj/rca - override date-picker component to maintain 0:00 as end stamp (#4080) new 435e8be Update doc for "Creating Pinot segments" to reflect the current code base (#4086) new cf08af7 Create leadControllerResource in Helix cluster This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (4495688) \ N -- N -- N refs/heads/create-lead-controller-resource (cf08af7) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 5938 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gitignore | 1 + docs/pinot_hadoop.rst | 262 +- .../HelixExternalViewBasedTimeBoundaryService.java | 42 +- .../pinot/annotations/InterfaceAudience.java | 73 + .../pinot/annotations/InterfaceStability.java | 70 + .../SegmentsValidationAndRetentionConfig.java | 16 +- .../apache/pinot/common/config/TagNameUtils.java | 5 +- .../apache/pinot/common/utils/ServiceStatus.java | 62 +- .../apache/pinot/common/utils/time/TimeUtils.java | 61 +- .../org/apache/pinot/common/utils/UtilsTest.java | 69 +- .../api/resources/PinotTableRestletResource.java | 7 +- .../helix/core/PinotHelixResourceManager.java | 22 +- .../helix/core/retention/RetentionManager.java | 4 +- .../pinot/controller/util/TableSizeReader.java | 9 +- .../validation/OfflineSegmentIntervalChecker.java | 9 +- .../helix/core/PinotHelixResourceManagerTest.java | 54 +- pinot-core/pom.xml | 33 +- .../manager/config/InstanceDataManagerConfig.java | 2 - .../pinot/core/data/readers/AvroRecordReader.java | 35 +- .../pinot/core/data/readers/RecordReader.java | 3 +- .../core/data/readers/RecordReaderFactory.java | 8 +- .../pinot/core/indexsegment/IndexSegment.java | 3 +- .../operator/filter/BitmapBasedFilterOperator.java | 26 +- .../invertedindex/RealtimeInvertedIndexReader.java | 13 +- .../pinot/core/realtime/stream/MessageBatch.java | 6 + .../realtime/stream/PartitionLevelConsumer.java | 4 + .../core/realtime/stream/StreamLevelConsumer.java | 4 + .../core/realtime/stream/StreamMessageDecoder.java | 4 + .../realtime/stream/StreamMetadataProvider.java | 4 + .../core/segment/index/SegmentMetadataImpl.java | 1 + .../segment/index/loader/IndexLoadingConfig.java | 12 +- .../segment/index/loader/SegmentPreProcessor.java | 2 +- .../name/NormalizedDateSegmentNameGenerator.java | 18 +- .../java/org/apache/pinot/core/util/AvroUtils.java | 42 +- .../realtime/LLRealtimeSegmentDataManagerTest.java | 1 - .../RealtimeInvertedIndexReaderTest.java | 106 + .../NormalizedDateSegmentNameGeneratorTest.java | 33 +- .../pinot/hadoop/job/SegmentCreationJob.java | 2 +- .../hadoop/job/mapper/SegmentCreationMapper.java | 10 +- .../tests/ChaosMonkeyIntegrationTest.java | 1 + .../tests/OfflineClusterIntegrationTest.java | 103 +- pinot-orc/pom.xml | 2 +- .../pinot/orc/data/readers/ORCRecordReader.java | 48 +- {pinot-hadoop-filesystem => pinot-parquet}/pom.xml | 37 +- .../parquet/data/readers/ParquetRecordReader.java | 78 +- .../pinot/parquet/data/readers/ParquetUtils.java | 87 + .../data/readers/ParquetRecordReaderTest.java | 101 + .../helix/HelixInstanceDataManagerConfig.java | 8 - .../realtime/RealtimeTableDataManagerTest.java | 320 - .../pinot/tools/admin/PinotAdministrator.java | 9 +- .../pinot/tools/admin/command/AddTableCommand.java | 5 + .../segment/converter/SegmentMergeCommand.java | 11 +- pom.xml | 7 + thirdeye/pom.xml | 1 - .../app/pods/anomalies/controller.js | 407 + .../thirdeye-frontend/app/pods/anomalies/route.js | 134 + .../app/pods/anomalies/template.hbs | 98 + .../app/pods/components/alert-details/component.js | 8 +- .../pods/components/anomaly-summary/component.js | 276 + .../pods/components/anomaly-summary/template.hbs | 111 + .../app/pods/components/entity-filter/component.js | 7 +- .../rootcause-chart-toolbar/component.js | 4 +- .../app/pods/components/yaml-editor/component.js | 88 +- .../app/pods/components/yaml-editor/template.hbs | 12 +- .../app/pods/self-serve/create-alert/template.hbs | 6 +- .../self-serve/import-sql-metric/controller.js | 137 + .../pods/self-serve/import-sql-metric/template.hbs | 166 + thirdeye/thirdeye-frontend/app/router.js | 2 + .../styles/components/range-pill-selectors.scss | 1 - thirdeye/thirdeye-frontend/app/utils/anomaly.js | 15 +- .../thirdeye-frontend/app/utils/api/anomaly.js | 13 +- thirdeye/thirdeye-frontend/app/utils/constants.js | 4 +- .../config/data-sources/data-sources-config.yml | 25 +- thirdeye/thirdeye-pinot/config/data/README.md | 7 + thirdeye/thirdeye-pinot/config/data/daily.csv | 732 + thirdeye/thirdeye-pinot/config/data/hourly.csv | 66498 +++++++++++++++++++ thirdeye/thirdeye-pinot/config/h2db.mv.db | Bin 2330624 -> 0 bytes thirdeye/thirdeye-pinot/pom.xml | 5 + .../pinot/thirdeye/anomaly/task/TaskDriver.java | 6 +- .../MultiDimensionalSummaryCLITool.java | 2 +- ...mmaryClient.java => ThirdEyeSummaryClient.java} | 8 +- .../dashboard/ThirdEyeDashboardApplication.java | 2 + .../dashboard/resources/SummaryResource.java | 6 +- .../resources/v2/RootCauseMetricResource.java | 2 +- .../thirdeye/datalayer/util/DaoProviderUtil.java | 3 - .../pinot/thirdeye/datasource/RelationalQuery.java | 35 +- ...sponse.java => RelationalThirdEyeResponse.java} | 7 +- .../loader/DefaultAggregationLoader.java | 2 +- .../datasource/mock/AutoOnboardMockDataSource.java | 58 +- .../datasource/mock/MockThirdEyeDataSource.java | 2 +- .../pinot/PinotControllerResponseCacheLoader.java | 10 +- .../datasource/pinot/PinotDataSourceMaxTime.java | 2 +- .../thirdeye/datasource/pinot/PinotQuery.java | 28 +- .../datasource/pinot/PinotThirdEyeDataSource.java | 252 +- .../resultset/ThirdEyeDataFrameResultSet.java | 82 +- .../pinot/resultset/ThirdEyeResultSetUtils.java | 190 + .../pinot/thirdeye/datasource/sql/SqlDataset.java | 88 + .../pinot/thirdeye/datasource/sql/SqlQuery.java | 113 + .../datasource/sql/SqlResponseCacheLoader.java | 330 + .../datasource/sql/SqlThirdEyeDataSource.java | 140 + .../{pinot/PqlUtils.java => sql/SqlUtils.java} | 451 +- .../sql/resources/SqlDataSourceResource.java | 54 + .../detection/DetectionPipelineScheduler.java | 2 +- .../pinot/thirdeye/detection/DetectionUtils.java | 18 + .../detection/alert/DetectionAlertJob.java | 10 +- .../detection/alert/DetectionAlertScheduler.java | 8 +- .../detection/alert/DetectionAlertTaskRunner.java | 2 +- .../thirdeye/detection/algorithm/MergeWrapper.java | 1 - .../detection/wrapper/AnomalyDetectorWrapper.java | 57 +- .../yaml/CompositePipelineConfigTranslator.java | 48 +- .../yaml/YamlDetectionAlertConfigTranslator.java | 6 +- .../detector/function/BaseAnomalyFunction.java | 4 - .../rootcause/impl/MetricAnalysisPipeline.java | 2 +- .../apache/pinot/thirdeye/util/ThirdEyeUtils.java | 116 + .../thirdeye/detector/holiday-anomaly-report.ftl | 92 +- .../src/main/resources/schema/create-schema.sql | 4 +- .../pinot/PinotThirdEyeDataSourceTest.java | 18 +- .../wrapper/AnomalyDetectorWrapperTest.java | 25 + .../YamlDetectionAlertConfigTranslatorTest.java | 2 +- .../AnomalyApplicationEndToEndTest.java | 4 +- ...multiple-anomalies-email-content-formatter.html | 74 +- 121 files changed, 71432 insertions(+), 1646 deletions(-) create mode 100644 pinot-common/src/main/java/org/apache/pinot/annotations/InterfaceAudience.java create mode 100644 pinot-common/src/main/java/org/apache/pinot/annotations/InterfaceStability.java create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeInvertedIndexReaderTest.java copy {pinot-hadoop-filesystem => pinot-parquet}/pom.xml (85%) copy pinot-core/src/main/java/org/apache/pinot/core/data/readers/JSONRecordReader.java => pinot-parquet/src/main/java/org/apache/pinot/parquet/data/readers/ParquetRecordReader.java (59%) create mode 100644 pinot-parquet/src/main/java/org/apache/pinot/parquet/data/readers/ParquetUtils.java create mode 100644 pinot-parquet/src/test/java/org/apache/pinot/parquet/data/readers/ParquetRecordReaderTest.java delete mode 100644 pinot-server/src/test/java/org/apache/pinot/server/integration/realtime/RealtimeTableDataManagerTest.java create mode 100644 thirdeye/thirdeye-frontend/app/pods/anomalies/controller.js create mode 100644 thirdeye/thirdeye-frontend/app/pods/anomalies/route.js create mode 100644 thirdeye/thirdeye-frontend/app/pods/anomalies/template.hbs create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-summary/component.js create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-summary/template.hbs create mode 100644 thirdeye/thirdeye-frontend/app/pods/self-serve/import-sql-metric/controller.js create mode 100644 thirdeye/thirdeye-frontend/app/pods/self-serve/import-sql-metric/template.hbs create mode 100644 thirdeye/thirdeye-pinot/config/data/README.md create mode 100644 thirdeye/thirdeye-pinot/config/data/daily.csv create mode 100755 thirdeye/thirdeye-pinot/config/data/hourly.csv delete mode 100644 thirdeye/thirdeye-pinot/config/h2db.mv.db rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/client/diffsummary/{PinotThirdEyeSummaryClient.java => ThirdEyeSummaryClient.java} (97%) copy pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/FloatingPointLiteralAstNode.java => thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/RelationalQuery.java (63%) rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/{pinot/PinotThirdEyeResponse.java => RelationalThirdEyeResponse.java} (93%) create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/pinot/resultset/ThirdEyeResultSetUtils.java create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlDataset.java create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlQuery.java create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlResponseCacheLoader.java create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlThirdEyeDataSource.java copy thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/{pinot/PqlUtils.java => sql/SqlUtils.java} (54%) create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/resources/SqlDataSourceResource.java --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org