This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_pinot_minion_segment_creation_tasks_2 in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard a254c01 Address comments discard 9ecf2f1 Adding logic to infer recordreader classes from input format discard 152d031 Adding pinot minion segment creation task add fb42e72 [TE]frontend - Add breadcrumb component (#6350) add a76e766 Broker time range pruning(#6189) (#6259) add 5432099 [TE]frontend - Add a lightweight PubSub system (#6358) add 8e41708 6355 don't lose authority portion of inputDirURI (#6359) add 2ea0185 Enhance task schedule api for single type/table support (#6352) add 79b12ed Fix empty data table for distinct query (#6363) add e3ae45b Adding pinot minion segment creation task add 5f27806 Adding logic to infer recordreader classes from input format add dc1fb27 Address comments This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (a254c01) \ N -- N -- N refs/heads/adding_pinot_minion_segment_creation_tasks_2 (dc1fb27) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .gitignore | 2 + .../pinot/broker/routing/RoutingManager.java | 4 +- .../instanceselector/BaseInstanceSelector.java | 2 - .../segmentpruner/PartitionSegmentPruner.java | 7 +- .../routing/segmentpruner/SegmentPruner.java | 3 +- .../segmentpruner/SegmentPrunerFactory.java | 50 +- .../routing/segmentpruner/TimeSegmentPruner.java | 346 +++++++ .../routing/segmentpruner/interval/Interval.java | 104 +++ .../segmentpruner/interval/IntervalTree.java | 201 +++++ .../segmentselector/OfflineSegmentSelector.java | 8 +- .../segmentselector/RealtimeSegmentSelector.java | 31 +- .../routing/segmentselector/SegmentSelector.java | 3 +- .../broker/routing/IntervalST/IntervalTest.java | 57 ++ .../routing/IntervalST/IntervalTreeTest.java | 89 ++ .../routing/segmentpruner/SegmentPrunerTest.java | 285 +++++- .../apache/pinot/common/minion/MinionClient.java | 17 +- .../common/minion/MinionRequestURLBuilder.java | 14 +- .../pinot/common/minion/MinionClientTest.java | 2 +- .../api/resources/PinotTaskRestletResource.java | 16 +- .../helix/core/minion/PinotTaskManager.java | 169 ++-- .../SegmentGenerationAndPushTaskGenerator.java | 50 +- .../core/common/datatable/DataTableUtils.java | 95 +- .../core/common/datatable/DataTableUtilsTest.java | 28 +- ...vertToRawIndexMinionClusterIntegrationTest.java | 6 +- .../tests/HybridClusterIntegrationTest.java | 2 +- ...fflineSegmentsMinionClusterIntegrationTest.java | 6 +- .../tests/SimpleMinionClusterIntegrationTest.java | 17 +- .../SegmentGenerationAndPushTaskExecutor.java | 66 +- .../batch/common/SegmentGenerationUtilsTest.java | 16 + .../standalone/SegmentGenerationJobRunner.java | 10 +- .../standalone/SegmentGenerationJobRunnerTest.java | 54 ++ .../src/test/resources/log4j2.xml | 0 .../pinot/spi/config/table/RoutingConfig.java | 1 + .../spi/ingestion/batch/BatchConfigProperties.java | 1 - .../org/apache/pinot/tools/BootstrapTableTool.java | 5 +- .../airlineStats_offline_table_config.json | 7 +- .../pods/components/breadcrumb-list/component.js | 56 ++ .../pods/components/breadcrumb-list/template.hbs | 10 + .../components/composite-anomalies/component.js | 87 ++ .../components/composite-anomalies/template.hbs | 8 + .../explore/composite-anomalies/controller.js | 76 +- .../manage/explore/composite-anomalies/route.js | 6 +- .../explore/composite-anomalies/template.hbs | 18 +- thirdeye/thirdeye-frontend/app/styles/app.scss | 1 + .../app/styles/components/breadcrumb-list.scss | 19 + .../app/styles/shared/_styles.scss | 10 + thirdeye/thirdeye-frontend/app/utils/pub-sub.js | 72 ++ thirdeye/thirdeye-frontend/package.json | 7 +- .../components/breadcrumb-list/component-test.js | 33 + .../composite-anomalies/component-test.js | 20 + .../tests/unit/utils/pub-sub-test.js | 19 + thirdeye/thirdeye-frontend/yarn.lock | 996 ++++++++++++++++++++- 52 files changed, 2937 insertions(+), 275 deletions(-) create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/TimeSegmentPruner.java create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/interval/Interval.java create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/interval/IntervalTree.java create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/IntervalST/IntervalTest.java create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/IntervalST/IntervalTreeTest.java create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/test/java/org/apache/pinot/plugin/ingestion/batch/standalone/SegmentGenerationJobRunnerTest.java copy {pinot-tools => pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone}/src/test/resources/log4j2.xml (100%) create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/breadcrumb-list/component.js create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/breadcrumb-list/template.hbs create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/composite-anomalies/component.js create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/composite-anomalies/template.hbs create mode 100644 thirdeye/thirdeye-frontend/app/styles/components/breadcrumb-list.scss create mode 100644 thirdeye/thirdeye-frontend/app/utils/pub-sub.js create mode 100644 thirdeye/thirdeye-frontend/tests/integration/pods/components/breadcrumb-list/component-test.js create mode 100644 thirdeye/thirdeye-frontend/tests/integration/pods/components/composite-anomalies/component-test.js create mode 100644 thirdeye/thirdeye-frontend/tests/unit/utils/pub-sub-test.js --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org