[GitHub] [incubator-pinot] rpatid10 removed a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-07 Thread GitBox
rpatid10 removed a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-875851750 @kishoreg @xiangfu0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [incubator-pinot] mayankshriv opened a new issue #7138: Support for Tenant data isolation

2021-07-07 Thread GitBox
mayankshriv opened a new issue #7138: URL: https://github.com/apache/incubator-pinot/issues/7138 We have seen requirements where multiple tenants (clients) need to be hosted on the same Pinot table (one table per client is not scalable). However, the tenants would like to ensure that their

[incubator-pinot] branch master updated: Release helm pinot 0.2.4 (#7136)

2021-07-07 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new 8b5c0ac Release helm pinot 0.2.4 (#71

[GitHub] [incubator-pinot] xiangfu0 merged pull request #7136: Release helm pinot 0.2.4

2021-07-07 Thread GitBox
xiangfu0 merged pull request #7136: URL: https://github.com/apache/incubator-pinot/pull/7136 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [incubator-pinot] Jackie-Jiang opened a new issue #7137: Star-tree Optimizations

2021-07-07 Thread GitBox
Jackie-Jiang opened a new issue #7137: URL: https://github.com/apache/incubator-pinot/issues/7137 Problems: 1. Certain predicates (e.g. `NOT_EQUAL`) can select too many branches, limiting the performance of star-tree 2. Star-tree does not support filters with `OR` Potential sol

[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #4508: Startree document

2021-07-07 Thread GitBox
Jackie-Jiang commented on issue #4508: URL: https://github.com/apache/incubator-pinot/issues/4508#issuecomment-876034562 We have added a star-tree page: https://docs.pinot.apache.org/basics/indexing/star-tree-index -- This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-pinot] Jackie-Jiang closed issue #4508: Startree document

2021-07-07 Thread GitBox
Jackie-Jiang closed issue #4508: URL: https://github.com/apache/incubator-pinot/issues/4508 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commit

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #7113: High Cardinality Order by Optimization

2021-07-07 Thread GitBox
Jackie-Jiang commented on a change in pull request #7113: URL: https://github.com/apache/incubator-pinot/pull/7113#discussion_r665779622 ## File path: pinot-core/src/main/java/org/apache/pinot/core/plan/AggregationGroupByOrderByPlanNode.java ## @@ -97,14 +116,38 @@ public Aggr

[GitHub] [incubator-pinot] codecov-commenter edited a comment on pull request #7136: Release helm pinot 0.2.4

2021-07-07 Thread GitBox
codecov-commenter edited a comment on pull request #7136: URL: https://github.com/apache/incubator-pinot/pull/7136#issuecomment-876023884 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7136?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr

[GitHub] [incubator-pinot] codecov-commenter commented on pull request #7136: Release helm pinot 0.2.4

2021-07-07 Thread GitBox
codecov-commenter commented on pull request #7136: URL: https://github.com/apache/incubator-pinot/pull/7136#issuecomment-876023884 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7136?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+commen

[GitHub] [incubator-pinot] Jackie-Jiang merged pull request #7133: Validate parsing multi value delimiter as unicode

2021-07-07 Thread GitBox
Jackie-Jiang merged pull request #7133: URL: https://github.com/apache/incubator-pinot/pull/7133 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: c

[incubator-pinot] branch master updated: Validate parsing multi value delimiter as unicode (#7133)

2021-07-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new c42aef6 Validate parsing multi value d

[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #6679: Admin command to recover from deleted CONSUMING segment case

2021-07-07 Thread GitBox
Jackie-Jiang commented on issue #6679: URL: https://github.com/apache/incubator-pinot/issues/6679#issuecomment-875993747 @mcvsubbu I see. Yes this api can be useful to skip the bad records which can cause consumption to stop. I would recommend modeling the api to take the following para

[GitHub] [incubator-pinot] xiangfu0 opened a new pull request #7136: Release helm pinot 0.2.4

2021-07-07 Thread GitBox
xiangfu0 opened a new pull request #7136: URL: https://github.com/apache/incubator-pinot/pull/7136 ## Description Release pinot helmChart 0.2.4 with the recent changes for Charts options and jdk11 upgrade. ## Upgrade Notes Does this PR prevent a zero down-time upgrade? (Assume

[incubator-pinot] branch master updated: Fix package for ReplicationUtils. (#7135)

2021-07-07 Thread mayanks
This is an automated email from the ASF dual-hosted git repository. mayanks pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new 0102227 Fix package for ReplicationUt

[GitHub] [incubator-pinot] mayankshriv merged pull request #7135: Fix package for ReplicationUtils.

2021-07-07 Thread GitBox
mayankshriv merged pull request #7135: URL: https://github.com/apache/incubator-pinot/pull/7135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: co

[GitHub] [incubator-pinot] codecov-commenter edited a comment on pull request #7135: Fix package for ReplicationUtils.

2021-07-07 Thread GitBox
codecov-commenter edited a comment on pull request #7135: URL: https://github.com/apache/incubator-pinot/pull/7135#issuecomment-875932194 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7135?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr

[GitHub] [incubator-pinot] codecov-commenter commented on pull request #7135: Fix package for ReplicationUtils.

2021-07-07 Thread GitBox
codecov-commenter commented on pull request #7135: URL: https://github.com/apache/incubator-pinot/pull/7135#issuecomment-875932194 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7135?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+commen

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #7126: Wire TaskMetricsEmitter to controller starter

2021-07-07 Thread GitBox
mcvsubbu commented on a change in pull request #7126: URL: https://github.com/apache/incubator-pinot/pull/7126#discussion_r665687574 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/minion/TaskMetricsEmitter.java ## @@ -86,5 +96,15 @@ protect

[GitHub] [incubator-pinot] mcvsubbu commented on issue #6679: Admin command to recover from deleted CONSUMING segment case

2021-07-07 Thread GitBox
mcvsubbu commented on issue #6679: URL: https://github.com/apache/incubator-pinot/issues/6679#issuecomment-875912170 > @npawar @kriti-sc This scenario should be handled within `PinotLLCRealtimeSegmentManager.ensureAllPartitionsConsuming()` when a partition does not have any consuming segm

[GitHub] [incubator-pinot] mcvsubbu commented on issue #6679: Admin command to recover from deleted CONSUMING segment case

2021-07-07 Thread GitBox
mcvsubbu commented on issue #6679: URL: https://github.com/apache/incubator-pinot/issues/6679#issuecomment-875911193 Currently (unless through human intervention), it is never possible that IDEALSTATE does not contain a CONSUMING segment for each partition(group). I therefore agree with N

[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #6865: Add controller rest API to list recently created/modified tables

2021-07-07 Thread GitBox
Jackie-Jiang commented on issue #6865: URL: https://github.com/apache/incubator-pinot/issues/6865#issuecomment-875908401 @yashrsharma44 Great! Thanks for volunteering. Basically we want to add a new rest API endpoint on controller to list all tables sorted by their creation/modification t

[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #6865: Add controller rest API to list recently created/modified tables

2021-07-07 Thread GitBox
Jackie-Jiang commented on issue #6865: URL: https://github.com/apache/incubator-pinot/issues/6865#issuecomment-875903834 @mcvsubbu I agree having a pinot cluster change log table could be very useful, but that involves much bigger change. IMO checking the ZNode metadata should be good eno

[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #7130: Add a partialResults flag in Response metadata

2021-07-07 Thread GitBox
Jackie-Jiang commented on issue #7130: URL: https://github.com/apache/incubator-pinot/issues/7130#issuecomment-875898849 @mcvsubbu @snleee @siddharthteotia @jackjlli I believe this flag is already available in the LinkedIn MP. Can you please help move that into the open source code? --

[incubator-pinot] branch master updated: Add datetime function with 2 arguments (#7116)

2021-07-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new 4e88da6 Add datetime function with 2 a

[GitHub] [incubator-pinot] Jackie-Jiang merged pull request #7116: Add datetime function with 2 arguments

2021-07-07 Thread GitBox
Jackie-Jiang merged pull request #7116: URL: https://github.com/apache/incubator-pinot/pull/7116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: c

[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #6679: Admin command to recover from deleted CONSUMING segment case

2021-07-07 Thread GitBox
Jackie-Jiang commented on issue #6679: URL: https://github.com/apache/incubator-pinot/issues/6679#issuecomment-875894482 @npawar @kriti-sc This scenario should be handled within `PinotLLCRealtimeSegmentManager.ensureAllPartitionsConsuming()` when a partition does not have any consuming se

[GitHub] [incubator-pinot] rpatid10 commented on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-07 Thread GitBox
rpatid10 commented on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-875851750 @kishoreg @xiangfu0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [incubator-pinot] codecov-commenter edited a comment on pull request #7133: Validate parsing multi value delimiter as unicode

2021-07-07 Thread GitBox
codecov-commenter edited a comment on pull request #7133: URL: https://github.com/apache/incubator-pinot/pull/7133#issuecomment-875832760 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7133?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr

[GitHub] [incubator-pinot] mayankshriv opened a new pull request #7135: Fix package for ReplicationUtils.

2021-07-07 Thread GitBox
mayankshriv opened a new pull request #7135: URL: https://github.com/apache/incubator-pinot/pull/7135 ## Description ## Upgrade Notes Does this PR prevent a zero down-time upgrade? (Assume upgrade order: Controller, Broker, Server, Minion) * [ ] Yes (Please label as **backward-

[GitHub] [incubator-pinot] codecov-commenter commented on pull request #7133: Validate parsing multi value delimiter as unicode

2021-07-07 Thread GitBox
codecov-commenter commented on pull request #7133: URL: https://github.com/apache/incubator-pinot/pull/7133#issuecomment-875832760 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7133?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+commen

[GitHub] [incubator-pinot] rpatid10 opened a new issue #7134: Pinot Not Able to Read JAAS File Property While Doing Integration With Kerberous Kafka.

2021-07-07 Thread GitBox
rpatid10 opened a new issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134 I am trying to Integrate Kerberos Kafka with Pinot Table.When I am starting Pinot With the help of **quick-start-batch.sh** file and set **JAAS file Location** In **quick-start-batch.sh** its wo

[GitHub] [incubator-pinot] yashrsharma44 commented on issue #6865: Add controller rest API to list recently created/modified tables

2021-07-07 Thread GitBox
yashrsharma44 commented on issue #6865: URL: https://github.com/apache/incubator-pinot/issues/6865#issuecomment-875819968 Hi @Jackie-Jiang, I wanted to pick up this issue, if no one is working on it. Could you provide more details about the requirements and what needs to be done?

[incubator-pinot] branch master updated: Adding ability to check ingestion status for Offline Pinot table (#7070)

2021-07-07 Thread cpsoman
This is an automated email from the ASF dual-hosted git repository. cpsoman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new a251c42 Adding ability to check inges

[GitHub] [incubator-pinot] icefury71 merged pull request #7070: Adding ability to check ingestion status for Offline Pinot table

2021-07-07 Thread GitBox
icefury71 merged pull request #7070: URL: https://github.com/apache/incubator-pinot/pull/7070 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: comm

[GitHub] [incubator-pinot] kkrugler opened a new pull request #7133: Validate parsing multi value delimiter as unicode

2021-07-07 Thread GitBox
kkrugler opened a new pull request #7133: URL: https://github.com/apache/incubator-pinot/pull/7133 ## Description Trivial new test to validate proper handling of Unicode code points in yaml (since this changed from 0.6 to 0.7) ## Upgrade Notes Does this PR prevent a zero down-t

[GitHub] [incubator-pinot] vmarchaud commented on pull request #6250: Add server configuration to lazy load files from deep storage.

2021-07-07 Thread GitBox
vmarchaud commented on pull request #6250: URL: https://github.com/apache/incubator-pinot/pull/6250#issuecomment-875711379 Hi @noahprince22, i'm interested in this feature and would like to know if there was a specific reason why the development on this was stopped ? -- This is an automa

[incubator-pinot] branch master updated: Fixing init controller conf for StartControllerCommand (#7132)

2021-07-07 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new 4fdf01b Fixing init controller conf f

[GitHub] [incubator-pinot] xiangfu0 merged pull request #7132: Fixing init controller conf for Start Component Commands

2021-07-07 Thread GitBox
xiangfu0 merged pull request #7132: URL: https://github.com/apache/incubator-pinot/pull/7132 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi