[GitHub] [incubator-pinot] rpatid10 edited a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 edited a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: 1. Create Your controller.conf,server.conf and broker.conf file **controller.conf** ``` controller.zk.st

[GitHub] [incubator-pinot] rpatid10 edited a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 edited a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: 1. Create Your controller.conf,server.conf and broker.conf file **controller.conf** ``` controller.zk.st

[GitHub] [incubator-pinot] rpatid10 edited a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 edited a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: 1. Create Your controller.conf,server.conf and broker.conf file **controller.conf** ``` controller.zk.st

[GitHub] [incubator-pinot] rpatid10 edited a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 edited a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: 1. Create Your controller.conf,server.conf and broker.conf file **controller.conf** ``` controller.zk.st

[GitHub] [incubator-pinot] rpatid10 edited a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 edited a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: 1. Create Your controller.conf,server.conf and broker.conf file controller.conf ``` controller.zk.str=

[GitHub] [incubator-pinot] rpatid10 edited a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 edited a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: First do kinit and klist: ``` kinit -kt klist ``` Command to start components: **Start Con

[GitHub] [incubator-pinot] rpatid10 edited a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 edited a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: First do kinit and klist: ``` kinit -kt klist ``` Command to start components: **Start Con

[GitHub] [incubator-pinot] rpatid10 edited a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 edited a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: First do kinit and klist: ``` kinit -kt klist ``` Command to start components: **Start Con

[GitHub] [incubator-pinot] rpatid10 edited a comment on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 edited a comment on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: First do kinit and klist: kinit -kt klist Command to start components: Start Controller :

[GitHub] [incubator-pinot] rpatid10 commented on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
rpatid10 commented on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877541179 Steps to enable Kerberos Authentication: First do kinit and klist: kinit -kt klist Command to start components: Start Controller : JAVA_

[GitHub] [incubator-pinot] codecov-commenter edited a comment on pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#issuecomment-876284165 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7141?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr

[GitHub] [incubator-pinot] codecov-commenter edited a comment on pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#issuecomment-876284165 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7141?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr

[GitHub] [incubator-pinot] mcvsubbu commented on issue #6679: Admin command to recover from deleted CONSUMING segment case

2021-07-09 Thread GitBox
mcvsubbu commented on issue #6679: URL: https://github.com/apache/incubator-pinot/issues/6679#issuecomment-877523700 @Jackie-Jiang I don't understand the proposal clearly. Table config already has ways to specify earliest/latest/1d/3d etc. Let us see what are the cases we need to

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
Jackie-Jiang commented on a change in pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#discussion_r66726 ## File path: pinot-core/src/main/java/org/apache/pinot/core/plan/maker/InstancePlanMakerImplV2.java ## @@ -264,4 +267,31 @@ static boolean

[GitHub] [incubator-pinot] atris commented on issue #7043: Support query result post-aggregation / nested query

2021-07-09 Thread GitBox
atris commented on issue #7043: URL: https://github.com/apache/incubator-pinot/issues/7043#issuecomment-877506030 @Jackie-Jiang If it makes sense, I would like to start working on this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-pinot] codecov-commenter edited a comment on pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#issuecomment-876284165 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7141?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #7142: Added a query param to /tables for getting sorted table names based on time metadata

2021-07-09 Thread GitBox
Jackie-Jiang commented on a change in pull request #7142: URL: https://github.com/apache/incubator-pinot/pull/7142#discussion_r667215753 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/config/table/TableStats.java ## @@ -27,11 +27,20 @@ */ public class TableStats

[incubator-pinot] branch master updated: Fixing pinot-admin script to parse env var PLUGINS_INCLUDE (#7145)

2021-07-09 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new 0500c12 Fixing pinot-admin script to

[GitHub] [incubator-pinot] xiangfu0 merged pull request #7145: Fixing pinot-admin script to parse env var PLUGINS_INCLUDE

2021-07-09 Thread GitBox
xiangfu0 merged pull request #7145: URL: https://github.com/apache/incubator-pinot/pull/7145 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
Jackie-Jiang commented on a change in pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#discussion_r667214214 ## File path: pinot-core/src/main/java/org/apache/pinot/core/plan/maker/InstancePlanMakerImplV2.java ## @@ -264,4 +267,31 @@ static boolean

[GitHub] [incubator-pinot] xiangfu0 commented on issue #7134: Pinot Is Not Able to Read JAAS File Property (java.security.auth.login.config) While Doing Integration With Kerberos Kafka.

2021-07-09 Thread GitBox
xiangfu0 commented on issue #7134: URL: https://github.com/apache/incubator-pinot/issues/7134#issuecomment-877457735 @rpatid10 can you provide the detailed command you are using for starting all pinot components, so we will document those. -- This is an automated message from the Apache

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
Jackie-Jiang commented on a change in pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#discussion_r667211807 ## File path: pinot-core/src/main/java/org/apache/pinot/core/plan/DictionaryBasedDistinctPlanNode.java ## @@ -0,0 +1,64 @@ +/** + * Licensed

[GitHub] [incubator-pinot] yashrsharma44 commented on a change in pull request #7142: Added a query param to /tables for getting sorted table names based on time metadata

2021-07-09 Thread GitBox
yashrsharma44 commented on a change in pull request #7142: URL: https://github.com/apache/incubator-pinot/pull/7142#discussion_r667202408 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableRestletResource.java ## @@ -210,21 +214,60

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #7142: Added a query param to /tables for getting sorted table names based on time metadata

2021-07-09 Thread GitBox
Jackie-Jiang commented on a change in pull request #7142: URL: https://github.com/apache/incubator-pinot/pull/7142#discussion_r667201129 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableRestletResource.java ## @@ -210,21 +214,60

[GitHub] [incubator-pinot] yashrsharma44 commented on a change in pull request #7142: Added a query param to /tables for getting sorted table names based on time metadata

2021-07-09 Thread GitBox
yashrsharma44 commented on a change in pull request #7142: URL: https://github.com/apache/incubator-pinot/pull/7142#discussion_r667190787 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableRestletResource.java ## @@ -210,21 +214,60

[GitHub] [incubator-pinot] yashrsharma44 commented on a change in pull request #7142: Added a query param to /tables for getting sorted table names based on time metadata

2021-07-09 Thread GitBox
yashrsharma44 commented on a change in pull request #7142: URL: https://github.com/apache/incubator-pinot/pull/7142#discussion_r667190630 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableRestletResource.java ## @@ -200,7 +202,9 @

[GitHub] [incubator-pinot] yashrsharma44 commented on a change in pull request #7142: Added a query param to /tables for getting sorted table names based on time metadata

2021-07-09 Thread GitBox
yashrsharma44 commented on a change in pull request #7142: URL: https://github.com/apache/incubator-pinot/pull/7142#discussion_r667189171 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableRestletResource.java ## @@ -210,21 +214,60

[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #6679: Admin command to recover from deleted CONSUMING segment case

2021-07-09 Thread GitBox
Jackie-Jiang commented on issue #6679: URL: https://github.com/apache/incubator-pinot/issues/6679#issuecomment-877386980 @mcvsubbu So the suggestion here is to add an `offsetMode`: - AUTO: pick the end offset of the last completed segment, or offset per the table config if there is no c

[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #7144: Add `numConsumingSegmentsProcessed` and `numConsumingSegmentsMatched` into the query response metadata

2021-07-09 Thread GitBox
Jackie-Jiang commented on issue #7144: URL: https://github.com/apache/incubator-pinot/issues/7144#issuecomment-877384513 @yashrsharma44 Sure, go ahead! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #7142: Added a query param to /tables for getting sorted table names based on time metadata

2021-07-09 Thread GitBox
Jackie-Jiang commented on a change in pull request #7142: URL: https://github.com/apache/incubator-pinot/pull/7142#discussion_r667133484 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableRestletResource.java ## @@ -210,21 +214,60

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
Jackie-Jiang commented on a change in pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#discussion_r667126687 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/query/DictionaryBasedDistinctOperator.java ## @@ -0,0 +1,142 @@ +/** +

[GitHub] [incubator-pinot] dongxiaoman edited a comment on pull request #7145: Fixing pinot-admin script to parse env var PLUGINS_INCLUDE

2021-07-09 Thread GitBox
dongxiaoman edited a comment on pull request #7145: URL: https://github.com/apache/incubator-pinot/pull/7145#issuecomment-877348583 > @dongxiaoman Can you please try and confirm this one-line fix on your side? @xiangfu0 Thanks for fixing it; it is working! -- This is an automated m

[GitHub] [incubator-pinot] dongxiaoman commented on pull request #7145: Fixing pinot-admin script to parse env var PLUGINS_INCLUDE

2021-07-09 Thread GitBox
dongxiaoman commented on pull request #7145: URL: https://github.com/apache/incubator-pinot/pull/7145#issuecomment-877348583 > @dongxiaoman Can you please try and confirm this one-line fix on your side? Thanks for fixing it; it is working! -- This is an automated message from the A

[GitHub] [incubator-pinot] yashrsharma44 commented on issue #7144: Add `numConsumingSegmentsProcessed` and `numConsumingSegmentsMatched` into the query response metadata

2021-07-09 Thread GitBox
yashrsharma44 commented on issue #7144: URL: https://github.com/apache/incubator-pinot/issues/7144#issuecomment-877300250 Can I pick this up? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [incubator-pinot] egalpin opened a new issue #7147: Apache Beam IO Connector

2021-07-09 Thread GitBox
egalpin opened a new issue #7147: URL: https://github.com/apache/incubator-pinot/issues/7147 Hi folks 👋 I noted that there's an Apache Spark integration[1] for creating segments and batch-ingesting data. I'd be keen to explore creating a similar IO connector for Apache Beam[2], and

[GitHub] [incubator-pinot] codecov-commenter edited a comment on pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#issuecomment-876284165 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7141?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr

[GitHub] [incubator-pinot] codecov-commenter edited a comment on pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#issuecomment-876284165 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7141?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr

[GitHub] [incubator-pinot] codecov-commenter edited a comment on pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
codecov-commenter edited a comment on pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#issuecomment-876284165 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7141?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr

[GitHub] [incubator-pinot] atris commented on a change in pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
atris commented on a change in pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#discussion_r666729703 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/query/DictionaryBasedDistinctOperator.java ## @@ -0,0 +1,163 @@ +/** + * Lice

[GitHub] [incubator-pinot] atris commented on a change in pull request #7141: Support Dictionary Based Plan For DISTINCT

2021-07-09 Thread GitBox
atris commented on a change in pull request #7141: URL: https://github.com/apache/incubator-pinot/pull/7141#discussion_r666729330 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/query/DictionaryBasedDistinctOperator.java ## @@ -0,0 +1,163 @@ +/** + * Lice