[GitHub] [pinot] amrishlal commented on a change in pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
amrishlal commented on a change in pull request #7568: URL: https://github.com/apache/pinot/pull/7568#discussion_r759008622 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/predicate/PredicateEvaluator.java ## @@ -28,6 +28,16 @@ * APIs for both

[GitHub] [pinot] amrishlal commented on a change in pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
amrishlal commented on a change in pull request #7568: URL: https://github.com/apache/pinot/pull/7568#discussion_r759008062 ## File path: pinot-core/src/main/java/org/apache/pinot/core/query/request/context/utils/QueryContextUtils.java ## @@ -52,4 +58,79 @@ public static boole

[GitHub] [pinot] siddharthteotia commented on pull request #7830: Implement Multiple Predicate Execution (FILTER Clauses)

2021-11-29 Thread GitBox
siddharthteotia commented on pull request #7830: URL: https://github.com/apache/pinot/pull/7830#issuecomment-982323715 Reviewed the design doc. Will review the PR tomorrow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [pinot] weixiangsun edited a comment on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
weixiangsun edited a comment on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982291784 Does the index here mean IndexSegment? @atris -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [pinot] weixiangsun commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
weixiangsun commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982291784 Does the index here mean IndexSegment? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [pinot] atris commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
atris commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982279802 Well, I am working on adding multiple predicate evaluation within a single query, where each predicate can be evaluated using an index. CASE can be modified to use this mechanism

[GitHub] [pinot] weixiangsun commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
weixiangsun commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982277821 What @atris is working on is to implement filter clause instead of case when clause. His work item does not add general index access support to case transform function. @atr

[GitHub] [pinot] Jackie-Jiang commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
Jackie-Jiang commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982273185 I believe @atris is working on that -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #7568: URL: https://github.com/apache/pinot/pull/7568#discussion_r758918478 ## File path: pinot-core/src/main/java/org/apache/pinot/core/query/request/context/utils/QueryContextUtils.java ## @@ -52,4 +58,79 @@ public static bo

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7840: Add getPredicate() to PredicateEvaluator

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7840: URL: https://github.com/apache/pinot/pull/7840#issuecomment-982256775 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7840?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7841: add ability to comment out queries with cmd + /

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7841: URL: https://github.com/apache/pinot/pull/7841#issuecomment-982256884 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7841?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter commented on pull request #7841: add ability to comment out queries with cmd + /

2021-11-29 Thread GitBox
codecov-commenter commented on pull request #7841: URL: https://github.com/apache/pinot/pull/7841#issuecomment-982256884 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7841?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] codecov-commenter commented on pull request #7840: Add getPredicate() to PredicateEvaluator

2021-11-29 Thread GitBox
codecov-commenter commented on pull request #7840: URL: https://github.com/apache/pinot/pull/7840#issuecomment-982256775 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7840?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7568: URL: https://github.com/apache/pinot/pull/7568#issuecomment-941686660 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7568?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] siddharthteotia commented on a change in pull request #7840: Add getPredicate() to PredicateEvaluator

2021-11-29 Thread GitBox
siddharthteotia commented on a change in pull request #7840: URL: https://github.com/apache/pinot/pull/7840#discussion_r758906121 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/predicate/BasePredicateEvaluator.java ## @@ -18,7 +18,25 @@ */ pack

[GitHub] [pinot] jadami10 opened a new pull request #7841: add ability to comment out queries with cmd + /

2021-11-29 Thread GitBox
jadami10 opened a new pull request #7841: URL: https://github.com/apache/pinot/pull/7841 ## Description I had some extra time, and this has been bothering me, so I decided to add it. Doing `cmd + /` in the query console now will add/remove `-- ` before the lines. A video is

[GitHub] [pinot] weixiangsun commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
weixiangsun commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982233908 adding general index access support to case transform function via BlockValSet or some other way? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [pinot] Jackie-Jiang opened a new pull request #7840: Add getPredicate() to PredicateEvaluator

2021-11-29 Thread GitBox
Jackie-Jiang opened a new pull request #7840: URL: https://github.com/apache/pinot/pull/7840 Add `getPredicate()` to `PredicateEvaluator` interface for query explanation purpose -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [pinot] Jackie-Jiang commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
Jackie-Jiang commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982220389 Understood. In order to solve `IS NULL` and `IS NOT NULL`, we need to access the `NullValueVector` index. Currently case transform function does not support accessing index, so I'

[GitHub] [pinot] weixiangsun commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
weixiangsun commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982217470 Is Null, Is Not Null checking are not only for case transform function. It might be for If function even though it is not supported by pinot yet. -- This is an automated message

[GitHub] [pinot] Jackie-Jiang commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
Jackie-Jiang commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982211557 The ask itself is different, but in order to solve the issue, we need to access the index within the case transform function. We should try to solve these 2 issues together by all

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7568: URL: https://github.com/apache/pinot/pull/7568#issuecomment-941686660 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7568?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] weixiangsun edited a comment on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
weixiangsun edited a comment on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982207016 They are different. Please reference to https://github.com/apache/pinot/issues/7691#issuecomment-982199086 @Jackie-Jiang -- This is an automated message from the Apach

[GitHub] [pinot] weixiangsun commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
weixiangsun commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982207016 They are different. Please reference to https://github.com/apache/pinot/issues/7691#issuecomment-982199086 -- This is an automated message from the Apache Git Service. To respond

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7568: URL: https://github.com/apache/pinot/pull/7568#issuecomment-941686660 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7568?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] weixiangsun commented on issue #7691: Use available indexes when in `CaseTransformFunction`

2021-11-29 Thread GitBox
weixiangsun commented on issue #7691: URL: https://github.com/apache/pinot/issues/7691#issuecomment-982199086 I see. This is used to reduce the data set for aggregation. My use case is: select case when timeStamp IS NULL then now() else timestamp end from meetupRsvp htt

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7839: Support non-selection-only GRPC server request handler

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7839: URL: https://github.com/apache/pinot/pull/7839#issuecomment-982180134 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7839?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter commented on pull request #7839: Support non-selection-only GRPC server request handler

2021-11-29 Thread GitBox
codecov-commenter commented on pull request #7839: URL: https://github.com/apache/pinot/pull/7839#issuecomment-982180134 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7839?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] codecov-commenter commented on pull request #7838: GRPC broker request handler

2021-11-29 Thread GitBox
codecov-commenter commented on pull request #7838: URL: https://github.com/apache/pinot/pull/7838#issuecomment-982162356 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7838?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] walterddr opened a new pull request #7839: Support non-selection-only GRPC server request handler

2021-11-29 Thread GitBox
walterddr opened a new pull request #7839: URL: https://github.com/apache/pinot/pull/7839 Currently GRPCServer only support selection-only queries. This PR adds support for streaming back all other types of query response from server to broker. This makes possible for the next s

[GitHub] [pinot] richardstartin commented on pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
richardstartin commented on pull request #7820: URL: https://github.com/apache/pinot/pull/7820#issuecomment-982151840 > Conceptually, we are moving from a Column to Column + path but modelling the path as an evaluator. But the query layer is deciding the evaluator instead of the storage la

[GitHub] [pinot] amrishlal commented on a change in pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
amrishlal commented on a change in pull request #7568: URL: https://github.com/apache/pinot/pull/7568#discussion_r758831328 ## File path: pinot-broker/src/main/java/org/apache/pinot/broker/requesthandler/BaseBrokerRequestHandler.java ## @@ -225,7 +225,13 @@ private BrokerRespo

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7568: URL: https://github.com/apache/pinot/pull/7568#issuecomment-941686660 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7568?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] atris commented on issue #7691: Use available indexes when in `CaseTransformFunction`

2021-11-29 Thread GitBox
atris commented on issue #7691: URL: https://github.com/apache/pinot/issues/7691#issuecomment-982145872 No, a single scan with multiple predicate evaluations along the way. Please see: https://github.com/apache/pinot/pull/7830 -- This is an automated message from the Apache Git Se

[GitHub] [pinot] richardstartin edited a comment on pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
richardstartin edited a comment on pull request #7820: URL: https://github.com/apache/pinot/pull/7820#issuecomment-982140750 > Conceptually, we are moving from a Column to Column + path but modelling the path as an evaluator. But the query layer is deciding the evaluator instead of the sto

[GitHub] [pinot] richardstartin edited a comment on pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
richardstartin edited a comment on pull request #7820: URL: https://github.com/apache/pinot/pull/7820#issuecomment-982140750 > Conceptually, we are moving from a Column to Column + path but modelling the path as an evaluator. But the query layer is deciding the evaluator instead of the sto

[pinot] branch master updated (9ba03e4 -> dfb7fee)

2021-11-29 Thread mcvsubbu
This is an automated email from the ASF dual-hosted git repository. mcvsubbu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git. from 9ba03e4 Fix thread safety issue and add cache to EmptySegmentPruner (#7828) add dfb7fee Make split commit th

[GitHub] [pinot] mcvsubbu merged pull request #7780: Make split-commit the default segment commit protocol

2021-11-29 Thread GitBox
mcvsubbu merged pull request #7780: URL: https://github.com/apache/pinot/pull/7780 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [pinot] richardstartin edited a comment on pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
richardstartin edited a comment on pull request #7820: URL: https://github.com/apache/pinot/pull/7820#issuecomment-982140750 > Conceptually, we are moving from a Column to Column + path but modelling the path as an evaluator. But the query layer is deciding the evaluator instead of the sto

[GitHub] [pinot] xiangfu0 commented on issue #7837: PrestoDB/Trino connector cannot connect to Pinot after Pinot cluster updates its instance hostname

2021-11-29 Thread GitBox
xiangfu0 commented on issue #7837: URL: https://github.com/apache/pinot/issues/7837#issuecomment-982141908 cc @elonazoulay -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [pinot] mcvsubbu commented on pull request #7780: Make split-commit the default segment commit protocol

2021-11-29 Thread GitBox
mcvsubbu commented on pull request #7780: URL: https://github.com/apache/pinot/pull/7780#issuecomment-982141873 > > Why do we have this config on both controller and server? > > Seems the controller one is for allowing split commit from servers. Should we consider removing this controlle

[GitHub] [pinot] richardstartin edited a comment on pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
richardstartin edited a comment on pull request #7820: URL: https://github.com/apache/pinot/pull/7820#issuecomment-982140750 > Conceptually, we are moving from a Column to Column + path but modelling the path as an evaluator. But the query layer is deciding the evaluator instead of the sto

[GitHub] [pinot] richardstartin commented on pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
richardstartin commented on pull request #7820: URL: https://github.com/apache/pinot/pull/7820#issuecomment-982140750 > Conceptually, we are moving from a Column to Column + path but modelling the path as an evaluator. But the query layer is deciding the evaluator instead of the storage la

[GitHub] [pinot] amrishlal commented on a change in pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
amrishlal commented on a change in pull request #7568: URL: https://github.com/apache/pinot/pull/7568#discussion_r758809059 ## File path: pinot-broker/src/main/java/org/apache/pinot/broker/requesthandler/BaseBrokerRequestHandler.java ## @@ -519,6 +543,18 @@ private BrokerRespo

[GitHub] [pinot] walterddr opened a new pull request #7838: GRPC broker request handler that streams data back from server

2021-11-29 Thread GitBox
walterddr opened a new pull request #7838: URL: https://github.com/apache/pinot/pull/7838 Currently there's no way to use the GRPC server request from broker side. Adding a framework of `GRPCBrokerResponseHandler` parallel to the `SingleConnectionBrokerRequestHandler` This ha

[GitHub] [pinot] weixiangsun commented on issue #7691: Use available indexes when in `CaseTransformFunction`

2021-11-29 Thread GitBox
weixiangsun commented on issue #7691: URL: https://github.com/apache/pinot/issues/7691#issuecomment-982131963 Are we going to run multiple queries corresponding to each condition inside the CaseTransform? @atris -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [pinot] Jackie-Jiang commented on issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
Jackie-Jiang commented on issue #7835: URL: https://github.com/apache/pinot/issues/7835#issuecomment-982128869 Same as #7691 where we need to access the null vector index within case statement -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [pinot] dongxiaoman opened a new issue #7837: PrestoDB/Trino connector cannot connect to Pinot after Pinot cluster updates its instance hostname

2021-11-29 Thread GitBox
dongxiaoman opened a new issue #7837: URL: https://github.com/apache/pinot/issues/7837 If the Pinot cluster adopts https://github.com/apache/pinot/pull/7064 to update its Helix hostname to Pinot Helix Instance, the PrestoDB/Trino connector will not be able to connect to Pinot any more.

[GitHub] [pinot] amrishlal commented on a change in pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
amrishlal commented on a change in pull request #7568: URL: https://github.com/apache/pinot/pull/7568#discussion_r758809219 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/InstanceResponseOperator.java ## @@ -113,9 +116,34 @@ private IntermediateResultsBl

[GitHub] [pinot] amrishlal commented on a change in pull request #7568: EXPLAIN PLAN

2021-11-29 Thread GitBox
amrishlal commented on a change in pull request #7568: URL: https://github.com/apache/pinot/pull/7568#discussion_r758809059 ## File path: pinot-broker/src/main/java/org/apache/pinot/broker/requesthandler/BaseBrokerRequestHandler.java ## @@ -519,6 +543,18 @@ private BrokerRespo

[pinot] branch master updated (1e25962 -> 9ba03e4)

2021-11-29 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git. from 1e25962 return exception when unavailable segments on empty broker response (#7823) add 9ba03e4 Fix thread saf

[GitHub] [pinot] Jackie-Jiang merged pull request #7828: Fix thread safety issue and add cache to EmptySegmentPruner

2021-11-29 Thread GitBox
Jackie-Jiang merged pull request #7828: URL: https://github.com/apache/pinot/pull/7828 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7828: Fix thread safety issue and add cache to EmptySegmentPruner

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7828: URL: https://github.com/apache/pinot/pull/7828#issuecomment-978626493 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7828?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7828: Fix thread safety issue and add cache to EmptySegmentPruner

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7828: URL: https://github.com/apache/pinot/pull/7828#issuecomment-978626493 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7828?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7828: Fix thread safety issue and add cache to EmptySegmentPruner

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7828: URL: https://github.com/apache/pinot/pull/7828#issuecomment-978626493 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7828?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7828: Fix thread safety issue and add cache to EmptySegmentPruner

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7828: URL: https://github.com/apache/pinot/pull/7828#issuecomment-978626493 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7828?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] kishoreg commented on pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
kishoreg commented on pull request #7820: URL: https://github.com/apache/pinot/pull/7820#issuecomment-982088481 I like the concept of the pushdown evaluator. Few thoughts/concerns - Some methods added to projectionBlock seem to be specific to projectionBlock and is deviating from the blo

[GitHub] [pinot] Jackie-Jiang commented on pull request #7828: Fix thread safety issue and add cache to EmptySegmentPruner

2021-11-29 Thread GitBox
Jackie-Jiang commented on pull request #7828: URL: https://github.com/apache/pinot/pull/7828#issuecomment-982064831 @richardstartin I didn't think from the readability perspective. I agree there is no clear evidence on the optimization. Changed it to use the concurrent set. -- This is a

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #7828: Fix thread safety issue and add cache to EmptySegmentPruner

2021-11-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #7828: URL: https://github.com/apache/pinot/pull/7828#discussion_r758768399 ## File path: pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/EmptySegmentPruner.java ## @@ -69,66 +68,99 @@ public void init

[GitHub] [pinot] richardstartin commented on a change in pull request #7828: Fix thread safety issue and add cache to EmptySegmentPruner

2021-11-29 Thread GitBox
richardstartin commented on a change in pull request #7828: URL: https://github.com/apache/pinot/pull/7828#discussion_r758729883 ## File path: pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/EmptySegmentPruner.java ## @@ -69,66 +68,99 @@ public void in

[GitHub] [pinot] richardstartin commented on a change in pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
richardstartin commented on a change in pull request #7820: URL: https://github.com/apache/pinot/pull/7820#discussion_r758722103 ## File path: pinot-core/src/main/java/org/apache/pinot/core/common/DataBlockCache.java ## @@ -120,6 +121,17 @@ public int getNumDocs() { retur

[GitHub] [pinot] jackjlli commented on a change in pull request #7828: Fix thread safety issue and add cache to EmptySegmentPruner

2021-11-29 Thread GitBox
jackjlli commented on a change in pull request #7828: URL: https://github.com/apache/pinot/pull/7828#discussion_r758711587 ## File path: pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/EmptySegmentPruner.java ## @@ -69,66 +68,99 @@ public void init(Ide

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7827: Use valid bucket end time instead of segment end time for merge/rollup delay metrics

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7827: URL: https://github.com/apache/pinot/pull/7827#issuecomment-978182588 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7827?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] mayankshriv commented on a change in pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
mayankshriv commented on a change in pull request #7820: URL: https://github.com/apache/pinot/pull/7820#discussion_r758704062 ## File path: pinot-core/src/main/java/org/apache/pinot/core/common/DataBlockCache.java ## @@ -120,6 +121,17 @@ public int getNumDocs() { return i

[GitHub] [pinot] mayankshriv commented on a change in pull request #7820: push JSON Path evaluation down to storage layer

2021-11-29 Thread GitBox
mayankshriv commented on a change in pull request #7820: URL: https://github.com/apache/pinot/pull/7820#discussion_r758704062 ## File path: pinot-core/src/main/java/org/apache/pinot/core/common/DataBlockCache.java ## @@ -120,6 +121,17 @@ public int getNumDocs() { return i

[GitHub] [pinot] mayankshriv commented on issue #7831: Multiple Predicates Within A Single Query

2021-11-29 Thread GitBox
mayankshriv commented on issue #7831: URL: https://github.com/apache/pinot/issues/7831#issuecomment-981977108 Thanks @atris for creating this PEP request. The overall design doc looks good to me. +1 on the feature implementation. -- This is an automated message from the Apache Git Servic

[GitHub] [pinot] jtao15 commented on a change in pull request #7827: Use valid bucket end time instead of segment end time for merge/rollup delay metrics

2021-11-29 Thread GitBox
jtao15 commented on a change in pull request #7827: URL: https://github.com/apache/pinot/pull/7827#discussion_r758685802 ## File path: pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/mergerollup/MergeRollupTaskGenerator.ja

[GitHub] [pinot] jtao15 commented on a change in pull request #7827: Use valid bucket end time instead of segment end time for merge/rollup delay metrics

2021-11-29 Thread GitBox
jtao15 commented on a change in pull request #7827: URL: https://github.com/apache/pinot/pull/7827#discussion_r758685536 ## File path: pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/mergerollup/MergeRollupTaskGenerator.ja

[GitHub] [pinot] jtao15 commented on a change in pull request #7827: Use valid bucket end time instead of segment end time for merge/rollup delay metrics

2021-11-29 Thread GitBox
jtao15 commented on a change in pull request #7827: URL: https://github.com/apache/pinot/pull/7827#discussion_r758681392 ## File path: pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/mergerollup/MergeRollupTaskGenerator.ja

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7827: Use valid bucket end time instead of segment end time for merge/rollup delay metrics

2021-11-29 Thread GitBox
codecov-commenter edited a comment on pull request #7827: URL: https://github.com/apache/pinot/pull/7827#issuecomment-978182588 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7827?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] richardstartin commented on issue #7836: Support MIN/MAX transformation functions

2021-11-29 Thread GitBox
richardstartin commented on issue #7836: URL: https://github.com/apache/pinot/issues/7836#issuecomment-981955434 I am interested in picking this up in early 2022 cc @mayankshriv @Jackie-Jiang -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [pinot] xiangfu0 commented on issue #7834: Upgrade Kafka Lib to 2.4+

2021-11-29 Thread GitBox
xiangfu0 commented on issue #7834: URL: https://github.com/apache/pinot/issues/7834#issuecomment-981953079 Do you want to file a PR to test the version upgrade? https://github.com/apache/pinot/blob/master/pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/pom.xml -- This is an autom

[GitHub] [pinot] xiangfu0 commented on issue #7834: Upgrade Kafka Lib to 2.4+

2021-11-29 Thread GitBox
xiangfu0 commented on issue #7834: URL: https://github.com/apache/pinot/issues/7834#issuecomment-981952144 From this wiki: https://cwiki.apache.org/confluence/display/KAFKA/Compatibility+Matrix Seems that we can safely upgrade kafka consumer to consume older broker verisons. -- T

[GitHub] [pinot] lakshmanan-v opened a new issue #7836: Support MIN/MAX transformation functions

2021-11-29 Thread GitBox
lakshmanan-v opened a new issue #7836: URL: https://github.com/apache/pinot/issues/7836 Currently MAX()/MIN() are supported in aggregate functions. But in non aggregate situations, we need to use complex Switch case statements to find MIN/MAX. It would be great if we can support th

[GitHub] [pinot] xiangfu0 commented on issue #7834: Upgrade Kafka Lib to 2.4+

2021-11-29 Thread GitBox
xiangfu0 commented on issue #7834: URL: https://github.com/apache/pinot/issues/7834#issuecomment-981950234 Thanks for bringing this up! Just wanna check the compatibility of using Kafka 2.4 consumer to consume Kafka broker from 2.0+. If things are fine, we can safely just bump

[GitHub] [pinot] snleee commented on a change in pull request #7827: Use valid bucket end time instead of segment end time for merge/rollup delay metrics

2021-11-29 Thread GitBox
snleee commented on a change in pull request #7827: URL: https://github.com/apache/pinot/pull/7827#discussion_r758668575 ## File path: pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/mergerollup/MergeRollupTaskGenerator.ja

[GitHub] [pinot] jtao15 commented on a change in pull request #7827: Use valid bucket end time instead of segment end time for merge/rollup delay metrics

2021-11-29 Thread GitBox
jtao15 commented on a change in pull request #7827: URL: https://github.com/apache/pinot/pull/7827#discussion_r758638441 ## File path: pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/mergerollup/MergeRollupTaskGenerator.ja

[GitHub] [pinot] weixiangsun opened a new issue #7835: support is null or is not null checking inside case condition

2021-11-29 Thread GitBox
weixiangsun opened a new issue #7835: URL: https://github.com/apache/pinot/issues/7835 Currently, null checking is only supported inside filtering. I want to support the following use case: select case when timeStamp IS NULL then now() else timestamp end from meetup

[GitHub] [pinot] mapshen opened a new issue #7834: Upgrade Kafka Lib to 2.4+

2021-11-29 Thread GitBox
mapshen opened a new issue #7834: URL: https://github.com/apache/pinot/issues/7834 Currently, Pinot is built using 2.0 by default. One feature we are looking at with 2.4+ is the capability to consume from follower replicas of a topic instead of the leader one. Are we considering an upgrade

[GitHub] [pinot] yeongjukang opened a new pull request #7833: added extraEnv, envFrom to statefulset template

2021-11-29 Thread GitBox
yeongjukang opened a new pull request #7833: URL: https://github.com/apache/pinot/pull/7833 ## Description - There was no way to inject env var like TZ to presto container on presto's helm chart. - I added extraEnv, envFrom to presto helm template, and initialized those values with e