[pinot] branch master updated: Remove secrets from job spec (#8420)

2022-03-29 Thread kharekartik
This is an automated email from the ASF dual-hosted git repository. kharekartik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 5b44c22 Remove secrets from job spec (#8420

[GitHub] [pinot] KKcorps merged pull request #8420: Remove secrets from job spec

2022-03-29 Thread GitBox
KKcorps merged pull request #8420: URL: https://github.com/apache/pinot/pull/8420 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[pinot] branch optimise_memory updated (e05c502 -> a8b687d)

2022-03-29 Thread kharekartik
This is an automated email from the ASF dual-hosted git repository. kharekartik pushed a change to branch optimise_memory in repository https://gitbox.apache.org/repos/asf/pinot.git. discard e05c502 Bug fix: use of Mv array instead of SV array discard 4548460 Remove unused imports discard 6

[GitHub] [pinot] KKcorps edited a comment on issue #8437: Support multiple response formats in Broker SQL API

2022-03-29 Thread GitBox
KKcorps edited a comment on issue #8437: URL: https://github.com/apache/pinot/issues/8437#issuecomment-1082646626 It will look something like this - https://github.com/KKcorps/incubator-pinot/pull/1/files This is a very crude implementation and final PR should look really different from

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8420: Remove secrets from job spec

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8420: URL: https://github.com/apache/pinot/pull/8420#issuecomment-1079765886 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8420?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] KKcorps commented on issue #8437: Support multiple response formats in Broker SQL API

2022-03-29 Thread GitBox
KKcorps commented on issue #8437: URL: https://github.com/apache/pinot/issues/8437#issuecomment-1082646626 It will look something like this - https://github.com/KKcorps/incubator-pinot/pull/1/files I do not like adding `avro` dependency to broker though so might move the classes to some

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8420: Remove secrets from job spec

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8420: URL: https://github.com/apache/pinot/pull/8420#issuecomment-1079765886 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8420?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] KKcorps commented on issue #8437: Support multiple response formats in Broker SQL API

2022-03-29 Thread GitBox
KKcorps commented on issue #8437: URL: https://github.com/apache/pinot/issues/8437#issuecomment-1082642019 @Jackie-Jiang @mayankshriv -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [pinot] KKcorps opened a new issue #8437: Support multiple response formats in Broker SQL API

2022-03-29 Thread GitBox
KKcorps opened a new issue #8437: URL: https://github.com/apache/pinot/issues/8437 Currently, for a query, broker can only return JSON response. However, for better performance on client side, it might be desirable to get response in a compact, fast, binary format such as Avro, ProtoBuf, F

[GitHub] [pinot] snleee commented on a change in pull request #8422: Change TableDataManger deletion to message based

2022-03-29 Thread GitBox
snleee commented on a change in pull request #8422: URL: https://github.com/apache/pinot/pull/8422#discussion_r838100092 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/PinotHelixResourceManager.java ## @@ -1757,6 +1758,10 @@ public void del

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r838098563 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BitmapCollection.java ## @@ -0,0 +1,103 @@ +/** + * Licensed to the Apa

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r838098478 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BitmapCollection.java ## @@ -0,0 +1,103 @@ +/** + * Licensed to the Apa

[GitHub] [pinot] mqliang commented on pull request #8433: Adjust comparison of numDocsScanned

2022-03-29 Thread GitBox
mqliang commented on pull request #8433: URL: https://github.com/apache/pinot/pull/8433#issuecomment-1082597767 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [pinot] snleee commented on a change in pull request #8422: Change TableDataManger deletion to message based

2022-03-29 Thread GitBox
snleee commented on a change in pull request #8422: URL: https://github.com/apache/pinot/pull/8422#discussion_r838064064 ## File path: pinot-server/src/main/java/org/apache/pinot/server/starter/helix/HelixInstanceDataManager.java ## @@ -184,18 +184,26 @@ private TableDataManag

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8426: Allow ingesting Avro complex types into JSON column.

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8426: URL: https://github.com/apache/pinot/pull/8426#issuecomment-1081210576 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8426?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8426: Allow ingesting Avro complex types into JSON column.

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8426: URL: https://github.com/apache/pinot/pull/8426#issuecomment-1081210576 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8426?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8433: Adjust comparison of numDocsScanned

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8433: URL: https://github.com/apache/pinot/pull/8433#issuecomment-1082486381 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8433?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8433: Adjust comparison of numDocsScanned

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8433: URL: https://github.com/apache/pinot/pull/8433#issuecomment-1082486381 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8433?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8426: Allow ingesting Avro complex types into JSON column.

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8426: URL: https://github.com/apache/pinot/pull/8426#issuecomment-1081210576 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8426?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8433: Adjust comparison of numDocsScanned

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8433: URL: https://github.com/apache/pinot/pull/8433#issuecomment-1082486381 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8433?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8434: [WIP][Not Ready for Review]Add replica group based instance assigment algorithm with FD awareness

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8434: URL: https://github.com/apache/pinot/pull/8434#issuecomment-1082275642 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8434?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8434: [WIP][Not Ready for Review]Add replica group based instance assigment algorithm with FD awareness

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8434: URL: https://github.com/apache/pinot/pull/8434#issuecomment-1082275642 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8434?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8434: [WIP][Not Ready for Review]Add replica group based instance assigment algorithm with FD awareness

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8434: URL: https://github.com/apache/pinot/pull/8434#issuecomment-1082275642 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8434?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] mqliang commented on a change in pull request #8433: Adjust comparison of numDocsScanned

2022-03-29 Thread GitBox
mqliang commented on a change in pull request #8433: URL: https://github.com/apache/pinot/pull/8433#discussion_r838036344 ## File path: pinot-common/src/main/java/org/apache/pinot/common/utils/SqlResultComparator.java ## @@ -126,29 +126,32 @@ public static boolean areEqual(Jso

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8434: [WIP][Not Ready for Review]Add replica group based instance assigment algorithm with FD awareness

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8434: URL: https://github.com/apache/pinot/pull/8434#issuecomment-1082275642 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8434?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] mcvsubbu commented on a change in pull request #8433: Adjust comparison of numDocsScanned

2022-03-29 Thread GitBox
mcvsubbu commented on a change in pull request #8433: URL: https://github.com/apache/pinot/pull/8433#discussion_r838034930 ## File path: pinot-common/src/main/java/org/apache/pinot/common/utils/SqlResultComparator.java ## @@ -126,29 +126,32 @@ public static boolean areEqual(Js

[GitHub] [pinot] codecov-commenter commented on pull request #8425: [PQL Cleanup] Cleanup PQL in integration tests

2022-03-29 Thread GitBox
codecov-commenter commented on pull request #8425: URL: https://github.com/apache/pinot/pull/8425#issuecomment-1082521230 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8425?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apa

[GitHub] [pinot] PrachiKhobragade commented on issue #8217: Add a query option to use more replica groups

2022-03-29 Thread GitBox
PrachiKhobragade commented on issue #8217: URL: https://github.com/apache/pinot/issues/8217#issuecomment-1082506697 Picking this issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r838008174 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BitmapCollection.java ## @@ -0,0 +1,103 @@ +/** + * Licensed to the Apach

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8426: Allow ingesting Avro complex types into JSON column.

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8426: URL: https://github.com/apache/pinot/pull/8426#issuecomment-1081210576 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8426?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8426: Allow ingesting Avro complex types into JSON column.

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8426: URL: https://github.com/apache/pinot/pull/8426#issuecomment-1081210576 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8426?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] jtao15 commented on pull request #8422: Change TableDataManger deletion to message based

2022-03-29 Thread GitBox
jtao15 commented on pull request #8422: URL: https://github.com/apache/pinot/pull/8422#issuecomment-1082493001 Updated the pr to remove TableDataManager only when the table is removed based on offline discussions. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8433: Adjust comparison of numDocsScanned

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8433: URL: https://github.com/apache/pinot/pull/8433#issuecomment-1082486381 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8433?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] mqliang commented on a change in pull request #8433: Adjust comparison of numDocsScanned

2022-03-29 Thread GitBox
mqliang commented on a change in pull request #8433: URL: https://github.com/apache/pinot/pull/8433#discussion_r838004763 ## File path: pinot-common/src/main/java/org/apache/pinot/common/utils/SqlResultComparator.java ## @@ -381,22 +384,22 @@ private static boolean areNumEntr

[GitHub] [pinot] codecov-commenter commented on pull request #8433: Adjust comparison of numDocsScanned

2022-03-29 Thread GitBox
codecov-commenter commented on pull request #8433: URL: https://github.com/apache/pinot/pull/8433#issuecomment-1082486381 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8433?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apa

[GitHub] [pinot] amrishlal commented on pull request #8426: Allow ingesting Avro complex types into JSON column.

2022-03-29 Thread GitBox
amrishlal commented on pull request #8426: URL: https://github.com/apache/pinot/pull/8426#issuecomment-1082478220 @siddharthteotia please review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [pinot] amrishlal commented on a change in pull request #8426: Allow ingesting Avro complex types into JSON column.

2022-03-29 Thread GitBox
amrishlal commented on a change in pull request #8426: URL: https://github.com/apache/pinot/pull/8426#discussion_r837997074 ## File path: pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractorTest.java ## @@

[GitHub] [pinot] amrishlal commented on a change in pull request #8426: Allow ingesting Avro complex types into JSON column.

2022-03-29 Thread GitBox
amrishlal commented on a change in pull request #8426: URL: https://github.com/apache/pinot/pull/8426#discussion_r837995097 ## File path: pinot-plugins/pinot-input-format/pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroSchemaUtil.java ## @@ -95,6 +10

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8411: URL: https://github.com/apache/pinot/pull/8411#issuecomment-1079284319 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8411?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8411: URL: https://github.com/apache/pinot/pull/8411#issuecomment-1079284319 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8411?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837962874 ## File path: pinot-core/src/main/java/org/apache/pinot/core/plan/AggregationPlanNode.java ## @@ -178,6 +179,11 @@ private TransformOperator buildT

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8355: [WIP] add a experiment API for upsert heap memory estimation

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8355: URL: https://github.com/apache/pinot/pull/8355#issuecomment-1082426754 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8355?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] nizarhejazi commented on issue #8418: Expose BigDecimal as a Pinot data type

2022-03-29 Thread GitBox
nizarhejazi commented on issue #8418: URL: https://github.com/apache/pinot/issues/8418#issuecomment-1082429570 @siddharthteotia Pinot BigDecimal can store arbitrary precision integer unscaled value, and a 16-bit integer scale. Precision and scale configuration are related Presto/Tri

[GitHub] [pinot] codecov-commenter commented on pull request #8355: add a experiment API for upsert heap memory estimation

2022-03-29 Thread GitBox
codecov-commenter commented on pull request #8355: URL: https://github.com/apache/pinot/pull/8355#issuecomment-1082426754 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8355?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apa

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837950536 ## File path: pinot-core/src/test/java/org/apache/pinot/core/operator/filter/BitmapCollectionTest.java ## @@ -0,0 +1,237 @@ +/** + * Licensed to the

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837949612 ## File path: pinot-core/src/test/java/org/apache/pinot/core/operator/filter/BitmapCollectionTest.java ## @@ -0,0 +1,237 @@ +/** + * Licensed to the

[GitHub] [pinot] richardstartin commented on pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on pull request #8411: URL: https://github.com/apache/pinot/pull/8411#issuecomment-1082418102 A few points about enforcing invariants and preconditions came up in this review: * it would be nice to be able to assume SV bitmap indexes are disjoint, but they won't

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837945158 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,28 @@ protected FilterBlock getN

[GitHub] [pinot] richardstartin commented on pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on pull request #8411: URL: https://github.com/apache/pinot/pull/8411#issuecomment-1082412064 I've squashed the commits to make it easier to rebase (merge conflict with #8408) -- This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837936950 ## File path: pinot-core/src/test/java/org/apache/pinot/core/operator/filter/BitmapCollectionTest.java ## @@ -0,0 +1,237 @@ +/** + * Licensed to the A

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837935497 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/SortedIndexBasedFilterOperator.java ## @@ -132,6 +133,92 @@ protected Fil

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837933873 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,28 @@ protected FilterBlock getNex

[pinot] branch master updated: Combine Metadata and Dictionary based plans into single operator (#8408)

2022-03-29 Thread richardstartin
This is an automated email from the ASF dual-hosted git repository. richardstartin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new d2ca07e Combine Metadata and Dictionary

[GitHub] [pinot] richardstartin merged pull request #8408: Combine Metadata and Dictionary based plans into single operator

2022-03-29 Thread GitBox
richardstartin merged pull request #8408: URL: https://github.com/apache/pinot/pull/8408 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-u

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8408: Combine Metadata and Dictionary based plans into single operator

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8408: URL: https://github.com/apache/pinot/pull/8408#issuecomment-1079508001 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8408?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8408: Combine Metadata and Dictionary based plans into single operator

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8408: URL: https://github.com/apache/pinot/pull/8408#issuecomment-1079508001 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8408?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] kodeine edited a comment on issue #8373: Ingress does not work

2022-03-29 Thread GitBox
kodeine edited a comment on issue #8373: URL: https://github.com/apache/pinot/issues/8373#issuecomment-1082381323 This works with new chart version just released, 0.2.5, but documentation is still wrong with indentation of host tls etc -- This is an automated message from the Apache Git

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837917982 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/OrFilterOperator.java ## @@ -60,4 +62,25 @@ public String toExplainStri

[GitHub] [pinot] kodeine closed issue #8373: Ingress does not work

2022-03-29 Thread GitBox
kodeine closed issue #8373: URL: https://github.com/apache/pinot/issues/8373 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@p

[GitHub] [pinot] kodeine commented on issue #8373: Ingress does not work

2022-03-29 Thread GitBox
kodeine commented on issue #8373: URL: https://github.com/apache/pinot/issues/8373#issuecomment-1082381323 This works with new chart version just released, 0.2.5 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8408: Combine Metadata and Dictionary based plans into single operator

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8408: URL: https://github.com/apache/pinot/pull/8408#issuecomment-1079508001 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8408?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837916533 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,28 @@ protected FilterBlock getN

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837912376 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/SortedIndexBasedFilterOperator.java ## @@ -132,6 +133,92 @@ protected F

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837903870 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,28 @@ protected FilterBlock getNex

[pinot] branch master updated: update 0.2.5 index with new zookeeper dependency (#8436)

2022-03-29 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 24cc357 update 0.2.5 index with new zookeeper d

[GitHub] [pinot] xiangfu0 merged pull request #8436: Pinot helm 0.2.5

2022-03-29 Thread GitBox
xiangfu0 merged pull request #8436: URL: https://github.com/apache/pinot/pull/8436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [pinot] xiangfu0 opened a new pull request #8436: Pinot helm 0.2.5

2022-03-29 Thread GitBox
xiangfu0 opened a new pull request #8436: URL: https://github.com/apache/pinot/pull/8436 ## Description Reformat helm index file ## Upgrade Notes Does this PR prevent a zero down-time upgrade? (Assume upgrade order: Controller, Broker, Server, Minion) * [ ] Yes (Please label as

[pinot] branch master updated: Adding pinot helm 0.2.5 (#8435)

2022-03-29 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 6ec6d4a Adding pinot helm 0.2.5 (#8435) 6ec6d4a

[GitHub] [pinot] xiangfu0 merged pull request #8435: Adding pinot helm 0.2.5

2022-03-29 Thread GitBox
xiangfu0 merged pull request #8435: URL: https://github.com/apache/pinot/pull/8435 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [pinot] Jackie-Jiang commented on pull request #8428: replace CombinedFilterOperator with AndFilterOperator

2022-03-29 Thread GitBox
Jackie-Jiang commented on pull request #8428: URL: https://github.com/apache/pinot/pull/8428#issuecomment-1082354580 This operator only applies to the aggregation FILTER, where we don't need to scan the main filter multiple times -- This is an automated message from the Apache Git Servic

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837889234 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BaseFilterOperator.java ## @@ -40,4 +43,128 @@ public boolean isResultE

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #8426: Allow ingesting Avro complex types into JSON column.

2022-03-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #8426: URL: https://github.com/apache/pinot/pull/8426#discussion_r837887248 ## File path: pinot-core/src/test/java/org/apache/pinot/queries/JsonIngestionFromAvroQueriesTest.java ## @@ -0,0 +1,341 @@ +/** + * Licensed to the Ap

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #8408: Combine Metadata and Dictionary based plans into single operator

2022-03-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #8408: URL: https://github.com/apache/pinot/pull/8408#discussion_r837877827 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/query/NonScanBasedAggregationOperator.java ## @@ -40,80 +39,90 @@ import org.a

[GitHub] [pinot] xiangfu0 opened a new pull request #8435: Adding pinot helm 0.2.5

2022-03-29 Thread GitBox
xiangfu0 opened a new pull request #8435: URL: https://github.com/apache/pinot/pull/8435 ## Description Release pinot helm 0.2.5 ## Upgrade Notes Does this PR prevent a zero down-time upgrade? (Assume upgrade order: Controller, Broker, Server, Minion) * [ ] Yes (Please label

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837877211 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BitmapBasedFilterOperator.java ## @@ -100,6 +101,67 @@ protected Filter

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #8369: [Generalized Pre-Aggregation] Initial Config wiring

2022-03-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #8369: URL: https://github.com/apache/pinot/pull/8369#discussion_r837876217 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/config/table/ingestion/IngestionConfig.java ## @@ -75,6 +81,11 @@ public FilterConfig getFi

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837875629 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/SortedIndexBasedFilterOperator.java ## @@ -132,6 +133,96 @@ protected F

[GitHub] [pinot] Jackie-Jiang commented on issue #8423: The race condition that TableDataManager is removed during segment download because of incorrect segment count.

2022-03-29 Thread GitBox
Jackie-Jiang commented on issue #8423: URL: https://github.com/apache/pinot/issues/8423#issuecomment-1082332216 After some offline discussion, one way to solve this issue is to add a `DELETE` message, and only remove the `tableDataManager` when the table is deleted -- This is an automat

[GitHub] [pinot] Jackie-Jiang commented on issue #8399: Persist raw data from kafka topic as it is

2022-03-29 Thread GitBox
Jackie-Jiang commented on issue #8399: URL: https://github.com/apache/pinot/issues/8399#issuecomment-1082330899 We may consider adding a new config in the `IngestionConfig` to store the json string of the record into a field. The logic needs to be implemented into the `RecordExtractor` -

[GitHub] [pinot] Jackie-Jiang commented on issue #8424: CAST after expression causes weird exception

2022-03-29 Thread GitBox
Jackie-Jiang commented on issue #8424: URL: https://github.com/apache/pinot/issues/8424#issuecomment-1082322894 We need to add the `ScalarFunction` version of the `CAST` function -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837851321 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/SortedIndexBasedFilterOperator.java ## @@ -132,6 +133,96 @@ protected F

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837850811 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/OrFilterOperator.java ## @@ -60,4 +64,37 @@ public String toExplainStri

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837850683 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/OrFilterOperator.java ## @@ -32,6 +34,8 @@ private final List _filte

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837850389 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BitmapBasedFilterOperator.java ## @@ -100,6 +101,67 @@ protected Filter

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837847120 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,39 @@ protected FilterBlock getN

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837845568 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,39 @@ protected FilterBlock getN

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837845361 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,39 @@ protected FilterBlock getN

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837845079 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BaseFilterOperator.java ## @@ -40,4 +43,128 @@ public boolean isResultE

[GitHub] [pinot] codecov-commenter commented on pull request #8434: [WIP][Not Ready for Review]Add replica group based instance assigment algorithm with FD awareness

2022-03-29 Thread GitBox
codecov-commenter commented on pull request #8434: URL: https://github.com/apache/pinot/pull/8434#issuecomment-1082275642 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8434?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apa

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837806164 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BaseFilterOperator.java ## @@ -40,4 +43,128 @@ public boolean isResultE

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837783754 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BaseFilterOperator.java ## @@ -40,4 +43,128 @@ public boolean isResultE

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837783041 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/SortedIndexBasedFilterOperator.java ## @@ -132,6 +133,96 @@ protected F

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837782397 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/OrFilterOperator.java ## @@ -60,4 +64,37 @@ public String toExplainStri

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837782085 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BitmapBasedFilterOperator.java ## @@ -100,6 +101,67 @@ protected Filter

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837780689 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BitmapBasedFilterOperator.java ## @@ -100,6 +101,67 @@ protected Filter

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837779585 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/BaseFilterOperator.java ## @@ -40,4 +43,128 @@ public boolean isResultE

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837779005 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,39 @@ protected FilterBlock getN

[GitHub] [pinot] richardstartin commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
richardstartin commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837778215 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,39 @@ protected FilterBlock getN

[GitHub] [pinot] codecov-commenter edited a comment on pull request #8343: Timestamp type index

2022-03-29 Thread GitBox
codecov-commenter edited a comment on pull request #8343: URL: https://github.com/apache/pinot/pull/8343#issuecomment-1065843913 # [Codecov](https://codecov.io/gh/apache/pinot/pull/8343?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #8411: accelerate counts over filters

2022-03-29 Thread GitBox
Jackie-Jiang commented on a change in pull request #8411: URL: https://github.com/apache/pinot/pull/8411#discussion_r837719142 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/AndFilterOperator.java ## @@ -45,6 +47,39 @@ protected FilterBlock getNex

  1   2   >