[incubator-pinot] branch master updated: Adding scalar function JsonPathArray to extract arrays from json (#6490)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new fde307b Adding scalar function JsonPa

[GitHub] [incubator-pinot] fx19880617 merged pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
fx19880617 merged pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-pinot] pabrahamusa edited a comment on issue #6449: Errors after Pinot server ran out of max map count

2021-01-26 Thread GitBox
pabrahamusa edited a comment on issue #6449: URL: https://github.com/apache/incubator-pinot/issues/6449#issuecomment-767933847 @fx19880617 , Other than adding configs to controller and server I can see a Job spec as well. Is Job spec mandatory? I was expecting controller to push segment d

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6440: Add authentication for write endpoints of Controller resources

2021-01-26 Thread GitBox
mcvsubbu commented on a change in pull request #6440: URL: https://github.com/apache/incubator-pinot/pull/6440#discussion_r564991028 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/access/AccessType.java ## @@ -0,0 +1,24 @@ +/** + * Licensed to the

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6440: Add authentication for write endpoints of Controller resources

2021-01-26 Thread GitBox
mcvsubbu commented on a change in pull request #6440: URL: https://github.com/apache/incubator-pinot/pull/6440#discussion_r564990881 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/access/AccessControl.java ## @@ -30,9 +30,35 @@ /** * Return

[GitHub] [incubator-pinot] siddharthteotia commented on a change in pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
siddharthteotia commented on a change in pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490#discussion_r564979320 ## File path: pinot-common/src/test/java/org/apache/pinot/common/function/JsonFunctionsTest.java ## @@ -65,4 +65,42 @@ public void testJs

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #6494: Support generating derived column during segment load

2021-01-26 Thread GitBox
Jackie-Jiang commented on a change in pull request #6494: URL: https://github.com/apache/incubator-pinot/pull/6494#discussion_r564973731 ## File path: pinot-core/src/main/java/org/apache/pinot/core/segment/index/loader/defaultcolumn/BaseDefaultColumnHandler.java ## @@ -324,8 +

[GitHub] [incubator-pinot] codecov-io commented on pull request #6495: Support chained transform functions

2021-01-26 Thread GitBox
codecov-io commented on pull request #6495: URL: https://github.com/apache/incubator-pinot/pull/6495#issuecomment-767953990 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6495?src=pr&el=h1) Report > Merging [#6495](https://codecov.io/gh/apache/incubator-pinot/pull/6495?s

[GitHub] [incubator-pinot] npawar opened a new pull request #6495: Support chained transform functions

2021-01-26 Thread GitBox
npawar opened a new pull request #6495: URL: https://github.com/apache/incubator-pinot/pull/6495 ## Description Allow chained transform functions. This will be needed when supporting derived columns https://github.com/apache/incubator-pinot/pull/6494. For example, millisSinceEpoch =

[GitHub] [incubator-pinot] fx19880617 commented on a change in pull request #6494: Support generating derived column during segment load

2021-01-26 Thread GitBox
fx19880617 commented on a change in pull request #6494: URL: https://github.com/apache/incubator-pinot/pull/6494#discussion_r564951218 ## File path: pinot-core/src/main/java/org/apache/pinot/core/segment/index/loader/defaultcolumn/BaseDefaultColumnHandler.java ## @@ -324,8 +34

[GitHub] [incubator-pinot] Jackie-Jiang commented on pull request #6403: [WORK IN PROGRESS] Fix upcasting/downcasting of numerical values used in SQL predicates.

2021-01-26 Thread GitBox
Jackie-Jiang commented on pull request #6403: URL: https://github.com/apache/incubator-pinot/pull/6403#issuecomment-767937220 Per the performance concern, can we always parse the String as double? This is an automated messag

[GitHub] [incubator-pinot] pabrahamusa commented on issue #6449: Errors after Pinot server ran out of max map count

2021-01-26 Thread GitBox
pabrahamusa commented on issue #6449: URL: https://github.com/apache/incubator-pinot/issues/6449#issuecomment-767933847 @fx19880617 , Other than adding configs to controller and server I can see a Job spec as well. Why we need a Job spec? I was expecting controller to push segment directl

[GitHub] [incubator-pinot] fx19880617 commented on issue #6487: Adding numStartreeUsed in query stats

2021-01-26 Thread GitBox
fx19880617 commented on issue #6487: URL: https://github.com/apache/incubator-pinot/issues/6487#issuecomment-767932792 Yes, this is a good sign for users to check if the query is fitting for star-tree or not. This will also help when we are adding a new star-tree, we can just query to

[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #6487: Adding numStartreeUsed in query stats

2021-01-26 Thread GitBox
Jackie-Jiang commented on issue #6487: URL: https://github.com/apache/incubator-pinot/issues/6487#issuecomment-767928309 Is this mostly for default star-tree where we don't know if a dimension is included? This is an automa

[GitHub] [incubator-pinot] Jackie-Jiang opened a new pull request #6494: Support generating derived column during segment load

2021-01-26 Thread GitBox
Jackie-Jiang opened a new pull request #6494: URL: https://github.com/apache/incubator-pinot/pull/6494 ## Description Currently we allow transform function in the ingestion config to generate derived columns during segment creation. This PR adds the support for generating the derived co

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6403: [WORK IN PROGRESS] Fix upcasting/downcasting of numerical values used in SQL predicates.

2021-01-26 Thread GitBox
codecov-io edited a comment on pull request #6403: URL: https://github.com/apache/incubator-pinot/pull/6403#issuecomment-759105793 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6403?src=pr&el=h1) Report > Merging [#6403](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] kishoreg commented on issue #6493: Fatal Error - Problematic frame libc.so.6+0x15c6ff - Server Crash

2021-01-26 Thread GitBox
kishoreg commented on issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493#issuecomment-767904970 add more servers and once they catch up, shrink the cluster and rebalance.. This is an automated messag

[incubator-pinot] branch adding_scalar_function_to_extract_json_array updated (17688a5 -> a2407f1)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 17688a5 Adding scalar function JsonPathArray to extract arrays from

[incubator-pinot] branch adding_scalar_function_to_extract_json_array updated (c0198c0 -> 17688a5)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard c0198c0 Adding scalar function JsonPathArray to extract arrays from

[GitHub] [incubator-pinot] SandishKumarHN commented on issue #6478: Time column predicates are invalidating use of star-tree indices

2021-01-26 Thread GitBox
SandishKumarHN commented on issue #6478: URL: https://github.com/apache/incubator-pinot/issues/6478#issuecomment-767896182 @Jackie-Jiang will work on adding a scalar function for cast() based on your suggestion offline. Th

[GitHub] [incubator-pinot] pabrahamusa commented on issue #6493: Fatal Error - Problematic frame libc.so.6+0x15c6ff - Server Crash

2021-01-26 Thread GitBox
pabrahamusa commented on issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493#issuecomment-767893189 I reloaded the segments and the server is back online . Is there any way to speed up the catch up process from the kafka stream? ---

[incubator-pinot] branch adding_scalar_function_to_extract_json_array updated (1951881 -> c0198c0)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 1951881 Adding scalar function JsonPathArray to extract arrays from

[GitHub] [incubator-pinot] fx19880617 commented on a change in pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
fx19880617 commented on a change in pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490#discussion_r564890469 ## File path: pinot-common/src/main/java/org/apache/pinot/common/function/scalar/JsonFunctions.java ## @@ -21,6 +21,7 @@ import com.fasterxml

[incubator-pinot] branch adding_scalar_function_to_extract_json_array updated (1b01c23 -> 1951881)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 1b01c23 Adding scalar function JsonPathArray to extract arrays from

[GitHub] [incubator-pinot] fx19880617 commented on a change in pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
fx19880617 commented on a change in pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490#discussion_r564890271 ## File path: pinot-common/src/test/java/org/apache/pinot/common/function/JsonFunctionsTest.java ## @@ -65,4 +65,42 @@ public void testJsonFun

[GitHub] [incubator-pinot] pabrahamusa commented on issue #6493: Fatal Error - Problematic frame libc.so.6+0x15c6ff - Server Crash

2021-01-26 Thread GitBox
pabrahamusa commented on issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493#issuecomment-767878868 Anyways all the segments are in corrupted status..!!! It seems I have to restore the server from backup again..!!!

[GitHub] [incubator-pinot] pabrahamusa edited a comment on issue #6493: Fatal Error - Problematic frame libc.so.6+0x15c6ff - Server Crash

2021-01-26 Thread GitBox
pabrahamusa edited a comment on issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493#issuecomment-767876403 @kishoreg Nothing Changed it was running for 3 days without a hitch and suddenly keep crashing. I changed the memory from -Xms512M -Xmx4G to -Xms12G -Xmx12G and

[incubator-pinot] branch adding_scalar_function_to_extract_json_array updated (c8e6d8c -> 1b01c23)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard c8e6d8c Adding scalar function JsonPathArray to extract arrays from

[GitHub] [incubator-pinot] pabrahamusa commented on issue #6493: Fatal Error - Problematic frame libc.so.6+0x15c6ff - Server Crash

2021-01-26 Thread GitBox
pabrahamusa commented on issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493#issuecomment-767876403 Nothing Changes it was running for 3 days without a hinch and suddenly keep crashing. I changed the memory from -Xms512M -Xmx4G to -Xms12G -Xmx12G and servers are up . N

[GitHub] [incubator-pinot] kishoreg commented on issue #6493: Fatal Error - Problematic frame libc.so.6+0x15c6ff - Server Crash

2021-01-26 Thread GitBox
kishoreg commented on issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493#issuecomment-76788 what changed? This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [incubator-pinot] siddharthteotia commented on a change in pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
siddharthteotia commented on a change in pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490#discussion_r564874873 ## File path: pinot-common/src/test/java/org/apache/pinot/common/function/JsonFunctionsTest.java ## @@ -65,4 +65,42 @@ public void testJs

[GitHub] [incubator-pinot] pabrahamusa commented on issue #6493: Fatal Error - Problematic frame libc.so.6+0x15c6ff - Server Crash

2021-01-26 Thread GitBox
pabrahamusa commented on issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493#issuecomment-767865939 ``` my-pinot-controller-0 controller 2021/01/26 22:17:12.039 WARN [ZkBaseDataAccessor] [HelixController-pipeline-task-pinot-quickstart-(83ee1db3_TASK)] Fail to read

[GitHub] [incubator-pinot] siddharthteotia commented on a change in pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
siddharthteotia commented on a change in pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490#discussion_r564872686 ## File path: pinot-common/src/test/java/org/apache/pinot/common/function/JsonFunctionsTest.java ## @@ -65,4 +65,42 @@ public void testJs

[GitHub] [incubator-pinot] pabrahamusa commented on issue #6493: Fatal Error - Problematic frame libc.so.6+0x15c6ff - Server Crash

2021-01-26 Thread GitBox
pabrahamusa commented on issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493#issuecomment-767864417 ``` my-pinot-server-0 server [Times: user=0.08 sys=0.00, real=0.02 secs] my-pinot-controller-0 controller 2021/01/26 22:17:09.409 WARN [CallbackHandler] [ZkClient

[GitHub] [incubator-pinot] pabrahamusa opened a new issue #6493: Fatal Error - Problematic frame libc.so.6+0x15c6ff - Server Crash

2021-01-26 Thread GitBox
pabrahamusa opened a new issue #6493: URL: https://github.com/apache/incubator-pinot/issues/6493 I am facing an issue where both Pinot servers are not restarting and they are keep on crashing with following error. I am using latest image. Any one came across this? [Times: user=0.02

[incubator-pinot] 01/01: Fixing hadoop plugins jar copy issue

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch fixing_hadoop_copy_plugin_dir in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit 4e21e1fb072cec417e01473dc1e8e2b3a6f86b08 Author: Xiang Fu AuthorDate: Tue Jan 26 13:45:

[incubator-pinot] branch fixing_hadoop_copy_plugin_dir created (now 4e21e1f)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch fixing_hadoop_copy_plugin_dir in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. at 4e21e1f Fixing hadoop plugins jar copy issue This branch includes the following ne

[GitHub] [incubator-pinot] fx19880617 commented on a change in pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
fx19880617 commented on a change in pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490#discussion_r564846949 ## File path: pinot-common/src/main/java/org/apache/pinot/common/function/scalar/JsonFunctions.java ## @@ -21,6 +21,7 @@ import com.fasterxml

[GitHub] [incubator-pinot] fx19880617 commented on a change in pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
fx19880617 commented on a change in pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490#discussion_r564846949 ## File path: pinot-common/src/main/java/org/apache/pinot/common/function/scalar/JsonFunctions.java ## @@ -21,6 +21,7 @@ import com.fasterxml

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
kishoreg commented on a change in pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490#discussion_r564820569 ## File path: pinot-common/src/main/java/org/apache/pinot/common/function/scalar/JsonFunctions.java ## @@ -21,6 +21,7 @@ import com.fasterxml.j

[GitHub] [incubator-pinot] kkrugler opened a new issue #6492: HadoopSegmentGenerationJobRunner isn't setting up Hadoop distributed cache correctly

2021-01-26 Thread GitBox
kkrugler opened a new issue #6492: URL: https://github.com/apache/incubator-pinot/issues/6492 Currently the code creates a tarball of the plugin directory inside of the Pinot distribution directory, and then calls `job.addCacheArchive(file://`. This won't work, as all that this call does is

[GitHub] [incubator-pinot] kkrugler opened a new issue #6491: Groovy-based SimpleTemplateScript1 parser for job yaml file complains about characters in commented-out lines

2021-01-26 Thread GitBox
kkrugler opened a new issue #6491: URL: https://github.com/apache/incubator-pinot/issues/6491 If you have a job spec file that contains something like: ``` yaml # excludeFileNamePattern: exclude file name pattern, supported glob pattern. # Sample usage: # 'glob:*.avro' will

[GitHub] [incubator-pinot] sajjad-moradi commented on a change in pull request #6440: Add authentication for write endpoints of Controller resources

2021-01-26 Thread GitBox
sajjad-moradi commented on a change in pull request #6440: URL: https://github.com/apache/incubator-pinot/pull/6440#discussion_r564808321 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/access/AccessControlUtils.java ## @@ -0,0 +1,65 @@ +/** + * Li

[incubator-pinot] branch adding_scalar_function_to_extract_json_array updated (93eb9db -> c8e6d8c)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 93eb9db Adding scalar function JsonPathArray to extract arrays from

[GitHub] [incubator-pinot] sajjad-moradi commented on a change in pull request #6440: Add authentication for write endpoints of Controller resources

2021-01-26 Thread GitBox
sajjad-moradi commented on a change in pull request #6440: URL: https://github.com/apache/incubator-pinot/pull/6440#discussion_r564806601 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/access/AccessControl.java ## @@ -30,9 +30,35 @@ /** * R

[GitHub] [incubator-pinot] fx19880617 opened a new pull request #6490: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread GitBox
fx19880617 opened a new pull request #6490: URL: https://github.com/apache/incubator-pinot/pull/6490 ## Description Adding scalar function JsonPathArray to extract arrays from JSON. This is an automated message from the Ap

[incubator-pinot] 01/01: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit 93eb9db4959c81cef8a0fc479dfead827e29903d Author: Xiang Fu AuthorDate: Tu

[incubator-pinot] branch adding_scalar_function_to_extract_json_array updated (5f08b3a -> 93eb9db)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 5f08b3a Adding scalar function JsonPathArray to extract arrays from

[incubator-pinot] 01/01: Adding scalar function JsonPathArray to extract arrays from json

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit 5f08b3a8c1e6e2983b9611eb7979f24d39ab3e81 Author: Xiang Fu AuthorDate: Tu

[incubator-pinot] branch adding_scalar_function_to_extract_json_array created (now 5f08b3a)

2021-01-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_scalar_function_to_extract_json_array in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. at 5f08b3a Adding scalar function JsonPathArray to extract arrays from

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6440: Add authentication for write endpoints of Controller resources

2021-01-26 Thread GitBox
codecov-io edited a comment on pull request #6440: URL: https://github.com/apache/incubator-pinot/pull/6440#issuecomment-759753751 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6440?src=pr&el=h1) Report > Merging [#6440](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6440: Add authentication for write endpoints of Controller resources

2021-01-26 Thread GitBox
mcvsubbu commented on a change in pull request #6440: URL: https://github.com/apache/incubator-pinot/pull/6440#discussion_r564699735 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/api/access/AccessControl.java ## @@ -30,9 +30,35 @@ /** * Return

[incubator-pinot] branch master updated: Guard against multiple consuming segments for same partition (#6483)

2021-01-26 Thread mcvsubbu
This is an automated email from the ASF dual-hosted git repository. mcvsubbu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new bacaed2 Guard against multiple consu

[GitHub] [incubator-pinot] mcvsubbu merged pull request #6483: Guard against multiple consuming segments for same partition

2021-01-26 Thread GitBox
mcvsubbu merged pull request #6483: URL: https://github.com/apache/incubator-pinot/pull/6483 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-pinot] fx19880617 edited a comment on issue #6449: Errors after Pinot server ran out of max map count

2021-01-26 Thread GitBox
fx19880617 edited a comment on issue #6449: URL: https://github.com/apache/incubator-pinot/issues/6449#issuecomment-767304859 you can follow this doc to add configs for s3. [Use S3 as deep store for Pinot](https://docs.pinot.apache.org/users/tutorials/use-s3-as-deep-store-for-pinot)

[GitHub] [incubator-pinot] fx19880617 edited a comment on issue #6449: Errors after Pinot server ran out of max map count

2021-01-26 Thread GitBox
fx19880617 edited a comment on issue #6449: URL: https://github.com/apache/incubator-pinot/issues/6449#issuecomment-767304859 you can follow this doc to add configs for s3. https://docs.pinot.apache.org/users/tutorials/use-s3-as-deep-store-for-pinot

[GitHub] [incubator-pinot] siddharthteotia commented on issue #6431: Text Index lag time for realtime consuming segments

2021-01-26 Thread GitBox
siddharthteotia commented on issue #6431: URL: https://github.com/apache/incubator-pinot/issues/6431#issuecomment-767385927 I have a proposal to fix this. This is essentially an enhancement. Let's meet and discuss. Happy to help you make the code changes else I will find time to make the