[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6409: Merge H3-index branch to master

codecov-io edited a comment on pull request #6409: URL: https://github.com/apache/incubator-pinot/pull/6409#issuecomment-754395900 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6409?src=pr&el=h1) Report > Merging [#6409](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] codecov-io commented on pull request #6409: Merge H3-index branch to master

codecov-io commented on pull request #6409: URL: https://github.com/apache/incubator-pinot/pull/6409#issuecomment-754395900 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6409?src=pr&el=h1) Report > Merging [#6409](https://codecov.io/gh/apache/incubator-pinot/pull/6409?s

[GitHub] [incubator-pinot] yupeng9 opened a new pull request #6409: Merge H3-index branch to master

yupeng9 opened a new pull request #6409: URL: https://github.com/apache/incubator-pinot/pull/6409 Use this PR instead of the previous [PR](https://github.com/apache/incubator-pinot/pull/6376) because the last commit mistakenly merged master (instead of rebase). ## Description Add

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6408: Real-time json index

codecov-io edited a comment on pull request #6408: URL: https://github.com/apache/incubator-pinot/pull/6408#issuecomment-754368591 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6408?src=pr&el=h1) Report > Merging [#6408](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] codecov-io commented on pull request #6408: Real-time json index

codecov-io commented on pull request #6408: URL: https://github.com/apache/incubator-pinot/pull/6408#issuecomment-754368591 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6408?src=pr&el=h1) Report > Merging [#6408](https://codecov.io/gh/apache/incubator-pinot/pull/6408?s

[GitHub] [incubator-pinot] codecov-io commented on pull request #6407: data gen - use unique output file names in csv mode

codecov-io commented on pull request #6407: URL: https://github.com/apache/incubator-pinot/pull/6407#issuecomment-754346924 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6407?src=pr&el=h1) Report > Merging [#6407](https://codecov.io/gh/apache/incubator-pinot/pull/6407?s

[GitHub] [incubator-pinot] plaisted commented on issue #6349: Standalone ingestion jobs do not clean up output files after completing loading

plaisted commented on issue #6349: URL: https://github.com/apache/incubator-pinot/issues/6349#issuecomment-754346251 Ty @amarnathkarthik will check the changes out This is an automated message from the Apache Git Service. To

[GitHub] [incubator-pinot] plaisted closed issue #6349: Standalone ingestion jobs do not clean up output files after completing loading

plaisted closed issue #6349: URL: https://github.com/apache/incubator-pinot/issues/6349 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-pinot] Jackie-Jiang opened a new pull request #6408: Real-time json index

Jackie-Jiang opened a new pull request #6408: URL: https://github.com/apache/incubator-pinot/pull/6408 ## Description Add json index support to mutable (real-time) segments Add a new quickstart for real-time json index on meetup RSVP events Example query: Find events that are in

[incubator-pinot] branch sharded_consumer_type_support_with_kinesis updated: Consumer tweaks to get it working

This is an automated email from the ASF dual-hosted git repository. nehapawar pushed a commit to branch sharded_consumer_type_support_with_kinesis in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/sharded_consumer_type_support

[GitHub] [incubator-pinot] amarnathkarthik commented on issue #6349: Standalone ingestion jobs do not clean up output files after completing loading

amarnathkarthik commented on issue #6349: URL: https://github.com/apache/incubator-pinot/issues/6349#issuecomment-754333990 @plaisted Could you please mark this issue closed? I do not see an option to close. CC: @fx19880617

[GitHub] [incubator-pinot] mcvsubbu commented on pull request #6382: Compatibility test for segment operations upload and delete

mcvsubbu commented on pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#issuecomment-754333769 Thanks, @amarnathkarthik for your contribution. Also, big thanks for fixing existing bugs in this area. ---

[incubator-pinot] branch master updated (02ab193 -> 8fcb17d)

This is an automated email from the ASF dual-hosted git repository. mcvsubbu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from 02ab193 remove accidental junit imports (#6404) add 8fcb17d Compatibility test for segment operatio

[GitHub] [incubator-pinot] mcvsubbu merged pull request #6382: Compatibility test for segment operations upload and delete

mcvsubbu merged pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[incubator-pinot] branch master updated (e87e141 -> 02ab193)

This is an automated email from the ASF dual-hosted git repository. apucher pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from e87e141 [TE] limit reflection scanning range (#6405) add 02ab193 remove accidental junit imports (#6

[GitHub] [incubator-pinot] apucher merged pull request #6404: remove accidental org.junit.* imports

apucher merged pull request #6404: URL: https://github.com/apache/incubator-pinot/pull/6404 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [incubator-pinot] apucher opened a new pull request #6407: data gen - use unique output file names in csv mode

apucher opened a new pull request #6407: URL: https://github.com/apache/incubator-pinot/pull/6407 ## Description Use the file index when generating csv output from the data generator. This fixes an issue where output files are overridden repeatedly. ## Upgrade Notes Does this P

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6382: Compatibility test for segment operations upload and delete

codecov-io edited a comment on pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#issuecomment-751130863 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6382?src=pr&el=h1) Report > Merging [#6382](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] Jackie-Jiang merged pull request #6401: H3 index cleanup merge

Jackie-Jiang merged pull request #6401: URL: https://github.com/apache/incubator-pinot/pull/6401 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[incubator-pinot] branch h3-index updated (35f1257 -> d1373cf)

This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch h3-index in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from 35f1257 Add real-time H3 index reader (#6400) add d1373cf H3 index cleanup merge (#6401) No new re

[incubator-pinot] branch data-gen-csv-multifile-fix-20210104 created (now 4a1be6b)

This is an automated email from the ASF dual-hosted git repository. apucher pushed a change to branch data-gen-csv-multifile-fix-20210104 in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. at 4a1be6b use unique output file names in csv mode This branch includes the

[incubator-pinot] 01/01: use unique output file names in csv mode

This is an automated email from the ASF dual-hosted git repository. apucher pushed a commit to branch data-gen-csv-multifile-fix-20210104 in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit 4a1be6b8f07b51e038e30f3fc1ba32ca7ea7d819 Author: Alexander Pucher AuthorDate

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

mcvsubbu commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551663395 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +107,219 @@ public void setTableCo

[incubator-pinot] branch master updated (37f2e28 -> e87e141)

This is an automated email from the ASF dual-hosted git repository. jihao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from 37f2e28 Segment reset API (#6336) add e87e141 [TE] limit reflection scanning range (#6405) No new rev

[GitHub] [incubator-pinot] jihaozh merged pull request #6405: [TE] limit reflection scanning range

jihaozh merged pull request #6405: URL: https://github.com/apache/incubator-pinot/pull/6405 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

mcvsubbu commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551659343 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +107,219 @@ public void setTableCo

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551649765 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +107,221 @@ public void set

[GitHub] [incubator-pinot] JoeFuentes-WebDev opened a new pull request #6406: refactor AnomaliesResponses to avoid duplicate code

JoeFuentes-WebDev opened a new pull request #6406: URL: https://github.com/apache/incubator-pinot/pull/6406 ## Description clean up duplicate code with regard to `AnomaliesResponses` This is an automated message from t

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6404: remove accidental org.junit.* imports

codecov-io edited a comment on pull request #6404: URL: https://github.com/apache/incubator-pinot/pull/6404#issuecomment-754296756 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6404?src=pr&el=h1) Report > Merging [#6404](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] vincentchenjl opened a new pull request #6405: [TE] limit reflection scanning range

vincentchenjl opened a new pull request #6405: URL: https://github.com/apache/incubator-pinot/pull/6405 This PR is to limit scanning range of reflection for component classes, so that the memory footprint of JVM is reduced.

[GitHub] [incubator-pinot] codecov-io commented on pull request #6404: remove accidental org.junit.* imports

codecov-io commented on pull request #6404: URL: https://github.com/apache/incubator-pinot/pull/6404#issuecomment-754296756 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6404?src=pr&el=h1) Report > Merging [#6404](https://codecov.io/gh/apache/incubator-pinot/pull/6404?s

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

mcvsubbu commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551629011 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +107,221 @@ public void setTableCo

[GitHub] [incubator-pinot] apucher opened a new pull request #6404: remove accidental org.junit.* imports

apucher opened a new pull request #6404: URL: https://github.com/apache/incubator-pinot/pull/6404 ## Description Clean up a few dangling **org.junit.*** imports. Given that we're running on TestNG, they seem accidental. ## Upgrade Notes Does this PR prevent a zero down-time upg

[incubator-pinot] branch cleanup-junit-imports-20210104 updated (69100fa -> eeabeda)

This is an automated email from the ASF dual-hosted git repository. apucher pushed a change to branch cleanup-junit-imports-20210104 in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 69100fa remove junit imports new eeabeda remove junit imports This update

[incubator-pinot] 01/01: remove junit imports

This is an automated email from the ASF dual-hosted git repository. apucher pushed a commit to branch cleanup-junit-imports-20210104 in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit eeabeda7f6abb1ab57c07cfd2ae4e9ae82668f8a Author: Alexander Pucher AuthorDate: Mon Jan

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551621980 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +103,220 @@ public void set

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551621980 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +103,220 @@ public void set

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551621904 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -36,15 +57,23 @@ */ @JsonIgnore

[incubator-pinot] branch cleanup-junit-imports-20210104 created (now 69100fa)

This is an automated email from the ASF dual-hosted git repository. apucher pushed a change to branch cleanup-junit-imports-20210104 in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. at 69100fa remove junit imports This branch includes the following new commits

[incubator-pinot] 01/01: remove junit imports

This is an automated email from the ASF dual-hosted git repository. apucher pushed a commit to branch cleanup-junit-imports-20210104 in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit 69100fab0e22f3a866074fff5076bf84a45c022b Author: Alexander Pucher AuthorDate: Mon Jan

[GitHub] [incubator-pinot] amrishlal edited a comment on pull request #6403: Allow upcasting/downcasting of numerical values used in SQL statements.

amrishlal edited a comment on pull request #6403: URL: https://github.com/apache/incubator-pinot/pull/6403#issuecomment-754214569 @mayankshriv @fx19880617 This is the PR for dealing with timestamp arithmetic evaluation discussed in Apache Pinot slack channel (12/18 #general Apache Pinot C

[GitHub] [incubator-pinot] amrishlal commented on pull request #6403: Allow upcasting/downcasting of numerical values used in SQL statements.

amrishlal commented on pull request #6403: URL: https://github.com/apache/incubator-pinot/pull/6403#issuecomment-754214569 @mayankshriv @Jackie-Jiang This is the PR for dealing with timestamp arithmetic evaluation discussed in Apache Pinot slack channel. Please take a look. -

[GitHub] [incubator-pinot] amrishlal opened a new pull request #6403: Allow upcasting/downcasting of numerical values used in SQL statements.

amrishlal opened a new pull request #6403: URL: https://github.com/apache/incubator-pinot/pull/6403 This PR is motivated by a discussion thread in Apache Pinot # general slack channel (see Dec 18th, 2020 post by Will Briggs), where we noticed that the query `SELECT COUNT(*) FROM myTable WH

[incubator-pinot] branch sharded_consumer_type_support_with_kinesis updated: Fix offsets in StreamMetadataProvider impl

This is an automated email from the ASF dual-hosted git repository. nehapawar pushed a commit to branch sharded_consumer_type_support_with_kinesis in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/sharded_consumer_type_support

[incubator-pinot] branch sharded_consumer_type_support_with_kinesis updated: Add support for stream partition offsets (#6402)

This is an automated email from the ASF dual-hosted git repository. nehapawar pushed a commit to branch sharded_consumer_type_support_with_kinesis in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/sharded_consumer_type_support

[GitHub] [incubator-pinot] npawar merged pull request #6402: Add support for stream partition offsets

npawar merged pull request #6402: URL: https://github.com/apache/incubator-pinot/pull/6402 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

mcvsubbu commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551530533 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +103,220 @@ public void setTableCo

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551519877 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +103,220 @@ public void set

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551516583 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +103,220 @@ public void set

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551516583 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +103,220 @@ public void set

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

mcvsubbu commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551509121 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +103,220 @@ public void setTableCo

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551506521 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -36,15 +57,23 @@ */ @JsonIgnore

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551506342 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -82,14 +103,220 @@ public void set

[GitHub] [incubator-pinot] amarnathkarthik commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

amarnathkarthik commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551504105 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -36,15 +57,23 @@ */ @JsonIgnore

[GitHub] [incubator-pinot] mcvsubbu commented on a change in pull request #6382: Compatibility test for segment operations upload and delete

mcvsubbu commented on a change in pull request #6382: URL: https://github.com/apache/incubator-pinot/pull/6382#discussion_r551492153 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/compat/tests/SegmentOp.java ## @@ -36,15 +57,23 @@ */ @JsonIgnorePropert

[GitHub] [incubator-pinot] mcvsubbu commented on issue #6378: Create a dashboard for most expensive queries per table

mcvsubbu commented on issue #6378: URL: https://github.com/apache/incubator-pinot/issues/6378#issuecomment-754138688 > why not write the query response back to Pinot. Have a logger that logs the query response to kafka topic and have that ingested into Pinot. We can build multiple visuali

[GitHub] [incubator-pinot] mayankshriv commented on issue #6334: SegmentPurger does not handle schema evolution gracefully

mayankshriv commented on issue #6334: URL: https://github.com/apache/incubator-pinot/issues/6334#issuecomment-754109980 No, SegmentPurger uses the table config from controller (to identify that a it needs to build inverted index for a column), but it uses the schema in the segment and doe

[GitHub] [incubator-pinot] mayankshriv commented on a change in pull request #6396: Adding ImportData sub command in pinot admin

mayankshriv commented on a change in pull request #6396: URL: https://github.com/apache/incubator-pinot/pull/6396#discussion_r551413695 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/helix/ControllerRequestURLBuilder.java ## @@ -211,6 +211,9 @@ public

[GitHub] [incubator-pinot] KKcorps opened a new pull request #6402: Add support for stream partition offsets

KKcorps opened a new pull request #6402: URL: https://github.com/apache/incubator-pinot/pull/6402 Currently, Kinesis integration is not working as expected due to StreamPartition offsets being Long. The PR aims to fix this issue by implementing checkpoints in kinesis as Offsets.

[GitHub] [incubator-pinot] samarth-gupta-traceable commented on a change in pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

samarth-gupta-traceable commented on a change in pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#discussion_r551306383 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/OfflineClusterIntegrationTest.java ## @@ -

[GitHub] [incubator-pinot] samarth-gupta-traceable commented on a change in pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

samarth-gupta-traceable commented on a change in pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#discussion_r551306383 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/OfflineClusterIntegrationTest.java ## @@ -

[GitHub] [incubator-pinot] samarth-gupta-traceable commented on a change in pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

samarth-gupta-traceable commented on a change in pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#discussion_r551306383 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/OfflineClusterIntegrationTest.java ## @@ -