[GitHub] [pinot] Jackie-Jiang commented on a diff in pull request #10915: [Upsert TTL] Add Watermark for each partitions for Primary key cleanup

2023-06-16 Thread via GitHub
Jackie-Jiang commented on code in PR #10915: URL: https://github.com/apache/pinot/pull/10915#discussion_r1232972361 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/upsert/BasePartitionUpsertMetadataManager.java: ## @@ -395,6 +402,18 @@ protected void finishOp

[pinot] branch master updated: [Flaky-test] Fix flaky PinotResourceManagerTest and also clean it up (#10941)

2023-06-16 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 8b2fb03d85 [Flaky-test] Fix flaky PinotResourceMa

[GitHub] [pinot] Jackie-Jiang merged pull request #10941: [Flaky-test] Fix flaky PinotResourceManagerTest and also clean it up

2023-06-16 Thread via GitHub
Jackie-Jiang merged PR #10941: URL: https://github.com/apache/pinot/pull/10941 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

[GitHub] [pinot] walterddr commented on issue #10872: Has pinot supported subquery?

2023-06-16 Thread via GitHub
walterddr commented on issue #10872: URL: https://github.com/apache/pinot/issues/10872#issuecomment-1595598701 sub-query is supported. the problem is this particular sub-query is not supported :-) reason is exactly in GAP-FILL -- This is an automated message from the Apache Git Service. T

[GitHub] [pinot] walterddr commented on pull request #10873: Use pinot-query-planner utils to extract table names in pinot-controller

2023-06-16 Thread via GitHub
walterddr commented on PR #10873: URL: https://github.com/apache/pinot/pull/10873#issuecomment-1595597854 the integration test failure seems legit. could you help take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [pinot] walterddr commented on a diff in pull request #10873: Use pinot-query-planner utils to extract table names in pinot-controller

2023-06-16 Thread via GitHub
walterddr commented on code in PR #10873: URL: https://github.com/apache/pinot/pull/10873#discussion_r1232943998 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotQueryResource.java: ## @@ -185,8 +190,10 @@ private String getMultiStageQueryResponse

[GitHub] [pinot] walterddr commented on pull request #10933: Fixing table name extraction for lateral join queries

2023-06-16 Thread via GitHub
walterddr commented on PR #10933: URL: https://github.com/apache/pinot/pull/10933#issuecomment-1595597232 +1 we are moving away from this. since extracting table name only needed by controller and it is not designed as QPS heavy path -- This is an automated message from the Apache Git Ser

[pinot] branch master updated (a8988dd48f -> 4af43665ec)

2023-06-16 Thread rongr
This is an automated email from the ASF dual-hosted git repository. rongr pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from a8988dd48f Bump snappy-java from 1.1.8.2 to 1.1.10.1 (#10922) add 4af43665ec [multistage] Do Not Log Entire Plan in

[GitHub] [pinot] walterddr merged pull request #10930: [multistage] Do Not Log Entire Plan in QueryServer

2023-06-16 Thread via GitHub
walterddr merged PR #10930: URL: https://github.com/apache/pinot/pull/10930 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.ap

[GitHub] [pinot] codecov-commenter commented on pull request #10941: [Flaky-test] Fix flaky PinotResourceManagerTest and also clean it up

2023-06-16 Thread via GitHub
codecov-commenter commented on PR #10941: URL: https://github.com/apache/pinot/pull/10941#issuecomment-1595580531 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/10941?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) R

[pinot] branch dependabot/maven/org.xerial.snappy-snappy-java-1.1.10.1 deleted (was 0d96cec1ac)

2023-06-16 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/org.xerial.snappy-snappy-java-1.1.10.1 in repository https://gitbox.apache.org/repos/asf/pinot.git was 0d96cec1ac Bump snappy-java from 1.1.8.2 to 1.1.10.1 The revisions t

[pinot] branch master updated (ce50e71d1e -> a8988dd48f)

2023-06-16 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from ce50e71d1e Fix an integer overflow bug. (#10940) add a8988dd48f Bump snappy-java from 1.1.8.2 to 1.1.10.1 (#10922)

[GitHub] [pinot] Jackie-Jiang merged pull request #10922: Bump snappy-java from 1.1.8.2 to 1.1.10.1

2023-06-16 Thread via GitHub
Jackie-Jiang merged PR #10922: URL: https://github.com/apache/pinot/pull/10922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

[GitHub] [pinot] Jackie-Jiang commented on issue #10921: Improve Syntax Error Messages

2023-06-16 Thread via GitHub
Jackie-Jiang commented on issue #10921: URL: https://github.com/apache/pinot/issues/10921#issuecomment-1595572662 Great suggestion! Currently we simply return the exception thrown by the Calcite SQL parser. We can explore if Calcite supports identifying the syntax error from a query.

[GitHub] [pinot] Jackie-Jiang commented on issue #10907: Enabling Null Support after table creation results in incorrect results for `IS [NOT] NULL` expressions

2023-06-16 Thread via GitHub
Jackie-Jiang commented on issue #10907: URL: https://github.com/apache/pinot/issues/10907#issuecomment-1595571975 We don't want to enforce user to re-create the table when they want to enable null handling because a lot of users are okay to have old segments not handling null and just the n

[GitHub] [pinot] Jackie-Jiang opened a new pull request, #10941: [Flaky-test] Fix flaky PinotResourceManagerTest and also clean it up

2023-06-16 Thread via GitHub
Jackie-Jiang opened a new pull request, #10941: URL: https://github.com/apache/pinot/pull/10941 `testBasicAndConcurrentAddingAndDeletingSegments()` is flaky when segment addition/deletion takes long time. -- This is an automated message from the Apache Git Service. To respond to the messa

[pinot] branch master updated: Fix an integer overflow bug. (#10940)

2023-06-16 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new ce50e71d1e Fix an integer overflow bug. (#10940)

[GitHub] [pinot] Jackie-Jiang merged pull request #10940: Fix an integer overflow bug.

2023-06-16 Thread via GitHub
Jackie-Jiang merged PR #10940: URL: https://github.com/apache/pinot/pull/10940 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

[pinot] branch dependabot/maven/com.google.guava-guava-32.0.1-jre deleted (was 15d01ee44a)

2023-06-16 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/com.google.guava-guava-32.0.1-jre in repository https://gitbox.apache.org/repos/asf/pinot.git was 15d01ee44a Bump guava from 30.1.1-jre to 32.0.1-jre The revisions tha

[GitHub] [pinot] Jackie-Jiang closed pull request #10920: Bump guava from 30.1.1-jre to 32.0.1-jre

2023-06-16 Thread via GitHub
Jackie-Jiang closed pull request #10920: Bump guava from 30.1.1-jre to 32.0.1-jre URL: https://github.com/apache/pinot/pull/10920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [pinot] dependabot[bot] commented on pull request #10920: Bump guava from 30.1.1-jre to 32.0.1-jre

2023-06-16 Thread via GitHub
dependabot[bot] commented on PR #10920: URL: https://github.com/apache/pinot/pull/10920#issuecomment-1595520565 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

[GitHub] [pinot] Jackie-Jiang commented on pull request #10920: Bump guava from 30.1.1-jre to 32.0.1-jre

2023-06-16 Thread via GitHub
Jackie-Jiang commented on PR #10920: URL: https://github.com/apache/pinot/pull/10920#issuecomment-1595520529 There are dependency conflict -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [pinot] Jackie-Jiang commented on issue #10917: Integration Test Failure in BaseRawIntSingleColumnDistinctExecutor

2023-06-16 Thread via GitHub
Jackie-Jiang commented on issue #10917: URL: https://github.com/apache/pinot/issues/10917#issuecomment-1595519828 Should be fixed by #10887. We can reopen it if it happens again -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [pinot] Jackie-Jiang closed issue #10917: Integration Test Failure in BaseRawIntSingleColumnDistinctExecutor

2023-06-16 Thread via GitHub
Jackie-Jiang closed issue #10917: Integration Test Failure in BaseRawIntSingleColumnDistinctExecutor URL: https://github.com/apache/pinot/issues/10917 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [pinot] Jackie-Jiang commented on a diff in pull request #10703: Add delete support to upsert tables

2023-06-16 Thread via GitHub
Jackie-Jiang commented on code in PR #10703: URL: https://github.com/apache/pinot/pull/10703#discussion_r1232890455 ## pinot-integration-test-base/src/test/java/org/apache/pinot/integration/tests/BaseClusterIntegrationTest.java: ## @@ -409,7 +416,62 @@ protected TableConfig crea

[GitHub] [pinot] Jackie-Jiang commented on pull request #10904: Refactored broker start to allow registration of filter in BrokerAdminApiApplication

2023-06-16 Thread via GitHub
Jackie-Jiang commented on PR #10904: URL: https://github.com/apache/pinot/pull/10904#issuecomment-1595499931 `init()` should not connect the component to the cluster. To allow registering extra properties, we can add a method in `BaseBrokerStarter()` and leave the default implementation e

[GitHub] [pinot] mcvsubbu commented on issue #10910: Flaky Test PinotFSSegmentUploaderTest

2023-06-16 Thread via GitHub
mcvsubbu commented on issue #10910: URL: https://github.com/apache/pinot/issues/10910#issuecomment-1595491068 I would prefer that we write unit tests to test the ```uploadSegment()``` method in ```PinotFSSegmentUploader``` class. Can we try to avoid sleeps in test? There is no right value

[GitHub] [pinot] Jackie-Jiang commented on issue #10872: Has pinot supported subquery?

2023-06-16 Thread via GitHub
Jackie-Jiang commented on issue #10872: URL: https://github.com/apache/pinot/issues/10872#issuecomment-1595488581 The new multi-stage query engine (with join support) should support sub-query (cc @walterddr to confirm). One concern of directly supporting sub-query in the single-stage query

[GitHub] [pinot] Jackie-Jiang commented on issue #10910: Flaky Test PinotFSSegmentUploaderTest

2023-06-16 Thread via GitHub
Jackie-Jiang commented on issue #10910: URL: https://github.com/apache/pinot/issues/10910#issuecomment-1595486217 Yeah, I can see the timeout is set pretty aggressive (100ms). We can definitely make it longer -- This is an automated message from the Apache Git Service. To respond to the m

[pinot] branch master updated (e800693dad -> 2baff8180f)

2023-06-16 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from e800693dad Avoid parsing offset when invalid (#10893) add 2baff8180f Bump jetty-server in /pinot-plugins/pinot-st

[GitHub] [pinot] Jackie-Jiang merged pull request #10908: Bump jetty-server from 9.4.45.v20220203 to 9.4.51.v20230217 in /pinot-plugins/pinot-stream-ingestion/pinot-pulsar

2023-06-16 Thread via GitHub
Jackie-Jiang merged PR #10908: URL: https://github.com/apache/pinot/pull/10908 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

[pinot] branch dependabot/maven/pinot-plugins/pinot-stream-ingestion/pinot-pulsar/org.eclipse.jetty-jetty-server-9.4.51.v20230217 deleted (was 16007e7074)

2023-06-16 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/pinot-plugins/pinot-stream-ingestion/pinot-pulsar/org.eclipse.jetty-jetty-server-9.4.51.v20230217 in repository https://gitbox.apache.org/repos/asf/pinot.git was 16007e7074

[GitHub] [pinot] codecov-commenter commented on pull request #10867: FUNNEL_COUNT Aggregation Function

2023-06-16 Thread via GitHub
codecov-commenter commented on PR #10867: URL: https://github.com/apache/pinot/pull/10867#issuecomment-1595483248 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/10867?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) R

[GitHub] [pinot] Jackie-Jiang commented on pull request #10899: Return true when _resultSet is not null

2023-06-16 Thread via GitHub
Jackie-Jiang commented on PR #10899: URL: https://github.com/apache/pinot/pull/10899#issuecomment-1595482403 Not introduced in this PR, but per the documentation, seems `executeQuery()` and `execute()` shouldn't be allowed in the `PreparedStatement`. cc @KKcorps -- This is an automated m

[GitHub] [pinot] shenyu0127 commented on pull request #10613: [feature] [null support # 10] Add null support in all transform function and pass the bitmap to upstream

2023-06-16 Thread via GitHub
shenyu0127 commented on PR #10613: URL: https://github.com/apache/pinot/pull/10613#issuecomment-1595475333 @61yao will not continue working on this PR; I will patch this PR and finish it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [pinot] mcvsubbu commented on pull request #10892: [Draft] Skip Zk Call in Segment Post Commit Phase

2023-06-16 Thread via GitHub
mcvsubbu commented on PR #10892: URL: https://github.com/apache/pinot/pull/10892#issuecomment-1595473885 > Before actually fixing this issue, I want to discuss should we allow committing segment during the gracefully shutdown period? We need a clear cutting point beyond which there should b

[GitHub] [pinot] codecov-commenter commented on pull request #10940: Fix an integer overflow bug.

2023-06-16 Thread via GitHub
codecov-commenter commented on PR #10940: URL: https://github.com/apache/pinot/pull/10940#issuecomment-1595471106 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/10940?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) R

[GitHub] [pinot] Jackie-Jiang commented on issue #10903: Does Pinot support consuming multiple pieces of data from Kafka?

2023-06-16 Thread via GitHub
Jackie-Jiang commented on issue #10903: URL: https://github.com/apache/pinot/issues/10903#issuecomment-1595465096 cc @snleee @npawar @navina -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [pinot] chenboat commented on a diff in pull request #10867: FUNNEL_COUNT Aggregation Function

2023-06-16 Thread via GitHub
chenboat commented on code in PR #10867: URL: https://github.com/apache/pinot/pull/10867#discussion_r1232868278 ## pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/FunnelCountAggregationFunction.java: ## @@ -0,0 +1,512 @@ +/** + * Licensed to the Apache

[pinot] branch master updated: Avoid parsing offset when invalid (#10893)

2023-06-16 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new e800693dad Avoid parsing offset when invalid (#10

[GitHub] [pinot] Jackie-Jiang merged pull request #10893: Avoid parsing commit response's offset field unnecessarily

2023-06-16 Thread via GitHub
Jackie-Jiang merged PR #10893: URL: https://github.com/apache/pinot/pull/10893 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

[GitHub] [pinot] wirybeaver commented on pull request #10758: Add a new controller endpoint for segment deletion with a time window

2023-06-16 Thread via GitHub
wirybeaver commented on PR #10758: URL: https://github.com/apache/pinot/pull/10758#issuecomment-1595423664 @jtao15 @snleee Could you review the PR when you are available? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [pinot] deemoliu closed pull request #10826: Upsert snapshot should be taken before new a consuming segment created

2023-06-16 Thread via GitHub
deemoliu closed pull request #10826: Upsert snapshot should be taken before new a consuming segment created URL: https://github.com/apache/pinot/pull/10826 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [pinot] deemoliu commented on pull request #10826: Upsert snapshot should be taken before new a consuming segment created

2023-06-16 Thread via GitHub
deemoliu commented on PR #10826: URL: https://github.com/apache/pinot/pull/10826#issuecomment-1595422864 Discussed with @Jackie-Jiang. the fix will be addressed in partitionUpsertMetadata manager. see #10928 -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [pinot] Jackie-Jiang commented on pull request #10892: [Draft] Skip Zk Call in Segment Post Commit Phase

2023-06-16 Thread via GitHub
Jackie-Jiang commented on PR #10892: URL: https://github.com/apache/pinot/pull/10892#issuecomment-1595422857 Before actually fixing this issue, I want to discuss should we allow committing segment during the gracefully shutdown period? We need a clear cutting point beyond which there should

[GitHub] [pinot] tibrewalpratik17 commented on a diff in pull request #10873: Use pinot-query-planner utils to extract table names in pinot-controller

2023-06-16 Thread via GitHub
tibrewalpratik17 commented on code in PR #10873: URL: https://github.com/apache/pinot/pull/10873#discussion_r1232864254 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotQueryResource.java: ## @@ -185,8 +190,10 @@ private String getMultiStageQueryR

[GitHub] [pinot] Jackie-Jiang commented on a diff in pull request #10891: [WIP]: ensure min/max value generation in the segment metadata.

2023-06-16 Thread via GitHub
Jackie-Jiang commented on code in PR #10891: URL: https://github.com/apache/pinot/pull/10891#discussion_r1232863110 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/SegmentColumnarIndexCreator.java: ## @@ -570,12 +570,14 @@ public static v

[pinot] branch master updated: Upgrade to Apache Datasketches 4.0.0 (#10878)

2023-06-16 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 9a1795c2b0 Upgrade to Apache Datasketches 4.0.0 (

[GitHub] [pinot] Jackie-Jiang merged pull request #10878: Upgrade to Apache Datasketches 4.0.0

2023-06-16 Thread via GitHub
Jackie-Jiang merged PR #10878: URL: https://github.com/apache/pinot/pull/10878 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

[GitHub] [pinot] Jackie-Jiang commented on issue #10884: returns requestId for each broker query request

2023-06-16 Thread via GitHub
Jackie-Jiang commented on issue #10884: URL: https://github.com/apache/pinot/issues/10884#issuecomment-1595412501 Broker request id is generated within the `BrokerRequestHandler`, and I think we can keep it this way, but include it in the `org.apache.pinot.common.response.BrokerResponse`.

[GitHub] [pinot] walterddr commented on pull request #10940: Fix an integer overflow bug.

2023-06-16 Thread via GitHub
walterddr commented on PR #10940: URL: https://github.com/apache/pinot/pull/10940#issuecomment-1595408871 related to #10834 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [pinot] shenyu0127 opened a new pull request, #10940: Fix an integer overflow bug.

2023-06-16 Thread via GitHub
shenyu0127 opened a new pull request, #10940: URL: https://github.com/apache/pinot/pull/10940 Currently the when the `_limit` is `Integer.MAX_VALUE`, the assertion will fail because of the integer overflow. This bug makes the `MultiStageEngineCustomTenantIntegrationTest` flaky. Teste

[GitHub] [pinot] Jackie-Jiang commented on a diff in pull request #10463: Segment compaction for upsert real-time tables

2023-06-16 Thread via GitHub
Jackie-Jiang commented on code in PR #10463: URL: https://github.com/apache/pinot/pull/10463#discussion_r1232841016 ## pinot-server/src/main/java/org/apache/pinot/server/api/resources/TablesResource.java: ## @@ -425,7 +425,7 @@ public Response downloadSegment( public Response

[pinot] branch master updated (85bb1fab54 -> b2efb8117a)

2023-06-16 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 85bb1fab54 Change list.of to immutableList.of to solve java 8 compilation (#10929) add b2efb8117a Properly set th

[GitHub] [pinot] Jackie-Jiang merged pull request #10935: Properly set the records list initial size to avoid unnecessary resizing.

2023-06-16 Thread via GitHub
Jackie-Jiang merged PR #10935: URL: https://github.com/apache/pinot/pull/10935 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

[GitHub] [pinot] codecov-commenter commented on pull request #10938: Support NULL for multi-column GROUP BY.

2023-06-16 Thread via GitHub
codecov-commenter commented on PR #10938: URL: https://github.com/apache/pinot/pull/10938#issuecomment-1595365838 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/10938?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) R

[GitHub] [pinot] codecov-commenter commented on pull request #10939: Fix the NULL ordering in TableResizer for GROUP BY.

2023-06-16 Thread via GitHub
codecov-commenter commented on PR #10939: URL: https://github.com/apache/pinot/pull/10939#issuecomment-1595364737 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/10939?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) R

[GitHub] [pinot] tibrewalpratik17 commented on pull request #10933: Fixing table name extraction for lateral join queries

2023-06-16 Thread via GitHub
tibrewalpratik17 commented on PR #10933: URL: https://github.com/apache/pinot/pull/10933#issuecomment-1595337996 @xiangfu0 thanks for this! Just fyi we are planning to move away from this flow in #10873. -- This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [pinot] codecov-commenter commented on pull request #10935: Properly set the records list initial size to avoid unnecessary resizing.

2023-06-16 Thread via GitHub
codecov-commenter commented on PR #10935: URL: https://github.com/apache/pinot/pull/10935#issuecomment-1595338078 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/10935?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) R

[GitHub] [pinot] shenyu0127 opened a new pull request, #10939: Fix the NULL ordering in TableResizer for GROUP BY.

2023-06-16 Thread via GitHub
shenyu0127 opened a new pull request, #10939: URL: https://github.com/apache/pinot/pull/10939 Needs to rebase on top of https://github.com/apache/pinot/pull/10938 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [pinot] shenyu0127 opened a new pull request, #10938: Support NULL for multi-column GROUP BY.

2023-06-16 Thread via GitHub
shenyu0127 opened a new pull request, #10938: URL: https://github.com/apache/pinot/pull/10938 Tested in unit tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [pinot] ankitsultana commented on a diff in pull request #10937: [WIP] New API to get tenant tags

2023-06-16 Thread via GitHub
ankitsultana commented on code in PR #10937: URL: https://github.com/apache/pinot/pull/10937#discussion_r1232774116 ## pinot-server/src/main/java/org/apache/pinot/server/api/resources/InstanceTagResource.java: ## @@ -0,0 +1,70 @@ +/** + * Licensed to the Apache Software Foundati

[GitHub] [pinot] ankitsultana commented on a diff in pull request #10937: [WIP] New API to get tenant tags

2023-06-16 Thread via GitHub
ankitsultana commented on code in PR #10937: URL: https://github.com/apache/pinot/pull/10937#discussion_r1232772020 ## pinot-common/src/main/java/org/apache/pinot/common/metadata/ZKMetadataProvider.java: ## @@ -10,7 +10,7 @@ * http://www.apache.org/licenses/LICENSE-2.0 *

[GitHub] [pinot] npuppala111 opened a new pull request, #10937: [WIP] New API to get tenant tags

2023-06-16 Thread via GitHub
npuppala111 opened a new pull request, #10937: URL: https://github.com/apache/pinot/pull/10937 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [pinot] jbewing opened a new pull request, #10936: Fix casting when prefetching mmap'd segment larger than 2GB

2023-06-16 Thread via GitHub
jbewing opened a new pull request, #10936: URL: https://github.com/apache/pinot/pull/10936 ### What This PR fixes a bug which may trigger when an mmap'd segment larger than 2GB (Integer.MAX_VALUE bytes) is prefetched by SegmentLocalFSDirectory. There is an (outdated) comment above

[GitHub] [pinot] shenyu0127 opened a new pull request, #10935: Properly set the records list initial size to avoid unnecessary resizing.

2023-06-16 Thread via GitHub
shenyu0127 opened a new pull request, #10935: URL: https://github.com/apache/pinot/pull/10935 Tested in unit tests. @Jackie-Jiang identified this unnecessary resizing issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [pinot] zhuangdaz opened a new issue, #10934: TEXT_CONTAINS fails with NullPointerException

2023-06-16 Thread via GitHub
zhuangdaz opened a new issue, #10934: URL: https://github.com/apache/pinot/issues/10934 I have a col enabled with native text index and my query fails with the following exception: ``` [ { "errorCode": 200, "message": "QueryExecutionError:\njava.lang.RuntimeException

[GitHub] [pinot] codecov-commenter commented on pull request #10933: Fixing table name extraction for lateral join queries

2023-06-16 Thread via GitHub
codecov-commenter commented on PR #10933: URL: https://github.com/apache/pinot/pull/10933#issuecomment-1595188546 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/10933?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) R

[GitHub] [pinot] xiangfu0 commented on a diff in pull request #10933: Fixing table name extraction for lateral join queries

2023-06-16 Thread via GitHub
xiangfu0 commented on code in PR #10933: URL: https://github.com/apache/pinot/pull/10933#discussion_r1232628210 ## pinot-query-runtime/src/test/resources/queries/BasicQuery.json: ## @@ -61,6 +61,11 @@ { "description": "Correlated subquery test", "sql": "

[GitHub] [pinot] Jackie-Jiang closed issue #10875: Adding new column as noDictionaryColumn to existing table causes query-time exceptions

2023-06-16 Thread via GitHub
Jackie-Jiang closed issue #10875: Adding new column as noDictionaryColumn to existing table causes query-time exceptions URL: https://github.com/apache/pinot/issues/10875 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [pinot] Jackie-Jiang commented on issue #10875: Adding new column as noDictionaryColumn to existing table causes query-time exceptions

2023-06-16 Thread via GitHub
Jackie-Jiang commented on issue #10875: URL: https://github.com/apache/pinot/issues/10875#issuecomment-1595150238 Verified that #10851 fixed the issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [pinot] Jackie-Jiang commented on issue #10828: Enhance TableSize API to return compressed size in deep store

2023-06-16 Thread via GitHub
Jackie-Jiang commented on issue #10828: URL: https://github.com/apache/pinot/issues/10828#issuecomment-1595147866 @eaugene The compressed segment size should already been persisted within the segment ZK metadata under the key `segment.size.in.bytes`. See #8358 for more details -- This is

[GitHub] [pinot] shenyu0127 commented on pull request #10914: Fix the NULL ordering in object single column distinct executors.

2023-06-16 Thread via GitHub
shenyu0127 commented on PR #10914: URL: https://github.com/apache/pinot/pull/10914#issuecomment-1595143454 > Should we consider doing the same trick as primitive data types by tracking a `_hasNull` flag to avoid the extra null handling? That way the behavior is consistent across all data ty

[GitHub] [pinot] navina commented on issue #10452: Support delete record with upsert table

2023-06-16 Thread via GitHub
navina commented on issue #10452: URL: https://github.com/apache/pinot/issues/10452#issuecomment-1595141414 Thanks for the review @mcvsubbu . I have addressed your feedback. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [pinot] xiangfu0 opened a new pull request, #10933: Fixing table name extraction for lateral join queries

2023-06-16 Thread via GitHub
xiangfu0 opened a new pull request, #10933: URL: https://github.com/apache/pinot/pull/10933 - Fixing table name extraction for lateral join queries - Adding test examples for lateral join -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [pinot] Aravind-Suresh commented on a diff in pull request #10897: Fixes SQL wildcard escaping in LIKE queries

2023-06-16 Thread via GitHub
Aravind-Suresh commented on code in PR #10897: URL: https://github.com/apache/pinot/pull/10897#discussion_r1228963312 ## pinot-common/src/main/java/org/apache/pinot/common/utils/RegexpPatternConverterUtils.java: ## @@ -64,24 +71,42 @@ public static String likeToRegexpLike(String

[GitHub] [pinot] lucifer4j opened a new pull request, #10932: Make org.apache.pinot.client.BrokerResponse public

2023-06-16 Thread via GitHub
lucifer4j opened a new pull request, #10932: URL: https://github.com/apache/pinot/pull/10932 bugfix #10924 The org.apache.pinot.client.PinotClientTransport class is an interface to implement the client transport for Pinot Java Client connections. Currently, there is a default implem

[GitHub] [pinot] walterddr commented on a diff in pull request #10930: [multistage] Do Not Log Entire Plan in QueryServer

2023-06-16 Thread via GitHub
walterddr commented on code in PR #10930: URL: https://github.com/apache/pinot/pull/10930#discussion_r1232312062 ## pinot-query-runtime/src/main/java/org/apache/pinot/query/service/QueryServer.java: ## @@ -100,7 +100,7 @@ public void submit(Worker.QueryRequest request, StreamOb

[GitHub] [pinot] walterddr commented on a diff in pull request #10930: [multistage] Do Not Log Entire Plan in QueryServer

2023-06-16 Thread via GitHub
walterddr commented on code in PR #10930: URL: https://github.com/apache/pinot/pull/10930#discussion_r1232312062 ## pinot-query-runtime/src/main/java/org/apache/pinot/query/service/QueryServer.java: ## @@ -100,7 +100,7 @@ public void submit(Worker.QueryRequest request, StreamOb

[GitHub] [pinot] AnhQuanTran commented on issue #10931: Stream ingestion Kafka to Pinot error invalid utf-8 start byte

2023-06-16 Thread via GitHub
AnhQuanTran commented on issue #10931: URL: https://github.com/apache/pinot/issues/10931#issuecomment-1594232837 @mayankshriv Can u help me, bro? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [pinot] AnhQuanTran opened a new issue, #10931: Stream ingestion Kafka to Pinot error invalid utf-8 start byte

2023-06-16 Thread via GitHub
AnhQuanTran opened a new issue, #10931: URL: https://github.com/apache/pinot/issues/10931 Hi everyone, Pinot version: 0.12.1 Java JDK: 11 I tried to ingestion data realtime from kafka to pinot with 2 cases: **Case 1: It work like charm** `{"event":{"header": "v1","body"