Re: [PR] Cache configs for logical table context in server [pinot]

2025-06-09 Thread via GitHub
abhishekbafna commented on code in PR #15881: URL: https://github.com/apache/pinot/pull/15881#discussion_r2136904193 ## pinot-spi/src/main/java/org/apache/pinot/spi/utils/CommonConstants.java: ## @@ -1702,4 +1702,14 @@ public static class Groovy { public static final String

Re: [PR] Reject rebalance requests for tables that already have an in progress rebalance job [pinot]

2025-06-09 Thread via GitHub
yashmayya commented on code in PR #15990: URL: https://github.com/apache/pinot/pull/15990#discussion_r2136901895 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableRestletResource.java: ## @@ -783,29 +781,7 @@ public List cancelRebalance(

Re: [PR] Make OOM Protection work with GRPC Queries [pinot]

2025-06-09 Thread via GitHub
vrajat commented on code in PR #16004: URL: https://github.com/apache/pinot/pull/16004#discussion_r2136881578 ## pinot-spi/src/main/java/org/apache/pinot/spi/trace/Tracing.java: ## @@ -172,22 +171,23 @@ public InvocationRecording activeRecording() { */ public static class

Re: [PR] Make OOM Protection work with GRPC Queries [pinot]

2025-06-09 Thread via GitHub
vrajat commented on code in PR #16004: URL: https://github.com/apache/pinot/pull/16004#discussion_r2136894900 ## pinot-core/src/main/java/org/apache/pinot/core/accounting/PerQueryCPUMemAccountantFactory.java: ## @@ -310,22 +325,26 @@ public void setThreadResourceUsageProvider(T

[I] Fix OOM Cancellation in MSE [pinot]

2025-06-09 Thread via GitHub
vrajat opened a new issue, #16060: URL: https://github.com/apache/pinot/issues/16060 `QueryServer` in MSE submits work asynchronously. OOM protection framework assumes that there is a runner thread which is waiting for all the worker threads. The framework cancels the runner thread if

Re: [PR] [upsert] Ensure consistent creation time to prevent data inconsistency across replicas [pinot]

2025-06-09 Thread via GitHub
ankitsultana commented on code in PR #16034: URL: https://github.com/apache/pinot/pull/16034#discussion_r2136837250 ## pinot-segment-spi/src/main/java/org/apache/pinot/segment/spi/index/metadata/SegmentMetadataImpl.java: ## @@ -380,6 +381,23 @@ public long getIndexCreationTime()

[I] Create a request or correlation id for server GRPC requests [pinot]

2025-06-09 Thread via GitHub
vrajat opened a new issue, #16059: URL: https://github.com/apache/pinot/issues/16059 Request and correlation ids are created in the broker. The server may generate mangled versions for its own use. However queries that are submitted directly to server GRPC end points do not have a request/q

(pinot) branch master updated: [multistage] Handle Column Less Tuples in BlockSplitter (#16058)

2025-06-09 Thread chrispeck
This is an automated email from the ASF dual-hosted git repository. chrispeck pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new a5bc956fb0 [multistage] Handle Column Less Tup

Re: [PR] [upsert] Ensure consistent creation time to prevent data inconsistency across replicas [pinot]

2025-06-09 Thread via GitHub
ankitsultana commented on PR #16034: URL: https://github.com/apache/pinot/pull/16034#issuecomment-2957578386 @tarun11Mavani : can you fix the UTs too? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Tenant Rebalance API Improvement [pinot]

2025-06-09 Thread via GitHub
somandal commented on code in PR #15891: URL: https://github.com/apache/pinot/pull/15891#discussion_r2136697454 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/RebalanceConfig.java: ## @@ -32,9 +32,9 @@ public class RebalanceConfig { public

Re: [PR] [multistage] Handle Column Less Tuples in BlockSplitter [pinot]

2025-06-09 Thread via GitHub
itschrispeck merged PR #16058: URL: https://github.com/apache/pinot/pull/16058 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] [multistage] Handle Column Less Tuples in BlockSplitter [pinot]

2025-06-09 Thread via GitHub
codecov-commenter commented on PR #16058: URL: https://github.com/apache/pinot/pull/16058#issuecomment-2957420369 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/16058?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Tenant Rebalance API Improvement [pinot]

2025-06-09 Thread via GitHub
J-HowHuang commented on code in PR #15891: URL: https://github.com/apache/pinot/pull/15891#discussion_r2136712870 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/RebalanceConfig.java: ## @@ -32,9 +32,9 @@ public class RebalanceConfig { publi

[PR] [multistage] Handle Column Less Tuples in BlockSplitter [pinot]

2025-06-09 Thread via GitHub
ankitsultana opened a new pull request, #16058: URL: https://github.com/apache/pinot/pull/16058 Small change to fix broken support for column less tuples. This issue was caught while I was working on #15958. Not adding new tests for this since it will be covered by #15958. --

Re: [PR] Tenant Rebalance API Improvement [pinot]

2025-06-09 Thread via GitHub
somandal commented on code in PR #15891: URL: https://github.com/apache/pinot/pull/15891#discussion_r2136695381 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTenantRestletResource.java: ## @@ -690,9 +686,46 @@ public SuccessResponse deleteTenan

Re: [PR] Tenant Rebalance API Improvement [pinot]

2025-06-09 Thread via GitHub
J-HowHuang commented on code in PR #15891: URL: https://github.com/apache/pinot/pull/15891#discussion_r2136690876 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTenantRestletResource.java: ## @@ -690,9 +686,46 @@ public SuccessResponse deleteTen

Re: [PR] Support set default tier configurations from cluster server config [pinot]

2025-06-09 Thread via GitHub
Jackie-Jiang commented on PR #15998: URL: https://github.com/apache/pinot/pull/15998#issuecomment-2957225040 @klsince Can you help take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Tenant Rebalance API Improvement [pinot]

2025-06-09 Thread via GitHub
J-HowHuang commented on code in PR #15891: URL: https://github.com/apache/pinot/pull/15891#discussion_r2136686546 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/RebalanceConfig.java: ## @@ -32,9 +32,9 @@ public class RebalanceConfig { publi

Re: [PR] Tenant Rebalance API Improvement [pinot]

2025-06-09 Thread via GitHub
J-HowHuang commented on code in PR #15891: URL: https://github.com/apache/pinot/pull/15891#discussion_r2136687663 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/rebalance/tenant/TenantRebalanceConfig.java: ## @@ -27,18 +27,32 @@ public class Tenant

Re: [PR] Tenant Rebalance API Improvement [pinot]

2025-06-09 Thread via GitHub
somandal commented on code in PR #15891: URL: https://github.com/apache/pinot/pull/15891#discussion_r213857 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTenantRestletResource.java: ## @@ -690,9 +686,46 @@ public SuccessResponse deleteTenan

Re: [PR] Handle null Geometry gracefully In H3Index [pinot]

2025-06-09 Thread via GitHub
Jackie-Jiang commented on code in PR #16002: URL: https://github.com/apache/pinot/pull/16002#discussion_r2136632610 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/creator/impl/inv/geospatial/BaseH3IndexCreator.java: ## @@ -104,12 +106,25 @@ public ab

Re: [PR] Make dedup table use StrictRealtimeSegmentAssignment with support of multi tiers [pinot]

2025-06-09 Thread via GitHub
somandal commented on code in PR #16017: URL: https://github.com/apache/pinot/pull/16017#discussion_r2136567027 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/assignment/segment/MultiTierStrictRealtimeSegmentAssignment.java: ## @@ -0,0 +1,87 @@ +/** + *

Re: [PR] Make dedup table use StrictRealtimeSegmentAssignment with support of multi tiers [pinot]

2025-06-09 Thread via GitHub
somandal commented on code in PR #16017: URL: https://github.com/apache/pinot/pull/16017#discussion_r2136612615 ## pinot-controller/src/test/java/org/apache/pinot/controller/helix/core/assignment/segment/StrictRealtimeSegmentAssignmentTest.java: ## @@ -255,9 +279,74 @@ public vo

[I] Deprecation of parallelWhitelist/parallelBlacklist in favor of allowTables/blockTables in Tenant Rebalance API [pinot]

2025-06-09 Thread via GitHub
J-HowHuang opened a new issue, #16057: URL: https://github.com/apache/pinot/issues/16057 ### Background In the Tenant Rebalance API, the parameters `parallelWhitelist` and `parallelBlacklist` have been used to categorize tables into the parallel or sequential queue for rebalance operatio

(pinot) branch master updated (c96c318ef8 -> 064a86c647)

2025-06-09 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from c96c318ef8 Enhance TableConfig and Schema validation (#16025) add 064a86c647 Fix exception message in PinotDataTyp

Re: [PR] Fix exception message in PinotDataType.BYTE.toTimestamp [pinot]

2025-06-09 Thread via GitHub
Jackie-Jiang merged PR #16054: URL: https://github.com/apache/pinot/pull/16054 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Make dedup table use StrictRealtimeSegmentAssignment with support of multi tiers [pinot]

2025-06-09 Thread via GitHub
somandal commented on code in PR #16017: URL: https://github.com/apache/pinot/pull/16017#discussion_r2136567027 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/assignment/segment/MultiTierStrictRealtimeSegmentAssignment.java: ## @@ -0,0 +1,87 @@ +/** + *

(pinot) branch dependabot/maven/org.codehaus.plexus-plexus-utils-4.0.2 deleted (was de91b3d6e2)

2025-06-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.codehaus.plexus-plexus-utils-4.0.2 in repository https://gitbox.apache.org/repos/asf/pinot.git was de91b3d6e2 Bump org.codehaus.plexus:plexus-utils from 3.6.0 to 4.

Re: [PR] Add config for logging queries before processing on broker instances [pinot]

2025-06-09 Thread via GitHub
codecov-commenter commented on PR #16056: URL: https://github.com/apache/pinot/pull/16056#issuecomment-2957125406 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/16056?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Bump org.codehaus.plexus:plexus-utils from 3.6.0 to 4.0.2 [pinot]

2025-06-09 Thread via GitHub
Jackie-Jiang closed pull request #16048: Bump org.codehaus.plexus:plexus-utils from 3.6.0 to 4.0.2 URL: https://github.com/apache/pinot/pull/16048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Enhance TableConfig and Schema validation [pinot]

2025-06-09 Thread via GitHub
Jackie-Jiang merged PR #16025: URL: https://github.com/apache/pinot/pull/16025 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Reject rebalance requests for tables that already have an in progress rebalance job [pinot]

2025-06-09 Thread via GitHub
somandal commented on code in PR #15990: URL: https://github.com/apache/pinot/pull/15990#discussion_r2136337151 ## pinot-tools/src/main/java/org/apache/pinot/tools/PinotTableRebalancer.java: ## @@ -55,7 +57,12 @@ public PinotTableRebalancer(String zkAddress, String clusterName,

Re: [PR] Bump org.codehaus.plexus:plexus-utils from 3.6.0 to 4.0.2 [pinot]

2025-06-09 Thread via GitHub
dependabot[bot] commented on PR #16048: URL: https://github.com/apache/pinot/pull/16048#issuecomment-2957054792 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

[PR] Add config for logging queries before processing on broker instances [pinot]

2025-06-09 Thread via GitHub
dinoocch opened a new pull request, #16056: URL: https://github.com/apache/pinot/pull/16056 #15264 switches this query log statement to INFO level. This makes excellent sense for clusters with very variable query patterns or few overall qps, but we have some clusters for which this ex

Re: [PR] Make OOM Protection work with GRPC Queries [pinot]

2025-06-09 Thread via GitHub
vvivekiyer commented on code in PR #16004: URL: https://github.com/apache/pinot/pull/16004#discussion_r2136151788 ## pinot-core/src/main/java/org/apache/pinot/core/accounting/PerQueryCPUMemAccountantFactory.java: ## @@ -310,22 +325,26 @@ public void setThreadResourceUsageProvid

Re: [PR] Fix exception message in PinotDataType.BYTE.toTimestamp [pinot]

2025-06-09 Thread via GitHub
codecov-commenter commented on PR #16054: URL: https://github.com/apache/pinot/pull/16054#issuecomment-2956609345 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/16054?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[I] Incorrect expression rewrites involving SUM and CASE to FILTER [pinot]

2025-06-09 Thread via GitHub
songwdfu opened a new issue, #16055: URL: https://github.com/apache/pinot/issues/16055 Currently in Pinot, SUM0 is actually implemented using SUM. Current PinotAggregateReduceFunctionsRule + AggregateCaseToFilterRule results in the following behavior for queries like these: **

Re: [I] Pinot fanout constant queries to all servers which could cause unexpected DNS query spikes [pinot]

2025-06-09 Thread via GitHub
pengding-stripe commented on issue #16024: URL: https://github.com/apache/pinot/issues/16024#issuecomment-2956509678 thanks @ankitsultana, I feel this option should be default to true for this case? Our queries are sent from the user, it's hard for us to validate all of them and users could

[PR] Fix exception message in PinotDataType.BYTE.toTimestamp [pinot]

2025-06-09 Thread via GitHub
ayesheepatra07 opened a new pull request, #16054: URL: https://github.com/apache/pinot/pull/16054 toTimestamp(Object) method of the BYTE enum constant within PinotDataType has a typo where the exception text reads “Cannot convert value from BOOLEAN to TIMESTAMP", updated message to say BYTE

Re: [I] Pinot fanout constant queries to all servers which could cause unexpected DNS query spikes [pinot]

2025-06-09 Thread via GitHub
ankitsultana commented on issue #16024: URL: https://github.com/apache/pinot/issues/16024#issuecomment-2956420372 @pengding-stripe : the new MSE Query Optimizer is capable of handling this if you set `useBrokerPruning=true` in the query options: https://github.com/apache/pinot/pull/15959

[I] Make storage quota check more resilient [pinot]

2025-06-09 Thread via GitHub
jtao15 opened a new issue, #16053: URL: https://github.com/apache/pinot/issues/16053 The storage quota check during segment upload currently requires retrieving segment sizes from all servers for the table. If any server is unresponsive, the quota check fails and blocks segment pushes. We s

Re: [PR] add guava as dep in pinot-s3 [pinot]

2025-06-09 Thread via GitHub
codecov-commenter commented on PR #16052: URL: https://github.com/apache/pinot/pull/16052#issuecomment-2956290960 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/16052?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] [upsert] Ensure consistent creation time to prevent data inconsistency across replicas [pinot]

2025-06-09 Thread via GitHub
tarun11Mavani commented on code in PR #16034: URL: https://github.com/apache/pinot/pull/16034#discussion_r2136014001 ## pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/RealtimeTableDataManager.java: ## @@ -830,12 +834,61 @@ public void replaceConsumingSegmen

[PR] add guava as dep in pinot-s3 [pinot]

2025-06-09 Thread via GitHub
jadami10 opened a new pull request, #16052: URL: https://github.com/apache/pinot/pull/16052 This is a small dep fix to specify the dependency in `pinot-s3` for guava. It is used in `S3PinotFS.java` and `S3Config.java`. Our own internal build started failing at compile time without this when

Re: [PR] Continue Segment Reset post instance errors [pinot]

2025-06-09 Thread via GitHub
noob-se7en commented on code in PR #15903: URL: https://github.com/apache/pinot/pull/15903#discussion_r2135819344 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/PinotHelixResourceManager.java: ## @@ -2958,15 +2958,31 @@ public void resetSegment(String t

[PR] Make ThreadResourceUsageProvide a Helper/Utility Class. [pinot]

2025-06-09 Thread via GitHub
vrajat opened a new pull request, #16051: URL: https://github.com/apache/pinot/pull/16051 Closes #16042 Instructions: 1. The PR has to be tagged with at least one of the following labels (*): 1. `feature` 2. `bugfix` 3. `performance` 4. `ui` 5. `backwa

(pinot) branch dependabot/maven/com.microsoft.azure-msal4j-1.21.0 deleted (was 5eddf7a1e0)

2025-06-09 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a change to branch dependabot/maven/com.microsoft.azure-msal4j-1.21.0 in repository https://gitbox.apache.org/repos/asf/pinot.git was 5eddf7a1e0 Bump com.microsoft.azure:msal4j from 1.20.1 to 1.21.0 The r

Re: [PR] Bump com.gradle:common-custom-user-data-maven-extension from 2.0.2 to 2.0.3 [pinot]

2025-06-09 Thread via GitHub
yashmayya merged PR #16049: URL: https://github.com/apache/pinot/pull/16049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.ap

Re: [PR] Bump software.amazon.awssdk:bom from 2.31.58 to 2.31.59 [pinot]

2025-06-09 Thread via GitHub
yashmayya merged PR #16047: URL: https://github.com/apache/pinot/pull/16047 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.ap

(pinot) branch master updated (7572b182cf -> e1d519fca6)

2025-06-09 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 7572b182cf Bump com.microsoft.azure:msal4j from 1.20.1 to 1.21.0 (#16050) add e1d519fca6 Bump com.gradle:commo

(pinot) branch dependabot/maven/com.gradle-common-custom-user-data-maven-extension-2.0.3 deleted (was 80b14d2c33)

2025-06-09 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a change to branch dependabot/maven/com.gradle-common-custom-user-data-maven-extension-2.0.3 in repository https://gitbox.apache.org/repos/asf/pinot.git was 80b14d2c33 Bump com.gradle:common-custom-user-da

(pinot) branch master updated (95a1365751 -> 7572b182cf)

2025-06-09 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 95a1365751 Bump software.amazon.awssdk:bom from 2.31.58 to 2.31.59 (#16047) add 7572b182cf Bump com.microsoft.

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.31.59 deleted (was 1600f2476e)

2025-06-09 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.31.59 in repository https://gitbox.apache.org/repos/asf/pinot.git was 1600f2476e Bump software.amazon.awssdk:bom from 2.31.58 to 2.31.59 Th

Re: [PR] Bump com.microsoft.azure:msal4j from 1.20.1 to 1.21.0 [pinot]

2025-06-09 Thread via GitHub
yashmayya merged PR #16050: URL: https://github.com/apache/pinot/pull/16050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.ap

(pinot) branch master updated: Bump software.amazon.awssdk:bom from 2.31.58 to 2.31.59 (#16047)

2025-06-09 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 95a1365751 Bump software.amazon.awssdk:bom fro

[PR] Bump com.microsoft.azure:msal4j from 1.20.1 to 1.21.0 [pinot]

2025-06-09 Thread via GitHub
dependabot[bot] opened a new pull request, #16050: URL: https://github.com/apache/pinot/pull/16050 Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.20.1 to 1.21.0. Changelog Sourced from https://github.com/AzureAD/micr

(pinot) branch dependabot/maven/com.microsoft.azure-msal4j-1.21.0 created (now 5eddf7a1e0)

2025-06-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/com.microsoft.azure-msal4j-1.21.0 in repository https://gitbox.apache.org/repos/asf/pinot.git at 5eddf7a1e0 Bump com.microsoft.azure:msal4j from 1.20.1 to 1.21.0 No n

(pinot) branch dependabot/maven/com.gradle-common-custom-user-data-maven-extension-2.0.3 created (now 80b14d2c33)

2025-06-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/com.gradle-common-custom-user-data-maven-extension-2.0.3 in repository https://gitbox.apache.org/repos/asf/pinot.git at 80b14d2c33 Bump com.gradle:common-custom-user-d

[PR] Bump org.codehaus.plexus:plexus-utils from 3.6.0 to 4.0.2 [pinot]

2025-06-09 Thread via GitHub
dependabot[bot] opened a new pull request, #16048: URL: https://github.com/apache/pinot/pull/16048 Bumps [org.codehaus.plexus:plexus-utils](https://github.com/codehaus-plexus/plexus-utils) from 3.6.0 to 4.0.2. Release notes Sourced from https://github.com/codehaus-plexus/plexus-ut

[PR] Bump com.gradle:common-custom-user-data-maven-extension from 2.0.2 to 2.0.3 [pinot]

2025-06-09 Thread via GitHub
dependabot[bot] opened a new pull request, #16049: URL: https://github.com/apache/pinot/pull/16049 Bumps [com.gradle:common-custom-user-data-maven-extension](https://github.com/gradle/common-custom-user-data-maven-extension) from 2.0.2 to 2.0.3. Release notes Sourced from https://

(pinot) branch dependabot/maven/org.codehaus.plexus-plexus-utils-4.0.2 created (now de91b3d6e2)

2025-06-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.codehaus.plexus-plexus-utils-4.0.2 in repository https://gitbox.apache.org/repos/asf/pinot.git at de91b3d6e2 Bump org.codehaus.plexus:plexus-utils from 3.6.0 to 4.

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.31.59 created (now 1600f2476e)

2025-06-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.31.59 in repository https://gitbox.apache.org/repos/asf/pinot.git at 1600f2476e Bump software.amazon.awssdk:bom from 2.31.58 to 2.31.59 N

[PR] Bump software.amazon.awssdk:bom from 2.31.58 to 2.31.59 [pinot]

2025-06-09 Thread via GitHub
dependabot[bot] opened a new pull request, #16047: URL: https://github.com/apache/pinot/pull/16047 Bumps software.amazon.awssdk:bom from 2.31.58 to 2.31.59. Most Recent Ignore Conditions Applied to This Pull Request | Dependency Name | Ignore Conditions | | --- | --- |

Re: [PR] Cache configs for logical table context in server [pinot]

2025-06-09 Thread via GitHub
yashmayya commented on code in PR #15881: URL: https://github.com/apache/pinot/pull/15881#discussion_r2135609876 ## pinot-controller/src/test/java/org/apache/pinot/controller/helix/LogicalTableMetadataCacheTest.java: ## @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache Software

Re: [PR] Cache configs for logical table context in server [pinot]

2025-06-09 Thread via GitHub
yashmayya commented on code in PR #15881: URL: https://github.com/apache/pinot/pull/15881#discussion_r2135608841 ## pinot-controller/src/test/java/org/apache/pinot/controller/helix/LogicalTableMetadataCacheTest.java: ## @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache Software

Re: [PR] Cache configs for logical table context in server [pinot]

2025-06-09 Thread via GitHub
yashmayya commented on code in PR #15881: URL: https://github.com/apache/pinot/pull/15881#discussion_r2135604254 ## pinot-controller/src/test/java/org/apache/pinot/controller/helix/LogicalTableMetadataCacheTest.java: ## @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache Software

Re: [PR] Cache configs for logical table context in server [pinot]

2025-06-09 Thread via GitHub
yashmayya commented on code in PR #15881: URL: https://github.com/apache/pinot/pull/15881#discussion_r2135600671 ## pinot-spi/src/main/java/org/apache/pinot/spi/utils/CommonConstants.java: ## @@ -1702,4 +1702,14 @@ public static class Groovy { public static final String GRO

Re: [PR] Improve controller job ZK metadata cleanup logic [pinot]

2025-06-09 Thread via GitHub
codecov-commenter commented on PR #16046: URL: https://github.com/apache/pinot/pull/16046#issuecomment-2955525657 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/16046?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Adding changes for supporting RLS [pinot]

2025-06-09 Thread via GitHub
vrajat commented on code in PR #16043: URL: https://github.com/apache/pinot/pull/16043#discussion_r2135513783 ## pinot-broker/src/main/java/org/apache/pinot/broker/broker/BasicAuthAccessControlFactory.java: ## @@ -129,12 +132,43 @@ public TableAuthorizationResult authorize(Requ

[PR] Improve controller job ZK metadata cleanup logic [pinot]

2025-06-09 Thread via GitHub
yashmayya opened a new pull request, #16046: URL: https://github.com/apache/pinot/pull/16046 - Builds on top of https://github.com/apache/pinot/pull/15990/ and fixes https://github.com/apache/pinot/issues/16005. - Adds four new controller configs (one for each controller job type) to con

Re: [PR] Fix null join key matching in multi-stage hash joins [pinot]

2025-06-09 Thread via GitHub
yashmayya commented on code in PR #16038: URL: https://github.com/apache/pinot/pull/16038#discussion_r2135395629 ## pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/operator/HashJoinOperator.java: ## @@ -234,6 +289,11 @@ private List buildJoinedDataBlockAnti(Mse

Re: [PR] Fix null join key matching in multi-stage hash joins [pinot]

2025-06-09 Thread via GitHub
yashmayya commented on code in PR #16038: URL: https://github.com/apache/pinot/pull/16038#discussion_r2135395629 ## pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/operator/HashJoinOperator.java: ## @@ -234,6 +289,11 @@ private List buildJoinedDataBlockAnti(Mse

Re: [PR] Fix null join key matching in multi-stage hash joins [pinot]

2025-06-09 Thread via GitHub
yashmayya commented on code in PR #16038: URL: https://github.com/apache/pinot/pull/16038#discussion_r2135395629 ## pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/operator/HashJoinOperator.java: ## @@ -234,6 +289,11 @@ private List buildJoinedDataBlockAnti(Mse

Re: [PR] Adds remove ingestion-metrics API [pinot]

2025-06-09 Thread via GitHub
codecov-commenter commented on PR #16045: URL: https://github.com/apache/pinot/pull/16045#issuecomment-2955253510 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/16045?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Fix null join key matching in multi-stage hash joins [pinot]

2025-06-09 Thread via GitHub
yashmayya commented on code in PR #16038: URL: https://github.com/apache/pinot/pull/16038#discussion_r2135359159 ## pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/operator/HashJoinOperator.java: ## @@ -98,8 +104,36 @@ public String toExplainString() { protec

Re: [PR] Fail the config file reading if there are duplicated keys in the file [pinot]

2025-06-09 Thread via GitHub
xiangfu0 commented on code in PR #15648: URL: https://github.com/apache/pinot/pull/15648#discussion_r2135334331 ## pinot-spi/src/main/java/org/apache/pinot/spi/env/CommonsConfigurationUtils.java: ## @@ -170,6 +178,34 @@ public static PropertiesConfiguration fromFile(@Nullable F

Re: [PR] Fix null join key matching in multi-stage hash joins [pinot]

2025-06-09 Thread via GitHub
gortiz commented on code in PR #16038: URL: https://github.com/apache/pinot/pull/16038#discussion_r2135199476 ## pinot-query-runtime/src/main/java/org/apache/pinot/query/runtime/operator/HashJoinOperator.java: ## @@ -59,16 +60,21 @@ public class HashJoinOperator extends BaseJoin

[PR] Adds ingestion-metrics remove API [pinot]

2025-06-09 Thread via GitHub
noob-se7en opened a new pull request, #16045: URL: https://github.com/apache/pinot/pull/16045 **Problem Statement:** Sometimes due to changes like table rebalance/changes in upstream partitions lead to ingestion metrics not being cleaned up on servers. This leads to servers emitting inge

[PR] set skipInvalidJson default value to true [pinot]

2025-06-09 Thread via GitHub
wirybeaver opened a new pull request, #16044: URL: https://github.com/apache/pinot/pull/16044 Meant to introduce instance level config to specify the skipInvalidJson's default value. When instance level's default value is not null and table config's default value is null, we will use the in

[PR] Adding changes for supporting RLS [pinot]

2025-06-09 Thread via GitHub
9aman opened a new pull request, #16043: URL: https://github.com/apache/pinot/pull/16043 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail

[I] Change ThreadResourceUsageProvider to a utility or helper class [pinot]

2025-06-09 Thread via GitHub
vrajat opened a new issue, #16042: URL: https://github.com/apache/pinot/issues/16042 For every query execution thread, a ThreadResourceUsageProvider is created. Example for a worker: ``` public static void setupWorker(int taskId, ThreadExecutionContext.TaskType taskType,