Re: [PR] Add auth info while querying auth enabled broker endpoints from the controller [pinot]

2025-04-07 Thread via GitHub
codecov-commenter commented on PR #15486: URL: https://github.com/apache/pinot/pull/15486#issuecomment-2785318820 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/15486?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[PR] Add auth info while querying auth enabled broker endpoints from the controller [pinot]

2025-04-07 Thread via GitHub
rajagopr opened a new pull request, #15486: URL: https://github.com/apache/pinot/pull/15486 ## Description Changes are to pass the auth info while querying the broker endpoint from the controller. Without this change, the call to the broker endpoint `/debug/timeBoundary/{tableName}` fail

(pinot) branch master updated: Set InstanceType for OOM Protection during startup (#15374)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 88de1b7eba Set InstanceType for OOM Protection du

(pinot) branch master updated (be5c50e853 -> 5d7e843de7)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from be5c50e853 Bump org.webjars:swagger-ui from 5.20.3 to 5.20.6 (#15476) add 5d7e843de7 Bump software.amazon.awssdk:b

Re: [PR] STP-3739: Segment files batch deletion. [pinot]

2025-04-07 Thread via GitHub
abhishekbafna commented on code in PR #15473: URL: https://github.com/apache/pinot/pull/15473#discussion_r2032362232 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/SegmentDeletionManager.java: ## @@ -241,55 +290,64 @@ protected void removeSegmentFromSto

[PR] Fix httpsSegmentFetcher to use the configurable timeouts [pinot]

2025-04-07 Thread via GitHub
vvivekiyer opened a new pull request, #15485: URL: https://github.com/apache/pinot/pull/15485 In https://github.com/apache/pinot/pull/15010, we added configs to make http request/client timeouts tunable. However, these configs are not applied to `HttpsSegmentFetcher` So, in Ht

Re: [PR] reduce logging spam [pinot]

2025-04-07 Thread via GitHub
codecov-commenter commented on PR #15484: URL: https://github.com/apache/pinot/pull/15484#issuecomment-2785170818 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/15484?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[PR] reduce logging spam [pinot]

2025-04-07 Thread via GitHub
albertobastos opened a new pull request, #15484: URL: https://github.com/apache/pinot/pull/15484 This PR aims to reduce how we spam the logs under certain query error scenarios, usually including big stack traces that are either irrelevant or redundant. For that sake a `SimpleQueryEx

Re: [PR] fix for #12735. moving dependency version declarations to maven properties [pinot]

2025-04-07 Thread via GitHub
siddharthteotia closed pull request #12736: fix for #12735. moving dependency version declarations to maven properties URL: https://github.com/apache/pinot/pull/12736 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[PR] Improve logging for groovy transform functions [pinot]

2025-04-07 Thread via GitHub
ayesheepatra07 opened a new pull request, #15483: URL: https://github.com/apache/pinot/pull/15483 This change enhances error handling and display in Groovy transformation functions. When a Groovy script fails to compile, the error is logged into the controller logs and passed through the ca

Re: [PR] Consuming Rebalance Summary [pinot]

2025-04-07 Thread via GitHub
xiangfu0 merged PR #15368: URL: https://github.com/apache/pinot/pull/15368 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apa

Re: [PR] Refactor SegmentZKMetadata update logic during segment commit [pinot]

2025-04-07 Thread via GitHub
codecov-commenter commented on PR #15482: URL: https://github.com/apache/pinot/pull/15482#issuecomment-2784956201 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/15482?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] fix for #12735. moving dependency version declarations to maven properties [pinot]

2025-04-07 Thread via GitHub
siddharthteotia commented on PR #12736: URL: https://github.com/apache/pinot/pull/12736#issuecomment-2784246024 We are merging https://github.com/apache/pinot/pull/15437 This can be closed cc @leujean02 @gviedma -- This is an automated message from the Apache Git Service. To

Re: [I] [discussion] On Upsert Hybrid Tables [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang commented on issue #12261: URL: https://github.com/apache/pinot/issues/12261#issuecomment-2784936614 @rajat-sr1704 If you know the data is definitely not modified after 3 months, then you may use offline table as a workaround to support star-tree index. In the future we would i

(pinot) branch master updated: Deprecates AllowConsumptionDuringCommit config (#15452)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 156105931d Deprecates AllowConsumptionDuringCommi

Re: [PR] (Minor) fix logs [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang commented on code in PR #15438: URL: https://github.com/apache/pinot/pull/15438#discussion_r2032187344 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -621,7 +621,7 @@ private void commitSe

Re: [PR] Add off-heap distinct set implementations [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang commented on PR #15205: URL: https://github.com/apache/pinot/pull/15205#issuecomment-2784912504 @siddharthteotia This is used in the new added `DISTINCT_COUNT_OFF_HEAP` function in #15469 -- This is an automated message from the Apache Git Service. To respond to the message,

[PR] Refactor SegmentZKMetadata update logic during segment commit [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang opened a new pull request, #15482: URL: https://github.com/apache/pinot/pull/15482 Simplifies the logic. Also reduce one ZK metadata read for each pauseless consumption commit -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] Refactor SegmentZKMetadata update logic during segment commit [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang commented on PR #15482: URL: https://github.com/apache/pinot/pull/15482#issuecomment-2784893506 cc @9aman -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] Fix threshold update on stale metadata [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang merged PR #15480: URL: https://github.com/apache/pinot/pull/15480 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

(pinot) branch master updated (c299584812 -> e3eb087abc)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from c299584812 Bump nl.jqno.equalsverifier:equalsverifier from 3.19.2 to 3.19.3 (#15478) add e3eb087abc Fix threshold

(pinot) branch master updated (e3f3786bef -> be5c50e853)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from e3f3786bef Bump org.mockito:mockito-core from 5.16.1 to 5.17.0 (#15475) add be5c50e853 Bump org.webjars:swagger-ui

Re: [PR] Bump org.webjars:swagger-ui from 5.20.3 to 5.20.6 [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang merged PR #15476: URL: https://github.com/apache/pinot/pull/15476 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] roundDecimal() fails for null FLOAT values [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang commented on code in PR #15377: URL: https://github.com/apache/pinot/pull/15377#discussion_r2032037011 ## pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/RoundDecimalTransformFunction.java: ## @@ -90,8 +90,12 @@ public double[] transformTo

(pinot) branch dependabot/maven/nl.jqno.equalsverifier-equalsverifier-3.19.3 deleted (was 0dc24dec49)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/nl.jqno.equalsverifier-equalsverifier-3.19.3 in repository https://gitbox.apache.org/repos/asf/pinot.git was 0dc24dec49 Bump nl.jqno.equalsverifier:equalsverifier from 3.19

(pinot) branch master updated (5d7e843de7 -> c299584812)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 5d7e843de7 Bump software.amazon.awssdk:bom from 2.31.15 to 2.31.16 (#15477) add c299584812 Bump nl.jqno.equalsver

Re: [PR] Bump nl.jqno.equalsverifier:equalsverifier from 3.19.2 to 3.19.3 [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang merged PR #15478: URL: https://github.com/apache/pinot/pull/15478 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

(pinot) branch dependabot/maven/org.webjars-swagger-ui-5.20.6 deleted (was 42e0d3273b)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/org.webjars-swagger-ui-5.20.6 in repository https://gitbox.apache.org/repos/asf/pinot.git was 42e0d3273b Bump org.webjars:swagger-ui from 5.20.3 to 5.20.6 The revisions tha

(pinot) branch master updated (bdd20267dc -> e3f3786bef)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from bdd20267dc Bump org.codehaus.plexus:plexus-classworlds from 2.8.0 to 2.9.0 (#15474) add e3f3786bef Bump org.mocki

(pinot) branch master updated (e673c1223f -> bdd20267dc)

2025-04-07 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from e673c1223f [Issue 12676 - Part 1] Moving dependency version declarations to maven properties (#15437) add bdd2026

Re: [PR] Bump org.mockito:mockito-core from 5.16.1 to 5.17.0 [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang merged PR #15475: URL: https://github.com/apache/pinot/pull/15475 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Bump org.codehaus.plexus:plexus-classworlds from 2.8.0 to 2.9.0 [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang merged PR #15474: URL: https://github.com/apache/pinot/pull/15474 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Fallback for bad values in periodic controller task configurations [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang commented on code in PR #15466: URL: https://github.com/apache/pinot/pull/15466#discussion_r2032007475 ## pinot-controller/src/main/java/org/apache/pinot/controller/ControllerConf.java: ## @@ -1200,6 +1235,16 @@ private long convertPeriodToSeconds(String period) {

[PR] [multistage] Add Leaf Stage Worker Assignment / Boundary / Agg Rules [pinot]

2025-04-07 Thread via GitHub
ankitsultana opened a new pull request, #15481: URL: https://github.com/apache/pinot/pull/15481 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

(pinot) branch master updated: [Issue 12676 - Part 1] Moving dependency version declarations to maven properties (#15437)

2025-04-07 Thread siddteotia
This is an automated email from the ASF dual-hosted git repository. siddteotia pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new e673c1223f [Issue 12676 - Part 1] Moving depe

Re: [PR] [Issue 12676 - Part 1] Moving dependency version declarations to maven properties [pinot]

2025-04-07 Thread via GitHub
siddharthteotia merged PR #15437: URL: https://github.com/apache/pinot/pull/15437 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pi

Re: [PR] Add DISTINCT_COUNT_OFF_HEAP aggregate function [pinot]

2025-04-07 Thread via GitHub
Jackie-Jiang merged PR #15469: URL: https://github.com/apache/pinot/pull/15469 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

(pinot) branch master updated: Consuming Rebalance Summary (#15368)

2025-04-07 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 38ad8fe44e Consuming Rebalance Summary (#15368)

Re: [PR] Moving dependency version declarations to maven properties [pinot]

2025-04-07 Thread via GitHub
leujean02 commented on code in PR #15437: URL: https://github.com/apache/pinot/pull/15437#discussion_r2031624410 ## pom.xml: ## @@ -1215,6 +1234,12 @@ pom import + + +com.google.api.grpc +proto-google-common-protos +$

Re: [PR] Moving dependency version declarations to maven properties [pinot]

2025-04-07 Thread via GitHub
leujean02 commented on code in PR #15437: URL: https://github.com/apache/pinot/pull/15437#discussion_r2031624119 ## pom.xml: ## @@ -1215,6 +1234,12 @@ pom import + + +com.google.api.grpc +proto-google-common-protos +$

[PR] Fix segment throttle metrics by initializing them [pinot]

2025-04-07 Thread via GitHub
somandal opened a new pull request, #15479: URL: https://github.com/apache/pinot/pull/15479 As part of PR https://github.com/apache/pinot/pull/15392 metrics were added for tracking segment throttle thresholds and count of the operations undergoing the given operation. The metrics only show

(pinot) branch master updated: add_init (#15471)

2025-04-07 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 7805427c81 add_init (#15471) 7805427c81 is descr

Re: [PR] Make PinotTaskManager Fully Pluggable by Avoiding Overridable Method Calls in Constructor [pinot]

2025-04-07 Thread via GitHub
xiangfu0 merged PR #15471: URL: https://github.com/apache/pinot/pull/15471 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apa

Re: [I] Raplace spaces with underscore in segment name otherwise segment is going to be bad state [pinot]

2025-04-07 Thread via GitHub
xiangfu0 commented on issue #15472: URL: https://github.com/apache/pinot/issues/15472#issuecomment-2783380328 I'm up for this, do you want to submit a PR for this? You can find all the SegmentNameGenerator implementations from here and sanitize all the generated segment name: http

Re: [I] Support CityHash function [pinot]

2025-04-07 Thread via GitHub
xiangfu0 commented on issue #15454: URL: https://github.com/apache/pinot/issues/15454#issuecomment-2783371951 Thanks @vinodbaba ! More context, you can refer to this PR: https://github.com/apache/pinot/pull/15160/files#diff-ed72686fbe9a7f799a9a2c392c2dd24dad314f1e2428bdd89a2df2d99964f

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.31.16 created (now 607e5e5fd1)

2025-04-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.31.16 in repository https://gitbox.apache.org/repos/asf/pinot.git at 607e5e5fd1 Bump software.amazon.awssdk:bom from 2.31.15 to 2.31.16 N

(pinot) branch dependabot/maven/org.webjars-swagger-ui-5.20.6 created (now 42e0d3273b)

2025-04-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.webjars-swagger-ui-5.20.6 in repository https://gitbox.apache.org/repos/asf/pinot.git at 42e0d3273b Bump org.webjars:swagger-ui from 5.20.3 to 5.20.6 No new revis

[PR] Bump org.webjars:swagger-ui from 5.20.3 to 5.20.6 [pinot]

2025-04-07 Thread via GitHub
dependabot[bot] opened a new pull request, #15476: URL: https://github.com/apache/pinot/pull/15476 Bumps [org.webjars:swagger-ui](https://github.com/swagger-api/swagger-ui) from 5.20.3 to 5.20.6. Release notes Sourced from https://github.com/swagger-api/swagger-ui/releases";>org.we

(pinot) branch dependabot/maven/nl.jqno.equalsverifier-equalsverifier-3.19.3 created (now 3b64cd2866)

2025-04-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/nl.jqno.equalsverifier-equalsverifier-3.19.3 in repository https://gitbox.apache.org/repos/asf/pinot.git at 3b64cd2866 Bump nl.jqno.equalsverifier:equalsverifier from

[PR] Bump nl.jqno.equalsverifier:equalsverifier from 3.19.2 to 3.19.3 [pinot]

2025-04-07 Thread via GitHub
dependabot[bot] opened a new pull request, #15478: URL: https://github.com/apache/pinot/pull/15478 Bumps [nl.jqno.equalsverifier:equalsverifier](https://github.com/jqno/equalsverifier) from 3.19.2 to 3.19.3. Changelog Sourced from https://github.com/jqno/equalsverifier/blob/main/C

[PR] Bump software.amazon.awssdk:bom from 2.31.15 to 2.31.16 [pinot]

2025-04-07 Thread via GitHub
dependabot[bot] opened a new pull request, #15477: URL: https://github.com/apache/pinot/pull/15477 Bumps software.amazon.awssdk:bom from 2.31.15 to 2.31.16. Most Recent Ignore Conditions Applied to This Pull Request | Dependency Name | Ignore Conditions | | --- | --- |

[PR] Bump org.mockito:mockito-core from 5.16.1 to 5.17.0 [pinot]

2025-04-07 Thread via GitHub
dependabot[bot] opened a new pull request, #15475: URL: https://github.com/apache/pinot/pull/15475 Bumps [org.mockito:mockito-core](https://github.com/mockito/mockito) from 5.16.1 to 5.17.0. Release notes Sourced from https://github.com/mockito/mockito/releases";>org.mockito:mockit

(pinot) branch dependabot/maven/org.mockito-mockito-core-5.17.0 created (now 611f2b44e2)

2025-04-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.mockito-mockito-core-5.17.0 in repository https://gitbox.apache.org/repos/asf/pinot.git at 611f2b44e2 Bump org.mockito:mockito-core from 5.16.1 to 5.17.0 No new r

[PR] Bump org.codehaus.plexus:plexus-classworlds from 2.8.0 to 2.9.0 [pinot]

2025-04-07 Thread via GitHub
dependabot[bot] opened a new pull request, #15474: URL: https://github.com/apache/pinot/pull/15474 Bumps [org.codehaus.plexus:plexus-classworlds](https://github.com/codehaus-plexus/plexus-classworlds) from 2.8.0 to 2.9.0. Release notes Sourced from https://github.com/codehaus-plex

Re: [PR] Make PinotTaskManager Fully Pluggable by Avoiding Overridable Method Calls in Constructor [pinot]

2025-04-07 Thread via GitHub
codecov-commenter commented on PR #15471: URL: https://github.com/apache/pinot/pull/15471#issuecomment-2782172251 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/15471?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] STP-3739: Segment files batch deletion. [pinot]

2025-04-07 Thread via GitHub
codecov-commenter commented on PR #15473: URL: https://github.com/apache/pinot/pull/15473#issuecomment-2782468239 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/15473?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[PR] STP-3739: Segment files batch deletion. [pinot]

2025-04-07 Thread via GitHub
abhishekbafna opened a new pull request, #15473: URL: https://github.com/apache/pinot/pull/15473 Currently table delete API deletes the segments files in iterative manner which is slow. To improve the table deletion operation performance, introducing batch deletion. Implementation fo

[I] Raplace spaces with underscore in segment name otherwise segment is going to be bad state [pinot]

2025-04-07 Thread via GitHub
chrajeshbabu opened a new issue, #15472: URL: https://github.com/apache/pinot/issues/15472 In case of Hive partition column values are allowed with spaces which apparently generate the HDFS files with spaces. To load data from such files with input file path segment name generator ended up