Re: [PR] Fix flaky upsert integration tests [pinot]

2024-11-13 Thread via GitHub
codecov-commenter commented on PR #14447: URL: https://github.com/apache/pinot/pull/14447#issuecomment-2475654992 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14447?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
rohityadav1993 commented on code in PR #14443: URL: https://github.com/apache/pinot/pull/14443#discussion_r1841713786 ## pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationTaskRunner.java: ##

Re: [PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
rohityadav1993 commented on code in PR #14443: URL: https://github.com/apache/pinot/pull/14443#discussion_r1841685172 ## pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationTaskRunner.java: ##

Re: [PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
rohityadav1993 commented on code in PR #14443: URL: https://github.com/apache/pinot/pull/14443#discussion_r1841685172 ## pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationTaskRunner.java: ##

Re: [I] Caused by: org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata [pinot]

2024-11-13 Thread via GitHub
Abdulsamirkhan commented on issue #14372: URL: https://github.com/apache/pinot/issues/14372#issuecomment-2475595972 @Jackie-Jiang @swaminathanmanish @KKcorps, gentle reminder -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] Fix flaky upsert integration tests [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang opened a new pull request, #14447: URL: https://github.com/apache/pinot/pull/14447 The core reason for the flakiness is that snapshot is not guaranteed for the just committed segment. Made the following enhancements: 1. Ensure snapshot is taken by pause/resume consumpt

Re: [PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
rohityadav1993 commented on code in PR #14443: URL: https://github.com/apache/pinot/pull/14443#discussion_r1841682046 ## pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationTaskRunner.java: ##

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
jadami10 commented on PR #14445: URL: https://github.com/apache/pinot/pull/14445#issuecomment-2475503315 thank you for the quick review! test should now be fixed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
vrajat commented on PR #14445: URL: https://github.com/apache/pinot/pull/14445#issuecomment-2475488273 Approved. Tests are failing because of the new metrics. You might have to add it to a list or change regex. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Handle kafka backward incompatible props [pinot]

2024-11-13 Thread via GitHub
codecov-commenter commented on PR #14446: URL: https://github.com/apache/pinot/pull/14446#issuecomment-2475476345 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14446?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
jadami10 commented on PR #14445: URL: https://github.com/apache/pinot/pull/14445#issuecomment-2475470327 I specifically chose not to add the metric there because it throws, and the server does not start. This metric is specifically for when the server starts to understand if it started in a

Re: [PR] [Dependency] Cleanup unnecessary dependencies and exclusions [pinot]

2024-11-13 Thread via GitHub
jadami10 commented on PR #13832: URL: https://github.com/apache/pinot/pull/13832#issuecomment-2475472699 I believe in our case the issue is that hadoop came with `curator`. And we use `curator` in a plugin as well. So the version in our plugin then clashed with the version hadoop brought in

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
jadami10 commented on PR #14445: URL: https://github.com/apache/pinot/pull/14445#issuecomment-2475429950 > Meter will expose count, 1-min, 5-min and 15-min rates. That's a good point. I guess those don't help either. I've revised based on your comments. Let me know what you think. -

Re: [PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on code in PR #14443: URL: https://github.com/apache/pinot/pull/14443#discussion_r1841579010 ## pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationTaskRunner.java:

(pinot) branch master updated (76cc9bbd4a -> b90d1da2ed)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 76cc9bbd4a Upgrade kafka3 from 3.8.0 to 3.9.0 (#14442) add b90d1da2ed Using local copy of segment instead of downl

Re: [PR] Using local copy of segment instead of downloading from remote [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14429: URL: https://github.com/apache/pinot/pull/14429 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

[PR] Handle kafka backward incompatible props [pinot]

2024-11-13 Thread via GitHub
KKcorps opened a new pull request, #14446: URL: https://github.com/apache/pinot/pull/14446 Earlier we were adding shaded prefix to some stream config properties such as `PlainLoginModule` in jaas, so that older kafka tables work properly. However, now we need to do the opposite as we

Re: [PR] [Dependency] Cleanup unnecessary dependencies and exclusions [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on PR #13832: URL: https://github.com/apache/pinot/pull/13832#issuecomment-2475432507 @jadami10 It is mostly for easier dependency management, and avoid unnecessary repeated declarations. Which exclusion do you find necessary? Most of the removed exclusions should

Re: [PR] Enhance funnel functions to accept a new option for maxStepDuration [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on code in PR #14434: URL: https://github.com/apache/pinot/pull/14434#discussion_r1841563599 ## pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/funnel/window/FunnelBaseAggregationFunction.java: ## @@ -58,12 +62,25 @@ public Funne

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
vrajat commented on PR #14445: URL: https://github.com/apache/pinot/pull/14445#issuecomment-2475408283 > You're paying for a lot of extra timeseries. Thoughts? Meter will expose count, 1-min, 5-min and 15-min rates. The rates are not interpretable - rate of time taken. Count is cumula

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
vrajat commented on code in PR #14445: URL: https://github.com/apache/pinot/pull/14445#discussion_r1841547166 ## pinot-server/src/main/java/org/apache/pinot/server/starter/helix/BaseServerStarter.java: ## @@ -707,6 +710,13 @@ public void start() _serverQueriesDisabledTracke

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
jadami10 commented on code in PR #14445: URL: https://github.com/apache/pinot/pull/14445#discussion_r1841541265 ## pinot-server/src/main/java/org/apache/pinot/server/starter/helix/BaseServerStarter.java: ## @@ -707,6 +710,13 @@ public void start() _serverQueriesDisabledTrac

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
jadami10 commented on code in PR #14445: URL: https://github.com/apache/pinot/pull/14445#discussion_r1841540867 ## pinot-server/src/main/java/org/apache/pinot/server/starter/helix/BaseServerStarter.java: ## @@ -520,7 +520,7 @@ private void setupHelixSystemProperties() { *

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
codecov-commenter commented on PR #14445: URL: https://github.com/apache/pinot/pull/14445#issuecomment-2475382083 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14445?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
vrajat commented on code in PR #14445: URL: https://github.com/apache/pinot/pull/14445#discussion_r1841531696 ## pinot-server/src/main/java/org/apache/pinot/server/starter/helix/BaseServerStarter.java: ## @@ -520,7 +520,7 @@ private void setupHelixSystemProperties() { *

[PR] add metric of startup time for all components [pinot]

2024-11-13 Thread via GitHub
jadami10 opened a new pull request, #14445: URL: https://github.com/apache/pinot/pull/14445 This is a new metric `feature` to add a time to start for each component. Since servers wait for startup status check = GOOD or timeout, this has a success and failure metric associated with it.

Re: [I] Pauseless Consumption [pinot]

2024-11-13 Thread via GitHub
KKcorps commented on issue #10147: URL: https://github.com/apache/pinot/issues/10147#issuecomment-2475326356 @mcvsubbu @sajjad-moradi it would be better if we synced up offline on this. Can you let us know your availability in the OSS slack #feat-pausless-consumption channel -- This is

Re: [PR] Enhance funnel functions to accept a new option for maxStepDuration [pinot]

2024-11-13 Thread via GitHub
xiangfu0 commented on code in PR #14434: URL: https://github.com/apache/pinot/pull/14434#discussion_r1841486004 ## pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/funnel/window/FunnelBaseAggregationFunction.java: ## @@ -58,12 +62,25 @@ public FunnelBas

Re: [PR] Enhance funnel functions to accept a new option for maxStepDuration [pinot]

2024-11-13 Thread via GitHub
xiangfu0 commented on code in PR #14434: URL: https://github.com/apache/pinot/pull/14434#discussion_r1841485598 ## pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/funnel/window/FunnelBaseAggregationFunction.java: ## @@ -58,12 +62,25 @@ public FunnelBas

Re: [PR] Enhance funnel functions to accept a new option for maxStepDuration [pinot]

2024-11-13 Thread via GitHub
xiangfu0 commented on code in PR #14434: URL: https://github.com/apache/pinot/pull/14434#discussion_r1841485598 ## pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/funnel/window/FunnelBaseAggregationFunction.java: ## @@ -58,12 +62,25 @@ public FunnelBas

Re: [PR] Enhance funnel functions to accept a new option for maxStepDuration [pinot]

2024-11-13 Thread via GitHub
xiangfu0 commented on code in PR #14434: URL: https://github.com/apache/pinot/pull/14434#discussion_r1841485598 ## pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/funnel/window/FunnelBaseAggregationFunction.java: ## @@ -58,12 +62,25 @@ public FunnelBas

Re: [PR] Re-implement CSV record reader to skip unparseable lines [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on PR #14396: URL: https://github.com/apache/pinot/pull/14396#issuecomment-2474909656 @KKcorps when `stopOnError` is set to `true`, the record reader will stop parsing when encountering error, and return `false` in `hasNext()`. When it is not set, `hasNext()` will ret

Re: [PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
pengding-stripe commented on code in PR #14443: URL: https://github.com/apache/pinot/pull/14443#discussion_r1841374633 ## pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationTaskRunner.java: #

Re: [PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
pengding-stripe commented on code in PR #14443: URL: https://github.com/apache/pinot/pull/14443#discussion_r1841373531 ## pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationTaskRunner.java: #

Re: [PR] Add `optimizeDictionaryType` config to automatically choose dictionary type [pinot]

2024-11-13 Thread via GitHub
codecov-commenter commented on PR #1: URL: https://github.com/apache/pinot/pull/1#issuecomment-2475112838 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/1?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Add Option to Optimize `NOT` Predicates with Push Down [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on PR #14432: URL: https://github.com/apache/pinot/pull/14432#issuecomment-2475090569 In most cases, `NOT(x AND y)` will be faster than `NOT(x) OR NOT(y)` because `OR` is a very expensive operation and quite hard to optimize. IIRC, `NOT(x OR y AND z)` should be equ

(pinot) branch master updated (b4c46ef0b8 -> 76cc9bbd4a)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from b4c46ef0b8 Add hex decimal to long scalar functions (#14435) add 76cc9bbd4a Upgrade kafka3 from 3.8.0 to 3.9.0 (#1

Re: [PR] log segment name at best effort upon query exception to help locate the error segment [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on code in PR #14440: URL: https://github.com/apache/pinot/pull/14440#discussion_r1841356093 ## pinot-core/src/main/java/org/apache/pinot/core/operator/combine/BaseSingleBlockCombineOperator.java: ## @@ -92,6 +92,9 @@ protected void processSegments() {

Re: [PR] Upgrade kafka3 from 3.8.0 to 3.9.0 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14442: URL: https://github.com/apache/pinot/pull/14442 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Add hex decimal to long scalar functions [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on PR #14435: URL: https://github.com/apache/pinot/pull/14435#issuecomment-2475080258 Remember to add this to the pinot doc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on code in PR #14443: URL: https://github.com/apache/pinot/pull/14443#discussion_r1841342429 ## pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationTaskRunner.java:

Re: [PR] Add multi stream ingestion support [pinot]

2024-11-13 Thread via GitHub
lnbest0707-uber commented on PR #13790: URL: https://github.com/apache/pinot/pull/13790#issuecomment-2475067735 Add the production running report: The feature has been running in Uber production environment with PBs of data for months. There are hundreds of Pinot tables created. One table

Re: [PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
codecov-commenter commented on PR #14443: URL: https://github.com/apache/pinot/pull/14443#issuecomment-2475048952 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14443?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Enhance funnel functions to accept a new option for maxStepDuration [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on code in PR #14434: URL: https://github.com/apache/pinot/pull/14434#discussion_r1841323394 ## pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/funnel/window/FunnelBaseAggregationFunction.java: ## @@ -58,12 +62,25 @@ public Funne

Re: [I] [Pinot 1.2.0] Batch upload for realtime table using Spark fails with error "Creation time must be set for uploaded realtime segment name generator" [pinot]

2024-11-13 Thread via GitHub
pengding-stripe commented on issue #14083: URL: https://github.com/apache/pinot/issues/14083#issuecomment-2475014470 @rohityadav1993 I made a PR to fix this: https://github.com/apache/pinot/pull/14443 -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] Lucene 9.12 Upgrade [pinot]

2024-11-13 Thread via GitHub
klsince commented on code in PR #14361: URL: https://github.com/apache/pinot/pull/14361#discussion_r1841271692 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/readers/LuceneFSTIndexReader.java: ## @@ -52,8 +51,7 @@ public LuceneFSTIndexReader(Pi

[PR] Spark upsert table backfill support [pinot]

2024-11-13 Thread via GitHub
pengding-stripe opened a new pull request, #14443: URL: https://github.com/apache/pinot/pull/14443 `bugfix` ### Summary - `SegmentNameGenerator` for `UPLOADED_REALTIME` should get parameters from job spec instead of table config. This PR fixes this issue https://github.com/apache/

Re: [PR] Upgrade kafka3 from 3.8.0 to 3.9.0 [pinot]

2024-11-13 Thread via GitHub
codecov-commenter commented on PR #14442: URL: https://github.com/apache/pinot/pull/14442#issuecomment-2474996661 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14442?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Add hex decimal to long scalar functions [pinot]

2024-11-13 Thread via GitHub
xiangfu0 commented on code in PR #14435: URL: https://github.com/apache/pinot/pull/14435#discussion_r1841184841 ## pinot-common/src/main/java/org/apache/pinot/common/function/scalar/DataTypeConversionFunctions.java: ## @@ -129,4 +129,27 @@ public static byte[] base64Encode(byte[

Re: [PR] Upgrade lucene to 9.10.0 and compatibility changes to code. [pinot]

2024-11-13 Thread via GitHub
klsince commented on code in PR #12866: URL: https://github.com/apache/pinot/pull/12866#discussion_r1841269269 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/readers/LuceneFSTIndexReader.java: ## @@ -52,7 +52,8 @@ public LuceneFSTIndexReader(Pi

Re: [PR] Upgrade lucene to 9.10.0 and compatibility changes to code. [pinot]

2024-11-13 Thread via GitHub
klsince commented on code in PR #12866: URL: https://github.com/apache/pinot/pull/12866#discussion_r1841269269 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/readers/LuceneFSTIndexReader.java: ## @@ -52,7 +52,8 @@ public LuceneFSTIndexReader(Pi

Re: [PR] Add instance level consumer dir usage metric [pinot]

2024-11-13 Thread via GitHub
SabrinaZhaozyf commented on code in PR #14430: URL: https://github.com/apache/pinot/pull/14430#discussion_r1840938825 ## pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/RealtimeTableDataManager.java: ## @@ -102,7 +102,7 @@ public class RealtimeTableDataManag

Re: [PR] Allows multiple requests per server per request ID [pinot]

2024-11-13 Thread via GitHub
egalpin commented on PR #13742: URL: https://github.com/apache/pinot/pull/13742#issuecomment-2474864633 ![image](https://github.com/user-attachments/assets/527ce6fd-7ecd-4744-9c53-aac07431962c) -- This is an automated message from the Apache Git Service. To respond to the message, ple

(pinot) branch master updated: Add hex decimal to long scalar functions (#14435)

2024-11-13 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new b4c46ef0b8 Add hex decimal to long scalar functi

Re: [PR] Add hex decimal to long scalar functions [pinot]

2024-11-13 Thread via GitHub
xiangfu0 merged PR #14435: URL: https://github.com/apache/pinot/pull/14435 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apa

Re: [PR] Bump kafka2.version from 2.8.2 to 3.9.0 [pinot]

2024-11-13 Thread via GitHub
dependabot[bot] commented on PR #14409: URL: https://github.com/apache/pinot/pull/14409#issuecomment-2474787336 OK, I won't notify you again about this release, but will get in touch when a new version is available. You can also ignore all major, minor, or patch releases for a dependency by

(pinot) branch dependabot/maven/kafka2.version-3.9.0 deleted (was 2d3315aa53)

2024-11-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/kafka2.version-3.9.0 in repository https://gitbox.apache.org/repos/asf/pinot.git was 2d3315aa53 Bump kafka2.version from 2.8.2 to 3.9.0 The revisions that were on this

Re: [PR] Bump kafka2.version from 2.8.2 to 3.9.0 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang closed pull request #14409: Bump kafka2.version from 2.8.2 to 3.9.0 URL: https://github.com/apache/pinot/pull/14409 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Pauseless consumption [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang commented on PR #14439: URL: https://github.com/apache/pinot/pull/14439#issuecomment-2474776192 Some high level questions: 1. How does broker detect the new consuming segment? 2. What will happen if a new consuming segment is created by the Helix message, and a rebalance i

(pinot) branch dependabot/maven/net.openhft-posix-2.26ea3 deleted (was 991eafd50a)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/net.openhft-posix-2.26ea3 in repository https://gitbox.apache.org/repos/asf/pinot.git was 991eafd50a Bump net.openhft:posix from 2.26ea2 to 2.26ea3 The revisions that were

(pinot) branch master updated (5a57606472 -> 994667f0ff)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 5a57606472 Bump nl.jqno.equalsverifier:equalsverifier from 3.17.2 to 3.17.3 (#14412) add 994667f0ff Bump net.open

Re: [PR] Bump net.openhft:posix from 2.26ea2 to 2.26ea3 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14410: URL: https://github.com/apache/pinot/pull/14410 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

(pinot) branch dependabot/maven/nl.jqno.equalsverifier-equalsverifier-3.17.3 deleted (was a1f664813b)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/nl.jqno.equalsverifier-equalsverifier-3.17.3 in repository https://gitbox.apache.org/repos/asf/pinot.git was a1f664813b Bump nl.jqno.equalsverifier:equalsverifier from 3.17

Re: [PR] Bump nl.jqno.equalsverifier:equalsverifier from 3.17.2 to 3.17.3 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14412: URL: https://github.com/apache/pinot/pull/14412 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Bump com.puppycrawl.tools:checkstyle from 10.20.0 to 10.20.1 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14416: URL: https://github.com/apache/pinot/pull/14416 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Bump com.nimbusds:nimbus-jose-jwt from 9.45 to 9.46 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14421: URL: https://github.com/apache/pinot/pull/14421 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Bump parquet.version from 1.14.3 to 1.14.4 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14427: URL: https://github.com/apache/pinot/pull/14427 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Bump org.webjars:swagger-ui from 5.18.0 to 5.18.2 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14422: URL: https://github.com/apache/pinot/pull/14422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

(pinot) branch dependabot/maven/org.webjars-swagger-ui-5.18.2 deleted (was a10bf2aa99)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/org.webjars-swagger-ui-5.18.2 in repository https://gitbox.apache.org/repos/asf/pinot.git was a10bf2aa99 Bump org.webjars:swagger-ui from 5.18.0 to 5.18.2 The revisions tha

(pinot) branch master updated (b2654664f1 -> 73fe82d598)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from b2654664f1 Bump parquet.version from 1.14.3 to 1.14.4 (#14427) add 73fe82d598 Bump org.webjars:swagger-ui from 5.1

(pinot) branch dependabot/maven/org.quartz-scheduler-quartz-2.5.0 deleted (was 7c66e423ef)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/org.quartz-scheduler-quartz-2.5.0 in repository https://gitbox.apache.org/repos/asf/pinot.git was 7c66e423ef Bump org.quartz-scheduler:quartz from 2.3.2 to 2.5.0 The revis

(pinot) branch master updated (42e17e7350 -> 288d77fd4c)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 42e17e7350 Bump io.netty:netty-bom from 4.1.114.Final to 4.1.115.Final (#14437) add 288d77fd4c Bump org.quartz-sc

Re: [PR] Bump org.quartz-scheduler:quartz from 2.3.2 to 2.5.0 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14436: URL: https://github.com/apache/pinot/pull/14436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

(pinot) branch dependabot/maven/io.netty-netty-bom-4.1.115.Final deleted (was cf4479ca40)

2024-11-13 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/io.netty-netty-bom-4.1.115.Final in repository https://gitbox.apache.org/repos/asf/pinot.git was cf4479ca40 Bump io.netty:netty-bom from 4.1.114.Final to 4.1.115.Final The

Re: [PR] Bump io.netty:netty-bom from 4.1.114.Final to 4.1.115.Final [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14437: URL: https://github.com/apache/pinot/pull/14437 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] Bump software.amazon.awssdk:bom from 2.29.5 to 2.29.11 [pinot]

2024-11-13 Thread via GitHub
Jackie-Jiang merged PR #14438: URL: https://github.com/apache/pinot/pull/14438 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

[PR] log segment name at best effort upon query exception to help locate the error segment [pinot]

2024-11-13 Thread via GitHub
klsince opened a new pull request, #14440: URL: https://github.com/apache/pinot/pull/14440 Try to log out segment name when query failed to help quickly locate the segment to help debug the query error, as sometimes the segment might have got corrupted data. One could tweak the query to nar

Re: [PR] Minion Task to support automatic Segment Refresh [pinot]

2024-11-13 Thread via GitHub
vvivekiyer commented on code in PR #14300: URL: https://github.com/apache/pinot/pull/14300#discussion_r1840978986 ## pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/segmentrefresh/SegmentRefreshTaskExecutor.java: ##

Re: [PR] Minion Task to support automatic Segment Refresh [pinot]

2024-11-13 Thread via GitHub
vvivekiyer commented on code in PR #14300: URL: https://github.com/apache/pinot/pull/14300#discussion_r1840978942 ## pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/segmentrefresh/SegmentRefreshTaskGenerator.java: ##

Re: [PR] Minion Task to support automatic Segment Refresh [pinot]

2024-11-13 Thread via GitHub
vvivekiyer commented on code in PR #14300: URL: https://github.com/apache/pinot/pull/14300#discussion_r1840978359 ## pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/segmentrefresh/SegmentRefreshTaskExecutor.java: ##

Re: [PR] Minion Task to support automatic Segment Refresh [pinot]

2024-11-13 Thread via GitHub
vvivekiyer commented on code in PR #14300: URL: https://github.com/apache/pinot/pull/14300#discussion_r1840978287 ## pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/segmentrefresh/SegmentRefreshTaskExecutor.java: ##

Re: [PR] Minion Task to support automatic Segment Refresh [pinot]

2024-11-13 Thread via GitHub
vvivekiyer commented on code in PR #14300: URL: https://github.com/apache/pinot/pull/14300#discussion_r1840977593 ## pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/segmentrefresh/SegmentRefreshTaskGenerator.java: ##

Re: [I] Pauseless Consumption [pinot]

2024-11-13 Thread via GitHub
sajjad-moradi commented on issue #10147: URL: https://github.com/apache/pinot/issues/10147#issuecomment-2474335371 A couple of weeks ago, I implemented most of the required changes for this feature based on the design outlined in this issue. A few months ago, Jackie, Subbu, and I had an in-

Re: [PR] Add hex decimal to long scalar functions [pinot]

2024-11-13 Thread via GitHub
gortiz commented on code in PR #14435: URL: https://github.com/apache/pinot/pull/14435#discussion_r1840261002 ## pinot-common/src/main/java/org/apache/pinot/common/function/scalar/DataTypeConversionFunctions.java: ## @@ -129,4 +129,27 @@ public static byte[] base64Encode(byte[]

[PR] Bump org.quartz-scheduler:quartz from 2.3.2 to 2.5.0 [pinot]

2024-11-13 Thread via GitHub
dependabot[bot] opened a new pull request, #14436: URL: https://github.com/apache/pinot/pull/14436 Bumps [org.quartz-scheduler:quartz](https://github.com/quartz-scheduler/quartz) from 2.3.2 to 2.5.0. Release notes Sourced from https://github.com/quartz-scheduler/quartz/releases";>

[PR] Bump io.netty:netty-bom from 4.1.114.Final to 4.1.115.Final [pinot]

2024-11-13 Thread via GitHub
dependabot[bot] opened a new pull request, #14437: URL: https://github.com/apache/pinot/pull/14437 Bumps [io.netty:netty-bom](https://github.com/netty/netty) from 4.1.114.Final to 4.1.115.Final. Commits https://github.com/netty/netty/commit/04f9b4a827d992ad439823eeba85d65d3a89c

(pinot) branch dependabot/maven/io.netty-netty-bom-4.1.115.Final created (now cf4479ca40)

2024-11-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/io.netty-netty-bom-4.1.115.Final in repository https://gitbox.apache.org/repos/asf/pinot.git at cf4479ca40 Bump io.netty:netty-bom from 4.1.114.Final to 4.1.115.Final

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.29.11 created (now 36820461a8)

2024-11-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.29.11 in repository https://gitbox.apache.org/repos/asf/pinot.git at 36820461a8 Bump software.amazon.awssdk:bom from 2.29.5 to 2.29.11 No

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.29.10 deleted (was e30b6236c0)

2024-11-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.29.10 in repository https://gitbox.apache.org/repos/asf/pinot.git was e30b6236c0 Bump software.amazon.awssdk:bom from 2.29.5 to 2.29.10 Th

Re: [PR] Bump software.amazon.awssdk:bom from 2.29.5 to 2.29.10 [pinot]

2024-11-13 Thread via GitHub
dependabot[bot] commented on PR #14428: URL: https://github.com/apache/pinot/pull/14428#issuecomment-2473387773 Superseded by #14438. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Bump software.amazon.awssdk:bom from 2.29.5 to 2.29.10 [pinot]

2024-11-13 Thread via GitHub
dependabot[bot] closed pull request #14428: Bump software.amazon.awssdk:bom from 2.29.5 to 2.29.10 URL: https://github.com/apache/pinot/pull/14428 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] Bump software.amazon.awssdk:bom from 2.29.5 to 2.29.11 [pinot]

2024-11-13 Thread via GitHub
dependabot[bot] opened a new pull request, #14438: URL: https://github.com/apache/pinot/pull/14438 Bumps software.amazon.awssdk:bom from 2.29.5 to 2.29.11. Most Recent Ignore Conditions Applied to This Pull Request | Dependency Name | Ignore Conditions | | --- | --- |

(pinot) branch dependabot/maven/org.quartz-scheduler-quartz-2.5.0 created (now 7c66e423ef)

2024-11-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.quartz-scheduler-quartz-2.5.0 in repository https://gitbox.apache.org/repos/asf/pinot.git at 7c66e423ef Bump org.quartz-scheduler:quartz from 2.3.2 to 2.5.0 No ne