Re: [PR] Adding a new config skipSegmentPreprocess in table IndexingConfig [pinot]

2025-02-03 Thread via GitHub
xiangfu0 merged PR #14982: URL: https://github.com/apache/pinot/pull/14982 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apa

(pinot) branch master updated: Adding a new config skipSegmentPreprocess in table IndexingConfig (#14982)

2025-02-03 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 3c02ec48b9 Adding a new config skipSegmentPrepro

[I] Regex Query for TEXT_MATCH is not working for input words with a space [pinot]

2025-02-03 Thread via GitHub
rahulkrishna-dev opened a new issue, #14983: URL: https://github.com/apache/pinot/issues/14983 Query being executed: ``` SELECT keyword FROM keywords_rank_v1 WHERE TEXT_MATCH(keyword, '/.*amul milk.*/') ORDER BY rank ASC LIMIT 100 ``` The above q

Re: [PR] Adding a new config enableSegmentPreprocess in table IndexingConfig [pinot]

2025-02-03 Thread via GitHub
codecov-commenter commented on PR #14982: URL: https://github.com/apache/pinot/pull/14982#issuecomment-2632595967 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14982?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
Jackie-Jiang commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1940355486 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -442,6 +446,10 @@ public IdealState ge

Re: [PR] Adding a new config enableSegmentPreprocess in table IndexingConfig [pinot]

2025-02-03 Thread via GitHub
xiangfu0 commented on code in PR #14982: URL: https://github.com/apache/pinot/pull/14982#discussion_r1940327893 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/loader/IndexLoadingConfig.java: ## @@ -337,6 +340,14 @@ public void setErrorOnColumnB

Re: [PR] Adding a new config enableSegmentPreprocess in table IndexingConfig [pinot]

2025-02-03 Thread via GitHub
Jackie-Jiang commented on code in PR #14982: URL: https://github.com/apache/pinot/pull/14982#discussion_r1940316175 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/loader/IndexLoadingConfig.java: ## @@ -337,6 +340,14 @@ public void setErrorOnCol

[PR] Adding a new config enableSegmentPreprocess in table IndexingConfig [pinot]

2025-02-03 Thread via GitHub
xiangfu0 opened a new pull request, #14982: URL: https://github.com/apache/pinot/pull/14982 This config: `enableSegmentPreprocess` allows the table to skip preprocess during server startup or reload -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [PR] Bump jakarta.validation:jakarta.validation-api from 2.0.2 to 3.1.1 [pinot]

2025-02-03 Thread via GitHub
Jackie-Jiang commented on PR #14979: URL: https://github.com/apache/pinot/pull/14979#issuecomment-2632446882 @dependabot ignore this dependency -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] Server replica allowed to overwrite deep store segment after segment was already committed [pinot]

2025-02-03 Thread via GitHub
Jackie-Jiang commented on issue #14786: URL: https://github.com/apache/pinot/issues/14786#issuecomment-2632457409 @KKcorps should we simply change the if condition to `segmentMetadata.getStatus() != CommonConstants.Segment.Realtime.Status.IN_PROGRESS`? Can you help submit a fix? -- This

Re: [PR] Bump jakarta.validation:jakarta.validation-api from 2.0.2 to 3.1.1 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] closed pull request #14979: Bump jakarta.validation:jakarta.validation-api from 2.0.2 to 3.1.1 URL: https://github.com/apache/pinot/pull/14979 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Bump jakarta.validation:jakarta.validation-api from 2.0.2 to 3.1.1 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] commented on PR #14979: URL: https://github.com/apache/pinot/pull/14979#issuecomment-2632446931 OK, I won't notify you about jakarta.validation:jakarta.validation-api again, unless you re-open this PR. -- This is an automated message from the Apache Git Service. To respond

(pinot) branch dependabot/maven/jakarta.validation-jakarta.validation-api-3.1.1 deleted (was f931d99b18)

2025-02-03 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/jakarta.validation-jakarta.validation-api-3.1.1 in repository https://gitbox.apache.org/repos/asf/pinot.git was f931d99b18 Bump jakarta.validation:jakarta.validation-ap

Re: [PR] Introducing MSE result holder config to minimize rehashing for high cardinality group by [pinot]

2025-02-03 Thread via GitHub
codecov-commenter commented on PR #14981: URL: https://github.com/apache/pinot/pull/14981#issuecomment-2632408914 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14981?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[PR] Introducing MSE result holder config to minimize rehashing for high cardinality group by [pinot]

2025-02-03 Thread via GitHub
shauryachats opened a new pull request, #14981: URL: https://github.com/apache/pinot/pull/14981 A new configuration to control the size of result holders for MSE is necessary to avoid resizing and rehashing operations in use cases where grouping is needed on high-cardinality columns (e.g.,

Re: [PR] Bump com.mchange:c3p0 from 0.10.1 to 0.10.2 [pinot]

2025-02-03 Thread via GitHub
Jackie-Jiang merged PR #14978: URL: https://github.com/apache/pinot/pull/14978 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] [timeseries] Add Support for limit and numGroupsLimit [pinot]

2025-02-03 Thread via GitHub
tibrewalpratik17 merged PR #14945: URL: https://github.com/apache/pinot/pull/14945 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@p

(pinot) branch master updated: [timeseries] Add Support for limit and numGroupsLimit (#14945)

2025-02-03 Thread pratik
This is an automated email from the ASF dual-hosted git repository. pratik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new c7fcda980b [timeseries] Add Support for limit and

(pinot) branch master updated: Bump com.mchange:c3p0 from 0.10.1 to 0.10.2 (#14978)

2025-02-03 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 8eb98534d2 Bump com.mchange:c3p0 from 0.10.1 to 0

(pinot) branch dependabot/maven/com.mchange-c3p0-0.10.2 deleted (was 12224b8484)

2025-02-03 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/com.mchange-c3p0-0.10.2 in repository https://gitbox.apache.org/repos/asf/pinot.git was 12224b8484 Bump com.mchange:c3p0 from 0.10.1 to 0.10.2 The revisions that were on th

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.30.11 deleted (was b3f564ef8f)

2025-02-03 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.30.11 in repository https://gitbox.apache.org/repos/asf/pinot.git was b3f564ef8f Bump software.amazon.awssdk:bom from 2.30.10 to 2.30.11 The r

Re: [PR] Bump software.amazon.awssdk:bom from 2.30.10 to 2.30.11 [pinot]

2025-02-03 Thread via GitHub
Jackie-Jiang merged PR #14977: URL: https://github.com/apache/pinot/pull/14977 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

(pinot) branch master updated (cbe1fd278d -> ac4374a1cf)

2025-02-03 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from cbe1fd278d Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.2 (#14975) add ac4374a1cf Bump so

(pinot) branch dependabot/maven/org.apache.httpcomponents.client5-httpclient5-5.4.2 deleted (was cc56ad9e60)

2025-02-03 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a change to branch dependabot/maven/org.apache.httpcomponents.client5-httpclient5-5.4.2 in repository https://gitbox.apache.org/repos/asf/pinot.git was cc56ad9e60 Bump org.apache.httpcomponents.client5:httpcl

(pinot) branch master updated: Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.2 (#14975)

2025-02-03 Thread jackie
This is an automated email from the ASF dual-hosted git repository. jackie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new cbe1fd278d Bump org.apache.httpcomponents.client5

Re: [PR] Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.2 [pinot]

2025-02-03 Thread via GitHub
Jackie-Jiang merged PR #14975: URL: https://github.com/apache/pinot/pull/14975 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

Re: [PR] [timeseries] Add Support for limit and numGroupsLimit [pinot]

2025-02-03 Thread via GitHub
ankitsultana commented on code in PR #14945: URL: https://github.com/apache/pinot/pull/14945#discussion_r1940034557 ## pinot-plugins/pinot-timeseries-lang/pinot-timeseries-m3ql/src/main/java/org/apache/pinot/tsdb/m3ql/M3TimeSeriesPlanner.java: ## @@ -152,7 +156,11 @@ public Base

Re: [PR] [timeseries] Add Support for limit and numGroupsLimit [pinot]

2025-02-03 Thread via GitHub
tibrewalpratik17 commented on code in PR #14945: URL: https://github.com/apache/pinot/pull/14945#discussion_r1940030515 ## pinot-plugins/pinot-timeseries-lang/pinot-timeseries-m3ql/src/main/java/org/apache/pinot/tsdb/m3ql/M3TimeSeriesPlanner.java: ## @@ -152,7 +156,11 @@ public

Re: [PR] [timeseries] Add Support for limit and numGroupsLimit [pinot]

2025-02-03 Thread via GitHub
ankitsultana commented on code in PR #14945: URL: https://github.com/apache/pinot/pull/14945#discussion_r1939936596 ## pinot-plugins/pinot-timeseries-lang/pinot-timeseries-m3ql/src/main/java/org/apache/pinot/tsdb/m3ql/M3TimeSeriesPlanner.java: ## @@ -78,7 +80,8 @@ public BaseTim

Re: [PR] [timeseries] Add Support for limit and numGroupsLimit [pinot]

2025-02-03 Thread via GitHub
raghavyadav01 commented on code in PR #14945: URL: https://github.com/apache/pinot/pull/14945#discussion_r1939932226 ## pinot-plugins/pinot-timeseries-lang/pinot-timeseries-m3ql/src/main/java/org/apache/pinot/tsdb/m3ql/M3TimeSeriesPlanner.java: ## @@ -78,7 +80,8 @@ public BaseTi

Re: [I] Server replica allowed to overwrite deep store segment after segment was already committed [pinot]

2025-02-03 Thread via GitHub
dang-stripe commented on issue #14786: URL: https://github.com/apache/pinot/issues/14786#issuecomment-2631671220 Yes, we were using upsert compaction for these segments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Push auth before query validation. [pinot]

2025-02-03 Thread via GitHub
codecov-commenter commented on PR #14953: URL: https://github.com/apache/pinot/pull/14953#issuecomment-2631657221 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14953?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939752971 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(

Re: [I] Null handing issue with Partial upserts and partialUpsertStrategies [pinot]

2025-02-03 Thread via GitHub
kishoreg commented on issue #14924: URL: https://github.com/apache/pinot/issues/14924#issuecomment-2631580298 Raghu, the partial update handler is a simple handler that takes old record and new record and returns a new record. May be you can add another handler and I think the handler is al

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939730030 ## pinot-core/src/main/java/org/apache/pinot/core/data/manager/BaseTableDataManager.java: ## @@ -389,15 +390,21 @@ protected void replaceSegmentIfCrcMismatch(SegmentDa

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939696837 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939694120 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939691471 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939687054 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(

Re: [PR] Add text_match() transform function. [pinot]

2025-02-03 Thread via GitHub
bziobrowski commented on code in PR #14980: URL: https://github.com/apache/pinot/pull/14980#discussion_r1939389293 ## pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/TextMatchTransformFunction.java: ## @@ -0,0 +1,100 @@ +/** + * Licensed to the Apache

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939679641 ## pinot-common/src/main/java/org/apache/pinot/common/utils/FileUploadDownloadClient.java: ## @@ -1274,6 +1275,47 @@ public File downloadUntarFileStreamed(URI uri, File

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939672741 ## pinot-server/src/main/java/org/apache/pinot/server/api/resources/ReIngestionResource.java: ## @@ -0,0 +1,525 @@ +/** + * Licensed to the Apache Software Foundation (

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939664013 ## pinot-controller/src/main/java/org/apache/pinot/controller/validation/RealtimeSegmentValidationManager.java: ## @@ -176,6 +177,12 @@ private void runSegmentLevelVali

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939663253 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
KKcorps commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939658249 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(

Re: [I] Null handing issue with Partial upserts and partialUpsertStrategies [pinot]

2025-02-03 Thread via GitHub
raghukn commented on issue #14924: URL: https://github.com/apache/pinot/issues/14924#issuecomment-2631361488 Thanks @mayankshriv -- Below is my usecase (DeNormalizing table and its extension table) - Fact table Tab1 with PK ID1 - Extension table of this, say TabX1 which shares the

(pinot) branch dependabot/maven/org.codehaus.mojo-buildnumber-maven-plugin-3.2.1 deleted (was eeeeef9962)

2025-02-03 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.codehaus.mojo-buildnumber-maven-plugin-3.2.1 in repository https://gitbox.apache.org/repos/asf/pinot.git was ef9962 Bump org.codehaus.mojo:buildnumber-maven-plu

Re: [I] Null handing issue with Partial upserts and partialUpsertStrategies [pinot]

2025-02-03 Thread via GitHub
mayankshriv commented on issue #14924: URL: https://github.com/apache/pinot/issues/14924#issuecomment-2631229240 Hi @raghukn, the idea behind current behavior is very intentional, and desired by most use cases. For example: * Use cases where sparse events are coming in for a PK, and we wa

Re: [PR] Bump org.codehaus.mojo:buildnumber-maven-plugin from 3.2.0 to 3.2.1 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] commented on PR #14976: URL: https://github.com/apache/pinot/pull/14976#issuecomment-2631227605 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Bump org.codehaus.mojo:buildnumber-maven-plugin from 3.2.0 to 3.2.1 [pinot]

2025-02-03 Thread via GitHub
abhioncbr closed pull request #14976: Bump org.codehaus.mojo:buildnumber-maven-plugin from 3.2.0 to 3.2.1 URL: https://github.com/apache/pinot/pull/14976 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Bump org.codehaus.mojo:buildnumber-maven-plugin from 3.2.0 to 3.2.1 [pinot]

2025-02-03 Thread via GitHub
abhioncbr commented on PR #14976: URL: https://github.com/apache/pinot/pull/14976#issuecomment-2631227487 We reverted this upgrade change recently. This should not be merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] Add text_match() transform function. [pinot]

2025-02-03 Thread via GitHub
codecov-commenter commented on PR #14980: URL: https://github.com/apache/pinot/pull/14980#issuecomment-263474 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14980?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Add text_match() transform function. [pinot]

2025-02-03 Thread via GitHub
bziobrowski commented on code in PR #14980: URL: https://github.com/apache/pinot/pull/14980#discussion_r1939389293 ## pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/TextMatchTransformFunction.java: ## @@ -0,0 +1,100 @@ +/** + * Licensed to the Apache

[PR] Add text_match() transform function. [pinot]

2025-02-03 Thread via GitHub
bziobrowski opened a new pull request, #14980: URL: https://github.com/apache/pinot/pull/14980 PR adds text_match() transform function, making it possible to use function outside WHERe clause, e.g. in SELECT. Example: - expression in SELECT list ```sql select id, skills, TEXT

Re: [PR] Fixes flaky test [pinot]

2025-02-03 Thread via GitHub
noob-se7en commented on PR #14970: URL: https://github.com/apache/pinot/pull/14970#issuecomment-2631002244 > We still want to test the case with batch size 1. Can you analyze the test failure log and see why the test is failing? Does increasing time out help here? Yes, But it's alread

Re: [PR] Releases partitionGroupConsumerSemaphore incase of Errors [pinot]

2025-02-03 Thread via GitHub
xiangfu0 merged PR #14974: URL: https://github.com/apache/pinot/pull/14974 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apa

(pinot) branch master updated: Releases partitionGroupConsumerSemaphore incase of Errors (#14974)

2025-02-03 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 891f7d19f0 Releases partitionGroupConsumerSemaph

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939232541 ## pinot-server/src/main/java/org/apache/pinot/server/api/resources/ReIngestionResource.java: ## @@ -0,0 +1,525 @@ +/** + * Licensed to the Apache Software Foundation (AS

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939232541 ## pinot-server/src/main/java/org/apache/pinot/server/api/resources/ReIngestionResource.java: ## @@ -0,0 +1,525 @@ +/** + * Licensed to the Apache Software Foundation (AS

(pinot) branch dependabot/maven/org.codehaus.mojo-buildnumber-maven-plugin-3.2.1 created (now eeeeef9962)

2025-02-03 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.codehaus.mojo-buildnumber-maven-plugin-3.2.1 in repository https://gitbox.apache.org/repos/asf/pinot.git at ef9962 Bump org.codehaus.mojo:buildnumber-maven-plu

Re: [PR] Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.1 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] closed pull request #14327: Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.1 URL: https://github.com/apache/pinot/pull/14327 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[PR] Bump com.mchange:c3p0 from 0.10.1 to 0.10.2 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] opened a new pull request, #14978: URL: https://github.com/apache/pinot/pull/14978 Bumps [com.mchange:c3p0](https://github.com/swaldman/c3p0) from 0.10.1 to 0.10.2. Changelog Sourced from https://github.com/swaldman/c3p0/blob/0.11.x/CHANGELOG";>com.mchange:c3p0's c

(pinot) branch dependabot/maven/jakarta.validation-jakarta.validation-api-3.1.1 created (now f931d99b18)

2025-02-03 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/jakarta.validation-jakarta.validation-api-3.1.1 in repository https://gitbox.apache.org/repos/asf/pinot.git at f931d99b18 Bump jakarta.validation:jakarta.validation-ap

[PR] Bump jakarta.validation:jakarta.validation-api from 2.0.2 to 3.1.1 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] opened a new pull request, #14979: URL: https://github.com/apache/pinot/pull/14979 Bumps [jakarta.validation:jakarta.validation-api](https://github.com/jakartaee/validation) from 2.0.2 to 3.1.1. Release notes Sourced from https://github.com/jakartaee/validation/rel

[PR] Bump software.amazon.awssdk:bom from 2.30.10 to 2.30.11 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] opened a new pull request, #14977: URL: https://github.com/apache/pinot/pull/14977 Bumps software.amazon.awssdk:bom from 2.30.10 to 2.30.11. Most Recent Ignore Conditions Applied to This Pull Request | Dependency Name | Ignore Conditions | | --- | --- |

(pinot) branch dependabot/maven/com.mchange-c3p0-0.10.2 created (now 12224b8484)

2025-02-03 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/com.mchange-c3p0-0.10.2 in repository https://gitbox.apache.org/repos/asf/pinot.git at 12224b8484 Bump com.mchange:c3p0 from 0.10.1 to 0.10.2 No new revisions were add

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.30.11 created (now b3f564ef8f)

2025-02-03 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.30.11 in repository https://gitbox.apache.org/repos/asf/pinot.git at b3f564ef8f Bump software.amazon.awssdk:bom from 2.30.10 to 2.30.11 N

[PR] Bump org.codehaus.mojo:buildnumber-maven-plugin from 3.2.0 to 3.2.1 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] opened a new pull request, #14976: URL: https://github.com/apache/pinot/pull/14976 Bumps [org.codehaus.mojo:buildnumber-maven-plugin](https://github.com/mojohaus/buildnumber-maven-plugin) from 3.2.0 to 3.2.1. Release notes Sourced from https://github.com/mojohaus/b

(pinot) branch dependabot/maven/org.apache.httpcomponents.client5-httpclient5-5.4.1 deleted (was dcbba40b52)

2025-02-03 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.apache.httpcomponents.client5-httpclient5-5.4.1 in repository https://gitbox.apache.org/repos/asf/pinot.git was dcbba40b52 Bump org.apache.httpcomponents.client5:ht

Re: [PR] Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.1 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] commented on PR #14327: URL: https://github.com/apache/pinot/pull/14327#issuecomment-2630666190 Superseded by #14975. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(pinot) branch dependabot/maven/org.apache.httpcomponents.client5-httpclient5-5.4.2 created (now cc56ad9e60)

2025-02-03 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.apache.httpcomponents.client5-httpclient5-5.4.2 in repository https://gitbox.apache.org/repos/asf/pinot.git at cc56ad9e60 Bump org.apache.httpcomponents.client5:ht

[PR] Bump org.apache.httpcomponents.client5:httpclient5 from 5.3.1 to 5.4.2 [pinot]

2025-02-03 Thread via GitHub
dependabot[bot] opened a new pull request, #14975: URL: https://github.com/apache/pinot/pull/14975 Bumps [org.apache.httpcomponents.client5:httpclient5](https://github.com/apache/httpcomponents-client) from 5.3.1 to 5.4.2. Changelog Sourced from https://github.com/apache/httpcompo

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939198758 ## pinot-server/src/main/java/org/apache/pinot/server/api/resources/ReIngestionResource.java: ## @@ -0,0 +1,525 @@ +/** + * Licensed to the Apache Software Foundation (AS

Re: [PR] Releases partitionGroupConsumerSemaphore incase of Errors [pinot]

2025-02-03 Thread via GitHub
codecov-commenter commented on PR #14974: URL: https://github.com/apache/pinot/pull/14974#issuecomment-2630589633 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14974?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Releases partitionGroupConsumerSemaphore incase of Errors [pinot]

2025-02-03 Thread via GitHub
codecov-commenter commented on PR #14973: URL: https://github.com/apache/pinot/pull/14973#issuecomment-2630547506 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14973?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939111661 ## pinot-core/src/main/java/org/apache/pinot/core/data/manager/BaseTableDataManager.java: ## @@ -389,15 +390,21 @@ protected void replaceSegmentIfCrcMismatch(SegmentData

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939110550 ## pinot-core/src/main/java/org/apache/pinot/core/data/manager/BaseTableDataManager.java: ## @@ -389,15 +390,21 @@ protected void replaceSegmentIfCrcMismatch(SegmentData

Re: [PR] Add debug API for pauseless tables. Add pauselessFSM as an option in realtimeQuickStart [pinot]

2025-02-03 Thread via GitHub
swaminathanmanish commented on code in PR #14961: URL: https://github.com/apache/pinot/pull/14961#discussion_r1939099616 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotRealtimeTableResource.java: ## @@ -301,6 +309,74 @@ public ConsumingSegmentIn

Re: [PR] Add debug API for pauseless tables. Add pauselessFSM as an option in realtimeQuickStart [pinot]

2025-02-03 Thread via GitHub
swaminathanmanish commented on code in PR #14961: URL: https://github.com/apache/pinot/pull/14961#discussion_r1939090788 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotRealtimeTableResource.java: ## @@ -301,6 +309,74 @@ public ConsumingSegmentIn

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939094922 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(St

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939093329 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(St

[PR] Releases partitionGroupConsumerSemaphore incase of Errors [pinot]

2025-02-03 Thread via GitHub
noob-se7en opened a new pull request, #14974: URL: https://github.com/apache/pinot/pull/14974 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [I] Null handing issue with Partial upserts and partialUpsertStrategies [pinot]

2025-02-03 Thread via GitHub
raghukn commented on issue #14924: URL: https://github.com/apache/pinot/issues/14924#issuecomment-2630452963 All, Is there any work around atall to achieve this?? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939085910 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(St

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1939084497 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(St

Re: [PR] Releases partitionGroupConsumerSemaphore incase of Errors [pinot]

2025-02-03 Thread via GitHub
noob-se7en closed pull request #14973: Releases partitionGroupConsumerSemaphore incase of Errors URL: https://github.com/apache/pinot/pull/14973 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[PR] Releases partitionGroupConsumerSemaphore incase of Errors [pinot]

2025-02-03 Thread via GitHub
noob-se7en opened a new pull request, #14973: URL: https://github.com/apache/pinot/pull/14973 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [I] Issue with NULL storage in column with 1.4.0 (must be there earlier versions too) [pinot]

2025-02-03 Thread via GitHub
raghukn commented on issue #14922: URL: https://github.com/apache/pinot/issues/14922#issuecomment-2630381642 @Jackie-Jiang yes, I was nissing this setting. I had assumed that setting automatically assumes table null handling is enabled. Thanks for your inputs. One ques

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1938946714 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(St

Re: [PR] Pauseless Consumption #3: Disaster Recovery with Reingestion [pinot]

2025-02-03 Thread via GitHub
9aman commented on code in PR #14920: URL: https://github.com/apache/pinot/pull/14920#discussion_r1938938285 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java: ## @@ -2096,6 +2104,137 @@ URI createSegmentPath(St