[I] Support for S3A Connector [pinot]

2024-10-25 Thread via GitHub
chrajeshbabu opened a new issue, #14312: URL: https://github.com/apache/pinot/issues/14312 Currently conntroller and servers able to start with s3a path but while creating the segments during ingestion facing following error because while preparing file names we are prefixing the s3 scheme

Re: [PR] Add optional 5th parameter - bucketing time zone - to dateTimeConvet() function [pinot]

2024-10-25 Thread via GitHub
bziobrowski commented on code in PR #14298: URL: https://github.com/apache/pinot/pull/14298#discussion_r1817374230 ## pinot-core/src/main/java/org/apache/pinot/core/operator/transform/transformer/datetime/DateTimeTransformerFactory.java: ## @@ -29,23 +30,39 @@ private DateTimeTr

Re: [PR] Add IGNORE NULLS option to FIRST_VALUE and LAST_VALUE window functions [pinot]

2024-10-25 Thread via GitHub
yashmayya commented on code in PR #14264: URL: https://github.com/apache/pinot/pull/14264#discussion_r1816148251 ## pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/NullHandlingIntegrationTest.java: ## @@ -326,6 +326,31 @@ public void testAggregateServerR

Re: [PR] Set skipUnparseableLines to true by default in CSV reader [pinot]

2024-10-25 Thread via GitHub
codecov-commenter commented on PR #14311: URL: https://github.com/apache/pinot/pull/14311#issuecomment-2437797887 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14311?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[I] Proposal: Extending merge rollup capabilities [pinot]

2024-10-25 Thread via GitHub
davecromberge opened a new issue, #14310: URL: https://github.com/apache/pinot/issues/14310 ### What needs to be done? Extend the merge-rollup framework to create additional transformations: - dimensionality reduction/erasure - varying aggregate behaviour over time Di

(pinot) branch master updated: [timeseries] Define Time Series ID and Broker Response Name Tag Semantics (#14286)

2024-10-25 Thread pratik
This is an automated email from the ASF dual-hosted git repository. pratik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 455e194195 [timeseries] Define Time Series ID and

Re: [PR] [timeseries] Define Time Series ID and Broker Response Name Tag Semantics [pinot]

2024-10-25 Thread via GitHub
tibrewalpratik17 merged PR #14286: URL: https://github.com/apache/pinot/pull/14286 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@p

Re: [PR] Enforce continue on error flag during batch segment ingestion as well [pinot]

2024-10-25 Thread via GitHub
codecov-commenter commented on PR #14309: URL: https://github.com/apache/pinot/pull/14309#issuecomment-2437735185 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14309?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[PR] Set skipUnparseableLines to true by default in CSV reader [pinot]

2024-10-25 Thread via GitHub
KKcorps opened a new pull request, #14311: URL: https://github.com/apache/pinot/pull/14311 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

[PR] Enforce continue on error flag during batch segment ingestion as well [pinot]

2024-10-25 Thread via GitHub
KKcorps opened a new pull request, #14309: URL: https://github.com/apache/pinot/pull/14309 This will allow us to ingest data even when some records are corrupt in a file -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Add optional 5th parameter - bucketing time zone - to dateTimeConvet() function [pinot]

2024-10-25 Thread via GitHub
gortiz commented on code in PR #14298: URL: https://github.com/apache/pinot/pull/14298#discussion_r1816504749 ## pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/DateTimeConversionTransformFunction.java: ## @@ -93,10 +113,14 @@ public String getName() {

[PR] Bump software.amazon.awssdk:bom from 2.28.12 to 2.29.0 [pinot]

2024-10-25 Thread via GitHub
dependabot[bot] opened a new pull request, #14308: URL: https://github.com/apache/pinot/pull/14308 Bumps software.amazon.awssdk:bom from 2.28.12 to 2.29.0. Most Recent Ignore Conditions Applied to This Pull Request | Dependency Name | Ignore Conditions | | --- | --- |

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.29.0 created (now 3ccf8a4382)

2024-10-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.29.0 in repository https://gitbox.apache.org/repos/asf/pinot.git at 3ccf8a4382 Bump software.amazon.awssdk:bom from 2.28.12 to 2.29.0 No

(pinot) branch dependabot/maven/org.apache.zookeeper-zookeeper-3.9.3 created (now 41bbae839c)

2024-10-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.apache.zookeeper-zookeeper-3.9.3 in repository https://gitbox.apache.org/repos/asf/pinot.git at 41bbae839c Bump org.apache.zookeeper:zookeeper from 3.9.2 to 3.9.3

[PR] Bump org.apache.zookeeper:zookeeper from 3.9.2 to 3.9.3 [pinot]

2024-10-25 Thread via GitHub
dependabot[bot] opened a new pull request, #14307: URL: https://github.com/apache/pinot/pull/14307 Bumps org.apache.zookeeper:zookeeper from 3.9.2 to 3.9.3. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=org.ap

Re: [PR] Fix pinot-perf annotation processor support [pinot]

2024-10-25 Thread via GitHub
codecov-commenter commented on PR #14306: URL: https://github.com/apache/pinot/pull/14306#issuecomment-2437523081 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14306?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Fix window frame upper bound offset extraction in PinotWindowExchangeNodeInsertRule [pinot]

2024-10-25 Thread via GitHub
codecov-commenter commented on PR #14304: URL: https://github.com/apache/pinot/pull/14304#issuecomment-2437480121 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14304?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

Re: [PR] Fix pinot-perf annotation processor support [pinot]

2024-10-25 Thread via GitHub
gortiz commented on PR #14306: URL: https://github.com/apache/pinot/pull/14306#issuecomment-2437457605 cc @bziobrowski -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[I] Upsert Small Segment Merger Task [Minion] [pinot]

2024-10-25 Thread via GitHub
tibrewalpratik17 opened a new issue, #14305: URL: https://github.com/apache/pinot/issues/14305 The concept of compaction traditionally refers to the process of making something denser or more tightly packed. In its current implementation, the Upsert-Compaction task in Apache Pinot operates

Re: [PR] Minion Task to support automatic Segment Refresh [pinot]

2024-10-25 Thread via GitHub
tibrewalpratik17 commented on PR #14300: URL: https://github.com/apache/pinot/pull/14300#issuecomment-2437243709 > We can increase concurrency for segment refresh thereby reducing the total time to reload all segments Are you suggesting an increase in concurrency at the minion level o

Re: [I] Not able to connect to slack [pinot]

2024-10-25 Thread via GitHub
Jackie-Jiang commented on issue #14297: URL: https://github.com/apache/pinot/issues/14297#issuecomment-2435864314 cc @xiangfu0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] Not able to connect to slack [pinot]

2024-10-25 Thread via GitHub
abhioncbr commented on issue #14297: URL: https://github.com/apache/pinot/issues/14297#issuecomment-2435599885 try this, apache-pinot.slack.com -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] bugfix: TextMatchFilterOptimizer grouping for inner compound query [pinot]

2024-10-25 Thread via GitHub
itschrispeck opened a new pull request, #14299: URL: https://github.com/apache/pinot/pull/14299 I missed this edge case when adding TextMatchFilterOptimizer. For a query such as `text_match(col1, 'aaa') AND text_match(col1, 'bbb OR ccc')`, this would have previously been optimized to

Re: [PR] Make it explicit that receive plan node should have no inputs [pinot]

2024-10-25 Thread via GitHub
codecov-commenter commented on PR #14294: URL: https://github.com/apache/pinot/pull/14294#issuecomment-2435382916 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14294?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[PR] Minion Task to support automatic Segment Refresh [pinot]

2024-10-25 Thread via GitHub
vvivekiyer opened a new pull request, #14300: URL: https://github.com/apache/pinot/pull/14300 Currently, when new columns are added or indexes are added/removed, the segment reloads happen on the server. There are a number of issues with this approach: 1. Increased startup times for

(pinot) branch intellij-method-chain-chop-if-long deleted (was 202fc995d1)

2024-10-25 Thread gortiz
This is an automated email from the ASF dual-hosted git repository. gortiz pushed a change to branch intellij-method-chain-chop-if-long in repository https://gitbox.apache.org/repos/asf/pinot.git was 202fc995d1 keep line breaks when reformatting The revisions that were on this branch are s

(pinot) branch revert-14290-intellij-method-chain-chop-if-long created (now d6a68807a2)

2024-10-25 Thread gortiz
This is an automated email from the ASF dual-hosted git repository. gortiz pushed a change to branch revert-14290-intellij-method-chain-chop-if-long in repository https://gitbox.apache.org/repos/asf/pinot.git at d6a68807a2 Revert "Update intellij codestyle (#14290)" This branch includes t

Re: [PR] Make it explicit that receive plan node should have no inputs [pinot]

2024-10-25 Thread via GitHub
gortiz merged PR #14294: URL: https://github.com/apache/pinot/pull/14294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apach

(pinot) 01/01: Revert "Update intellij codestyle (#14290)"

2024-10-25 Thread gortiz
This is an automated email from the ASF dual-hosted git repository. gortiz pushed a commit to branch revert-14290-intellij-method-chain-chop-if-long in repository https://gitbox.apache.org/repos/asf/pinot.git commit d6a68807a24cfaa2a4f2c059e4267ec68138af34 Author: Gonzalo Ortiz Jaureguizar Autho

(pinot) branch master updated (7c0c53f492 -> 4909b24a23)

2024-10-25 Thread gortiz
This is an automated email from the ASF dual-hosted git repository. gortiz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 7c0c53f492 Make it explicit that receive plan node should have no inputs (#14294) add 4909b24a23 Update intellij

Re: [PR] Update intellij codestyle [pinot]

2024-10-25 Thread via GitHub
gortiz merged PR #14290: URL: https://github.com/apache/pinot/pull/14290 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apach

(pinot) branch master updated (44eb01feae -> 7c0c53f492)

2024-10-25 Thread gortiz
This is an automated email from the ASF dual-hosted git repository. gortiz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 44eb01feae Use fixed thread pool in Pinot Controller (#14159) add 7c0c53f492 Make it explicit that receive plan no

Re: [PR] Add IGNORE NULLS option to FIRST_VALUE and LAST_VALUE window functions [pinot]

2024-10-25 Thread via GitHub
yashmayya commented on code in PR #14264: URL: https://github.com/apache/pinot/pull/14264#discussion_r1816156864 ## pinot-query-planner/src/main/java/org/apache/pinot/calcite/sql/fun/PinotOperatorTable.java: ## @@ -152,7 +149,17 @@ public static PinotOperatorTable instance() {

Re: [PR] [spool] Define equivalence between stages [pinot]

2024-10-25 Thread via GitHub
gortiz commented on code in PR #14296: URL: https://github.com/apache/pinot/pull/14296#discussion_r1816149443 ## pinot-query-planner/src/test/java/org/apache/pinot/query/planner/logical/EquivalentStagesFinderTest.java: ## @@ -0,0 +1,202 @@ +/** + * Licensed to the Apache Softwar

Re: [PR] Add IGNORE NULLS option to FIRST_VALUE and LAST_VALUE window functions [pinot]

2024-10-25 Thread via GitHub
yashmayya commented on code in PR #14264: URL: https://github.com/apache/pinot/pull/14264#discussion_r1816148251 ## pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/NullHandlingIntegrationTest.java: ## @@ -326,6 +326,31 @@ public void testAggregateServerR

Re: [PR] [spool] Define equivalence between stages [pinot]

2024-10-25 Thread via GitHub
gortiz commented on code in PR #14296: URL: https://github.com/apache/pinot/pull/14296#discussion_r1816145901 ## pinot-query-planner/src/main/java/org/apache/pinot/query/planner/plannode/PlanNodeVisitor.java: ## @@ -63,4 +63,150 @@ public interface PlanNodeVisitor { T visitEx

Re: [PR] [spool] Define equivalence between stages [pinot]

2024-10-25 Thread via GitHub
gortiz commented on code in PR #14296: URL: https://github.com/apache/pinot/pull/14296#discussion_r1816144288 ## pinot-query-planner/src/main/java/org/apache/pinot/query/planner/logical/EquivalentStagesFinder.java: ## @@ -0,0 +1,339 @@ +/** + * Licensed to the Apache Software Fo

Re: [PR] Bump lucene.version from 9.11.1 to 10.0.0 [pinot]

2024-10-25 Thread via GitHub
abhioncbr commented on PR #14219: URL: https://github.com/apache/pinot/pull/14219#issuecomment-2435375372 > @abhioncbr : do we know if Lucene 10.0 is backwards compatible with 9.x. > > More specifically, are the Lucene 10.x readers capable of reading Lucene 9.x indexes? Also, do we kn

(pinot) branch dependabot/maven/com.google.protobuf-protobuf-bom-4.28.3 deleted (was 0421ca5e0b)

2024-10-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/com.google.protobuf-protobuf-bom-4.28.3 in repository https://gitbox.apache.org/repos/asf/pinot.git was 0421ca5e0b Bump com.google.protobuf:protobuf-bom from 3.25.5 to

(pinot-site) branch new-site-dev updated: Update slack invite link (#137)

2024-10-25 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch new-site-dev in repository https://gitbox.apache.org/repos/asf/pinot-site.git The following commit(s) were added to refs/heads/new-site-dev by this push: new 95b35d7f Update slack invite li

[PR] [WIP] Add initial implementation immtuable CLPForwardIndex as associated classes [pinot]

2024-10-25 Thread via GitHub
jackluo923 opened a new pull request, #14288: URL: https://github.com/apache/pinot/pull/14288 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

[PR] Fix window frame upper bound offset extraction in PinotWindowExchangeNodeInsertRule [pinot]

2024-10-25 Thread via GitHub
yashmayya opened a new pull request, #14304: URL: https://github.com/apache/pinot/pull/14304 - This is a bug fix for window frame upper bound offset extraction in `PinotWindowExchangeNodeInsertRule` (from changes recently merged in https://github.com/apache/pinot/pull/14273). - This patc

Re: [PR] Make it explicit that receive plan node should have no inputs [pinot]

2024-10-25 Thread via GitHub
gortiz commented on PR #14294: URL: https://github.com/apache/pinot/pull/14294#issuecomment-2435292088 cc @bziobrowski (I cannot directly add you to the watchers) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Add support for defining custom window frame bounds for window functions [pinot]

2024-10-25 Thread via GitHub
Jackie-Jiang commented on code in PR #14273: URL: https://github.com/apache/pinot/pull/14273#discussion_r1814225259 ## pinot-query-planner/src/main/java/org/apache/pinot/query/planner/plannode/WindowNode.java: ## @@ -30,6 +30,7 @@ public class WindowNode extends BasePlanNode {

Re: [I] Lucene 10.0 upgrade [pinot]

2024-10-25 Thread via GitHub
abhioncbr commented on issue #14232: URL: https://github.com/apache/pinot/issues/14232#issuecomment-2435368703 The documentation shared by @hpvd, [link](https://lucene.apache.org/core/corenews.html#apache-lucenetm-1000-available) mentions that Lucene 10 needs JDK21 or newer https://g

Re: [PR] Upgrade http5 Client to 5.4 and using Http 2 Protocol [pinot]

2024-10-25 Thread via GitHub
Jackie-Jiang commented on PR #14191: URL: https://github.com/apache/pinot/pull/14191#issuecomment-2436122218 For reference: [5.4 release note](https://downloads.apache.org/httpcomponents/httpclient/RELEASE_NOTES-5.4.x.txt) -- This is an automated message from the Apache Git Service. To re

Re: [PR] fix(ui): remove redundant api calls in home page [pinot]

2024-10-25 Thread via GitHub
codecov-commenter commented on PR #14295: URL: https://github.com/apache/pinot/pull/14295#issuecomment-2435516082 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/14295?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

(pinot-site) branch update-invite-link deleted (was 84cc36b8)

2024-10-25 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch update-invite-link in repository https://gitbox.apache.org/repos/asf/pinot-site.git was 84cc36b8 Update slack invite link The revisions that were on this branch are still contained in othe

Re: [PR] Bump com.google.protobuf:protobuf-bom from 3.25.5 to 4.28.3 [pinot]

2024-10-25 Thread via GitHub
Jackie-Jiang commented on PR #14291: URL: https://github.com/apache/pinot/pull/14291#issuecomment-2435960035 @dependabot ignore this major version -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Upgrade http5 Client to 5.4 and using Http 2 Protocol [pinot]

2024-10-25 Thread via GitHub
Jackie-Jiang commented on code in PR #14191: URL: https://github.com/apache/pinot/pull/14191#discussion_r1815521655 ## pinot-common/src/main/java/org/apache/pinot/common/http/MultiHttpRequest.java: ## @@ -116,7 +117,8 @@ public CompletionService completionService = new Execut