[I] EDA-Brokers - PINOT TO PULSAR TOPICS [pinot]

2024-11-28 Thread via GitHub
arunkumarck opened a new issue, #14567: URL: https://github.com/apache/pinot/issues/14567 I really love pinot. I see that there is a connector from Pulsar Topic to Pinot for persisting data. But when it comes to retrieving from Pinot and fire-hosing it to a pulsar topic or two, there

Re: [PR] Cleanup Redundant JMX Exporter Rules [pinot]

2024-11-28 Thread via GitHub
suddendust commented on code in PR #14348: URL: https://github.com/apache/pinot/pull/14348#discussion_r1862967416 ## docker/images/pinot/etc/jmx_prometheus_javaagent/configs/server.yml: ## @@ -1,99 +1,12 @@ rules: -- pattern: "\"org\\.apache\\.pinot\\.common\\.metrics\"<>(\\w+

[I] Bulk Delete segments in deep store if it is supported. [pinot]

2024-11-28 Thread via GitHub
vrajat opened a new issue, #14566: URL: https://github.com/apache/pinot/issues/14566 Segments are deleted one by one from deep store during a table delete operation. If there are a large number of segments, the segment deletion phase may take a long time. e.g. it took 54 minutes to delete 6

Re: [PR] Allow override of segment name when uploading a segment tar file [pinot]

2024-11-28 Thread via GitHub
vrajat closed pull request #14455: Allow override of segment name when uploading a segment tar file URL: https://github.com/apache/pinot/pull/14455 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Allow override of segment name when uploading a segment tar file [pinot]

2024-11-28 Thread via GitHub
vrajat commented on PR #14455: URL: https://github.com/apache/pinot/pull/14455#issuecomment-2507062523 Agree. Also that seems like a major surgery and not worthwhile for the current use case (generate large data sets). I'll close this PR for now. -- This is an automated message from the A

Re: [PR] Adds check if controller tmp dir exists [pinot]

2024-11-28 Thread via GitHub
xiangfu0 commented on code in PR #14503: URL: https://github.com/apache/pinot/pull/14503#discussion_r1862754411 ## pinot-common/src/main/java/org/apache/pinot/common/utils/FileUtils.java: ## @@ -134,4 +136,15 @@ public static File concatAndValidateFile(File folderDir, String fi

Re: [PR] Add test to check data and index types compatibility [pinot]

2024-11-28 Thread via GitHub
bziobrowski commented on PR #14493: URL: https://github.com/apache/pinot/pull/14493#issuecomment-2506827402 @Jackie-Jiang I rewrote test at unit level. It takes about 5 seconds now (vs 5+ minutes before). @gortiz As discussed, I rewrote test to assert test cases against .csv f

Re: [PR] Add a Server API to list segments that need to be refreshed for a table [pinot]

2024-11-28 Thread via GitHub
vrajat commented on PR #14451: URL: https://github.com/apache/pinot/pull/14451#issuecomment-2506102938 Two more outstanding items: * Add a test where server returns an error. Is there a way to mock that ? * Add tests for startree index -- This is an automated message from the Apache

Re: [PR] [WIP] Pluggable fsm [pinot]

2024-11-28 Thread via GitHub
KKcorps commented on code in PR #14088: URL: https://github.com/apache/pinot/pull/14088#discussion_r1862173178 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/SegmentCompletionFSMFactory.java: ## @@ -0,0 +1,144 @@ +/** + * Licensed to the Apache

Re: [PR] Add a Server API to list segments that need to be refreshed for a table [pinot]

2024-11-28 Thread via GitHub
vrajat commented on code in PR #14451: URL: https://github.com/apache/pinot/pull/14451#discussion_r1862165234 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotSegmentRestletResource.java: ## @@ -891,6 +892,31 @@ public String getTableReloadMetadat

Re: [PR] Add a Server API to list segments that need to be refreshed for a table [pinot]

2024-11-28 Thread via GitHub
vrajat commented on code in PR #14451: URL: https://github.com/apache/pinot/pull/14451#discussion_r1862161067 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/data/manager/TableDataManager.java: ## @@ -323,4 +323,12 @@ default void onConsumingToDropped(String

(pinot) branch dependabot/maven/kotlin.stdlib.version-2.1.0 created (now e232c7df9b)

2024-11-28 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/kotlin.stdlib.version-2.1.0 in repository https://gitbox.apache.org/repos/asf/pinot.git at e232c7df9b Bump kotlin.stdlib.version from 2.0.21 to 2.1.0 No new revisions

[PR] Bump io.grpc:grpc-bom from 1.68.1 to 1.68.2 [pinot]

2024-11-28 Thread via GitHub
dependabot[bot] opened a new pull request, #14565: URL: https://github.com/apache/pinot/pull/14565 Bumps [io.grpc:grpc-bom](https://github.com/grpc/grpc-java) from 1.68.1 to 1.68.2. Release notes Sourced from https://github.com/grpc/grpc-java/releases";>io.grpc:grpc-bom's releases

(pinot) branch dependabot/maven/io.grpc-grpc-bom-1.68.2 created (now 475bc506c6)

2024-11-28 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/io.grpc-grpc-bom-1.68.2 in repository https://gitbox.apache.org/repos/asf/pinot.git at 475bc506c6 Bump io.grpc:grpc-bom from 1.68.1 to 1.68.2 No new revisions were add

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.29.23 created (now 2ccdacc37b)

2024-11-28 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.29.23 in repository https://gitbox.apache.org/repos/asf/pinot.git at 2ccdacc37b Bump software.amazon.awssdk:bom from 2.29.22 to 2.29.23 N

[PR] Bump software.amazon.awssdk:bom from 2.29.22 to 2.29.23 [pinot]

2024-11-28 Thread via GitHub
dependabot[bot] opened a new pull request, #14564: URL: https://github.com/apache/pinot/pull/14564 Bumps software.amazon.awssdk:bom from 2.29.22 to 2.29.23. Most Recent Ignore Conditions Applied to This Pull Request | Dependency Name | Ignore Conditions | | --- | --- |

[PR] Bump kotlin.stdlib.version from 2.0.21 to 2.1.0 [pinot]

2024-11-28 Thread via GitHub
dependabot[bot] opened a new pull request, #14563: URL: https://github.com/apache/pinot/pull/14563 Bumps `kotlin.stdlib.version` from 2.0.21 to 2.1.0. Updates `org.jetbrains.kotlin:kotlin-stdlib-jdk8` from 2.0.21 to 2.1.0 Release notes Sourced from https://github.com/JetBrains/ko

(pinot) branch dependabot/maven/com.fasterxml.jackson-jackson-bom-2.18.2 created (now a1fc040be7)

2024-11-28 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/com.fasterxml.jackson-jackson-bom-2.18.2 in repository https://gitbox.apache.org/repos/asf/pinot.git at a1fc040be7 Bump com.fasterxml.jackson:jackson-bom from 2.18.1 t

[PR] Bump com.fasterxml.jackson:jackson-bom from 2.18.1 to 2.18.2 [pinot]

2024-11-28 Thread via GitHub
dependabot[bot] opened a new pull request, #14562: URL: https://github.com/apache/pinot/pull/14562 Bumps [com.fasterxml.jackson:jackson-bom](https://github.com/FasterXML/jackson-bom) from 2.18.1 to 2.18.2. Commits https://github.com/FasterXML/jackson-bom/commit/55ff098b6134ce5

(pinot) branch master updated (a461989026 -> b1c7be2b97)

2024-11-28 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from a461989026 Bump software.amazon.awssdk:bom from 2.29.21 to 2.29.22 (#14549) add b1c7be2b97 Configure cross reg

Re: [PR] Configure cross region access in s3 client [pinot]

2024-11-28 Thread via GitHub
yashmayya merged PR #14561: URL: https://github.com/apache/pinot/pull/14561 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.ap

Re: [PR] [WIP] Pluggable fsm [pinot]

2024-11-28 Thread via GitHub
KKcorps commented on code in PR #14088: URL: https://github.com/apache/pinot/pull/14088#discussion_r1861838450 ## pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/SegmentCompletionFSMState.java: ## @@ -0,0 +1,30 @@ +/** + * Licensed to the Apache So

Re: [PR] Cleanup Redundant JMX Exporter Rules [pinot]

2024-11-28 Thread via GitHub
suddendust commented on code in PR #14348: URL: https://github.com/apache/pinot/pull/14348#discussion_r1861795559 ## docker/images/pinot/etc/jmx_prometheus_javaagent/configs/broker.yml: ## @@ -1,206 +1,13 @@ rules: -- pattern: "\"org\\.apache\\.pinot\\.common\\.metrics\"<>(\\w

Re: [PR] Cleanup Redundant JMX Exporter Rules [pinot]

2024-11-28 Thread via GitHub
suddendust commented on code in PR #14348: URL: https://github.com/apache/pinot/pull/14348#discussion_r1861768993 ## docker/images/pinot/etc/jmx_prometheus_javaagent/configs/broker.yml: ## @@ -1,206 +1,13 @@ rules: -- pattern: "\"org\\.apache\\.pinot\\.common\\.metrics\"<>(\\w

Re: [PR] Configure cross region access in s3 client [pinot]

2024-11-28 Thread via GitHub
suddendust commented on code in PR #14561: URL: https://github.com/apache/pinot/pull/14561#discussion_r1861742085 ## pinot-plugins/pinot-file-system/pinot-s3/src/main/java/org/apache/pinot/plugin/filesystem/S3PinotFS.java: ## @@ -161,6 +161,8 @@ public void init(PinotConfigurati

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.29.22 deleted (was a555c11358)

2024-11-28 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.29.22 in repository https://gitbox.apache.org/repos/asf/pinot.git was a555c11358 Bump software.amazon.awssdk:bom from 2.29.21 to 2.29.22 Th

(pinot) branch master updated (2d470e79e0 -> a461989026)

2024-11-28 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 2d470e79e0 Adjust RequestUtils#getTableNames to get table names from both left and right sides of join (#14554)

Re: [PR] Bump software.amazon.awssdk:bom from 2.29.21 to 2.29.22 [pinot]

2024-11-28 Thread via GitHub
yashmayya merged PR #14549: URL: https://github.com/apache/pinot/pull/14549 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.ap

Re: [I] RequestUtils getTableNames does not return multiple table names for sql join queries [pinot]

2024-11-28 Thread via GitHub
yashmayya closed issue #14555: RequestUtils getTableNames does not return multiple table names for sql join queries URL: https://github.com/apache/pinot/issues/14555 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] RequestUtils getTableNames does not return multiple table names for sql join queries [pinot]

2024-11-28 Thread via GitHub
yashmayya commented on issue #14555: URL: https://github.com/apache/pinot/issues/14555#issuecomment-2505484566 Fixed in https://github.com/apache/pinot/pull/14554 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

(pinot) branch master updated: Adjust RequestUtils#getTableNames to get table names from both left and right sides of join (#14554)

2024-11-28 Thread yashmayya
This is an automated email from the ASF dual-hosted git repository. yashmayya pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 2d470e79e0 Adjust RequestUtils#getTableNames t

Re: [PR] Adjust RequestUtils#getTableNames to get table names from both left and right sides of join [pinot]

2024-11-28 Thread via GitHub
yashmayya merged PR #14554: URL: https://github.com/apache/pinot/pull/14554 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.ap

Re: [PR] Configure cross region access in s3 client [pinot]

2024-11-28 Thread via GitHub
yashmayya commented on code in PR #14561: URL: https://github.com/apache/pinot/pull/14561#discussion_r1861673477 ## pinot-plugins/pinot-file-system/pinot-s3/src/main/java/org/apache/pinot/plugin/filesystem/S3PinotFS.java: ## @@ -161,6 +161,8 @@ public void init(PinotConfiguratio