[I] [feature] Add an query option orderedPreferredReplicas to control servers will be hit [pinot]

2024-12-01 Thread via GitHub
wirybeaver opened a new issue, #14572: URL: https://github.com/apache/pinot/issues/14572 Context: All Uber's stateless production service has nodes in a canary zone. The release will be rolled to canary zone at first. In order to reduce the blast radius when the release is baked in the cana

Re: [PR] Add broker setting to override default implicit query response limit [pinot]

2024-12-01 Thread via GitHub
yashmayya commented on code in PR #14452: URL: https://github.com/apache/pinot/pull/14452#discussion_r1865248601 ## pinot-broker/src/main/java/org/apache/pinot/broker/requesthandler/BaseSingleStageBrokerRequestHandler.java: ## @@ -140,7 +140,9 @@ public abstract class BaseSingle

Re: [PR] Add a Server API to list segments that need to be refreshed for a table [pinot]

2024-12-01 Thread via GitHub
KKcorps commented on code in PR #14451: URL: https://github.com/apache/pinot/pull/14451#discussion_r1865194105 ## pinot-core/src/main/java/org/apache/pinot/core/data/manager/BaseTableDataManager.java: ## @@ -1046,6 +1064,261 @@ public boolean needReloadSegments() return nee

Re: [I] Support new data type: `TimestampWithTimeZone` [pinot]

2024-12-01 Thread via GitHub
mghildiy commented on issue #13004: URL: https://github.com/apache/pinot/issues/13004#issuecomment-2509749167 There is a diff in velox and postgres approach. Velox stores timezone packed with instant value, while postgres stores instant in UTC, and then converts it to session timezone. --

Re: [PR] Add a Server API to list segments that need to be refreshed for a table [pinot]

2024-12-01 Thread via GitHub
swaminathanmanish commented on code in PR #14451: URL: https://github.com/apache/pinot/pull/14451#discussion_r1864869862 ## pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/TableStaleSegmentResponse.java: ## @@ -0,0 +1,67 @@ +/** + * Licensed to the Apach

Re: [PR] Add a Server API to list segments that need to be refreshed for a table [pinot]

2024-12-01 Thread via GitHub
swaminathanmanish commented on PR #14451: URL: https://github.com/apache/pinot/pull/14451#issuecomment-2509678253 > The core feature in this PR is a function `BaseTableDataManager.getSegmentsForRefresh` which finds all the segments of a table that requires a refresh. It accepts a Table Conf