siddharthteotia commented on issue #5664:
URL:
https://github.com/apache/incubator-pinot/issues/5664#issuecomment-878821631
I don't completely follow that. Can you give an example ? Also, are you
approaching this from making subqueries work for a particular scenario ?
--
This is an auto
atris commented on issue #5664:
URL:
https://github.com/apache/incubator-pinot/issues/5664#issuecomment-878820183
If the outer query is being executed on a broker node, on top of the result
of the underlying topmost Combine operator, would this still be a problem?
--
This is an automat
siddharthteotia commented on issue #5664:
URL:
https://github.com/apache/incubator-pinot/issues/5664#issuecomment-878819171
@atris, Subqueries can broadly be divided into two categories
- inner query (and there could be multiple of these) referring to same table
as outer query
-
cxing closed issue #7159:
URL: https://github.com/apache/incubator-pinot/issues/7159
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsub
cxing commented on issue #7159:
URL:
https://github.com/apache/incubator-pinot/issues/7159#issuecomment-878801729
> I think this is already fixed by #7027
>
> Can you confirm?
Yes it's already fixed in #7027 i will close this issue, thx
--
This is an automated message from
xiangfu0 commented on issue #7159:
URL:
https://github.com/apache/incubator-pinot/issues/7159#issuecomment-878795638
I think this is already fixed by
https://github.com/apache/incubator-pinot/pull/7027
Can you confirm?
--
This is an automated message from the Apache Git Servi
atris commented on issue #7043:
URL:
https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878786588
@siddharthteotia Thats great to hear. I am already working on this feature,
since its crucial for our evaluation of Pinot. I would request your inputs and
feedback on the prop
RuslanTM edited a comment on issue #7153:
URL:
https://github.com/apache/incubator-pinot/issues/7153#issuecomment-878752747
@Jackie-Jiang the first approach is more preferable. Is it supported in the
last version of pinot?
--
This is an automated message from the Apache Git Service.
To
RuslanTM commented on issue #7153:
URL:
https://github.com/apache/incubator-pinot/issues/7153#issuecomment-878752747
@Jackie-Jiang first approach is more preferable. Is it supported in the last
version of pinot?
--
This is an automated message from the Apache Git Service.
To respond to
atris commented on issue #5664:
URL:
https://github.com/apache/incubator-pinot/issues/5664#issuecomment-878751583
Great to see this. I am excited about this feature - but I don't see a
strict need for subqueries to be designed in conjunction with joins. IMO
subqueries are simpler and have
cxing opened a new issue #7159:
URL: https://github.com/apache/incubator-pinot/issues/7159
1. Realtime table can't be retention and fund exceptions in leader
controller log
2021-07-11 03:08:50.378 ERROR [ControllerPeriodicTask] [pool-12-thread-4]
Caught exception while running task: Ret
codecov-commenter edited a comment on pull request #7113:
URL: https://github.com/apache/incubator-pinot/pull/7113#issuecomment-873230145
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7113?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr
codecov-commenter edited a comment on pull request #7142:
URL: https://github.com/apache/incubator-pinot/pull/7142#issuecomment-876860754
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7142?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr
codecov-commenter edited a comment on pull request #7142:
URL: https://github.com/apache/incubator-pinot/pull/7142#issuecomment-876860754
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7142?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr
mcvsubbu commented on issue #6679:
URL:
https://github.com/apache/incubator-pinot/issues/6679#issuecomment-878692920
@Jackie-Jiang if that is the case (i.e. it fetches latest on new partitions)
then we have a bug. I know for certain it was not the case when we first coded
it up (at the ti
codecov-commenter edited a comment on pull request #7158:
URL: https://github.com/apache/incubator-pinot/pull/7158#issuecomment-878690453
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7158?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr
mqliang commented on pull request #7142:
URL: https://github.com/apache/incubator-pinot/pull/7142#issuecomment-878691836
> Are you suggesting calling /tables first, then loop over all the tables
and get stats for each individual table, then sort on the client side? This
could translate to
codecov-commenter commented on pull request #7158:
URL: https://github.com/apache/incubator-pinot/pull/7158#issuecomment-878690453
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7158?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+commen
Jackie-Jiang commented on pull request #7142:
URL: https://github.com/apache/incubator-pinot/pull/7142#issuecomment-878688927
I still don't see why adding sort type a bad thing to the list table api. If
not provided, it will just work as is. Adding it can save lots of effort on the
user si
Jackie-Jiang commented on pull request #7142:
URL: https://github.com/apache/incubator-pinot/pull/7142#issuecomment-878688331
@mcvsubbu @mqliang Are you suggesting calling `/tables` first, then loop
over all the tables and get stats for each individual table, then sort on the
client side?
Jackie-Jiang commented on issue #6679:
URL:
https://github.com/apache/incubator-pinot/issues/6679#issuecomment-878687725
@mcvsubbu I don't think that the case at least based on my reading. Once
controller detects a new partition, it will fetch the partition offset based on
the offset crit
mqliang commented on pull request #7142:
URL: https://github.com/apache/incubator-pinot/pull/7142#issuecomment-878681829
> A combination of jq and sort, for instance. You can sort/massage/filter
data to your heart's content
I agree:
* For sorting by name, client can use the `@
mcvsubbu commented on issue #6679:
URL:
https://github.com/apache/incubator-pinot/issues/6679#issuecomment-878680382
@Jackie-Jiang the user need not change back. They can keep it at LATEST. New
partitions will always consume as they are detected (and therefore earliest).
Like I mentioned
Jackie-Jiang commented on issue #6679:
URL:
https://github.com/apache/incubator-pinot/issues/6679#issuecomment-878679396
@mcvsubbu Forcing the user to change their table config in order to fix a
segment does not seem correct to me. For example, user is using EARLIEST for
all the new parti
mcvsubbu commented on pull request #7142:
URL: https://github.com/apache/incubator-pinot/pull/7142#issuecomment-878678074
> @mcvsubbu What external tool are you referring to? IMO listing tables in a
cluster sorted with creation time/last modified time is quite common request,
and currently
Jackie-Jiang commented on pull request #7142:
URL: https://github.com/apache/incubator-pinot/pull/7142#issuecomment-878677140
@mcvsubbu What external tool are you referring to? IMO listing tables in a
cluster sorted with creation time/last modified time is quite common request,
and current
siddharthteotia edited a comment on issue #7043:
URL:
https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878661085
At LinkedIn, we are exploring a combined design for subqueries and
distributed joins since design / architecture wise there might be overlap and
it is good to
Jackie-Jiang opened a new pull request #7158:
URL: https://github.com/apache/incubator-pinot/pull/7158
## Description
Currently within `SegmentProcessorFramework`, time handling is modeled as
separate general filter/transform/partition function within the processor
config, which is quit
siddharthteotia commented on issue #7043:
URL:
https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878664620
https://github.com/apache/incubator-pinot/issues/5664
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHu
siddharthteotia commented on issue #5664:
URL:
https://github.com/apache/incubator-pinot/issues/5664#issuecomment-878664475
At LinkedIn, we are exploring a combined design for subqueries and
distributed joins since design / architecture wise there might be overlap and
it is good to think
siddharthteotia edited a comment on issue #7043:
URL:
https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878661085
At LinkedIn, we are exploring a combined design for subqueries and
distributed joins since design / architecture wise there might be overlap and
it is good to
siddharthteotia edited a comment on issue #7043:
URL:
https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878661085
At LinkedIn, we will be exploring a combined design for subqueries and
distributed joins since design / architecture wise there might be overlap and
it is goo
siddharthteotia commented on issue #7043:
URL:
https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878661085
At LinkedIn, we will be exploring a combined design for subqueries and
distributed joins since design / architecture wise there might be overlap and
it is good to th
This is an automated email from the ASF dual-hosted git repository.
mcvsubbu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from db5dfd7 Fix race condition in MinionInstancesCleanupTask (#7122)
add de2f0e0 Enable parallel builds
mcvsubbu merged pull request #7149:
URL: https://github.com/apache/incubator-pinot/pull/7149
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commi
mqliang commented on pull request #7157:
URL: https://github.com/apache/incubator-pinot/pull/7157#issuecomment-878651270
test failed due to flaky issue. close and re-open to trigger a re-run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log
mqliang closed pull request #7157:
URL: https://github.com/apache/incubator-pinot/pull/7157
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commit
mqliang opened a new pull request #7157:
URL: https://github.com/apache/incubator-pinot/pull/7157
## Description
This is a follow-up PR of
https://github.com/apache/incubator-pinot/pull/7102, which:
* Add more detailed java docs for TableMetadataInfo class.
* move the `getE
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from 1ef50f7 Add controller/server API to fetch aggregated segment
metadata (#7102)
add db5dfd7 Fix race co
jackjlli merged pull request #7122:
URL: https://github.com/apache/incubator-pinot/pull/7122
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commi
codecov-commenter edited a comment on pull request #7149:
URL: https://github.com/apache/incubator-pinot/pull/7149#issuecomment-877709544
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7149?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr
This is an automated email from the ASF dual-hosted git repository.
siddteotia pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from e17029f Wire TaskMetricsEmitter to controller starter (#7126)
add 1ef50f7 Add controller/server A
siddharthteotia merged pull request #7102:
URL: https://github.com/apache/incubator-pinot/pull/7102
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail
jackjlli commented on a change in pull request #7122:
URL: https://github.com/apache/incubator-pinot/pull/7122#discussion_r668265229
##
File path:
pinot-controller/src/main/java/org/apache/pinot/controller/ControllerConf.java
##
@@ -146,6 +149,7 @@ private static long getRando
jackjlli opened a new issue #7156:
URL: https://github.com/apache/incubator-pinot/issues/7156
The current configs for controller periodic tasks have to use number in
seconds, which is not convenient.
We can introduce a new set of configs to make them human readable, like
`2h30m`.
--
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch fix-MinionInstancesCleanupTask
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard b27fc13 Fix race condition in MinionInstancesCleanupTask
add 0d9db6d Fix race c
codecov-commenter edited a comment on pull request #7102:
URL: https://github.com/apache/incubator-pinot/pull/7102#issuecomment-870233688
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7102?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr
mcvsubbu commented on a change in pull request #7122:
URL: https://github.com/apache/incubator-pinot/pull/7122#discussion_r668223484
##
File path:
pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/PinotHelixResourceManager.java
##
@@ -461,6 +462,34 @@ publi
mcvsubbu commented on a change in pull request #7149:
URL: https://github.com/apache/incubator-pinot/pull/7149#discussion_r668214495
##
File path: compatibility-verifier/checkoutAndBuild.sh
##
@@ -86,67 +100,145 @@ while [ "$1" != "" ]; do
shift
done
-if [ -z "$olderCommi
codecov-commenter edited a comment on pull request #7113:
URL: https://github.com/apache/incubator-pinot/pull/7113#issuecomment-873230145
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the speci
amrishlal opened a new issue #7155:
URL: https://github.com/apache/incubator-pinot/issues/7155
I discussed this with @mcvsubbu a bit. Setup controller api to allow for
manually triggering a periodic task. When the controller gets a request to
manually execute a periodic task, it will send
Jackie-Jiang opened a new pull request #7154:
URL: https://github.com/apache/incubator-pinot/pull/7154
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-m
Jackie-Jiang merged pull request #7154:
URL: https://github.com/apache/incubator-pinot/pull/7154
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: c
Jackie-Jiang commented on issue #7153:
URL:
https://github.com/apache/incubator-pinot/issues/7153#issuecomment-878412701
There are 2 ways of handling the schema change with new columns within
consuming segment:
1. (Supported) Keep the already consumed records and add new columns as
def
jackjlli commented on a change in pull request #7149:
URL: https://github.com/apache/incubator-pinot/pull/7149#discussion_r668121403
##
File path: compatibility-verifier/checkoutAndBuild.sh
##
@@ -41,20 +41,34 @@ function usage() {
}
# This function builds Pinot given a spe
RuslanTM commented on issue #7153:
URL:
https://github.com/apache/incubator-pinot/issues/7153#issuecomment-878344359
@xiangfu0 I set this property and everything the same:
https://user-images.githubusercontent.com/11804145/125307988-5c485600-e352-11eb-80b8-548a3dee8462.png";>
In k
wuwenw commented on a change in pull request #7113:
URL: https://github.com/apache/incubator-pinot/pull/7113#discussion_r668111237
##
File path:
pinot-core/src/main/java/org/apache/pinot/core/plan/AggregationGroupByOrderByPlanNode.java
##
@@ -97,14 +116,38 @@ public Aggregatio
jackjlli merged pull request #7111:
URL: https://github.com/apache/incubator-pinot/pull/7111
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commi
jackjlli merged pull request #7126:
URL: https://github.com/apache/incubator-pinot/pull/7126
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commi
codecov-commenter edited a comment on pull request #7102:
URL: https://github.com/apache/incubator-pinot/pull/7102#issuecomment-870233688
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7102?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr
kkrugler commented on issue #7090:
URL:
https://github.com/apache/incubator-pinot/issues/7090#issuecomment-878261884
@troywinter - Yes, I've started some work (see above for my comments on why
it's a bit harder than I was expecting)
--
This is an automated message from the Apache Git Se
siddharthteotia commented on a change in pull request #7102:
URL: https://github.com/apache/incubator-pinot/pull/7102#discussion_r668180843
##
File path:
pinot-server/src/main/java/org/apache/pinot/server/api/resources/TablesResource.java
##
@@ -117,6 +126,103 @@ public String
mqliang commented on a change in pull request #7149:
URL: https://github.com/apache/incubator-pinot/pull/7149#discussion_r668121696
##
File path: compatibility-verifier/checkoutAndBuild.sh
##
@@ -41,20 +41,34 @@ function usage() {
}
# This function builds Pinot given a spec
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch fix-MinionInstancesCleanupTask
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard da65fca Fix race condition in MinionInstancesCleanupTask
add b27fc13 Fix race c
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from f04078e Upgrade avro-mapred to 1.9.2 so that all avro dependencies
are 1.9.2. (#7111)
add e17029f Wire
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from 0447e74 Fix the exception message for segment reset (#7154)
add f04078e Upgrade avro-mapred to 1.9.2 so
This is an automated email from the ASF dual-hosted git repository.
jackie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from 7233e2c Support Dictionary Based Plan For DISTINCT (#7141)
add 0447e74 Fix the exception message for
atris commented on issue #7060:
URL:
https://github.com/apache/incubator-pinot/issues/7060#issuecomment-878104243
I would say that we document this behaviour and make users aware of this
scenario. WDYT?
--
This is an automated message from the Apache Git Service.
To respond to the messa
MrNeocore commented on issue #7060:
URL:
https://github.com/apache/incubator-pinot/issues/7060#issuecomment-878101573
This issue is not impacting my use cases much at all, but should
"technically understandable" be considered "expected behavior" (from a user
perspective) ?
Of cours
codecov-commenter edited a comment on pull request #7111:
URL: https://github.com/apache/incubator-pinot/pull/7111#issuecomment-878092225
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7111?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr
codecov-commenter commented on pull request #7111:
URL: https://github.com/apache/incubator-pinot/pull/7111#issuecomment-878092225
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/7111?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+commen
troywinter commented on issue #7090:
URL:
https://github.com/apache/incubator-pinot/issues/7090#issuecomment-878047071
May I ask anyone is working on this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
LiranBri commented on issue #7152:
URL:
https://github.com/apache/incubator-pinot/issues/7152#issuecomment-878029883
actually @kishoreg asked me to open this issue so he can document and
explain the work in progress for this issue
--
This is an automated message from the Apache Git Serv
xiangfu0 edited a comment on issue #7153:
URL:
https://github.com/apache/incubator-pinot/issues/7153#issuecomment-878024929
Please this this doc:
https://docs.pinot.apache.org/users/tutorials/schema-evolution#update-the-schema
```
Real-Time Pinot table: In case of real-time tables, m
xiangfu0 edited a comment on issue #7153:
URL:
https://github.com/apache/incubator-pinot/issues/7153#issuecomment-878024929
Please this this doc:
https://docs.pinot.apache.org/users/tutorials/schema-evolution#update-the-schema
```
Real-Time Pinot table: In case of real-time tables, m
xiangfu0 commented on issue #7153:
URL:
https://github.com/apache/incubator-pinot/issues/7153#issuecomment-878024929
Please this this doc:
https://docs.pinot.apache.org/users/tutorials/schema-evolution#update-the-schema
```
Real-Time Pinot table: In case of real-time tables, make sur
xiangfu0 commented on issue #7152:
URL:
https://github.com/apache/incubator-pinot/issues/7152#issuecomment-878023721
Pinot data are stored in columnar format and have multiple index supports.
Please see: https://docs.pinot.apache.org/basics/indexing
--
This is an automated message fro
77 matches
Mail list logo
