This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch fixing_spark_path_validation
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
at a039de3 Fix the issue in Pinot Spark ingestion job to handle listing
input files wi
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a commit to branch fixing_spark_path_validation
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit a039de3055d7ecf831a84312f4eb84a97e41fc57
Author: Xiang Fu
AuthorDate: Tue Feb 2 23:53:48
codecov-io commented on pull request #6536:
URL: https://github.com/apache/incubator-pinot/pull/6536#issuecomment-772309634
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6536?src=pr&el=h1)
Report
> Merging
[#6536](https://codecov.io/gh/apache/incubator-pinot/pull/6536?s
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from a2f0dbd update superset k8s example to latest image (#6534)
add b51518f Fix hadoop batch ingest (#65
fx19880617 commented on pull request #6506:
URL: https://github.com/apache/incubator-pinot/pull/6506#issuecomment-772300880
Thanks for fixing this!
This is an automated message from the Apache Git Service.
To respond to the m
fx19880617 merged pull request #6506:
URL: https://github.com/apache/incubator-pinot/pull/6506
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL abov
fx19880617 opened a new pull request #6536:
URL: https://github.com/apache/incubator-pinot/pull/6536
## Description
Default to enable controller task scheduler for minion tasks in Pinot Helm
## Upgrade Notes
Does this PR prevent a zero down-time upgrade? (Assume upgrade orde
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a commit to branch default_cron_scheduler_for_k8s_helm
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit df0616538f7eeec169dfd6bcfbc0e86936946a3b
Author: Xiang Fu
AuthorDate: Tue Feb 2 2
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch default_cron_scheduler_for_k8s_helm
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
at df06165 Default to enable controller task scheduler for minion tasks
This br
siddharthteotia commented on pull request #6530:
URL: https://github.com/apache/incubator-pinot/pull/6530#issuecomment-772237440
> LGTM.
> (Not related to this PR) For easier management of the cluster, I would
recommend having a separate tenant for the dimension table so that dimension
yupeng9 commented on pull request #6530:
URL: https://github.com/apache/incubator-pinot/pull/6530#issuecomment-772225363
> > > LGTM.
> > > (Not related to this PR) For easier management of the cluster, I would
recommend having a separate tenant for the dimension table so that dimension
siddharthteotia commented on a change in pull request #6535:
URL: https://github.com/apache/incubator-pinot/pull/6535#discussion_r569129249
##
File path:
pinot-core/src/test/java/org/apache/pinot/queries/JsonMatchPredicateTest.java
##
@@ -0,0 +1,291 @@
+/**
+ * Licensed to the
yupeng9 commented on pull request #6530:
URL: https://github.com/apache/incubator-pinot/pull/6530#issuecomment-772224451
> Thanks for the reviews @Jackie-Jiang , @yupeng9 .
>
> > Since this is the first time we have queries across tables, I think it's
a good time to discuss the polic
siddharthteotia commented on a change in pull request #6535:
URL: https://github.com/apache/incubator-pinot/pull/6535#discussion_r569127429
##
File path:
pinot-core/src/test/java/org/apache/pinot/queries/JsonMatchPredicateTest.java
##
@@ -0,0 +1,291 @@
+/**
+ * Licensed to the
siddharthteotia commented on a change in pull request #6535:
URL: https://github.com/apache/incubator-pinot/pull/6535#discussion_r569123015
##
File path:
pinot-core/src/test/java/org/apache/pinot/queries/JsonMatchPredicateTest.java
##
@@ -0,0 +1,291 @@
+/**
+ * Licensed to the
amrishlal opened a new pull request #6535:
URL: https://github.com/apache/incubator-pinot/pull/6535
This PR fixes a bug to allow using JSON_MATCH predicate in SQL queries and
adds SQL level unit test cases for JSON_MATCH predicate.
-`QueryContextConverterUtils.java` was modified to f
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from d1a0688 [THIRDEYE-3799](fix): the alert item style fix (#6504)
add a2f0dbd update superset k8s examp
cbalci commented on pull request #6530:
URL: https://github.com/apache/incubator-pinot/pull/6530#issuecomment-772211536
Thanks for the reviews @Jackie-Jiang , @yupeng9 .
> Since this is the first time we have queries across tables, I think it's
a good time to discuss the policy. The
fx19880617 merged pull request #6534:
URL: https://github.com/apache/incubator-pinot/pull/6534
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL abov
cbalci commented on a change in pull request #6530:
URL: https://github.com/apache/incubator-pinot/pull/6530#discussion_r569116464
##
File path:
pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/assignment/segment/OfflineDimTableSegmentAssignment.java
##
@@
siddharthteotia commented on pull request #6530:
URL: https://github.com/apache/incubator-pinot/pull/6530#issuecomment-772196569
> > LGTM.
> > (Not related to this PR) For easier management of the cluster, I would
recommend having a separate tenant for the dimension table so that dimensi
codecov-io edited a comment on pull request #6534:
URL: https://github.com/apache/incubator-pinot/pull/6534#issuecomment-772177566
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6534?src=pr&el=h1)
Report
> Merging
[#6534](https://codecov.io/gh/apache/incubator-pinot/pull
codecov-io commented on pull request #6534:
URL: https://github.com/apache/incubator-pinot/pull/6534#issuecomment-772177566
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6534?src=pr&el=h1)
Report
> Merging
[#6534](https://codecov.io/gh/apache/incubator-pinot/pull/6534?s
yupeng9 commented on a change in pull request #6530:
URL: https://github.com/apache/incubator-pinot/pull/6530#discussion_r569089286
##
File path:
pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/assignment/segment/OfflineDimTableSegmentAssignment.java
##
@
yupeng9 commented on pull request #6530:
URL: https://github.com/apache/incubator-pinot/pull/6530#issuecomment-772170902
> LGTM.
> (Not related to this PR) For easier management of the cluster, I would
recommend having a separate tenant for the dimension table so that dimension
table ca
rkanumul edited a comment on issue #6512:
URL:
https://github.com/apache/incubator-pinot/issues/6512#issuecomment-772160570
Pull request at :
https://github.com/apache/incubator-pinot/pull/6531
This is an automated messag
daniellavoie commented on issue #6524:
URL:
https://github.com/apache/incubator-pinot/issues/6524#issuecomment-772159802
Counters, metrics and gages does not tell the story of what is wrong. Health
check observability is not the problem I am trying to solve here. Client needs
to understan
rkanumul commented on issue #6512:
URL:
https://github.com/apache/incubator-pinot/issues/6512#issuecomment-772160570
https://github.com/apache/incubator-pinot/pull/6531
This is an automated message from the Apache Git Servic
rkanumul commented on issue #6510:
URL:
https://github.com/apache/incubator-pinot/issues/6510#issuecomment-772160672
https://github.com/apache/incubator-pinot/pull/6531
This is an automated message from the Apache Git Servic
rkanumul edited a comment on issue #6511:
URL:
https://github.com/apache/incubator-pinot/issues/6511#issuecomment-772160605
Pull request at :
https://github.com/apache/incubator-pinot/pull/6531
This is an automated messag
rkanumul edited a comment on issue #6510:
URL:
https://github.com/apache/incubator-pinot/issues/6510#issuecomment-772160672
Pull request at :
https://github.com/apache/incubator-pinot/pull/6531
This is an automated messag
rkanumul commented on issue #6511:
URL:
https://github.com/apache/incubator-pinot/issues/6511#issuecomment-772160605
https://github.com/apache/incubator-pinot/pull/6531
This is an automated message from the Apache Git Servic
mcvsubbu commented on issue #6524:
URL:
https://github.com/apache/incubator-pinot/issues/6524#issuecomment-772158231
We also return metadata to the broker as to the newest timestamp we have
consumed. It is set in the BrokerNativeResponse as the
minConsumingFreshnessTimeMs, indicating the
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch update_superset_image_version_in_k8s_example
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard c36297e udpate superset k8s example to latest image
add d90968e
fx19880617 opened a new pull request #6534:
URL: https://github.com/apache/incubator-pinot/pull/6534
## Description
Update superset k8s example to the latest image
## Upgrade Notes
Does this PR prevent a zero down-time upgrade? (Assume upgrade order:
Controller, Broker, Server,
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch update_superset_image_version_in_k8s_example
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
at c36297e udpate superset k8s example to latest image
This branch inc
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a commit to branch update_superset_image_version_in_k8s_example
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit c36297e403b84de176ba44529b0fe94c3688bab3
Author: Xiang Fu
AuthorDate: Tu
codecov-io commented on pull request #6533:
URL: https://github.com/apache/incubator-pinot/pull/6533#issuecomment-772146836
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6533?src=pr&el=h1)
Report
> Merging
[#6533](https://codecov.io/gh/apache/incubator-pinot/pull/6533?s
fx19880617 opened a new pull request #6533:
URL: https://github.com/apache/incubator-pinot/pull/6533
## Description
Allow creating a TAR file that contains an entry that is >8 GB in size.
## Upgrade Notes
Does this PR prevent a zero down-time upgrade? (Assume upgrade order:
jihaozh merged pull request #6504:
URL: https://github.com/apache/incubator-pinot/pull/6504
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
daniellavoie commented on issue #6524:
URL:
https://github.com/apache/incubator-pinot/issues/6524#issuecomment-772102874
Thanks for these details @mcvsubbu. My use case is more about providing
feedback to the user who created the table config from the rest API. Metrics
are intended to mon
codecov-io commented on pull request #6525:
URL: https://github.com/apache/incubator-pinot/pull/6525#issuecomment-771975222
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6525?src=pr&el=h1)
Report
> Merging
[#6525](https://codecov.io/gh/apache/incubator-pinot/pull/6525?s
mcvsubbu commented on issue #6516:
URL:
https://github.com/apache/incubator-pinot/issues/6516#issuecomment-771818395
I think Helix preserves the error stack/messages for a few days? State
stored in segmentDataManager can go away on restart. I think there is value in
retrieving helix messa
daniellavoie edited a comment on issue #6520:
URL:
https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772061131
Yes aggregated would be fine. Mostly, this metric is to answer `Is it done
yet?`
This is an aut
rkanumul closed pull request #6529:
URL: https://github.com/apache/incubator-pinot/pull/6529
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
pabrahamusa closed issue #6522:
URL: https://github.com/apache/incubator-pinot/issues/6522
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
akshayrai commented on a change in pull request #6528:
URL: https://github.com/apache/incubator-pinot/pull/6528#discussion_r568961845
##
File path:
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/pinot/SqlUtils.java
##
@@ -189,9 +195,13 @@ public sta
fx19880617 edited a comment on issue #6520:
URL:
https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772069028
This is an automated message from the Apache Git Service.
To respond to the message, please log on
HyunjoonCho edited a comment on issue #6519:
URL:
https://github.com/apache/incubator-pinot/issues/6519#issuecomment-771631182
Hi, the page I mentioned said WIP 8 hours ago but seems someone fixed it
today! Thanks

Report
> Merging
[#6518](https://codecov.io/gh/apache/incubator-pinot/pull/6518?s
jihaozh merged pull request #6528:
URL: https://github.com/apache/incubator-pinot/pull/6528
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
pabrahamusa commented on issue #6277:
URL:
https://github.com/apache/incubator-pinot/issues/6277#issuecomment-771881448
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Git
fx19880617 commented on a change in pull request #6506:
URL: https://github.com/apache/incubator-pinot/pull/6506#discussion_r568261109
##
File path:
pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSegm
tannghia025 commented on a change in pull request #5787:
URL: https://github.com/apache/incubator-pinot/pull/5787#discussion_r568417075
##
File path:
pinot-connectors/pinot-spark-connector/src/main/scala/org/apache/pinot/connector/spark/datasource/PinotDataSourceReader.scala
#
kishoreg commented on issue #6519:
URL:
https://github.com/apache/incubator-pinot/issues/6519#issuecomment-771365730
@KKcorps
This is an automated message from the Apache Git Service.
To respond to the message, please log o
tannghia025 edited a comment on issue #5598:
URL:
https://github.com/apache/incubator-pinot/issues/5598#issuecomment-771462472
có ví dụ write xuống pinot đâu nói như thiệt cay vl
This is an automated message from the Apache
kishoreg commented on issue #6516:
URL:
https://github.com/apache/incubator-pinot/issues/6516#issuecomment-771387950
Got it. One thing to keep in mind is that state transition error messages
get cleaned up automatically by Helix. we should probably do something like this
- each server s
apucher commented on a change in pull request #6507:
URL: https://github.com/apache/incubator-pinot/pull/6507#discussion_r568197551
##
File path:
pinot-controller/src/main/java/org/apache/pinot/controller/api/access/AccessControl.java
##
@@ -30,9 +30,38 @@
/**
* Return
subourbonite edited a comment on issue #6517:
URL:
https://github.com/apache/incubator-pinot/issues/6517#issuecomment-771281912
I actually think that having the same column name spread around multiple
systems with a different grain / format / definition can become a serious data
usability
apucher commented on a change in pull request #6515:
URL: https://github.com/apache/incubator-pinot/pull/6515#discussion_r568224380
##
File path:
pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/HelixBrokerStarter.java
##
@@ -133,9 +133,7 @@ public HelixBrokerSt
jihaozh merged pull request #6514:
URL: https://github.com/apache/incubator-pinot/pull/6514
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
icefury71 commented on a change in pull request #6485:
URL: https://github.com/apache/incubator-pinot/pull/6485#discussion_r568227370
##
File path:
pinot-spi/src/main/java/org/apache/pinot/spi/utils/validator/BaseJsonValidator.java
##
@@ -0,0 +1,56 @@
+package org.apache.pinot
kkrugler commented on a change in pull request #6506:
URL: https://github.com/apache/incubator-pinot/pull/6506#discussion_r568254617
##
File path:
pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSegmen
fx19880617 commented on issue #6509:
URL:
https://github.com/apache/incubator-pinot/issues/6509#issuecomment-771222590
hmm, does it work with java 11?
This is an automated message from the Apache Git Service.
To respond to t
jackjlli commented on a change in pull request #6414:
URL: https://github.com/apache/incubator-pinot/pull/6414#discussion_r568214842
##
File path:
pinot-clients/pinot-java-client/src/test/java/org/apache/pinot/client/DynamicBrokerSelectorTest.java
##
@@ -0,0 +1,109 @@
+/**
+ *
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a commit to branch fixing_big_tar_gz_file_issue
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit 9fa79be8e6d68ce91f2561dc8f8130fe34fa53ed
Author: Xiang Fu
AuthorDate: Tue Feb 2 16:59:31
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch fixing_big_tar_gz_file_issue
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
at 9fa79be Allow tar gz with > 8gb size
This branch includes the following new commits
longtrinhvan removed a comment on issue #5598:
URL:
https://github.com/apache/incubator-pinot/issues/5598#issuecomment-771458430
không làm mà đòi có ăn thì ăn đầu buồi, ăn cứt
This is an automated message from the Apache Git
subourbonite commented on issue #6517:
URL:
https://github.com/apache/incubator-pinot/issues/6517#issuecomment-771281912
I actually think that having the same column name spread around multiple
systems with a different grain / format / definition can become a serious data
usability proble
longtrinhvan commented on issue #5598:
URL:
https://github.com/apache/incubator-pinot/issues/5598#issuecomment-771458430
không làm mà đòi có ăn thì ăn đầu buồi, ăn cứt
This is an automated message from the Apache Git Service
codecov-io edited a comment on pull request #6515:
URL: https://github.com/apache/incubator-pinot/pull/6515#issuecomment-771241792
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6515?src=pr&el=h1)
Report
> Merging
[#6515](https://codecov.io/gh/apache/incubator-pinot/pull
tannghia025 commented on issue #5598:
URL:
https://github.com/apache/incubator-pinot/issues/5598#issuecomment-771462472
có ví dụ write xuống pinot đâu nó như thiệt cay vl
This is an automated message from the Apache Git Serv
Jackie-Jiang merged pull request #6515:
URL: https://github.com/apache/incubator-pinot/pull/6515
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL ab
codecov-io commented on pull request #6515:
URL: https://github.com/apache/incubator-pinot/pull/6515#issuecomment-771241792
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6515?src=pr&el=h1)
Report
> Merging
[#6515](https://codecov.io/gh/apache/incubator-pinot/pull/6515?s
Jackie-Jiang commented on a change in pull request #6515:
URL: https://github.com/apache/incubator-pinot/pull/6515#discussion_r568220638
##
File path:
pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/HelixBrokerStarter.java
##
@@ -133,9 +133,7 @@ public HelixBro
xulinjintu opened a new issue #6532:
URL: https://github.com/apache/incubator-pinot/issues/6532
In order to move Pinot to cloud, cloud VM rack metadata awareness is needed
for maintenance purpose and disaster recovery. In Azure use cases, fault domain
(FD) metadata is needed in the Pinot e
npawar commented on issue #6277:
URL:
https://github.com/apache/incubator-pinot/issues/6277#issuecomment-772105123
The segment size threshold config will kick in only when rows threshold is
set to 0. Prolly not working for you because the flush.threshold.rows is set to
something in your e
This is an automated email from the ASF dual-hosted git repository.
jihao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
The following commit(s) were added to refs/heads/master by this push:
new d1a0688 [THIRDEYE-3799](fix): the alert
jihaozh merged pull request #6504:
URL: https://github.com/apache/incubator-pinot/pull/6504
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
daniellavoie commented on issue #6524:
URL:
https://github.com/apache/incubator-pinot/issues/6524#issuecomment-772102874
Thanks for these details @mcvsubbu. My use case is more about providing
feedback to the user who created the table config from the rest API. Metrics
are intended to mon
fx19880617 commented on issue #6277:
URL:
https://github.com/apache/incubator-pinot/issues/6277#issuecomment-772100779
Meanwhile we will fix the tar gz issue
This is an automated message from the Apache Git Service.
To respo
fx19880617 commented on issue #6277:
URL:
https://github.com/apache/incubator-pinot/issues/6277#issuecomment-772100661
Right, `column.psf` is the single file that merges all the columns' data. Do
you have the index_map file or segment metadata file, which will tell the size
for each colum
rkanumul opened a new pull request #6531:
URL: https://github.com/apache/incubator-pinot/pull/6531
## Description
Linkedin plans to use ADLSGen2PinotFS but requires
1) Service principal based authentication to do that for better ACL control.
The current accesskey based auth would be h
rkanumul closed pull request #6529:
URL: https://github.com/apache/incubator-pinot/pull/6529
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
mcvsubbu commented on issue #6524:
URL:
https://github.com/apache/incubator-pinot/issues/6524#issuecomment-772095947
We have a metric that is set to 1 if a stream partition is consuming
correctly, 0 otherwise. In LinkedIn, we set an alert if the consumption falls
to 0 for more than some p
codecov-io commented on pull request #6518:
URL: https://github.com/apache/incubator-pinot/pull/6518#issuecomment-772093618
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6518?src=pr&el=h1)
Report
> Merging
[#6518](https://codecov.io/gh/apache/incubator-pinot/pull/6518?s
pabrahamusa commented on issue #6277:
URL:
https://github.com/apache/incubator-pinot/issues/6277#issuecomment-772084940
@fx19880617 further analysis it is clear that the size is coming from
columns.psf
```
root@my-pinot-server-0:/var/pinot/server/data/index/mylog_REALTIME/mylog_
This is an automated email from the ASF dual-hosted git repository.
jihao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
The following commit(s) were added to refs/heads/master by this push:
new 84ae4f1 [TE] SQL migration - escape the
jihaozh merged pull request #6528:
URL: https://github.com/apache/incubator-pinot/pull/6528
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
jihaozh commented on a change in pull request #6528:
URL: https://github.com/apache/incubator-pinot/pull/6528#discussion_r568990857
##
File path:
thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/pinot/SqlUtils.java
##
@@ -189,9 +195,13 @@ public stati
1 - 100 of 144 matches
Mail list logo