abhijeetkushe opened a new issue, #12308:
URL: https://github.com/apache/pinot/issues/12308
I have a realtime upsert table which reads data from kinesis.There are 2
partitions or 2 kinesis shards.I updated config but after I restarted broker
controller and server I still see 2 servers being hit when the accountId is in
the query.
This was the original config.
```
"segmentPartitionConfig":{
"columnPartitionMap": {
"accountId": {
"functionName": "Murmur",
"numPartitions": 2
}
}
}
},
"routing": {
"segmentPrunerTypes": [
"partition"
],
"instanceSelectorType": "strictReplicaGroup"
},
```
I tried the below config suggested on the following slack channel
https://apache-pinot.slack.com/archives/C011C9JHN7R/p1704225307389139
```"segmentPartitionConfig":{
"columnPartitionMap": {
"accountId": {
"functionName": "Murmur",
"numPartitions": 2
}
}
}
},
"upsertConfig": {
"mode": "FULL",
"hashFunction": "MURMUR3",
"enableSnapshot": true
},
"instanceAssignmentConfigMap": {
"CONSUMING": {
"tagPoolConfig": {
"tag": "DefaultTenant_REALTIME"
},
"replicaGroupPartitionConfig": {
"numInstances": 8,
"replicaGroupBased": true,
"numReplicaGroups": 4,
"numInstancesPerReplicaGroup": 2,
"partitionColumn": "accountId",
"numPartitions": 2,
"numInstancesPerPartition": 1
}
}
},
"routing": {
"segmentPrunerTypes": [
"partition"
],
"instanceSelectorType": "strictReplicaGroup"
}```
When I run the query
```
SELECT currencyCode,activityId, activityType,
distinctcount(sendIdContactId2) as 'sendId,contactId_count', sum(totalOrderNum)
as totalOrderNum_sum, sumprecision(totalOrderAmt, 19) as totalOrderAmt_sum FROM
events WHERE accountId = 1140607508363 AND flowId =
'd13c223f-b3fb-4fac-8689-77b89ab08f82' AND recordType = 'attribution' AND
softDelete = 'null' group by currencyCode,activityType,activityId LIMIT 0,
1000 option(timeoutMs=20000)SELECT currencyCode,activityId, activityType,
distinctcount(sendIdContactId2) as 'sendId,contactId_count', sum(totalOrderNum)
as totalOrderNum_sum, sumprecision(totalOrderAmt, 19) as totalOrderAmt_sum FROM
events WHERE accountId = 1140607508363 AND flowId =
'd13c223f-b3fb-4fac-8689-77b89ab08f82' AND recordType = 'attribution' AND
softDelete = 'null' group by currencyCode,activityType,activityId LIMIT 0,
1000 option(timeoutMs=20000)
```
I still see 2 servers queried
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
