yupeng9 commented on issue #6121:
URL:
https://github.com/apache/incubator-pinot/issues/6121#issuecomment-705873455
I see. Thanks @mcvsubbu
This is the output of run on one sample segment
```
Memory used per host
numHosts --> 2 |4 |6 |8 |10 |12 |14
|16 |
numHours
2 --------> 8.5G |4.25G |2.83G |2.83G |2.83G |1.42G
|1.42G |1.42G |
3 --------> 8.73G |4.36G |2.91G |2.91G |2.91G |1.45G
|1.45G |1.45G |
4 --------> 8.96G |4.48G |2.99G |2.99G |2.99G |1.49G
|1.49G |1.49G |
5 --------> 9.52G |4.76G |3.17G |3.17G |3.17G |1.59G
|1.59G |1.59G |
6 --------> 9.42G |4.71G |3.14G |3.14G |3.14G |1.57G
|1.57G |1.57G |
7 --------> 10.96G |5.48G |3.65G |3.65G |3.65G |1.83G
|1.83G |1.83G |
8 --------> 9.88G |4.94G |3.29G |3.29G |3.29G |1.65G
|1.65G |1.65G |
9 --------> 11.09G |5.55G |3.7G |3.7G |3.7G |1.85G
|1.85G |1.85G |
10 --------> 12.3G |6.15G |4.1G |4.1G |4.1G |2.05G
|2.05G |2.05G |
11 --------> 13.51G |6.76G |4.5G |4.5G |4.5G |2.25G
|2.25G |2.25G |
12 --------> 10.8G |5.4G |3.6G |3.6G |3.6G |1.8G
|1.8G |1.8G |
Optimal segment size
numHosts --> 2 |4 |6 |8 |10 |12 |14
|16 |
numHours
2 --------> 111.67M |111.67M |111.67M |111.67M |111.67M |111.67M
|111.67M |111.67M |
3 --------> 167.5M |167.5M |167.5M |167.5M |167.5M |167.5M
|167.5M |167.5M |
4 --------> 223.34M |223.34M |223.34M |223.34M |223.34M |223.34M
|223.34M |223.34M |
5 --------> 279.17M |279.17M |279.17M |279.17M |279.17M |279.17M
|279.17M |279.17M |
6 --------> 335M |335M |335M |335M |335M |335M
|335M |335M |
7 --------> 390.84M |390.84M |390.84M |390.84M |390.84M |390.84M
|390.84M |390.84M |
8 --------> 446.67M |446.67M |446.67M |446.67M |446.67M |446.67M
|446.67M |446.67M |
9 --------> 502.51M |502.51M |502.51M |502.51M |502.51M |502.51M
|502.51M |502.51M |
10 --------> 558.34M |558.34M |558.34M |558.34M |558.34M |558.34M
|558.34M |558.34M |
11 --------> 614.18M |614.18M |614.18M |614.18M |614.18M |614.18M
|614.18M |614.18M |
12 --------> 670.01M |670.01M |670.01M |670.01M |670.01M |670.01M
|670.01M |670.01M |
Consuming memory
numHosts --> 2 |4 |6 |8 |10 |12 |14
|16 |
numHours
2 --------> 1.3G |666.02M |444.01M |444.01M |444.01M |222.01M
|222.01M |222.01M |
3 --------> 1.86G |951.41M |634.27M |634.27M |634.27M |317.14M
|317.14M |317.14M |
4 --------> 2.42G |1.21G |824.53M |824.53M |824.53M |412.27M
|412.27M |412.27M |
5 --------> 2.97G |1.49G |1014.79M |1014.79M |1014.79M |507.39M
|507.39M |507.39M |
6 --------> 3.53G |1.77G |1.18G |1.18G |1.18G |602.52M
|602.52M |602.52M |
7 --------> 4.09G |2.04G |1.36G |1.36G |1.36G |697.65M
|697.65M |697.65M |
8 --------> 4.65G |2.32G |1.55G |1.55G |1.55G |792.78M
|792.78M |792.78M |
9 --------> 5.2G |2.6G |1.73G |1.73G |1.73G |887.91M
|887.91M |887.91M |
10 --------> 5.76G |2.88G |1.92G |1.92G |1.92G |983.04M
|983.04M |983.04M |
11 --------> 6.32G |3.16G |2.11G |2.11G |2.11G |1.05G
|1.05G |1.05G |
12 --------> 6.87G |3.44G |2.29G |2.29G |2.29G |1.15G
|1.15G |1.15G |
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
