pabrahamusa commented on issue #6277: URL: https://github.com/apache/incubator-pinot/issues/6277#issuecomment-771994796
So my config at the moment is this , however in the segment folder I can see massively huge segments i.e. > 4G . why this is happening. I am trying to control it to 500M . ``` "realtime.segment.flush.threshold.rows": "100000", "realtime.segment.flush.autotune.initialRows": "100000", "realtime.segment.flush.threshold.size": "500M", ``` ``` root@my-pinot-server-0:/var/pinot/server/data/index/mylog_REALTIME# du -sh * 0 consumers 520M mylog__0__13__20210202T2001Z 4.0G mylog__0__15__20210202T2002Z 522M mylog__0__26__20210202T2009Z 523M mylog__0__28__20210202T2010Z 4.5G mylog__0__2__20210202T1952Z 518M mylog__0__31__20210202T2012Z 746M mylog__0__39__20210202T2017Z 492M mylog__0__40__20210202T2017Z 521M mylog__0__42__20210202T2018Z 4.5G mylog__0__44__20210202T2019Z 523M mylog__0__46__20210202T2021Z 4.6G mylog__0__53__20210202T2024Z ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org