Yeah, we should address that: https://github.com/mozilla-services/heka/issues/1514
On Tue, May 5, 2015 at 9:48 AM, Antonin Kral <[email protected]> wrote: > Hi Mathieu, > > glad I am not alone :) > > * Mathieu Chouquet-Stringer <[email protected]> [2015-05-05 15:15] wrote: > > Wait, I just discovered something, if I switch the offset_method to > > oldest, I get around 5,000 messages/s instead of 1,600? > > Very in-line with what I have seen as well. I have observer quite a lot > of IO operations on the offset files > (e.g. ModgenKafkaInput0.logs.0.offset.bin). So moving them to SSD helped a > lot. > > I do see about 110KB/s per offset file. And heka itself is generating > about 80% of all IOS on the server. iostat shows around 200tps with > peaks at 600tps on the block device which hosts offset files. > > Best, > > Antonin > _______________________________________________ > Heka mailing list > [email protected] > https://mail.mozilla.org/listinfo/heka >
_______________________________________________ Heka mailing list [email protected] https://mail.mozilla.org/listinfo/heka
