Hi,
We are using td-agent to tail nginx logs and push them to s3 (every minute).
We are rotating access logs every 10 minutes and we've noticed that when a
log rotation happens log lines still go to the rotated log file for up to a
minute after the rotation. Because of this we are losing some log
Thanks for the useful information Maxim!
We ended up using strace to monitor the system calls and it looks like that
with our current setup (i.e. default buffer size) the record length is 65536
bytes.
read(17, "\355\247=^\256\36\361\235~\356z"..., 65536) = 65536
write(18, "\355\247=^\256\36\361\