Nginx access log / logrotate, tailing and td-agent

2017-05-04 Thread nicktgr15
Hi, We are using td-agent to tail nginx logs and push them to s3 (every minute). We are rotating access logs every 10 minutes and we've noticed that when a log rotation happens log lines still go to the rotated log file for up to a minute after the rotation. Because of this we are losing some log

Re: Nginx record length during disk IO

2017-01-16 Thread nicktgr15
Thanks for the useful information Maxim! We ended up using strace to monitor the system calls and it looks like that with our current setup (i.e. default buffer size) the record length is 65536 bytes. read(17, "\355\247=^\256\36\361\235~\356z"..., 65536) = 65536 write(18, "\355\247=^\256\36\361\