Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

2019-01-11 Thread gnusys
Set multi_accept off And the web service did not hang this time https://i.imgur.com/irbA5MO.png But the connections in CLOSE_WAIT and LAST_ACK got a spike Posted at Nginx Forum: https://forum.nginx.org/read.php?2,282613,282675#msg-282675 ___ nginx m

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

2019-01-10 Thread gnusys
Its a shared server and I am unable to modify the domains CloudFlare/DNS settings. As said the question mostly is why Nginx is freezing for the same setup and traffic while Apache handles it just fine. If its an issue with the Nginx setting, what should I change? or is it a bug in Nginx? Nginx

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

2019-01-10 Thread gnusys
The TCP state graph for the situation is: https://i.imgur.com/USECPtc.png You can see at 16:55 the FIN_WAIT1 ,CLOSE_WAIT and ESTABLISHED takes a steep climb, At this point Nginx hangs as the server has a script that checks stub status and this doesn't finish. The server itself and all other servi

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

2019-01-10 Thread gnusys
The domain is proxied over cloudflare and the access log shows a large number of requests to the website from the cloudflare servers 121115 162.158.88.4 121472 162.158.89.99 121697 162.158.90.176 122265 162.158.91.97 122969 162.158.93.113 125020 162.158.91.103 126132 162.158.90.194 128913

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

2019-01-10 Thread gnusys
Can multi_accept be on cause this? I have now set multi_accep to off and set up the Nginx again as a reverse proxy. The attack is not ongoing now, so can't tell immediately if that setting helps/not Posted at Nginx Forum: https://forum.nginx.org/read.php?2,282613,282646#msg-282646 _

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

2019-01-10 Thread gnusys
My Current settings are higher except the worker_process worker_processes 1; worker_rlimit_nofile 69152; worker_shutdown_timeout 10s; thread_pool iopool threads=32 max_queue=65536; I think the issue is that nginx accumulate ESTABLISHED and CLOSE_WAIT and FIN_WAIT1 >From successive netstat -apn

Re: Nginx hang and do not respond with large number of network connection in FIN_WAIT state

2019-01-10 Thread gnusys
I have more info on the system state at the time the CLOSE_WAIT connections went sky rocketing Memory ### KiB Mem : 13174569+total, 8684164 free, 28138264 used, 94923264 buff/cache KiB Swap: 4194300 total, 4194300 free,0 used. 86984112 avail Mem