Hi.
Here is my complete log including restart related:
*goodbye to uWSGI.*
*VACUUM: pidfile removed.*
*waiting for Emperor death...*
*Wed Jun 25 09:53:26 2014 - [emperor] removed uwsgi instance vassal.ini*
*waiting for Emperor death...*
*Wed Jun 25 09:53:27 2014 - The Emperor is buried.*
*The Emperor has been buried (pid: 34580)*
*...gracefully killing workers...*
*binary reloading uWSGI...*
*chdir() to /opt/uwsgi*
*closing all non-uwsgi socket fds > 2 (max_fd = 120000)...*
*running /opt/uwsgi/uwsgi*
*[uWSGI] getting INI configuration from /opt/uwsgi_conf/emperor_php.ini*
*;uWSGI instance configuration*
*[uwsgi]*
*ini = /opt/uwsgi_conf/emperor_php.ini*
*is_master = 1*
*emperor = mongodb://x.x.x.x:xxxx,emperor.vassals,{enabled:1,
hostname:'x.x.x.x'}*
*plugin = emperor_mongodb*
*master = true*
*pidfile = /var/run/uwsgi/emperor_php.pid*
*daemonize = /var/log/uwsgi/emperor_php.log*
*max-fd = 120000*
*listen = 8192*
*procname-prefix-spaced = myapp_emperor*
*binary-path = /opt/uwsgi/uwsgi*
*show-config = true*
*emperor-stats = /var/run/uwsgi/emperor_php.socket*
*if-opt = is_master=1*
*smart-attach-daemon = /var/log/mongodb/myapp.pid mongod --config
/opt/mongodb_conf/mongodb_php.conf*
*endif =*
*;end of configuration*
**** Starting uWSGI 2.0.6 (64bit) on [Wed Jun 25 09:53:28 2014] ****
*compiled with version: 4.6.3 on 24 June 2014 21:02:50*
*os: Linux-3.10.23-xxxx-std-ipv6-64 #1 SMP Tue Mar 18 14:48:24 CET 2014*
*nodename: x.x.x.x*
*machine: x86_64*
*clock source: unix*
*pcre jit disabled*
*detected number of CPU cores: 40*
*current working directory: /opt/uwsgi*
*detected binary path: /opt/uwsgi/uwsgi*
*uWSGI running as root, you can use --uid/--gid/--chroot options*
**** WARNING: you are running uWSGI as root !!! (use the --uid flag) ****
*your processes number limit is 2063402*
*your memory page size is 4096 bytes*
*detected max file descriptor number: 120000*
*lock engine: pthread robust mutexes*
*thunder lock: disabled (you can enable it with --thunder-lock)*
*[emperor] enabled emperor MongoDB monitor for x.x.x.x:xxxx on collection
emperor.vassals*
**** starting uWSGI Emperor ****
**** Emperor stats server enabled on /var/run/uwsgi/emperor_php.socket fd:
5 ****
*Python version: 2.7.3 (default, Feb 27 2014, 20:09:21) [GCC 4.6.3]*
**** has_emperor mode detected (fd: 8) ****
*[uWSGI] getting INI configuration from emperor://vassal.ini*
*;uWSGI instance configuration*
*[uwsgi]*
*ini = emperor://vassal.ini*
*plugin = php*
*socket = x.x.x.x:0*
*processes = 60*
*master = true*
*vacuum = true*
*auto-procname = true*
*max-requests = 100000*
*harakiri = 7200*
*harakiri-verbose = true*
*limit-post = 65536*
*post-buffering = 1048576*
*procname-prefix-spaced = myapp_worker*
*subscribe2 = server=x.x.x.x:xxxx,key=myapp,modifier1=14*
*no-orphans = true*
*log-slow = false*
*listen = 8192*
*reload-on-rss = 300*
*buffer-size = 65535*
*env = LANG=en_US.UTF-8*
*binary-path = /opt/uwsgi/uwsgi*
*show-config = true*
*pidfile = /var/run/uwsgi/vassal_1.pid*
*stats = /var/run/uwsgi/vassal_1.socket*
*touch-reload = /home/myapp/uwsgi_reload*
*;end of configuration*
**** Starting uWSGI 2.0.6 (64bit) on [Wed Jun 25 09:53:28 2014] ****
*compiled with version: 4.6.3 on 24 June 2014 21:02:50*
*os: Linux-3.10.23-xxxx-std-ipv6-64 #1 SMP Tue Mar 18 14:48:24 CET 2014*
*nodename: x.x.x.x*
*machine: x86_64*
*clock source: unix*
*pcre jit disabled*
*detected number of CPU cores: 40*
*current working directory: /opt/uwsgi*
*writing pidfile to /var/run/uwsgi/vassal_1.pid*
*detected binary path: /opt/uwsgi/uwsgi*
*uWSGI running as root, you can use --uid/--gid/--chroot options*
**** WARNING: you are running uWSGI as root !!! (use the --uid flag) ****
*your processes number limit is 2063402*
*your memory page size is 4096 bytes*
*detected max file descriptor number: 120000*
*lock engine: pthread robust mutexes*
*thunder lock: disabled (you can enable it with --thunder-lock)*
*uwsgi socket 0 bound to TCP address x.x.x.x:49974 (port auto-assigned) fd
3*
*Python version: 2.7.3 (default, Feb 27 2014, 20:09:21) [GCC 4.6.3]*
**** Python threads support is disabled. You can enable it with
--enable-threads ****
*Python main interpreter initialized at 0x73ed30*
*your mercy for graceful operations on workers is 60 seconds*
**** Operational MODE: no-workers ****
*gracefully (RE)spawned uWSGI master process (pid: 27294)*
*[uwsgi-daemons] found valid/active pidfile for "mongod --config
/opt/mongodb_conf/mongodb_php.conf" (pid: 15917)*
**** Python threads support is disabled. You can enable it with
--enable-threads ****
*Python main interpreter initialized at 0x724890*
*PHP 5.5.10-1+deb.sury.org <http://deb.sury.org>~precise+1 initialized*
*your server socket listen backlog is limited to 8192 connections*
*your mercy for graceful operations on workers is 60 seconds*
*setting request body buffering size to 1048576 bytes*
*mapped 72149763 bytes (70458 KB) for 60 cores*
**** Operational MODE: preforking ****
**** no app loaded. going in full dynamic mode ****
**** uWSGI is running in multiple interpreter mode ****
*spawned uWSGI master process (pid: 5057)*
*Wed Jun 25 09:53:28 2014 - [emperor] vassal vassal.ini has been spawned*
*spawned uWSGI worker 1 (pid: 5060, cores: 1)*
*spawned uWSGI worker 2 (pid: 5061, cores: 1)*
*...*
*spawned uWSGI worker 60 (pid: 5121, cores: 1)*
**** Stats server enabled on /var/run/uwsgi/vassal_1.socket fd: 129 ****
*subscribing to server=x.x.x.x:1010,key=myapp,modifier1=14*
*[pid: 5107|app: -1|req: -1/1] x.x.x.x () {62 vars in 921 bytes} [Wed Jun
25 09:53:28 2014] GET /my/html => generated 63594 by$*
*announcing my loyalty to the Emperor...*
*Wed Jun 25 09:53:28 2014 - [emperor] vassal vassal.ini is now loyal*
*[pid: 5103|app: -1|req: -1/2] x.x.x.x () {60 vars in 888 bytes} [Wed Jun
25 09:53:28 2014] GET my.html => generated 32349 bytes in 307 msecs (HTTP/$*
*announcing my loyalty to the Emperor...*
*Wed Jun 25 09:53:28 2014 - [emperor] vassal vassal.ini is now loyal*
*[pid: 5099|app: -1|req: -1/3] x.x.x.x () {50 vars in 785 bytes} [Wed Jun
25 09:53:28 2014] GET my.tml => generated$*
*announcing my loyalty to the Emperor...*
*Wed Jun 25 09:53:28 2014 - [emperor] vassal vassal.ini is now loyal*
*[pid: 5096|app: -1|req: -1/4] x.x.x.x () {62 vars in 1135 bytes} [Wed Jun
25 09:53:28 2014] GET my.html => generated 27197 bytes in 367 msecs
(HTTP/1.1 200) 7 $*
*announcing my loyalty to the Emperor...*
*Wed Jun 25 09:53:29 2014 - [emperor] vassal vassal.ini is now loyal*
*[pid: 5102|app: -1|req: -1/5] x.x.x.x () {48 vars in 795 bytes} [Wed Jun
25 09:53:28 2014] GET my.html => generated 39306 bytes in 374 msecs$*
*announcing my loyalty to the Emperor...*
*Wed Jun 25 09:53:29 2014 - [emperor] vassal vassal.ini is now loyal*
*[pid: 5120|app: -1|req: -1/6] x.x.x.x () {50 vars in 810 bytes} [Wed Jun
25 09:53:28 2014] GET my.tml*
*announcing my loyalty to the Emperor...*
After that I goes requests without errors, so not other suspicious requests
or errors besides this one:
**** uWSGI listen queue of socket "37.187.137.224:49974
<http://37.187.137.224:49974>" (fd: 3) full !!! (2001/2000) ****
Note that I manually changed the queue limit from uwsgi/core/init.c just to
make some tests.
I think that this may be a system related limit, but not sure why there is
not efet when I change them:
*net.core.somaxconn=1000000*
*net.core.netdev_max_backlog = 1000000*
*net.ipv4.tcp_max_syn_backlog=1000000*
*net.netfilter.nf_conntrack_max=1000000*
*net.netfilter.nf_conntrack_count=250000*
After restart I get them same issue.
Also netstatus: netstat -an | awk '/^tcp/ {print $NF}' | sort | uniq -c |
sort -rn
*15389 TIME_WAIT*
* 4494 ESTABLISHED*
* 474 FIN_WAIT2*
* 462 CLOSE_WAIT*
* 55 LAST_ACK*
* 31 FIN_WAIT1*
* 18 LISTEN*
* 16 SYN_RECV*
* 4 CLOSING*
* 1 SYN_SENT*
Thx.
On 25 June 2014 08:55, Roberto De Ioris <[email protected]> wrote:
>
> > I have uwsgi setup using emperor, fastrouter configuration and I'm using
> > the php plugin.
> >
> >
> > After latest uwsgi update from master I get such error in logs:
> >
> > *** uWSGI listen queue of socket "x.x.x.x:xxxxx" (fd: 3) full !!!
> > (101/100) ***
> >
> > I edited /etc/sysctl.conf and added:
> >
> > net.core.somaxconn = 65535
> > net.core.netdev_max_backlog = 65536
> > net.ipv4.tcp_max_syn_backlog=65536
> >
> >
> > restarted the uwsgi(soft and hard), but I still get the same issue.
> > This is running onUbuntu 12.04.4 LTS server. How can I increase the this
> > value?
> >
> > Note that listen parameter from config is set to 1024 (both fastrouter
> and
> > emperor).
> >
> > I build uwsgi myself, not sure if this is relevant info.
> >
> > I also tried to change the default value from uwsgi.listen_queue = 100;
> > <
> https://github.com/unbit/uwsgi/blob/930c19210af71511b0288cb61a8901606038f077/core/init.c#L109
> >,
> > recompiled the uwsgi but still the same result. I'm not sure what I'm
> > doing
> > wrong.
> >
> >
>
>
> can you check you are running the right uWSGI version ? modern versions
> suddenly exits if the listen_queue value is higher than the set limit.
>
> Report startup logs (until the first request), as they contains lot of
> useful infos. Remember that the listen_queue must be set for each vassal
>
>
> --
> Roberto De Ioris
> http://unbit.it
> _______________________________________________
> uWSGI mailing list
> [email protected]
> http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi
>
_______________________________________________
uWSGI mailing list
[email protected]
http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi
