Hi Chris, I analysed the thread dump using TDA (Thread Dump Analyser) and got the following summary:
Overall Thread Count 69 Overall Monitor Count 33 Number of threads waiting for a monitor 0 Number of threads locking a monitor 7 Number of threads sleeping on a monitor 48 Number of deadlocks 0 Number of Monitors without locking threads 0 69% of all threads are sleeping on a monitor. This might indicate they are waiting for some external resource (e.g. database) which is overloaded or not available or are just waiting to get to do something (idle threads). The 7 Threads locking a monitor are as follows:- Thanks again for your help. "PostgreSQL-JDBC-SharedTimer-1" #104 daemon prio=5 os_prio=0 tid=0x00007f65bc06c800 nid=0x18f7 in Object.wait() [0x00007f65abf22000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:552) - locked <0x00000006c18fc1d8> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:505) "OpenEJB-TimerService-Scheduler_QuartzSchedulerThread" #62 daemon prio=5 os_prio=0 tid=0x0000000002483000 nid=0x1849 in Object.wait() [0x00007f65ad8e9000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.openejb.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:311) - locked <0x00000006c13641c0> (a java.lang.Object) "AbstractSecurityService.Timer" #30 daemon prio=5 os_prio=0 tid=0x00007f6608b6b000 nid=0x180c in Object.wait() [0x00007f65d4b71000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:552) - locked <0x00000006c01105a0> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:505) "RetryTimer" #29 daemon prio=5 os_prio=0 tid=0x00007f6608b5f800 nid=0x180b in Object.wait() [0x00007f65d4c72000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000006c0110778> (a java.util.TaskQueue) at java.lang.Object.wait(Object.java:502) at java.util.TimerThread.mainLoop(Timer.java:526) - locked <0x00000006c0110778> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:505) "GC Daemon" #10 daemon prio=2 os_prio=0 tid=0x00007f6608990800 nid=0x17ec in Object.wait() [0x00007f65d54bd000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000006c0110790> (a sun.misc.GC$LatencyLock) at sun.misc.GC$Daemon.run(GC.java:117) - locked <0x00000006c0110790> (a sun.misc.GC$LatencyLock) "Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f6608108000 nid=0x17d6 in Object.wait() [0x00007f65f05f4000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143) - locked <0x00000006c0110f78> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209) "Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f6608103800 nid=0x17d5 in Object.wait() [0x00007f65f06f5000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at java.lang.ref.Reference.tryHandlePending(Reference.java:191) - locked <0x00000006c0111148> (a java.lang.ref.Reference$Lock) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153) -----Original Message----- From: Christopher Schultz [mailto:ch...@christopherschultz.net] Sent: 31 July 2016 14:04 To: Tomcat Users List <users@tomcat.apache.org> Subject: Re: Hanging threads in tomee 1.7.4 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Kuldeep, On 7/29/16 10:18 AM, Kuldeep Sagoo wrote: > I was really hoping you could help – I’m currently workingin > application support and one of our key applications as started > behavingabnormally when upgrading from Tomee version 1.68 to 1.7.4 > (Apache Tomcat(TomEE)/7.0.68 (1.7.4)) . > > > > JDK > > java version "1.8.0_77" > > Java(TM) SE Runtime Environment (build 1.8.0_77-b03) > > Java HotSpot(TM) 64-Bit Server VM (build 25.77-b03, mixedmode) > > > > OS > > Red Hat Enterprise Linux Server release 6.7 (Santiago) > > Oracle Linux Server release 6.7 > > > > The issue occurs intermittently. The Tomee processwhen its status is > checked reports to be in ‘Running’ state. But from adatabase and > application perspective all created orders remain in “New State”and > remain in a Wait state to be processed. > > > > I have taken a thread dump at the point when this occurs andwas hoping > you that someone could give me some pointers. > > > > Thanks for your help in advance and have a great weekend > > > > > > > > Thread Dump > Sorry, this thread dump is unreadable. Can you remove all of the threads that are sleeping for obvious reasons and post the problematic one(s)? - -chris -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAled9zsACgkQ9CaO5/Lv0PBhWgCgpYdiT0GZghNwGXYD35JGb+ev y6wAn0cl5HZzPAA3Qa1Dc8L5x3KgCegh =ueK0 -----END PGP SIGNATURE----- --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org This email is only intended for the person to whom it is addressed and may contain confidential information. If you have received this email in error, please notify the sender and delete this email which must not be copied, distributed or disclosed to any other person. Unless stated otherwise, the contents of this email are personal to the writer and do not represent the official view of Ordnance Survey. Nor can any contract be formed on Ordnance Survey's behalf via email. We reserve the right to monitor emails and attachments without prior notice. Thank you for your cooperation. Ordnance Survey Limited (Company Registration number 09121572) Registered Office: Explorer House Adanac Drive Southampton SO16 0AS Tel: 03456 050505 http://www.os.uk