Hi and thank you! This is what I got when I user the -QUIT flag.
Does it say you anything? Regards Erik Full thread dump OpenJDK 64-Bit Server VM (1.6.0-b09 mixed mode): "DestroyJavaVM" prio=10 tid=0x00000000010c7c00 nid=0x13c waiting on condition [0x0000000000000000..0x0000000000507c60] java.lang.Thread.State: RUNNABLE "Timer-2" prio=10 tid=0x00000000013f0400 nid=0x156 in Object.wait() [0x0000000040ff6000..0x0000000040ff6c60] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152b6a29f0> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:531) - locked <0x00007f152b6a29f0> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:484) "pool-1-thread-1" prio=10 tid=0x00007f14e8196000 nid=0x155 waiting on condition [0x000000004175e000..0x000000004175ebe0] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00007f152e0f5ad0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1978) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:636) "Timer-1" prio=10 tid=0x00007f14e8170c00 nid=0x154 in Object.wait() [0x0000000041d8e000..0x0000000041d8eb60] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e08f070> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:531) - locked <0x00007f152e08f070> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:484) "btpool0-9" prio=10 tid=0x00007f14e8126400 nid=0x153 in Object.wait() [0x000000004165d000..0x000000004165dae0] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0aa038> (a org.mortbay.thread.BoundedThreadPool$PoolThread) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:482) - locked <0x00007f152e0aa038> (a org.mortbay.thread.BoundedThreadPool$PoolThread) "btpool0-8" prio=10 tid=0x00007f14e8125000 nid=0x152 in Object.wait() [0x0000000040669000..0x0000000040669a60] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0aa280> (a org.mortbay.thread.BoundedThreadPool$PoolThread) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:482) - locked <0x00007f152e0aa280> (a org.mortbay.thread.BoundedThreadPool$PoolThread) "btpool0-7" prio=10 tid=0x00007f14e80d6800 nid=0x151 in Object.wait() [0x0000000040568000..0x00000000405689e0] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0aa4c8> (a org.mortbay.thread.BoundedThreadPool$PoolThread) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:482) - locked <0x00007f152e0aa4c8> (a org.mortbay.thread.BoundedThreadPool$PoolThread) "btpool0-6" prio=10 tid=0x00007f14e8116c00 nid=0x150 in Object.wait() [0x0000000040ef5000..0x0000000040ef5d60] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0aa710> (a org.mortbay.thread.BoundedThreadPool$PoolThread) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:482) - locked <0x00007f152e0aa710> (a org.mortbay.thread.BoundedThreadPool$PoolThread) "btpool0-5" prio=10 tid=0x00007f14e8115800 nid=0x14f in Object.wait() [0x0000000040df4000..0x0000000040df4ce0] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0aa958> (a org.mortbay.thread.BoundedThreadPool$PoolThread) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:482) - locked <0x00007f152e0aa958> (a org.mortbay.thread.BoundedThreadPool$PoolThread) "btpool0-4" prio=10 tid=0x00007f14e810d800 nid=0x14e in Object.wait() [0x0000000040cf3000..0x0000000040cf3c60] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0aaba0> (a org.mortbay.thread.BoundedThreadPool$PoolThread) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:482) - locked <0x00007f152e0aaba0> (a org.mortbay.thread.BoundedThreadPool$PoolThread) "btpool0-3 - Acceptor0 SocketConnector @ 0.0.0.0:8983" prio=10 tid=0x00007f14e811c400 nid=0x14d runnable [0x0000000040bf2000..0x0000000040bf2be0] java.lang.Thread.State: RUNNABLE at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:358) at java.net.ServerSocket.implAccept(ServerSocket.java:470) at java.net.ServerSocket.accept(ServerSocket.java:438) at org.mortbay.jetty.bio.SocketConnector.accept(SocketConnector.java:97) at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:516) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:442) "btpool0-2" prio=10 tid=0x00007f14e811bc00 nid=0x14c in Object.wait() [0x0000000040af1000..0x0000000040af1b60] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0aade8> (a org.mortbay.thread.BoundedThreadPool$PoolThread) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:482) - locked <0x00007f152e0aade8> (a org.mortbay.thread.BoundedThreadPool$PoolThread) "btpool0-1" prio=10 tid=0x00007f14e811b800 nid=0x14b in Object.wait() [0x000000004205f000..0x000000004205fae0] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0ab030> (a org.mortbay.thread.BoundedThreadPool$PoolThread) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:482) - locked <0x00007f152e0ab030> (a org.mortbay.thread.BoundedThreadPool$PoolThread) "btpool0-0" prio=10 tid=0x00007f14e8117800 nid=0x14a in Object.wait() [0x0000000041f5e000..0x0000000041f5ea60] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0ab278> (a org.mortbay.thread.BoundedThreadPool$PoolThread) at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:482) - locked <0x00007f152e0ab278> (a org.mortbay.thread.BoundedThreadPool$PoolThread) "Timer-0" prio=10 tid=0x00007f14e80dc400 nid=0x149 in Object.wait() [0x00000000407b3000..0x00000000407b39e0] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e0ab700> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:531) - locked <0x00007f152e0ab700> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:484) "Low Memory Detector" daemon prio=10 tid=0x0000000001144800 nid=0x147 runnable [0x0000000000000000..0x0000000000000000] java.lang.Thread.State: RUNNABLE "CompilerThread1" daemon prio=10 tid=0x00007f14f402b800 nid=0x146 waiting on condition [0x0000000000000000..0x00000000402644f0] java.lang.Thread.State: RUNNABLE "CompilerThread0" daemon prio=10 tid=0x00007f14f402a000 nid=0x145 waiting on condition [0x0000000000000000..0x0000000040163470] java.lang.Thread.State: RUNNABLE "Signal Dispatcher" daemon prio=10 tid=0x00007f14f4028800 nid=0x144 waiting on condition [0x0000000000000000..0x0000000000000000] java.lang.Thread.State: RUNNABLE "Finalizer" daemon prio=10 tid=0x000000000113c000 nid=0x143 in Object.wait() [0x0000000041b8c000..0x0000000041b8cae0] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e1d5d08> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:133) - locked <0x00007f152e1d5d08> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:149) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:177) "Reference Handler" daemon prio=10 tid=0x000000000113a800 nid=0x142 in Object.wait() [0x0000000041984000..0x0000000041984a60] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00007f152e1d5d40> (a java.lang.ref.Reference$Lock) at java.lang.Object.wait(Object.java:502) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133) - locked <0x00007f152e1d5d40> (a java.lang.ref.Reference$Lock) "VM Thread" prio=10 tid=0x0000000001135400 nid=0x141 runnable "GC task thread#0 (ParallelGC)" prio=10 tid=0x00000000010d2400 nid=0x13d runnable "GC task thread#1 (ParallelGC)" prio=10 tid=0x00000000010d3800 nid=0x13e runnable "GC task thread#2 (ParallelGC)" prio=10 tid=0x00000000010d4c00 nid=0x13f runnable "GC task thread#3 (ParallelGC)" prio=10 tid=0x00000000010d6000 nid=0x140 runnable "VM Periodic Task Thread" prio=10 tid=0x000000000114e400 nid=0x148 waiting on condition JNI global references: 674 Heap PSYoungGen total 69440K, used 33784K [0x00007f1529ca0000, 0x00007f152e5a0000, 0x00007f153f1f0000) eden space 64128K, 48% used [0x00007f1529ca0000,0x00007f152bb185b8,0x00007f152db40000) from space 5312K, 48% used [0x00007f152e070000,0x00007f152e2f5c08,0x00007f152e5a0000) to space 5312K, 0% used [0x00007f152db40000,0x00007f152db40000,0x00007f152e070000) PSOldGen total 85440K, used 0K [0x00007f14ff1f0000, 0x00007f1504560000, 0x00007f1529ca0000) object space 85440K, 0% used [0x00007f14ff1f0000,0x00007f14ff1f0000,0x00007f1504560000) PSPermGen total 21248K, used 13941K [0x00007f14f9df0000, 0x00007f14fb2b0000, 0x00007f14ff1f0000) object space 21248K, 65% used [0x00007f14f9df0000,0x00007f14fab8d7b8,0x00007f14fb2b0000) On Wed, Oct 1, 2008 at 8:34 PM, Lance Norskog <[EMAIL PROTECTED]> wrote: > We send it a normal kill, wait 30 seconds, then use a "kill -9". This means > we tell it to shut down, give it thirty seconds to do whatever it wants to, > then forcefully kill it. I'm not sure we have ever seen the first 'normal > kill' work, but we do it anyway. > > Lance > > -----Original Message----- > From: Otis Gospodnetic [mailto:[EMAIL PROTECTED] > Sent: Wednesday, October 01, 2008 8:22 PM > To: solr-user@lucene.apache.org > Subject: Re: Problem restarting Solr after shutting it down. > > Sorry, I gave you the wrong kill signal. It's kill -QUIT <pid here>. > > > Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > > ----- Original Message ---- > > From: Erik Holstad <[EMAIL PROTECTED]> > > To: solr-user@lucene.apache.org > > Sent: Wednesday, October 1, 2008 5:48:04 PM > > Subject: Re: Problem restarting Solr after shutting it down. > > > > Hi Otis! > > Thanks for the reply, tried it and this is the output: > > > > [EMAIL PROTECTED] ~]$ startsolr.sh > > 2008-10-01 14:26:47.771::INFO: Logging to STDERR via > > org.mortbay.log.StdErrLog > > 2008-10-01 14:26:47.904::INFO: jetty-6.1.3 > > 2008-10-01 14:27:28.086::INFO: Shutdown hook executing > > 2008-10-01 14:27:28.187::INFO: Shutdown hook complete > > > > when doing kill -HUP on the java process. So it shut down the Solr > process. > > > > > > > > > > > > On Wed, Oct 1, 2008 at 2:20 PM, Otis Gospodnetic > > > wrote: > > > > > Erik, > > > > > > While it's sitting there try kill -HUP the java process a few times > > > and see it any threads are blocking and where. > > > The 2-minute pause smells like a network timeout of some kind. > > > > > > Otis > > > -- > > > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > > > > > > > > > > ----- Original Message ---- > > > > From: Erik Holstad > > > > To: solr-user@lucene.apache.org > > > > Sent: Wednesday, October 1, 2008 3:53:49 PM > > > > Subject: Problem restarting Solr after shutting it down. > > > > > > > > Hi! > > > > We are having this weird issue when killing a running instance of > > > > Solr > > > and > > > > then trying to > > > > restart it right away. > > > > > > > > We just switched from one machine to another and on the old one > > > everything > > > > works fine. > > > > When turning off Solr you can restart it right away with no > > > > problem. But > > > on > > > > the new one > > > > the first time you fire it up everything is ok, but when you kill > > > > it and > > > try > > > > to restart it, it just > > > > sits at the jetty lien for about 2-3 mins and then starts. > > > > > > > > 2008-10-01 12:18:49.785::INFO: jetty-6.1.3 Oct 1, 2008 12:20:41 > > > > PM org.apache.solr.servlet.SolrDispatchFilter init > > > > > > > > Regards Erik > > > > > > > > >