has anyone tried jvm _20 or _19 with cassandra? On Wed, May 5, 2010 at 10:00 AM, Nathan McCall <n...@vervewireless.com>wrote:
> Ran, > You may want to upgrade your jvm. I had a similar core with a heavily > loaded tomcat recently and found the following on the release notes > page for 1.6.0_18: > "Card-Marking Optimization Issue > > A flaw in the implementation of a card-marking performance > optimization in the JVM can cause heap corruption under some > circumstances. This issue affects the CMS garbage collector prior to > 6u18, and the CMS, G1 and Parallel Garbage Collectors in 6u18. The > serial garbage collector is not affected. Applications most likely to > be affected by this issue are those that allocate very large objects > which would not normally fit in Eden, or those that make extensive use > of JNI Critical Sections (JNI Get/Release*Critical)." > > http://java.sun.com/javase/6/webnotes/6u18.html > > Note that there is an apparent work-around jvm option to add: > -XX:-ReduceInitialCardMarks > > -Nate > > > On Tue, May 4, 2010 at 11:24 PM, Ran Tavory <ran...@gmail.com> wrote: > > Running a cluster of 0.6.1, one of the hosts crashed during GC. > > Can anyone suggest what needs tweaking to prevent that? > > The last configuration change I made was to > > change <DiskAccessMode>standard</DiskAccessMode> (it was auto); but I > can't > > determine if it's related. > > > > System is 64 bit centos, the rest of the system info is at the bottom of > the > > email. > > The last lines before the crash from system.log are: > > > > INFO [COMPACTION-POOL:1] 2010-05-04 17:01:49,913 CompactionManager.java > > (line 246) Compacting > > > [org.apache.cassandra.io.SSTableReader(path='/outbrain/cassandra/data/outbrain_kvdb/KvImpressions-607-Data.db'),org.apache.cassandra.io.SSTableReader(path='/outbrain/cassandra/data/outbrain_kvdb/KvImpressions-608-Data.db'),org.apache.cassandra.io.SSTableReader(path='/outbrain/cassandra/data/outbrain_kvdb/KvImpressions-609-Data.db'),org.apache.cassandra.io.SSTableReader(path='/outbrain/cassandra/data/outbrain_kvdb/KvImpressions-610-Data.db')] > > INFO [COMMIT-LOG-WRITER] 2010-05-04 17:01:49,920 CommitLog.java (line > 407) > > Discarding obsolete commit > > > log:CommitLogSegment(/outbrain/cassandra/commitlog/CommitLog-1273006181463.log) > > INFO [COMPACTION-POOL:1] 2010-05-04 17:02:09,820 CompactionManager.java > > (line 326) Compacted to > > /outbrain/cassandra/data/outbrain_kvdb/KvImpressions-611-Data.db. > > 291072443/291071793 bytes for 123292 keys. Time: 19906ms. > > And a summary of hs_err is here. The rest is attached. Let me know if > you've > > see this before and can advice, thanks! > > # > > # A fatal error has been detected by the Java Runtime Environment: > > # > > # SIGSEGV (0xb) at pc=0x00002add529adb76, pid=943, tid=1112779072 > > # > > # JRE version: 6.0_17-b04 > > # Java VM: Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode > > linux-amd64 ) > > # Problematic frame: > > # V [libjvm.so+0x1ffb76] > > # > > # If you would like to submit a bug report, please visit: > > # http://java.sun.com/webapps/bugreport/crash.jsp > > # > > --------------- T H R E A D --------------- > > Current thread (0x0000000047276800): GCTaskThread [stack: > > 0x0000000000000000,0x0000000000000000] [id=974] > > siginfo:si_signo=SIGSEGV: si_errno=0, si_code=128 (), > > si_addr=0x0000000000000000 > > > > --------------- P R O C E S S --------------- > > Java Threads: ( => current thread ) > > 0x0000000047a08800 JavaThread "FILEUTILS-DELETE-POOL:1" > [_thread_blocked, > > id=1297, stack(0x0000000043e54000,0x0000000043f55000)] > > 0x0000000047ab9000 JavaThread "CACHETABLE-TIMER-3" daemon > > [_thread_blocked, id=1270, stack(0x0000000049dbf000,0x0000000049ec0000)] > > 0x0000000047691000 JavaThread "Thread-26" [_thread_in_native, id=1191, > > stack(0x0000000043d53000,0x0000000043e54000)] > > 0x00000000476ac000 JavaThread "Thread-19" [_thread_in_native, id=1117, > > stack(0x0000000048daf000,0x0000000048eb0000)] > > 0x0000000047a42800 JavaThread "WRITE-/192.168.252.61" > [_thread_blocked, > > id=1110, stack(0x0000000049cbe000,0x0000000049dbf000)] > > 0x0000000047abc800 JavaThread "WRITE-/192.168.252.62" > [_thread_blocked, > > id=1109, stack(0x0000000049bbd000,0x0000000049cbe000)] > > 0x00002aabc841b800 JavaThread "Hint delivery" [_thread_blocked, > id=1108, > > stack(0x0000000049abc000,0x0000000049bbd000)] > > 0x00002aabc841a800 JavaThread "HINTED-HANDOFF-POOL:1" [_thread_blocked, > > id=1107, stack(0x00000000499bb000,0x0000000049abc000)] > > 0x0000000047693800 JavaThread "Thread-16" [_thread_in_native, id=1106, > > stack(0x00000000498ba000,0x00000000499bb000)] > > 0x0000000047693000 JavaThread "WRITE-/192.168.252.99" > [_thread_blocked, > > id=1105, stack(0x00000000497b9000,0x00000000498ba000)] > > 0x0000000047b05000 JavaThread "Thread-15" [_thread_blocked, id=1104, > > stack(0x00000000496b8000,0x00000000497b9000)] > > 0x0000000047a7b000 JavaThread "Thread-14" [_thread_in_native, id=1103, > > stack(0x00000000495b7000,0x00000000496b8000)] > > 0x00002aabc8056000 JavaThread "WRITE-/192.168.254.59" > [_thread_blocked, > > id=1102, stack(0x00000000494b6000,0x00000000495b7000)] > > 0x00002aabccf61800 JavaThread "Thread-13" [_thread_in_native, id=1101, > > stack(0x00000000493b5000,0x00000000494b6000)] > > 0x00002aabccf5f000 JavaThread "WRITE-/192.168.252.61" > [_thread_blocked, > > id=1100, stack(0x00000000492b4000,0x00000000493b5000)] > > 0x00002aabc8054000 JavaThread "WRITE-/192.168.254.58" > [_thread_blocked, > > id=1099, stack(0x00000000491b3000,0x00000000492b4000)] > > 0x00002aabc8053800 JavaThread "WRITE-/192.168.252.62" > [_thread_blocked, > > id=1098, stack(0x00000000490b2000,0x00000000491b3000)] > > 0x00000000475db000 JavaThread "Thread-12" [_thread_in_native, id=1097, > > stack(0x0000000048fb1000,0x00000000490b2000)] > > 0x00000000475d8000 JavaThread "Thread-11" [_thread_blocked, id=1096, > > stack(0x0000000048eb0000,0x0000000048fb1000)] > > 0x00002aabbc2ac800 JavaThread "Timer-1" [_thread_blocked, id=1093, > > stack(0x0000000048bad000,0x0000000048cae000)] > > 0x00002aabbc1b0800 JavaThread "Timer-0" [_thread_blocked, id=1092, > > stack(0x0000000048aac000,0x0000000048bad000)] > > 0x00002aabbc1ae800 JavaThread "LB-TARGET:1" [_thread_blocked, id=1091, > > stack(0x00000000489ab000,0x0000000048aac000)] > > 0x00002aabbc1ad000 JavaThread "LB-OPERATIONS:1" [_thread_blocked, > id=1090, > > stack(0x00000000488aa000,0x00000000489ab000)] > > 0x00002aabbc1ac000 JavaThread > > "ACCEPT-ob2057.ladc1.outbrain.com/192.168.254.57" [_thread_in_native, > > id=1089, stack(0x00000000487a9000,0x00000000488aa000)] > > 0x00002aabbc1ab800 JavaThread "GC inspection" [_thread_blocked, > id=1088, > > stack(0x0000000040694000,0x0000000040795000)] > > 0x00002aabcc1fd800 JavaThread "COMPACTION-POOL:1" [_thread_blocked, > > id=1087, stack(0x00000000486a8000,0x00000000487a9000)] > > 0x00002aabbc29f000 JavaThread "PERIODIC-COMMIT-LOG-SYNCER" > > [_thread_blocked, id=1086, stack(0x00000000485a7000,0x00000000486a8000)] > > 0x00002aabbc29a000 JavaThread "COMMIT-LOG-WRITER" [_thread_blocked, > > id=1085, stack(0x0000000040830000,0x0000000040931000)] > > 0x00002aabbc194800 JavaThread "LOAD-BALANCER-STAGE:1" [_thread_blocked, > > id=1082, stack(0x00000000484a6000,0x00000000485a7000)] > > 0x00002aabbc275000 JavaThread "AE-SERVICE-STAGE:1" [_thread_blocked, > > id=1081, stack(0x00000000483a5000,0x00000000484a6000)] > > 0x00002aabbc273000 JavaThread "GMFD:1" [_thread_blocked, id=1079, > > stack(0x00000000482a4000,0x00000000483a5000)] > > 0x00002aabbc271000 JavaThread "STREAM-STAGE:1" [_thread_blocked, > id=1078, > > stack(0x00000000481a3000,0x00000000482a4000)] > > 0x00002aabbc26f800 JavaThread "RESPONSE-STAGE:16" [_thread_blocked, > > id=1077, stack(0x00000000480a2000,0x00000000481a3000)] > > 0x00002aabbc26d800 JavaThread "RESPONSE-STAGE:15" [_thread_blocked, > > id=1076, stack(0x0000000047fa1000,0x00000000480a2000)] > > 0x00002aabbc26b800 JavaThread "RESPONSE-STAGE:14" [_thread_blocked, > > id=1075, stack(0x0000000047ea0000,0x0000000047fa1000)] > > 0x00002aabbc269800 JavaThread "RESPONSE-STAGE:13" [_thread_blocked, > > id=1074, stack(0x0000000047d9f000,0x0000000047ea0000)] > > 0x00002aabbc267800 JavaThread "RESPONSE-STAGE:12" [_thread_blocked, > > id=1073, stack(0x0000000047c9e000,0x0000000047d9f000)] > > 0x00002aabbc265800 JavaThread "RESPONSE-STAGE:11" [_thread_blocked, > > id=1072, stack(0x0000000047b9d000,0x0000000047c9e000)] > > 0x00002aabbc263800 JavaThread "RESPONSE-STAGE:10" [_thread_blocked, > > id=1071, stack(0x0000000047086000,0x0000000047187000)] > > 0x00002aabbc261800 JavaThread "RESPONSE-STAGE:9" [_thread_blocked, > > id=1070, stack(0x0000000046f85000,0x0000000047086000)] > > 0x00002aabbc25f800 JavaThread "RESPONSE-STAGE:8" [_thread_blocked, > > id=1069, stack(0x0000000046e84000,0x0000000046f85000)] > > 0x00002aabbc25d800 JavaThread "RESPONSE-STAGE:7" [_thread_blocked, > > id=1068, stack(0x0000000046d83000,0x0000000046e84000)] > > 0x00002aabbc25c000 JavaThread "RESPONSE-STAGE:6" [_thread_blocked, > > id=1067, stack(0x0000000046c82000,0x0000000046d83000)] > > 0x00002aabbc20b000 JavaThread "RESPONSE-STAGE:5" [_thread_blocked, > > id=1066, stack(0x0000000046b81000,0x0000000046c82000)] > > 0x00002aabbc209800 JavaThread "RESPONSE-STAGE:4" [_thread_blocked, > > id=1065, stack(0x0000000046a80000,0x0000000046b81000)] > > 0x00002aabbc207800 JavaThread "RESPONSE-STAGE:3" [_thread_blocked, > > id=1064, stack(0x000000004697f000,0x0000000046a80000)] > > 0x00002aabbc205800 JavaThread "RESPONSE-STAGE:2" [_thread_blocked, > > id=1063, stack(0x000000004687e000,0x000000004697f000)] > > 0x00002aabbc203800 JavaThread "RESPONSE-STAGE:1" [_thread_blocked, > > id=1062, stack(0x000000004677d000,0x000000004687e000)] > > 0x00002aabbc201800 JavaThread "ROW-READ-STAGE:8" [_thread_blocked, > > id=1061, stack(0x000000004667c000,0x000000004677d000)] > > 0x00002aabbc1ff800 JavaThread "ROW-READ-STAGE:7" [_thread_blocked, > > id=1060, stack(0x000000004657b000,0x000000004667c000)] > > 0x00002aabbc1fd800 JavaThread "ROW-READ-STAGE:6" [_thread_blocked, > > id=1059, stack(0x000000004647a000,0x000000004657b000)] > > 0x00002aabbc1fb800 JavaThread "ROW-READ-STAGE:5" [_thread_in_native, > > id=1058, stack(0x0000000046379000,0x000000004647a000)] > > 0x00002aabbc1f9800 JavaThread "ROW-READ-STAGE:4" [_thread_blocked, > > id=1057, stack(0x0000000046278000,0x0000000046379000)] > > 0x00002aabbc1f7800 JavaThread "ROW-READ-STAGE:3" [_thread_in_native, > > id=1056, stack(0x0000000046177000,0x0000000046278000)] > > 0x00002aabbc1f5800 JavaThread "ROW-READ-STAGE:2" [_thread_in_native, > > id=1055, stack(0x0000000046076000,0x0000000046177000)] > > 0x00002aabbc28e800 JavaThread "ROW-READ-STAGE:1" [_thread_blocked, > > id=1054, stack(0x0000000045f75000,0x0000000046076000)] > > 0x00002aabbc28c800 JavaThread "ROW-MUTATION-STAGE:32" [_thread_blocked, > > id=1053, stack(0x0000000045e74000,0x0000000045f75000)] > > 0x00002aabbc28a800 JavaThread "ROW-MUTATION-STAGE:31" [_thread_blocked, > > id=1052, stack(0x0000000045d73000,0x0000000045e74000)] > > 0x00002aabbc288800 JavaThread "ROW-MUTATION-STAGE:30" [_thread_blocked, > > id=1051, stack(0x0000000045c72000,0x0000000045d73000)] > > 0x00002aabbc286800 JavaThread "ROW-MUTATION-STAGE:29" [_thread_blocked, > > id=1050, stack(0x0000000045b71000,0x0000000045c72000)] > > 0x00002aabbc284800 JavaThread "ROW-MUTATION-STAGE:28" [_thread_blocked, > > id=1049, stack(0x0000000045a70000,0x0000000045b71000)] > > 0x00002aabbc282800 JavaThread "ROW-MUTATION-STAGE:27" [_thread_blocked, > > id=1048, stack(0x000000004596f000,0x0000000045a70000)] > > 0x00002aabbc280800 JavaThread "ROW-MUTATION-STAGE:26" [_thread_blocked, > > id=1047, stack(0x000000004586e000,0x000000004596f000)] > > 0x00002aabbc27e800 JavaThread "ROW-MUTATION-STAGE:25" [_thread_blocked, > > id=1046, stack(0x000000004576d000,0x000000004586e000)] > > 0x00002aabbc27c800 JavaThread "ROW-MUTATION-STAGE:24" [_thread_blocked, > > id=1045, stack(0x000000004566c000,0x000000004576d000)] > > 0x00002aabbc27a800 JavaThread "ROW-MUTATION-STAGE:23" [_thread_blocked, > > id=1044, stack(0x000000004556b000,0x000000004566c000)] > > 0x00002aabbc279000 JavaThread "ROW-MUTATION-STAGE:22" [_thread_blocked, > > id=1043, stack(0x000000004546a000,0x000000004556b000)] > > 0x00002aabbc220000 JavaThread "ROW-MUTATION-STAGE:21" [_thread_blocked, > > id=1042, stack(0x0000000045369000,0x000000004546a000)] > > 0x00002aabbc21e000 JavaThread "ROW-MUTATION-STAGE:20" [_thread_blocked, > > id=1041, stack(0x0000000045268000,0x0000000045369000)] > > 0x00002aabbc21c000 JavaThread "ROW-MUTATION-STAGE:19" [_thread_blocked, > > id=1040, stack(0x0000000045167000,0x0000000045268000)] > > 0x00002aabbc21a000 JavaThread "ROW-MUTATION-STAGE:18" [_thread_blocked, > > id=1039, stack(0x0000000045066000,0x0000000045167000)] > > 0x00002aabbc218000 JavaThread "ROW-MUTATION-STAGE:17" [_thread_blocked, > > id=1038, stack(0x0000000044f65000,0x0000000045066000)] > > 0x00002aabbc216000 JavaThread "ROW-MUTATION-STAGE:16" [_thread_blocked, > > id=1037, stack(0x0000000044e64000,0x0000000044f65000)] > > 0x00002aabbc214000 JavaThread "ROW-MUTATION-STAGE:15" [_thread_blocked, > > id=1036, stack(0x0000000044d63000,0x0000000044e64000)] > > 0x00002aabbc212000 JavaThread "ROW-MUTATION-STAGE:14" [_thread_blocked, > > id=1035, stack(0x0000000044c62000,0x0000000044d63000)] > > 0x00002aabbc210800 JavaThread "ROW-MUTATION-STAGE:13" [_thread_blocked, > > id=1034, stack(0x0000000044b61000,0x0000000044c62000)] > > 0x00002aabbc259000 JavaThread "ROW-MUTATION-STAGE:12" [_thread_blocked, > > id=1033, stack(0x0000000044a60000,0x0000000044b61000)] > > 0x00002aabbc257000 JavaThread "ROW-MUTATION-STAGE:11" [_thread_blocked, > > id=1032, stack(0x000000004495f000,0x0000000044a60000)] > > 0x00002aabbc255000 JavaThread "ROW-MUTATION-STAGE:10" [_thread_blocked, > > id=1031, stack(0x000000004485e000,0x000000004495f000)] > > 0x00002aabbc253000 JavaThread "ROW-MUTATION-STAGE:9" [_thread_blocked, > > id=1030, stack(0x000000004475d000,0x000000004485e000)] > > 0x00002aabbc040800 JavaThread "ROW-MUTATION-STAGE:8" [_thread_blocked, > > id=1029, stack(0x000000004465c000,0x000000004475d000)] > > 0x00002aabbc03e800 JavaThread "ROW-MUTATION-STAGE:7" [_thread_blocked, > > id=1028, stack(0x000000004455b000,0x000000004465c000)] > > 0x00002aabbc03c800 JavaThread "ROW-MUTATION-STAGE:6" [_thread_blocked, > > id=1027, stack(0x000000004445a000,0x000000004455b000)] > > 0x00002aabbc03a800 JavaThread "ROW-MUTATION-STAGE:5" [_thread_blocked, > > id=1026, stack(0x0000000044359000,0x000000004445a000)] > > 0x00002aabbc036000 JavaThread "ROW-MUTATION-STAGE:4" [_thread_blocked, > > id=1025, stack(0x0000000044258000,0x0000000044359000)] > > 0x00002aabbc034800 JavaThread "ROW-MUTATION-STAGE:3" [_thread_blocked, > > id=1024, stack(0x0000000044157000,0x0000000044258000)] > > 0x00002aabbc033000 JavaThread "ROW-MUTATION-STAGE:2" [_thread_blocked, > > id=1023, stack(0x0000000044056000,0x0000000044157000)] > > 0x00002aabbc24d800 JavaThread "ROW-MUTATION-STAGE:1" [_thread_blocked, > > id=1022, stack(0x0000000043f55000,0x0000000044056000)] > > 0x00002aabbc24d000 JavaThread "SSTABLE-CLEANUP-TIMER" [_thread_blocked, > > id=1021, stack(0x0000000040c68000,0x0000000040d69000)] > > 0x00000000475e5000 JavaThread "RMI Scheduler(0)" daemon > [_thread_blocked, > > id=1017, stack(0x0000000041499000,0x000000004159a000)] > > 0x00002aabbc245800 JavaThread "SSTABLE-DELETER" [_thread_blocked, > id=1009, > > stack(0x0000000043c52000,0x0000000043d53000)] > > 0x00002aabbc243000 JavaThread "MESSAGE-STREAMING-POOL:1" > [_thread_blocked, > > id=1008, stack(0x0000000043b51000,0x0000000043c52000)] > > 0x00002aabbc241800 JavaThread "MESSAGE-DESERIALIZER-POOL:1" > > [_thread_blocked, id=1007, stack(0x0000000043a50000,0x0000000043b51000)] > > 0x00002aabbc23d800 JavaThread "CACHETABLE-TIMER-2" daemon > > [_thread_blocked, id=1006, stack(0x000000004394f000,0x0000000043a50000)] > > 0x00002aabbc23f000 JavaThread "CACHETABLE-TIMER-1" daemon > > [_thread_blocked, id=1005, stack(0x000000004384e000,0x000000004394f000)] > > 0x00002aabbc232000 JavaThread "CONSISTENCY-MANAGER:4" [_thread_blocked, > > id=1004, stack(0x000000004374d000,0x000000004384e000)] > > 0x00002aabbc230000 JavaThread "CONSISTENCY-MANAGER:3" [_thread_blocked, > > id=1003, stack(0x000000004364c000,0x000000004374d000)] > > 0x00002aabbc233000 JavaThread "CONSISTENCY-MANAGER:2" [_thread_blocked, > > id=1002, stack(0x000000004354b000,0x000000004364c000)] > > 0x00002aabbc235000 JavaThread "CONSISTENCY-MANAGER:1" [_thread_blocked, > > id=1001, stack(0x000000004344a000,0x000000004354b000)] > > 0x00002aabbc226800 JavaThread "MEMTABLE-POST-FLUSHER:1" > [_thread_blocked, > > id=1000, stack(0x0000000043349000,0x000000004344a000)] > > 0x00002aabbc20f000 JavaThread "FLUSH-WRITER-POOL:1" [_thread_blocked, > > id=999, stack(0x0000000043248000,0x0000000043349000)] > > 0x00002aabbc1b8800 JavaThread "FLUSH-SORTER-POOL:1" [_thread_blocked, > > id=998, stack(0x0000000043147000,0x0000000043248000)] > > 0x00002aabbc1f3800 JavaThread "FLUSH-TIMER" [_thread_blocked, id=997, > > stack(0x000000004117f000,0x0000000041280000)] > > 0x00002aabbc17e000 JavaThread "RMI TCP Accept-0" daemon > > [_thread_in_native, id=995, stack(0x0000000040f7d000,0x000000004107e000)] > > 0x00002aabbc178800 JavaThread "RMI TCP Accept-9004" daemon > > [_thread_in_native, id=994, stack(0x0000000043046000,0x0000000043147000)] > > 0x00002aabbc169800 JavaThread "RMI TCP Accept-0" daemon > > [_thread_in_native, id=989, stack(0x0000000040a48000,0x0000000040b49000)] > > 0x00002aabbc026800 JavaThread "Low Memory Detector" daemon > > [_thread_blocked, id=988, stack(0x0000000042f45000,0x0000000043046000)] > > 0x00002aabbc024000 JavaThread "CompilerThread1" daemon > [_thread_blocked, > > id=987, stack(0x0000000042e44000,0x0000000042f45000)] > > 0x00002aabbc022000 JavaThread "CompilerThread0" daemon > [_thread_blocked, > > id=986, stack(0x0000000042d43000,0x0000000042e44000)] > > 0x00002aabbc01f800 JavaThread "Signal Dispatcher" daemon > [_thread_blocked, > > id=985, stack(0x00000000417e8000,0x00000000418e9000)] > > 0x00002aabbc01e000 JavaThread "Surrogate Locker Thread (CMS)" daemon > > [_thread_blocked, id=984, stack(0x00000000416e7000,0x00000000417e8000)] > > 0x000000004742c000 JavaThread "Finalizer" daemon [_thread_blocked, > id=983, > > stack(0x0000000042c42000,0x0000000042d43000)] > > 0x0000000047424800 JavaThread "Reference Handler" daemon > [_thread_blocked, > > id=982, stack(0x0000000042b41000,0x0000000042c42000)] > > 0x000000004725d000 JavaThread "main" [_thread_in_native, id=945, > > stack(0x00000000412b1000,0x00000000413b2000)] > > Other Threads: > > 0x000000004741d800 VMThread [stack: > 0x0000000042a40000,0x0000000042b41000] > > [id=981] > > 0x00002aabbc181000 WatcherThread [stack: > > 0x000000004107e000,0x000000004117f000] [id=996] > > =>0x0000000047276800 (exited) GCTaskThread [stack: > > 0x0000000000000000,0x0000000000000000] [id=974] > > VM state:at safepoint (normal execution) > > VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event]) > > [0x000000004725a730] Threads_lock - owner thread: 0x000000004741d800 > > [0x000000004725acb0] Heap_lock - owner thread: 0x00002aabbc1fd800 > > Heap > > par new generation total 274752K, used 272640K [0x00002aaaae1f0000, > > 0x00002aaabf050000, 0x00002aaabf050000) > > eden space 272640K, 100% used [0x00002aaaae1f0000, 0x00002aaabec30000, > > 0x00002aaabec30000) > > from space 2112K, 0% used [0x00002aaabee40000, 0x00002aaabee40000, > > 0x00002aaabf050000) > > to space 2112K, 0% used [0x00002aaabec30000, 0x00002aaabec30000, > > 0x00002aaabee40000) > > concurrent mark-sweep generation total 3184972K, used 2657590K > > [0x00002aaabf050000, 0x00002aab816a3000, 0x00002aabae1f0000) > > concurrent-mark-sweep perm gen total 26272K, used 15697K > > [0x00002aabae1f0000, 0x00002aabafb98000, 0x00002aabb35f0000) > > VM Arguments: > > jvm_args: -ea -Xms128M -Xmx4G -XX:TargetSurvivorRatio=90 > -XX:+AggressiveOpts > > -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled > > -XX:+HeapDumpOnOutOfMemoryError -XX:SurvivorRatio=128 > > -XX:MaxTenuringThreshold=0 -Dcom.sun.management.jmxremote.port=9004 > > -Dcom.sun.management.jmxremote.ssl=false > > -Dcom.sun.management.jmxremote.authenticate=false > > -Dstorage-config=/outbrain/cassandra/apache-cassandra-0.6.1/bin/../conf > > -Dcassandra-pidfile=/var/run/cassandra.pid > > java_command: org.apache.cassandra.thrift.CassandraDaemon > > Launcher Type: SUN_STANDARD > > Environment Variables: > > JAVA_HOME=/usr/java/jdk1.6.0_17/ > > > PATH=/usr/kerberos/bin:/usr/java/jdk1.6.0_17//bin:/outbrain/cassandra/apache-cassandra-0.6.1/bin:/usr/local/bin:/bin:/usr/bin:/opt/dell/srvadmin/bin:/outbrain/cassandra/bin > > > LD_LIBRARY_PATH=/usr/java/jdk1.6.0_17/jre/lib/amd64/server:/usr/java/jdk1.6.0_17/jre/lib/amd64:/usr/java/jdk1.6.0_17/jre/../lib/amd64 > > SHELL=/bin/bash > > Signal Handlers: > > SIGSEGV: [libjvm.so+0x6bddc0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 > > SIGBUS: [libjvm.so+0x6bddc0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 > > SIGFPE: [libjvm.so+0x594f90], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 > > SIGPIPE: [libjvm.so+0x594f90], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 > > SIGXFSZ: [libjvm.so+0x594f90], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 > > SIGILL: [libjvm.so+0x594f90], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 > > SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 > > SIGUSR2: [libjvm.so+0x597750], sa_mask[0]=0x00000000, sa_flags=0x10000004 > > SIGHUP: [libjvm.so+0x5974a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 > > SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000 > > SIGTERM: [libjvm.so+0x5974a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 > > SIGQUIT: [libjvm.so+0x5974a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 > > > > --------------- S Y S T E M --------------- > > OS:CentOS release 5.4 (Final) > > uname:Linux 2.6.18-164.15.1.el5 #1 SMP Wed Mar 17 11:30:06 EDT 2010 > x86_64 > > libc:glibc 2.5 NPTL 2.5 > > rlimit: STACK 10240k, CORE 0k, NPROC infinity, NOFILE 63536, AS infinity > > load average:2.50 3.93 5.66 > > CPU:total 16 (8 cores per cpu, 2 threads per core) family 6 model 26 > > stepping 5, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, > ht > > Memory: 4k page, physical 16429856k(55128k free), swap 5242872k(5220216k > > free) > > vm_info: Java HotSpot(TM) 64-Bit Server VM (14.3-b01) for linux-amd64 JRE > > (1.6.0_17-b04), built on Oct 11 2009 01:08:48 by "java_re" with gcc 3.2.2 > > (SuSE Linux) > > time: Tue May 4 17:03:44 2010 > > elapsed time: 11909 seconds > > > > >