+ Viki From: Gregory Vortman Sent: Tuesday, November 21, 2017 6:49 PM To: u...@geode.apache.org; dev@geode.apache.org Cc: *Technology - Digital - BSS – Charging - GEODE team <pbgrcmrmgeodet...@int.amdocs.com>; Guy Turkenits <guy.turken...@amdocs.com> Subject: DiskStore exception while region data evicted
Hi team, One of the grid members went down and entire cache is closed whenever Partition region got an LRU threshold and overflow to disk is started: <lru-entry-count maximum="200000" action="overflow-to-disk"/> Disk-store defined with 40GB. Actual metrics while crashed: entries on disk 700000, bytes only on disk ~1GB. There is much room in the File system. Can you help to understand the following exception: [severe 2017/11/21 15:41:05.678 IST host1-pwinfo1 <Asynchronous disk writer for region ExternalRecord-overflow> tid=0xdc] Fatal error from asynchronous flusher thread org.apache.geode.InternalGemFireError: Bucket BucketRegion[path='/__PR/_B__EXTERNAL__RECORDS__1_171;serial=6025;primary=true] size (-1425) negative after applying delta of -2401 at org.apache.geode.internal.cache.BucketRegion.updateBucketMemoryStats(BucketRegion.java:2291) at org.apache.geode.internal.cache.BucketRegion.updateBucket2Size(BucketRegion.java:2279) at org.apache.geode.internal.cache.BucketRegion.updateSizeOnEvict(BucketRegion.java:2157) at org.apache.geode.internal.cache.DiskEntry$Helper.writeEntryToDisk(DiskEntry.java:1441) at org.apache.geode.internal.cache.DiskEntry$Helper.doAsyncFlush(DiskEntry.java:1388) at org.apache.geode.internal.cache.DiskStoreImpl$FlusherThread.run(DiskStoreImpl.java:1729) at java.lang.Thread.run(Thread.java:748) [error 2017/11/21 15:41:05.679 IST host1-pwinfo1 <Asynchronous disk writer for region ExternalRecord-overflow> tid=0xdc] A DiskAccessException has occurred while writing to the disk for disk sto re ExternalRecord-overflow. The cache will be closed. org.apache.geode.cache.DiskAccessException: For DiskStore: ExternalRecord-overflow: Fatal error from asynchronous flusher thread, caused by org.apache.geode.InternalGemFireError: Bucket BucketRegion [path='/__PR/_B__EXTERNAL__RECORDS__1_171;serial=6025;primary=true] size (-1425) negative after applying delta of -2401 at org.apache.geode.internal.cache.DiskStoreImpl$FlusherThread.run(DiskStoreImpl.java:1774) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.geode.InternalGemFireError: Bucket BucketRegion[path='/__PR/_B__EXTERNAL__RECORDS__1_171;serial=6025;primary=true] size (-1425) negative after applying delta of -2401 at org.apache.geode.internal.cache.BucketRegion.updateBucketMemoryStats(BucketRegion.java:2291) at org.apache.geode.internal.cache.BucketRegion.updateBucket2Size(BucketRegion.java:2279) at org.apache.geode.internal.cache.BucketRegion.updateSizeOnEvict(BucketRegion.java:2157) at org.apache.geode.internal.cache.DiskEntry$Helper.writeEntryToDisk(DiskEntry.java:1441) at org.apache.geode.internal.cache.DiskEntry$Helper.doAsyncFlush(DiskEntry.java:1388) at org.apache.geode.internal.cache.DiskStoreImpl$FlusherThread.run(DiskStoreImpl.java:1729) ... 1 more Thanks Gregory Vortman This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at https://www.amdocs.com/about/email-disclaimer <https://www.amdocs.com/about/email-disclaimer>