Re: New RFC about Enhancements in Off-heap memory fragmentation visibility

the implementation of the proposal after the deadline is met. Thanks, Alberto From: Alberto Gomez Sent: Monday, February 7, 2022 6:48 PM To: dev@geode.apache.org Subject: New RFC about Enhancements in Off-heap memory fragmentation visibility Hi fellow devs, Here is an R

New RFC about Enhancements in Off-heap memory fragmentation visibility

Hi fellow devs, Here is an RFC on "Enhance Off-heap memory fragmentation visibility": https://cwiki.apache.org/confluence/display/GEODE/Enhance+Off-heap+memory+fragmentation+visibility Your review and comments are very welcome! Alberto

Re: Off-heap support deactivation

. On Wed, Oct 2, 2019 at 1:44 AM Alberto Bustamante Reyes wrote: > thanks for the detailed explanation Darrel. > > There is something I did not get: "alter disk-store" is used to align the > region info the disk store has when a region attribute is changed. But > off-hea

RE: Off-heap support deactivation

thanks for the detailed explanation Darrel. There is something I did not get: "alter disk-store" is used to align the region info the disk store has when a region attribute is changed. But off-heap support is an attribute that cannot be changed on a region after it is created. So the

Re: Off-heap support deactivation

store the first recovery will be slower but the actual region config will be stored again in the disk-store and subsequent recoveries will be fast. On Mon, Sep 30, 2019 at 8:28 AM Alberto Bustamante Reyes wrote: > Hi all, > > Is it possible to change the off-heap support of a region o

Off-heap support deactivation

Hi all, Is it possible to change the off-heap support of a region once it is created? The idea I got from documentation is that it is possible to do it if the region is persistent, as the off-heap flag of the region can be changed using "alter disk-store". I have run the following

off heap question

Hi Everyone, Does one here already tried or worked with off heap feature and not just small check, a wide check with many objects? I am wondering regard those who wrote or already using the off heap feature way of work. It seems that there isn't any external or 3rd party framework

Re: off heap

Ben, Such questions are excellent right here on the Dev List. Other people may be interested in the answers to your questions. -Greg On Mon, May 29, 2017 at 5:58 AM, Dor Ben Dov wrote: > Hi, > > Did anyone test / used under load or kind of load the off heap new feature? > > T

off heap

Hi, Did anyone test / used under load or kind of load the off heap new feature? To whom should I direct questions regard the service, for example how it was implemented? Regards, Dor This message and the information contained herein is proprietary and confidential and subject to the Amdocs

[jira] [Updated] (GEODE-2841) unable to create off-heap region from cache.xml

[ https://issues.apache.org/jira/browse/GEODE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darrel Schneider updated GEODE-2841: Component/s: (was: offheap) management > unable to create off-h

[jira] [Commented] (GEODE-2841) unable to create off-heap region from cache.xml

changed or not some I'm changing the component to management. > unable to create off-heap region from cache.xml > --- > > Key: GEODE-2841 > URL: https://issues.apache.org/jira/browse

[jira] [Created] (GEODE-2841) unable to create off-heap region from cache.xml

Swapnil Bawaskar created GEODE-2841: --- Summary: unable to create off-heap region from cache.xml Key: GEODE-2841 URL: https://issues.apache.org/jira/browse/GEODE-2841 Project: Geode Issue

Re: Review Request 58722: fix thread leak when off-heap is configured

l 25, 2017, 10:36 p.m.) > > > Review request for geode, anilkumar gingade, Eric Shu, and Lynn Gallinat. > > > Bugs: GEODE-2811 > https://issues.apache.org/jira/browse/GEODE-2811 > > > Repository: geode > > > Description > --- >

Review Request 58722: fix thread leak when off-heap is configured

: GEODE-2811 https://issues.apache.org/jira/browse/GEODE-2811 Repository: geode Description --- Closing the cache now closes the off-heap evictor. Rejected executions are now ignored if shutting down. The execute method is now used instead of submit in the HeapEvictor. Close logic on

Re: Review Request 58397: check off-heap limit during disk recovery

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58397/#review171896 --- Ship it! Ship It! - Eric Shu On April 12, 2017, 11:42 p.m.,

Re: Review Request 58397: check off-heap limit during disk recovery

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58397/ --- (Updated April 12, 2017, 4:42 p.m.) Review request for geode, anilkumar gingade

Re: Review Request 58397: check off-heap limit during disk recovery

> On April 12, 2017, 2:50 p.m., Eric Shu wrote: > > geode-core/src/main/java/org/apache/geode/internal/cache/lru/LRUCapacityController.java > > Lines 294 (patched) > > > > > > lruStatistics or stats passed in? Good

Re: Review Request 58397: check off-heap limit during disk recovery

> On April 12, 2017, 3:44 p.m., anilkumar gingade wrote: > > geode-core/src/main/java/org/apache/geode/internal/cache/lru/HeapLRUCapacityController.java > > Line 283 (original), 274 (patched) > > > > > > Is it more r

Re: Review Request 58397: check off-heap limit during disk recovery

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58397/#review171803 --- geode-core/src/main/java/org/apache/geode/internal/cache/lru/Heap

Re: Review Request 58397: check off-heap limit during disk recovery

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58397/#review171801 --- geode-core/src/main/java/org/apache/geode/internal/cache/lru/LRUC

Review Request 58397: check off-heap limit during disk recovery

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58397/ --- Review request for geode, anilkumar gingade, Eric Shu, and Lynn Gallinat. Bugs:

RE: off heap

Thanks Anthony. Dor -Original Message- From: Anthony Baker [mailto:aba...@pivotal.io] Sent: יום ד 22 פברואר 2017 21:28 To: dev@geode.apache.org Subject: Re: off heap Hi Dor, Here’s a few documentation links on off-heap usage: https://geode.apache.org/docs/guide/managing/heap_use

Re: off heap

Hi Dor, Here’s a few documentation links on off-heap usage: https://geode.apache.org/docs/guide/managing/heap_use/off_heap_management.html https://www.slideshare.net/PivotalOpenSourceHub/apache-geode-offheap-storage Does that help? Thanks, Anthony > On Feb 22, 2017, at 11:17 AM, Dor Ben

off heap

Hi, Can one tell me how does the off heap flags solution is being done. I mean what solution is being used for it ? Regards, Dor This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http

[jira] [Closed] (GEODE-2090) Update off-heap statistics documentation

[ https://issues.apache.org/jira/browse/GEODE-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Khamesra closed GEODE-2090. -- > Update off-heap statistics documentat

[jira] [Closed] (GEODE-2293) The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

while releasing an off-heap object > - > > Key: GEODE-2293 > URL: https://issues.apache.org/jira/browse/GEODE-2293 > Project: G

[jira] [Resolved] (GEODE-2293) The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

an IllegalStateException is > thrown while releasing an off-heap object > - > > Key: GEODE-2293 > URL: https://issues.apache.org/jira

[jira] [Commented] (GEODE-2293) The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

mmit ad02e975c0cc4f6753dc1edb27926ade49ea8dcb in geode's branch refs/heads/develop from [~huynhja] [ https://git-wip-us.apache.org/repos/asf?p=geode.git;h=ad02e97 ] GEODE-2293: Queue now handles illegalStateException if thrown when releasing off-heap object > The AckReaderThread incor

Re: Review Request 55645: GEODE-2293: The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/55645/#review161992 --- Ship it! Ship It! - Barry Oglesby On Jan. 17, 2017, 11:36 p.

Re: Review Request 55645: GEODE-2293: The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/55645/ --- (Updated Jan. 17, 2017, 11:36 p.m.) Review request for geode and Barry Oglesby.

Re: Review Request 55645: GEODE-2293: The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

> On Jan. 17, 2017, 9:42 p.m., Barry Oglesby wrote: > > geode-core/src/main/java/org/apache/geode/internal/cache/wan/parallel/ParallelGatewaySenderQueue.java, > > line 1099 > > > > > > I think I would add a message

Re: Review Request 55645: GEODE-2293: The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/55645/#review161962 --- geode-core/src/main/java/org/apache/geode/internal/cache/wan/para

Review Request 55645: GEODE-2293: The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/55645/ --- Review request for geode and Barry Oglesby. Bugs: GEODE-2293 https://issues

[jira] [Assigned] (GEODE-2293) The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

an IllegalStateException is > thrown while releasing an off-heap object > - > > Key: GEODE-2293 > URL: https://issues.apache.org/jira/browse/GEODE-2293 >

[jira] [Updated] (GEODE-2293) The AckReaderThread incorrectly shuts down when an IllegalStateException is thrown while releasing an off-heap object

releasing an off-heap object (was: The AckReaderThread incorrectly shuts down when an IllegalStateException is throw while releasing an off-heap object) > The AckReaderThread incorrectly shuts down when an IllegalStateException is > thrown while releasing an off-heap

[jira] [Updated] (GEODE-2293) The AckReaderThread incorrectly shuts down when an IllegalStateException is throw while releasing an off-heap object

/01/07 09:14:40.789 UTC bridgegemfire_1_1_rs-QueuesBTTest-2017-01-06-14-07-15-client-12_3912 tid=0x97] Stopping the processor because the following exception occurred while processing a batch: java.lang.IllegalStateException: It looks like off heap memory @7f33a8000238 was already freed

[jira] [Updated] (GEODE-2293) The AckReaderThread incorrectly shuts down when an IllegalStateException is throw while releasing an off-heap object

releasing an off-heap object (was: The AckReaderThread incorrectly shuts down when an IllegalStateException is throw whiel releasing an off-heap object) > The AckReaderThread incorrectly shuts down when an IllegalStateException is > throw while releasing an off-heap

[jira] [Updated] (GEODE-2293) The AckReaderThread incorrectly shuts down when an IllegalStateException is throw whiel releasing an off-heap object

an IllegalStateException is > throw whiel releasing an off-heap object > > > Key: GEODE-2293 > URL: https://issues.apache.org/jira

[jira] [Created] (GEODE-2293) The AckReaderThread incorrectly shuts down when an IllegalStateException is throw whiel releasing an off-heap object

Barry Oglesby created GEODE-2293: Summary: The AckReaderThread incorrectly shuts down when an IllegalStateException is throw whiel releasing an off-heap object Key: GEODE-2293 URL: https://issues.apache.org/jira

Re: Off-Heap Annotations

It is just flags / configuration. The APIs would just let you set the flags/configuration. You could also use APIs to read the offheap statistics. Basically just allocate the offheap memory using "off-heap-memory-size" and then configure one or more regions with offheap set to true.

RE: Off-Heap Annotations

Kirk & Darrel & Hitesh, Thank you all for the detailed info on the off heap option. One more question, do I have any kind of API or it is purely flags / configuration? Regards, Dor -Original Message- From: Kirk Lund [mailto:kl...@apache.org] Sent: יום ג 03 ינואר 2017 22:47 T

RE: Off-Heap Annotations

Michael, Currently I am not trying to achieve anything but trying to understand the capabilities and how to work with the feature. Dor -Original Message- From: Michael Stolz [mailto:mst...@pivotal.io] Sent: יום ג 03 ינואר 2017 18:34 To: dev@geode.apache.org Subject: Re: Off-Heap

Re: Off-Heap Annotations

Oh yeah! We were hoping to get more feedback from users to find out what they want or need for migrating a region from heap to off-heap. Right now it doesn't support anything like that but it was definitely discussed. On Tue, Jan 3, 2017 at 12:27 PM, Hitesh Khamesra < hitesh...@yahoo.com

Re: Off-Heap Annotations

ubject: Re: Off-Heap Annotations The region is required to be off-heap in every member in the cluster. Imagine memberA with 12 GB heap, 100 GB off-heap and memberB with 8 GB heap, 0 GB off-heap. What's the point of having replicated regionA be off-heap in memberA but on heap in memberB?

Re: Off-Heap Annotations

The region is required to be off-heap in every member in the cluster. Imagine memberA with 12 GB heap, 100 GB off-heap and memberB with 8 GB heap, 0 GB off-heap. What's the point of having replicated regionA be off-heap in memberA but on heap in memberB? The region will always be limited b

Re: Off-Heap Annotations

che.org Sent: Tuesday, January 3, 2017 11:33 AM Subject: Re: Off-Heap Annotations When a region is created you need to mark it as off-heap or on-heap. Once it is created you can not change it on that region. You can create and destroy regions on the fly. c On Tue, Jan 3, 2017 at 8:01 AM, Dor

Re: Off-Heap Annotations

When a region is created you need to mark it as off-heap or on-heap. Once it is created you can not change it on that region. You can create and destroy regions on the fly. Also the region needs to be consistently configured on-heap or off-heap across the entire cluster. The first cluster member

Re: Off-Heap Annotations

Dor, I'd like to understand the reason you would like to have different semantics than what's in Geode with regard to off-heap. Can you expand a bit on what you are trying to achieve? On Tue, Jan 3, 2017 at 11:22 AM, Udo Kohlmeyer wrote: > Hi there Dor, > > I will allow

Re: Off-Heap Annotations

Dor -Original Message- From: Udo Kohlmeyer [mailto:u...@apache.org] Sent: יום ג 03 ינואר 2017 17:32 To: dev@geode.apache.org Subject: Re: Off-Heap Annotations Hi there Gal, That is not possible. A region is either on-heap or off-heap. --Udo On 1/2/17 13:50, Gal Palmery wrote: Ok, So

RE: Off-Heap Annotations

Udo, This means it can't be changed on the fly in runtime ? Need to be flagged before? Dor -Original Message- From: Udo Kohlmeyer [mailto:u...@apache.org] Sent: יום ג 03 ינואר 2017 17:32 To: dev@geode.apache.org Subject: Re: Off-Heap Annotations Hi there Gal, That is not possib

Re: Off-Heap Annotations

Hi there Gal, That is not possible. A region is either on-heap or off-heap. --Udo On 1/2/17 13:50, Gal Palmery wrote: Ok, So if I want to have just a certain part of the region off heap and the rest of it on heap - how do I do that? -Original Message- From: Dan Smith [mailto:dsm

RE: Off-Heap Annotations

Ok, So if I want to have just a certain part of the region off heap and the rest of it on heap - how do I do that? -Original Message- From: Dan Smith [mailto:dsm...@pivotal.io] Sent: Monday, January 02, 2017 19:46 To: dev@geode.apache.org Subject: Re: Off-Heap Annotations Hi Gal

RE: Off-Heap Annotations

Dan This means also that I can do this dynamically or is it static definition? Dor -Original Message- From: Dan Smith [mailto:dsm...@pivotal.io] Sent: יום ב 02 ינואר 2017 19:46 To: dev@geode.apache.org Subject: Re: Off-Heap Annotations Hi Gal, The way to control what is on or off heap

Re: Off-Heap Annotations

Hi Gal, The way to control what is on or off heap is when you configure a region. Regions that are configured with off-heap=true will store all of the values in off heap memory, regions with off-heap= false will store the values on the heap. -Dan On Mon, Jan 2, 2017 at 5:57 AM, Gal Palmery

RE: Off-Heap Annotations

Thanks Kirk. for example, before I call put, I'd like to indicate to geode server that I want to keep specific data off heap. how can I do that? is there an api that will move data off or on heap? Gal -Original Message- From: Kirk Lund [mailto:kl...@apache.org] Sent: Tuesday, Dec

[jira] [Closed] (GEODE-1962) When queue is unable to create object from off-heap, stats can be incorrect

[ https://issues.apache.org/jira/browse/GEODE-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Baker closed GEODE-1962. > When queue is unable to create object from off-heap, stats can be incorr

Re: off heap feature

There's been over 3 years of developer and QA work on the off-heap feature. It's more mature than some of the other features ;) -Kirk On Mon, Dec 26, 2016 at 1:14 AM, Dor Ben Dov wrote: > Hi, > > How mature is the off heap feature, how many of you are working or worked >

Re: Off-Heap Annotations

Those annotations are part of the internal implementation of Geode. The developers used it as a way to help keep track of references to off-heap. -Kirk On Mon, Dec 26, 2016 at 1:34 AM, Gal Palmery wrote: > Hi everyone, > > Is this feature: > https://cwiki.apache.org/confluence/d

Off-Heap Annotations

Hi everyone, Is this feature: https://cwiki.apache.org/confluence/display/GEODE/Off-Heap+Annotations a part of the last release? (1.0.0-incubating) thanks, Gal This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may

off heap feature

Hi, How mature is the off heap feature, how many of you are working or worked with it ? Regards, Dor This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp