Re: GeodeRedisAdapter improvments/feedback

2017-02-17 Thread Hitesh Khamesra
Right.. Sent from Yahoo Mail on Android On Fri, Feb 17, 2017 at 8:05 AM, Wes Williams wrote: I'm not clear on the reference to "I like the idea of first class data structures like Lists and Sorted Sets." Is the suggestion here to extend Geode to not only support a distributed ConcurrentHa

Re: GeodeRedisAdapter improvments/feedback

2017-02-17 Thread Wes Williams
I'm not clear on the reference to "I like the idea of first class data structures like Lists and Sorted Sets." Is the suggestion here to extend Geode to not only support a distributed ConcurrentHashMap but also distributed ConcurrentList's and ConcurrentSortedSet's? *Wes Williams | Pivotal Advis

Re: GeodeRedisAdapter improvments/feedback

2017-02-16 Thread Hitesh Khamesra
should generate good value. Thanks Again.Hitesh. From: Dan Smith To: dev@geode.apache.org Sent: Wednesday, February 15, 2017 3:12 PM Subject: Re: GeodeRedisAdapter improvments/feedback Deltas would help. If the regions are persistent, the whole new value does get written to

Re: GeodeRedisAdapter improvments/feedback

2017-02-16 Thread Anthony Baker
Me too! Bi-modal behaviors can result in systems with a large step function in performance when a threshold is crossed (I’m looking at you Compressed OOPS!). It would be nice to keep operational complexity low and give users a consistent behavior expectation. Anthony > On Feb 16, 2017, at 8:

Re: GeodeRedisAdapter improvments/feedback

2017-02-16 Thread John Blum
I agree with Swapnil here on all points. Why duplicate what Redis already does? We need to focus on our strengths and why we are targeting Redis users... i.e. our "value add". Geode is not going to win any popularity contest against Redis for the exact reasons/UCs why Redis exists in the first p

Re: GeodeRedisAdapter improvments/feedback

2017-02-16 Thread Michael Stolz
I like the idea of first class data structures like Lists and Sorted Sets. I'm not sure which side of the fence I'm on in terms of very large objects and using Regions to represent them. Feels very heavy because of all the overhead of a Region entry in Geode (over 300 bytes per entry). I think th

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Swapnil Bawaskar
I think we as a community need to determine what value do we want to add with the Redis adapter. Redis already does a great job storing small data structures in memory and sharding them. We do a great job of making sure that these data structures are horizontally scalable; why would we want to repl

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Dan Smith
Deltas would help. If the regions are persistent, the whole new value does get written to disk though. I suppose a third option would be to store all collections in the same region, but store each element of the collection as a separate entry. For example for HSET rkey rfield rvalue would create a

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Udo Kohlmeyer
I think we are now straddling into the territory where any distributed storage gains would be negated by the memory we require to make the queries/lookup/operation fast. In addition to the added memory pressure, we still face network latency for every operation. On 2/15/17 15:12, Dan Smith

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Udo Kohlmeyer
uot; < u...@geode.apache.org<mailto:u...@geode.apache.org><mailto:u...@geode.apache.org<mailto:u...@geode.apache.org>>>; Hitesh Khamesra mailto:hitesh...@yahoo.com><mailto:hitesh...@yahoo.com<mailto:hitesh...@yahoo.com>>> Sent: Tuesday, February 14, 2017

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Galen M O'Sullivan
On Wed, Feb 15, 2017 at 1:34 PM, Real Wes wrote: > Does delta propagation make worrying about frequently updated fat collections moot? As long as we don't have collections on the order of the available RAM on a single server (in which case we'd want to distribute it across multiple servers), and

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Real Wes
..@pivotal.io><mailto:jhu...@pivotal.io<mailto:jhu...@pivotal.io>>> > > To: > > dev@geode.apache.org<mailto:dev@geode.apache.org><mailto:dev@geode.apache.org<mailto:dev@geode.apache.org>>; > > " > u...@geode.apache.org<mailto:u...@geode.apache

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Dan Smith
> > question. > > > it depends on your use-case(item 2,3,4,5) . For example "hashes" can be > > > use to define key-value pair or java bean. In this case probably it is > > > better to keep that hash at region-entry level. But if you want to > know > > >

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Jason Huynh
bly you want use > > partition-region for "sorted-set". > > > > > > From: Jason Huynh mailto:jhu...@pivotal.io>> > > To: dev@geode.apache.org<mailto:dev@geode.apache.org>; " > u...@geode.apache.org<mailto:u...@geode.apache.org>"

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Real Wes
region for "sorted-set". > > > From: Jason Huynh mailto:jhu...@pivotal.io>> > To: dev@geode.apache.org<mailto:dev@geode.apache.org>; > "u...@geode.apache.org<mailto:u...@geode.apache.org>" > mailto:u...@geode.apache.org>>; > Hitesh

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Real Wes
We should be careful here on a decision. If we start replicating fat lists/sets/hash maps synchronously every update, the Geode user will complain how slow the API is compared with Redis. Note: Redis replicates asynchronously. For fat collections we’re better off creating a region and suffer

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Hitesh Khamesra
>>>The Redis adapter was designed so that we can scale all the Redis data structures horizontally. If you bring the data structures to region entry level, there is no reason for anyone to use our implementation over Redis. hmm, here we need to understand when we need to create partition-region for

Re: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Gregory Green
> I think the default setting should be partitioned with persistence and no > redundant copies. > > 7. It seems; redis knows type(list, hashes, string ,set ..) of each key... > > I suggested most operations can assume all keys are strings in UTF8 byte > encoding, not sure

Fwd: GeodeRedisAdapter improvments/feedback

2017-02-15 Thread Gregory Green
ys are strings in UTF8 byte encoding, not sure if there are any mathematical number based Redis commands that need numbers. *8. Transactions:* +1 I agree to not support transactions *9. Redis COMMAND* (https://redis.io/commands/comman <https://redis.io/commands/command> +1 for implementing

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Hitesh Khamesra
How's going on. What are you working these days. Sent from Yahoo Mail on Android On Tue, Feb 14, 2017 at 4:16 PM, William Markito Oliveira wrote: Definitely not by asking in the middle of on-going  discussion threads. Instructions: http://bfy.tw/A5ub :) Sent from my iPhone > On Feb 14

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Jason Huynh
u want to know > > top 10 tweets which are trending then probably you want use > > partition-region for "sorted-set". > > > > > > From: Jason Huynh > > To: dev@geode.apache.org; "u...@geode.apache.org" < > u...@geode.apache.org>

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Galen M O'Sullivan
ets which are trending then probably you want use > partition-region for "sorted-set". > > > From: Jason Huynh > To: dev@geode.apache.org; "u...@geode.apache.org" ; > Hitesh Khamesra > Sent: Tuesday, February 14, 2017 3:15 PM > Subject: Re: GeodeRedisA

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Hitesh Khamesra
ou want to know top 10 tweets which are trending then probably you want use partition-region for "sorted-set". From: Jason Huynh To: dev@geode.apache.org; "u...@geode.apache.org" ; Hitesh Khamesra Sent: Tuesday, February 14, 2017 3:15 PM Subject: Re: GeodeRed

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread William Markito Oliveira
Definitely not by asking in the middle of on-going discussion threads. Instructions: http://bfy.tw/A5ub :) Sent from my iPhone > On Feb 14, 2017, at 6:38 PM, Michael Vos wrote: > > How do I unsubscribe from this email list? > > Thank you, > > Michael Vos > Strategic Partnerships > 310-804

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Michael Vos
How do I unsubscribe from this email list? Thank you, Michael Vos Strategic Partnerships 310-804-7223 | m...@pivotal.io > On Feb 14, 2017, at 3:37 PM, Dan Smith wrote: > > I also had a hard time reading this. It sounds like the tl;dr is that your > are proposing storing each redis collec

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Dan Smith
I also had a hard time reading this. It sounds like the tl;dr is that your are proposing storing each redis collection in a single region entry, rather than a a partition region? I guess the question is whether users will have a few very large collections that need to be partitioned, or lots and lo

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Swapnil Bawaskar
The Redis adapter was designed so that we can scale all the Redis data structures horizontally. If you bring the data structures to region entry level, there is no reason for anyone to use our implementation over Redis. On Tue, Feb 14, 2017 at 3:15 PM Jason Huynh wrote: > Hi Hitesh, > > Not sure

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Jason Huynh
Hi Hitesh, Not sure about everyone else, but I had a hard time reading this, however I think I figured out what you were describing... the only part I still am unsure about is Feedback/vote: both behaviour is desirable. Do you mean you want feedback and voting on whether both behaviors are desi

Re: GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Real Wes
In what format do you want the feedback Hitesh? For now I’ll just comment: 1. Redis Type String No comments except that a future Geode value-add would be to extend the Jedis client so that the K/V’s are not compressed. In this way OQL and CQ will work. The tradeoff of this is that the data can

GeodeRedisAdapter improvments/feedback

2017-02-14 Thread Hitesh Khamesra
Current GeodeRedisAdapter implementation is based on https://cwiki.apache.org/confluence/display/GEODE/Geode+Redis+Adapter+Proposal. We are looking for some feedback on Redis commands and their mapping to geode region. 1. Redis Type String   a. Usage Set k1 v1   b. Current implementation creates