Re: [PROPOSAL]Pistachio

2015-06-29 Thread Gavin Li
on and data. Thanks, Gavin Li On Fri, Jun 26, 2015 at 12:07 PM, Andrew Purtell wrote: > Thanks Gavin. > > Please let me suggest that novelty is not a requirement for incubation, and > a proposal doesn't need to make claims of novelty to be accepted. > > Should the propos

Re: [PROPOSAL]Pistachio

2015-06-29 Thread Gavin Li
local storage engines like kyoto cabinet or Rocks DB. On our production we mainly used kyoto cabinet based SSD storage system to optimize for read to resolve the low latency high volume read problem in RTB applications. Thanks, Gavin Li On Mon, Jun 22, 2015 at 8:25 PM, Gavin Li wrote: > Roman, >

Re: [PROPOSAL]Pistachio

2015-06-26 Thread Gavin Li
pluggable and very loosely coupled. > > We can easily remove it in graduation. > > > > I don't think removing dependency at graduation is option for incubator > > releases. You might have to remove it for the first incubating release > > itself. > > > > Th

Re: [PROPOSAL]Pistachio

2015-06-25 Thread Gavin Li
We need more mentors. Please let me know if you are interested. THanks, Gavin Li On Mon, Jun 22, 2015 at 8:25 PM, Gavin Li wrote: > Roman, > > I think Pistachio is similar to Ignite in the sense that they both try to > distribute the computation to storage to co-locate

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Gavin Li
Pistachio was originally developed as a storage system of SSD disk and has been used on our large scale production serving system with SSD disk. We're not that familiar with Geode, I'll look into it and provide some detailed comparisons. Thanks, Gavin Li On Mon, Jun 22, 2015 at 8:00

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Gavin Li
The other difference is in Pistachio we can do computation based on in-memory storage with data replication. Different from the in-memory computation in Spark, the storage can be in-memory here. Please let me know if I'm not clear enough. Thanks, Gavin Li On Mon, Jun 22, 2015 at 7:53 PM,

Re: [PROPOSAL]Pistachio

2015-06-22 Thread Gavin Li
Wiki has been created for the proposal: https://wiki.apache.org/incubator/PistachioProposal. The comments here has been addressed and reflected in the wiki. Thanks, Gavin Li On Fri, Jun 19, 2015 at 11:30 AM, Gavin Li wrote: > Henry, > > Thanks for the suggestion. > > We agre

Re: [PROPOSAL]Pistachio

2015-06-19 Thread Gavin Li
Henry, Thanks for the suggestion. We agree that at early stage we'd better shunt the user discussion to dev list to help developing the community. I'll update the proposal on the wiki once I have write access on wiki. THanks, Gavin Li On Fri, Jun 19, 2015 at 10:51 AM, Henry Sapu

[PROPOSAL]Pistachio

2015-06-18 Thread Gavin Li
Hi, I want to propose project Pistachio to enter Apache Incubator. Below please find the proposal. Thanks, Gavin Li = Pistachio = == Abstract == Pistachio is a fault-tolerant low latency distributed storage system which enables simple embedding the computation to the storage layer to