RE: [EXTERNAL] Re: Using Cassandra as an object store

2019-04-19 Thread Durity, Sean R
Object stores are some of our largest and oldest use cases. Cassandra has been a good choice for us. We do chunk the objects into 64k chunks (I think), so that partitions are not too large and it scales predictably. For us, the choice was more about high availability and scalability, which Cassa

Re: Using Cassandra as an object store

2019-04-19 Thread Paul Chandler
Gene, I have found that clusters used as object stores have caused me more problems than normal in the past, so I recommend using a separate object store if possible. However, it certainly can be done, there is just a few things to consider: 1) Deletion policy: How are these objects going to b

Re: Using Cassandra as an object store

2019-04-19 Thread DuyHai Doan
Idea: To guarantee data integrity, you can store an MD5 of all chunks data as static column in the partition that contains the chunks On Fri, Apr 19, 2019 at 9:18 AM cclive1601你 wrote: > we have use cassandra as object store for some years, you can just split > the object into some small pieces

Re: Using Cassandra as an object store

2019-04-19 Thread cclive1601你
we have use cassandra as object store for some years, you can just split the object into some small pieces. object got a pk, then the some small pieces got some pks ,object's pk and pieces's pk can be store in meta table in cassandra, and small pieces's pk and some pieces store in data table. we st