Re: [EXTERNAL] Re: loading big amount of data to Cassandra

2019-08-06 Thread Amanda Moran
om: p...@xvalheru.org > Sent: Saturday, August 3, 2019 6:06 AM > To: user@cassandra.apache.org > Cc: Dimo Velev > Subject: [EXTERNAL] Re: loading big amount of data to Cassandra > > Thanks to all, > > I'll try the SSTables. > > Thanks > > Pat > >

Re: [EXTERNAL] Re: loading big amount of data to Cassandra

2019-08-05 Thread Hiroyuki Yamada
mo Velev > Subject: [EXTERNAL] Re: loading big amount of data to Cassandra > > Thanks to all, > > I'll try the SSTables. > > Thanks > > Pat > > On 2019-08-03 09:54, Dimo Velev wrote: > > Check

RE: [EXTERNAL] Re: loading big amount of data to Cassandra

2019-08-05 Thread Durity, Sean R
AM To: user@cassandra.apache.org Cc: Dimo Velev Subject: [EXTERNAL] Re: loading big amount of data to Cassandra Thanks to all, I'll try the SSTables. Thanks Pat On 2019-08-03 09:54, Dimo Velev wrote: > Check out the CQLSSTableWriter java class - > https://urldefense.proofpoint.c

Re: loading big amount of data to Cassandra

2019-08-03 Thread pat
Thanks to all, I'll try the SSTables. Thanks Pat On 2019-08-03 09:54, Dimo Velev wrote: Check out the CQLSSTableWriter java class - https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/io/sstable/CQLSSTableWriter.java . You use it to generate sstables - you need to wri

Re: loading big amount of data to Cassandra

2019-08-03 Thread Dimo Velev
Check out the CQLSSTableWriter java class - https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/io/sstable/CQLSSTableWriter.java . You use it to generate sstables - you need to write a small program for that. You can then stream them over the network using the sstablelo

Re: loading big amount of data to Cassandra

2019-08-02 Thread Ayub M
Dimo, how do you generate sstables? Do you mean load data locally on a cassandra node and use sstableloader? On Fri, Aug 2, 2019, 5:48 PM Dimo Velev wrote: > Hi, > > Batches will actually slow down the process because they mean a different > thing in C* - as you read they are just grouping chang

Re: loading big amount of data to Cassandra

2019-08-02 Thread Dimo Velev
Hi, Batches will actually slow down the process because they mean a different thing in C* - as you read they are just grouping changes together that you want executed atomically. Cassandra does not really have indices so that is different than a relational DB. However, after writing stuff to

Re: loading big amount of data to Cassandra

2019-08-02 Thread Jeff Jirsa
CQLSSTableWriter On Fri, Aug 2, 2019 at 9:59 AM wrote: > Hi, > > I need to upload to Cassandra about 7 billions of records. What is the > best setup of Cassandra for this task? Will usage of batch speeds up the > upload (I've read somewhere that batch in Cassandra is dedicated to > atomicity n

loading big amount of data to Cassandra

2019-08-02 Thread pat
Hi, I need to upload to Cassandra about 7 billions of records. What is the best setup of Cassandra for this task? Will usage of batch speeds up the upload (I've read somewhere that batch in Cassandra is dedicated to atomicity not to speeding up communication)? How Cassandra internally works r