RE: Retrieving all row keys of a CF

2015-01-29 Thread Jens Rantil
wrote: > Select distinct keys from column family; hits a timeout exception. > pk1, pk2,…pkn are 800K in total. > From: Mohammed Guller [mailto:moham...@glassbeam.com] > Sent: Friday, January 23, 2015 3:24 PM > To: user@cassandra.apache.org > Subject: RE: Retrieving all row keys o

RE: Retrieving all row keys of a CF

2015-01-29 Thread Ravi Agrawal
Select distinct keys from column family; hits a timeout exception. pk1, pk2,…pkn are 800K in total. From: Mohammed Guller [mailto:moham...@glassbeam.com] Sent: Friday, January 23, 2015 3:24 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF No wonder, the client is

RE: Retrieving all row keys of a CF

2015-01-23 Thread Mohammed Guller
ct: RE: Retrieving all row keys of a CF What is the average and max # of CQL rows in each partition? Is 800,000 the number of CQL rows or Cassandra partitions (storage engine rows)? Another option you could try is a CQL statement to fetch all partition keys. You could first try this in the cqlsh: “

RE: Retrieving all row keys of a CF

2015-01-22 Thread Ravi Agrawal
In each partition cql rows on average is 200K. Max is 3M. 800K is number of cassandra partitions. From: Mohammed Guller [mailto:moham...@glassbeam.com] Sent: Thursday, January 22, 2015 7:43 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF What is the average and max

RE: Retrieving all row keys of a CF

2015-01-22 Thread Mohammed Guller
CF” You will need to specify all the composite columns if you are using a composite partition key. Mohammed From: Ravi Agrawal [mailto:ragra...@clearpoolgroup.com] Sent: Thursday, January 22, 2015 1:57 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF Hi, I increased

RE: Retrieving all row keys of a CF

2015-01-22 Thread Ravi Agrawal
] Sent: Saturday, January 17, 2015 9:55 AM To: user@cassandra.apache.org Subject: Re: Retrieving all row keys of a CF If you're getting partial data back, then failing eventually, try setting .withCheckpointManager() - this will let you keep track of the token ranges you've successfully

Re: Retrieving all row keys of a CF

2015-01-17 Thread Eric Stevens
arpoolgroup.com] > *Sent:* Friday, January 16, 2015 5:11 PM > > *To:* user@cassandra.apache.org > *Subject:* RE: Retrieving all row keys of a CF > > > > > > 1)What is the heap size and total memory on each node? 8GB, > 8GB > > 2)How big is th

RE: Retrieving all row keys of a CF

2015-01-16 Thread Mohammed Guller
t the nodes after increasing the timeout and try again. Mohammed From: Ravi Agrawal [mailto:ragra...@clearpoolgroup.com] Sent: Friday, January 16, 2015 5:11 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF 1)What is the heap size and total memory on each

RE: Retrieving all row keys of a CF

2015-01-16 Thread Ravi Agrawal
day, January 16, 2015 7:30 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF A few questions: 1) What is the heap size and total memory on each node? 2) How big is the cluster? 3) What are the read and range timeouts (in cassandra.yaml) on the C* nodes?

RE: Retrieving all row keys of a CF

2015-01-16 Thread Mohammed Guller
* nodes? How long does GC for new gen and old gen take? 6) Does any node crash with OOM error when you try AllRowsReader? Mohammed From: Ravi Agrawal [mailto:ragra...@clearpoolgroup.com] Sent: Friday, January 16, 2015 4:14 PM To: user@cassandra.apache.org Subject: Re: Retrieving all row keys of

Re: Retrieving all row keys of a CF

2015-01-16 Thread Ravi Agrawal
Hi, I and Ruchir tried query using AllRowsReader recipe but had no luck. We are seeing PoolTimeoutException. SEVERE: [Thread_1] Error reading RowKeys com.netflix.astyanax.connectionpool.exceptions.PoolTimeoutException: PoolTimeoutException: [host=servername, latency=2003(2003), attempts=4]Timed

RE: Retrieving all row keys of a CF

2015-01-16 Thread Mohammed Guller
Ruchir, I am curious if you had better luck with the AllRowsReader recipe. Mohammed From: Eric Stevens [mailto:migh...@gmail.com] Sent: Friday, January 16, 2015 12:33 PM To: user@cassandra.apache.org Subject: Re: Retrieving all row keys of a CF Note that getAllRows() is deprecated in Astyanax

Re: Retrieving all row keys of a CF

2015-01-16 Thread Eric Stevens
Note that getAllRows() is deprecated in Astyanax (see here ). You should prefer to use the AllRowsReader recipe: https://github.com/Netflix/astyanax/wiki/AllRowsReader-All-rows-query Note the

Retrieving all row keys of a CF

2015-01-16 Thread Ruchir Jha
We have a column family that has about 800K rows and on an average about a million columns. I am interested in getting all the row keys in this column family and I am using the following Astyanax code snippet to do this. This query never finishes (ran it for 2 days but did not finish). This quer