Does SASI index support IN?

2017-03-17 Thread Yu, John
All, I've been experimenting with Cassandra 3.10 now, with the hope that SASI has improved. To much disappointment, it seems it still doesn't support simple operation like IN. Have others tried the same? Also with a small test data set (160K records), the performance is also not better than jus

RE: [External] Re: Cassandra ad hoc search options

2017-02-02 Thread Yu, John
value to pushdown the second key predicate, then the third key... 2017-01-31 8:56 GMT+01:00 Yu, John mailto:john...@sandc.com>>: Thanks. I thought you have given up Lucene for Spark, but it seems your Lucene still works. Spark also has a Cassandra connector, and my questions were

RE: [External] Re: Cassandra ad hoc search options

2017-01-30 Thread Yu, John
ystem. Hence as a work around, we used a faster scan utility. For all the adhoc purposes/scripts, you could do a full scan. I hope it helps. Regards On Tue, Jan 31, 2017 at 4:11 AM, Yu, John mailto:john...@sandc.com>> wrote: A follow up question is: did you use Spark for the full set of d

RE: [External] Re: Cassandra ad hoc search options

2017-01-30 Thread Yu, John
ome tech discussions going around for the bulk job ecosystem. Hence as a work around, we used a faster scan utility. For all the adhoc purposes/scripts, you could do a full scan. I hope it helps. Regards On Tue, Jan 31, 2017 at 4:11 AM, Yu, John mailto:john...@sandc.com>> wrote: A follow up qu

RE: [External] Re: Cassandra ad hoc search options

2017-01-30 Thread Yu, John
A follow up question is: did you use Spark for the full set of data or just partial? In our case, I feel we need all the data to support ad hoc queries (with multiple conditional filters). Thanks, John From: Yu, John [mailto:john...@sandc.com] Sent: Monday, January 30, 2017 12:04 AM To: user

RE: [External] Re: Cassandra ad hoc search options

2017-01-30 Thread Yu, John
might have used it sub optimally, not sure. Later, we had to do away with it, and tried to serve most of the read patterns with materialised views. (currently C*3.0.9) Currently, for adhoc querries, we use spark or full scan. Regards, On Fri, Jan 27, 2017 at 1:03 PM, Yu, John mailto:john

RE: [External] Re: Cassandra ad hoc search options

2017-01-26 Thread Yu, John
ith Cassandra, what are the options for ad hoc query/search similar to RDBMS? Your best options are Spark w/ the DataStax connector or Presto. Cassandra isn't built for ad-hoc queries so you need to use other tools to make it work. On Thu, Jan 26, 2017 at 2:22 PM Yu, John mailto:john...@s

Cassandra ad hoc search options

2017-01-26 Thread Yu, John
Hi All, Hope I can get some help here. We're using Cassandra for services, and recently we're adding UI support. With Cassandra, what are the options for ad hoc query/search similar to RDBMS? We love the features of Cassandra but it seems it's a known "weakness" that it doesn't come with strong