Re: Lucandra Limitations

2011-01-27 Thread Jake Luciani
The latest iteration of Lucandra, called Solandra, creates localized sub-indexes of size N and spreads them around the cassandra ring. Then using solr, will behind the scenes search all the subindexes in parallel. This approach should give you what you need and it would be great to have such a

Re: Lucandra Limitations

2011-01-27 Thread David G. Boney
I am new to Lucene and Lucandra. My use case is that I have a trillion URIs to index with Lucene. Each URI is either a resource or literal in an RDF graph. Each URI is a document for Lucene If I were using Lucene, my understanding is that it would create a segment, stuff as many URIs in the

Re: Lucandra Limitations

2011-01-27 Thread Jake Luciani
m> wrote: > I was reviewing the Lucandra schema presented on the below page at > Datastax: > > http://www.datastax.com/docs/0.7/data_model/lucandra > > In the TermInfo Super Column Family, docID is the key for a supercolumn. > Does this imply that the maximum number of doc

Re: Lucandra Limitations

2011-01-27 Thread Paul Brown
Lucene trades on (32-bit) ints internally, so I expect you're just seeing a projection of that limitation. On Jan 27, 2011, at 10:40 AM, David G. Boney wrote: > I was reviewing the Lucandra schema presented on the below page at Datastax: > > http://www.datastax.com/docs/

Lucandra Limitations

2011-01-27 Thread David G. Boney
I was reviewing the Lucandra schema presented on the below page at Datastax: http://www.datastax.com/docs/0.7/data_model/lucandra In the TermInfo Super Column Family, docID is the key for a supercolumn. Does this imply that the maximum number of documents that can be index for a term with

RE: Lucandra issues

2010-06-20 Thread Carlos Sanchez
Jake, I will be interested in this functionality Carlos From: Jake Luciani [jak...@gmail.com] Sent: Friday, June 18, 2010 10:57 PM To: user@cassandra.apache.org Subject: Re: Lucandra issues Hi Maxim, Lucandra doesn't support numeric queries quite y

Re: Lucandra issues

2010-06-18 Thread Jake Luciani
Hi Maxim, Lucandra doesn't support numeric queries quite yet. A workaround would be to load your numbers and convert them to strings. I'll eventually add support for this. Please feel free to help out if you can :) Jake On Jun 17, 2010, at 1:16 PM, Maxim Kramarenko wrote

Lucandra issues

2010-06-17 Thread Maxim Kramarenko
Hello! I am trying to rework our current lucene-based application to lucandra. Note the following problem: when I try to use NumericRangeQuery like this one: query.add(NumericRangeQuery.newLongRange("deliveryTimestampMinute", 6, fromDate, toDate, true, true), BooleanClause.Occur.

Re: Lucandra

2010-06-07 Thread David Boxenhorn
Oops. No crawler. My mistake. On Mon, Jun 7, 2010 at 10:56 AM, David Boxenhorn wrote: > Is there a way to not use the Solr's web crawler (we have our own) and just > use Solr for indexing and serving content? > > On Mon, Jun 7, 2010 at 12:51 AM, Abhi Yerra wrote: > >> I created a web crawler us

Re: Lucandra

2010-06-07 Thread David Boxenhorn
Is there a way to not use the Solr's web crawler (we have our own) and just use Solr for indexing and serving content? On Mon, Jun 7, 2010 at 12:51 AM, Abhi Yerra wrote: > I created a web crawler using Cassandra as the datastore and push to a > bunch of Solr shards. It works well. > > -Abhi > >

Re: Lucandra

2010-06-06 Thread Abhi Yerra
I created a web crawler using Cassandra as the datastore and push to a bunch of Solr shards. It works well. -Abhi On Sun, Jun 6, 2010 at 9:17 AM, Sten Roger Sandvik wrote: > > 2010/6/6 David Boxenhorn > >> Solr looks like exactly what I want! How mature is it? >> >> > It's very mature. You sho

Re: Lucandra

2010-06-06 Thread Sten Roger Sandvik
2010/6/6 David Boxenhorn > Solr looks like exactly what I want! How mature is it? > > It's very mature. You should also look at ElasticSearch. Much better distribution model. /srs

Re: Lucandra

2010-06-06 Thread David Boxenhorn
Solr looks like exactly what I want! How mature is it? On Sun, Jun 6, 2010 at 6:32 PM, William Ashley wrote: > Have you looked at Solr? Chances are it meets for your needs, and it is > much simpler than Lucandra. > > > On Jun 6, 2010, at 7:44 AM, David Boxenhorn wrote: > >

Re: Lucandra

2010-06-06 Thread William Ashley
Have you looked at Solr? Chances are it meets for your needs, and it is much simpler than Lucandra. On Jun 6, 2010, at 7:44 AM, David Boxenhorn wrote: > We're thinking of using Lucandra. We already use Lucene, but not in a > production-level environment, and we are concerned about

Re: Lucandra

2010-06-06 Thread 朱蓝天
i am curious how to intersect results from multi-terms with lucandra 2010/6/6 David Boxenhorn > We're thinking of using Lucandra. We already use Lucene, but not in a > production-level environment, and we are concerned about the problem of > distributing Lucene over multiple ser

Lucandra

2010-06-06 Thread David Boxenhorn
We're thinking of using Lucandra. We already use Lucene, but not in a production-level environment, and we are concerned about the problem of distributing Lucene over multiple servers. Lucandra seems like an obvious solution to this problem. Any comments or advice? My primary concern at

Re: Lucandra - Lucene/Solr on Cassandra: April 26, NYC

2010-04-25 Thread Utku Can Topçu
Can you please release the talk at a place after it's been done? Best Regards, Utku On Thu, Apr 22, 2010 at 6:51 PM, Otis Gospodnetic < otis_gospodne...@yahoo.com> wrote: > Hello folks, > > Those of you in or near NYC and using Lucene or Solr should come to > "

Re: Lucandra or some way to query

2010-04-15 Thread malsmith
We looking into migrating from a replicated solr infrastructure to some form of clustered approach. Lucandra looks fantastic -- but this statement is troubling: "No normalizations are stored (no scoring)" from http://github.com/tjake/Lucandra When I use the demo/samples get do get a

Re: Lucandra or some way to query

2010-04-14 Thread Jake Luciani
Lucandra spreads the data randomly by index + field combination so you do get "some" distribution for free. Otherwise you can use "nodetool loadbalance" to alter the token ring to alleviate hotspots. On Thu, Apr 15, 2010 at 2:04 AM, HubertChang wrote: > > If you

Re: Lucandra or some way to query

2010-04-14 Thread HubertChang
If you worked with Lucandra in a dedicated searching-purposed cluster, you could balanced the data very well with some effort. >>I think Lucandra is really a great idea, but since it needs order-preserving-partitioner, does that mean >>there may be some 'hot-spot' during se

Re: Lucandra or some way to query

2010-04-14 Thread Zhuguo Shi
I think Lucandra is really a great idea, but since it needs order-preserving-partitioner, does that mean there may be some 'hot-spot' during searching?

Re: Lucandra or some way to query

2010-04-14 Thread Jake Luciani
Hi, What doesn't work with lucandra exactly? Feel free to msg me. -Jake On Wed, Apr 14, 2010 at 9:30 PM, Jesus Ibanez wrote: > I will explore Lucandra a little more and if I can't get it to work today, > I will go for Option 2. > Using SQL will not be efficient in the fu

Re: Lucandra or some way to query

2010-04-14 Thread Jesus Ibanez
I will explore Lucandra a little more and if I can't get it to work today, I will go for Option 2. Using SQL will not be efficient in the future, if my website grows. Thenks for your answer Eric! Jesús. 2010/4/14 Eric Evans > On Wed, 2010-04-14 at 06:45 -0300, Jesus Ibanez wrote: &g

Re: Lucandra or some way to query

2010-04-14 Thread Eric Evans
On Wed, 2010-04-14 at 06:45 -0300, Jesus Ibanez wrote: > Option 1 - insert data in all different ways I need in order to be > able to query? Rolling your own indexes is fairly common with Cassandra. > Option 2 - implement Lucandra? Can you link me to a blog or an article > that guid

Lucandra or some way to query

2010-04-14 Thread Jesus Ibanez
or each property I need to query on, I have doubts if this is a good idea. But if you think it can works, I will do it. I red about Lucandra and seems interesting, but I couldn't run the examples, I don't know if it is a good idea to use it and to be honest, I don't know where to start