Re: keeping data consistent between Database and Solr

2011-03-21 Thread onlinespend...@gmail.com
On Mon, Mar 21, 2011 at 10:57 AM, Shawn Heisey wrote: > On 3/15/2011 12:54 PM, onlinespend...@gmail.com wrote: > >> That's pretty interesting to use the autoincrementing document ID as a way >> to keep track of what has not been indexed in Solr. And you overwrite >> this >> document ID even when

Re: keeping data consistent between Database and Solr

2011-03-21 Thread Shawn Heisey
On 3/15/2011 12:54 PM, onlinespend...@gmail.com wrote: That's pretty interesting to use the autoincrementing document ID as a way to keep track of what has not been indexed in Solr. And you overwrite this document ID even when you modify an existing document. Very cool. I suppose the number ca

Re: keeping data consistent between Database and Solr

2011-03-15 Thread onlinespend...@gmail.com
That's pretty interesting to use the autoincrementing document ID as a way to keep track of what has not been indexed in Solr. And you overwrite this document ID even when you modify an existing document. Very cool. I suppose the number can even rotate back to 0, as long as you handle that. I a

RE: keeping data consistent between Database and Solr

2011-03-15 Thread Tim Gilbert
To: solr-user@lucene.apache.org Subject: Re: keeping data consistent between Database and Solr On 3/14/2011 9:38 PM, onlinespend...@gmail.com wrote: > But my main question is, how do I guarantee that data between my Cassandra > database and Solr index are consistent and up-to-date? Our MySQL data

Re: keeping data consistent between Database and Solr

2011-03-15 Thread Shawn Heisey
On 3/14/2011 9:38 PM, onlinespend...@gmail.com wrote: But my main question is, how do I guarantee that data between my Cassandra database and Solr index are consistent and up-to-date? Our MySQL database has two unique indexes. One is a document ID, implemented in MySQL as an autoincrement int

Re: keeping data consistent between Database and Solr

2011-03-15 Thread onlinespend...@gmail.com
Solandra is great for adding better scalability and NRT to Solr, but it pretty much just stores the index in Cassandra and insulates that from the user. It doesn't solve the problem of allowing quick and direct retrieval of data that need not be searched. I could certainly just use a Solr search qu

Re: keeping data consistent between Database and Solr

2011-03-14 Thread Bill Bell
Look at Solandra. Solr + Cassandra. On 3/14/11 9:38 PM, "onlinespend...@gmail.com" wrote: >Like many people, Solr is not my primary data store. Not all of my data >need >be searchable and for simple and fast retrieval I store it in a database >(Cassandra in my case). Actually I don't have this

keeping data consistent between Database and Solr

2011-03-14 Thread onlinespend...@gmail.com
Like many people, Solr is not my primary data store. Not all of my data need be searchable and for simple and fast retrieval I store it in a database (Cassandra in my case). Actually I don't have this all built up yet, but my intention is that whenever new data is entered that it be added to my Ca