Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Bill Au
The CSVLoader is very fast but it doesn't support document or field boosting at index time. If you don't need that you can also generate input data to Solr into file(s) to be loaded by the CSVLoader. Just reload whenever you change the schema. You will need to regenerate data if you add/remove f

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Edwin Stauthamer
Simple but effective ;-) On Fri, Jul 31, 2009 at 3:23 PM, Erik Hatcher wrote: > There certainly could be some intermediate storage of documents prior to > indexing, but as far as the Lucene index goes it is inherently a one-way > process. Solr could facilitate this pretty easily... with an updat

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Erik Hatcher
There certainly could be some intermediate storage of documents prior to indexing, but as far as the Lucene index goes it is inherently a one-way process. Solr could facilitate this pretty easily... with an update processor that wrote the documents coming in to some other storage (one opti

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Chantal Ackermann
Hi Edwin, what prevents you of storing the data (possibly formatted in SOLR xml input format) yourself on some disk? Cheers, Chantal Edwin Stauthamer schrieb: That is a shame. I have much experience with Autonomy IDOL and the possibility of quickly reindexing the content without making a cal

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Shalin Shekhar Mangar
On Fri, Jul 31, 2009 at 6:29 PM, Erik Hatcher wrote: > > On Jul 31, 2009, at 7:01 AM, Vannia Rajan wrote: > > On Fri, Jul 31, 2009 at 3:22 PM, Erik Hatcher > >wrote: >> >> You'll have to reindex your documents from scratch. Such is the nature >>> of >>> changing the schema of an index. It's al

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Edwin Stauthamer
That is a shame. I have much experience with Autonomy IDOL and the possibility of quickly reindexing the content without making a call to the original source is great. Just Export, update the config, and import (=reindex) to see if, for instance the performance is better or just to transport the in

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Erik Hatcher
On Jul 31, 2009, at 7:01 AM, Vannia Rajan wrote: On Fri, Jul 31, 2009 at 3:22 PM, Erik Hatcher >wrote: You'll have to reindex your documents from scratch. Such is the nature of changing the schema of an index. It's always a great idea (in fact, I'd say mandatory) to have a full reindex

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Vannia Rajan
On Fri, Jul 31, 2009 at 3:22 PM, Erik Hatcher wrote: > You'll have to reindex your documents from scratch. Such is the nature of > changing the schema of an index. It's always a great idea (in fact, I'd say > mandatory) to have a full reindex process handy. > > Thank you for your response. Yes,

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Vannia Rajan
On Fri, Jul 31, 2009 at 3:17 PM, Tim Sell wrote: > Are you using solr as a data store? > No, data comes from somewhere else, solr is just for indexing giving back query results. > > It is not possible via solr to change existing documents in a solr > index. It would be a nice feature though. >

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Erik Hatcher
You'll have to reindex your documents from scratch. Such is the nature of changing the schema of an index. It's always a great idea (in fact, I'd say mandatory) to have a full reindex process handy. Erik On Jul 31, 2009, at 2:37 AM, Vannia Rajan wrote: Hi, We are using solr-se

Re: Recreating SOLR index after a schema change - without having to re-post the data

2009-07-31 Thread Tim Sell
That really is the only way, it would be far easier if you were importing from another source. Are you using solr as a data store? It is not possible via solr to change existing documents in a solr index. It would be a nice feature though. ~Tim. 2009/7/31 Vannia Rajan : > Hi, > >  We are using s

Recreating SOLR index after a schema change - without having to re-post the data

2009-07-30 Thread Vannia Rajan
Hi, We are using solr-server for a large data-set. We need some changes in solr schema.xml (datatype change from integer to sint for few fields). It turns out that the two datatypes (integer and sint) are incompatible and hence we need to re-index SOLR. My question is: Is there any way by wh