RE: Solr delta indexing approach

2014-02-12 Thread Sadler, Anthony
ully that makes a bit more sense. -Original Message- From: Walter Underwood [mailto:wun...@wunderwood.org] Sent: Thursday, 13 February 2014 5:26 PM To: solr-user@lucene.apache.org Subject: Re: Solr delta indexing approach Why write a Perl script for that? touch new_timestamp find . -n

Re: Solr delta indexing approach

2014-02-12 Thread lalitjangra
Thanks all. I am following couple of articles for same. I am sending data to solr instead of using DIH and able to successfully index data in solr. My concern here is to ensure how to minimize solr indexing so that only updated data is indexed each time out of all data items. Is this something

Re: Solr delta indexing approach

2014-02-12 Thread Walter Underwood
From: lalitjangra [mailto:lalit.j.jan...@gmail.com] > Sent: Thursday, 13 February 2014 4:45 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr delta indexing approach > > Thanks Alex, > > Yes my source system maintains the crettion & last modificaiton system of &g

Re: Solr delta indexing approach

2014-02-12 Thread Alexandre Rafalovitch
I'd start from doing Solr tutorial. It will explain a lot of things. But in summary, you can send data to Solr (best option) or you can pull it using DataImportHandler. Take your pick, do the tutorial, maybe read some books. Then come back with specific questions of where you started. Regards,

RE: Solr delta indexing approach

2014-02-12 Thread Sadler, Anthony
: Thursday, 13 February 2014 4:45 PM To: solr-user@lucene.apache.org Subject: Re: Solr delta indexing approach Thanks Alex, Yes my source system maintains the crettion & last modificaiton system of each document. As per your inputs, can i assume that next time when solr starts indexing, it

Re: Solr delta indexing approach

2014-02-12 Thread lalitjangra
Thanks Alex, Yes my source system maintains the crettion & last modificaiton system of each document. As per your inputs, can i assume that next time when solr starts indexing, it scans all the prsent in source but only picks those for indexing which are either new or have been updated since las

Re: Solr delta indexing approach

2014-02-12 Thread Alexandre Rafalovitch
You have read that Solr needs to reindex a full source. That's correct (unless you use atomic updates). But - the important point is - this is per document. So, once you indexed your 1 documents, you don't need to worry about them until they change. Just go ahead and index your additional docu