Hi, Thanks a lot for your replies!!!!
Here is the exact problem I am facing right now.. I have a scheduled batch indexing happening in master every 2 days for 3 sources (Ex: s1, s2, s3) Once the batch indexing gets completed I replicate that to slave instance for user queries. There is one more app which posts the XML (of s3) to SOLR slave instance (to perform real time indexing) and the posted XML can add / update document to the slave index (created by batch indexing). Now since the data posted via XML is also available for batch indexing, If I do a batch indexing for s3 after 2 days and replicate it in slave users should be able to view all data. I am posting just to slave first in order to have a kind of real time indexing where the user can see the results immediately but whenever the XML post happens to SOLR there is a db entry corresponding to that post.. Now I am afraid that I might run in to an issue when someone kicks off real time indexing from the app when batch indexing is in progress as the batch indexing might not pick up the changes made to slave at that time (when the batch indexing is in progress). Has anyone faced this kind of scenario.. My ideal solution is that I should be able to do real time (XML post) / batch indexing at same time and also I cant use shards as real time data may even need to update the existing index (not just add a new document)..My assumption is that I can use shards if we are going to maintain index separately for real time / batch indexing but if I need to update an existing document using XML post I don't think Shards would work... I also thought of doing this.. I will always write both XML post / batch indexing to Master and do a replication to slave every 15 seconds.. even in this case if I am doing a batch indexing I suppose SOLR will lock the index files and I wont be able to do a XML push to the same index at that time.. please correct me if I am wrong.. Any suggestion / thoughts would be greatly appreciated. Thanks, BB -- View this message in context: http://lucene.472066.n3.nabble.com/Realtime-Batch-indexing-tp952293p955442.html Sent from the Solr - User mailing list archive at Nabble.com.
