Hi, 
I have been using external file field (eff) for holding rank of the document
which gets updated every day based on different stats collected by the
system. Once the rank is computed the new files are pushed to Master which
will eventually replicate to slaves on next commit. 

Our eff file has around 1.6M lines a simple key value pare. Its roughly
about 16MB. Its been observed that loading this file at first takes around
192 sec. I agree this can be done at the start of the server and should not
impact the performance while serving traffic. (We have 10 such fields, file
per zone).

Now documents are pushed to Master every 2 hrs in batches. Eff is just
pushed once a day. As we apply commit every 2hrs, On slaves when new reader
is opened after replication it takes a long time to warmup because it has to
load the eff file again. 

Curious to know if the file has not changed and resides outside index, is
there a way in solar to check if the eff file is actually modified before
trying to reload it? 

Any other suggestions?

 



--
View this message in context: 
http://lucene.472066.n3.nabble.com/External-File-field-Reload-option-tp4101929.html
Sent from the Solr - User mailing list archive at Nabble.com.

Reply via email to