Re: Incremental replication...

2007-02-14 Thread Kevin Lewandowski
t;[EMAIL PROTECTED]> wrote: I was wondering if the scripts provided in Solr do incremental replication. Looking at the script for snapshooter, it seems like the whole index directory is copied over. Is that correct ? If so, isn't performance a problem over the long run ? Thanks for the

Re: Incremental replication...

2007-02-13 Thread Bill Au
FYI, additional information on replication is available in the Solr TWiki: http://wiki.apache.org/solr/CollectionDistribution Bill On 2/13/07, Bertrand Delacretaz <[EMAIL PROTECTED]> wrote: On 2/13/07, escher2k <[EMAIL PROTECTED]> wrote: > ...Atleast from looking at the snapshooter script, i

Re: Incremental replication...

2007-02-13 Thread Bertrand Delacretaz
On 2/13/07, escher2k <[EMAIL PROTECTED]> wrote: ...Atleast from looking at the snapshooter script, it doesn't seem to be doing anything specific... The snapshooter script only makes an "instant snapshot" of the index directory using cp -lr. This does not involve any copying of index data. The

RE: Incremental replication...

2007-02-13 Thread escher2k
into temporary location # then move it into place atomically cp -lr ${data_dir}/index ${temp} mv ${temp} ${name} -- View this message in context: http://www.nabble.com/Incremental-replication...-tf3222946.html#a8952716 Sent from the Solr - User mailing list archive at Nabble.com.

RE: Incremental replication...

2007-02-13 Thread Graham Stead
We have used replication for a few weeks now and it generally works well. I believe you'll find that commit operations cause only new segments to be transferred, whereas optimize operations cause the entire index to be transferred. Therefore, the amount of data transferred really depends on how fr

Incremental replication...

2007-02-13 Thread escher2k
I was wondering if the scripts provided in Solr do incremental replication. Looking at the script for snapshooter, it seems like the whole index directory is copied over. Is that correct ? If so, isn't performance a problem over the long run ? Thanks for the clarification in advance (I hope