Re: Incremental replication...

2007-02-14 Thread Kevin Lewandowski
snapshooter copies all files but most files in the snapshot directories are hard links pointing to segments in the main index directory. So only new segments end up getting copied. We've been running replication on discogs.com for several months and it works great. On 2/13/07, escher2k <[EMAIL P

Re: Incremental replication...

2007-02-13 Thread Bill Au
FYI, additional information on replication is available in the Solr TWiki: http://wiki.apache.org/solr/CollectionDistribution Bill On 2/13/07, Bertrand Delacretaz <[EMAIL PROTECTED]> wrote: On 2/13/07, escher2k <[EMAIL PROTECTED]> wrote: > ...Atleast from looking at the snapshooter script, i

Re: Incremental replication...

2007-02-13 Thread Bertrand Delacretaz
On 2/13/07, escher2k <[EMAIL PROTECTED]> wrote: ...Atleast from looking at the snapshooter script, it doesn't seem to be doing anything specific... The snapshooter script only makes an "instant snapshot" of the index directory using cp -lr. This does not involve any copying of index data. The

RE: Incremental replication...

2007-02-13 Thread escher2k
Graham Stead-2 wrote: > > We have used replication for a few weeks now and it generally works well. > > I believe you'll find that commit operations cause only new segments to be > transferred, whereas optimize operations cause the entire index to be > transferred. Therefore, the amount of data

RE: Incremental replication...

2007-02-13 Thread Graham Stead
We have used replication for a few weeks now and it generally works well. I believe you'll find that commit operations cause only new segments to be transferred, whereas optimize operations cause the entire index to be transferred. Therefore, the amount of data transferred really depends on how fr