Re: Replicating Large Indexes

2011-11-01 Thread Chris Hostetter
: We optimize less frequently than we used to. Down to twice a month from once a day. : : Without optimizing the search speed stays the same, however the index size increases to 70+ GB. : : Perhaps there is a different way to restrict disk usage. Consider using the "maxSegments" option on o

RE: Replicating Large Indexes

2011-11-01 Thread Jason Biggin
Thanks Erick, Will take a look at this article. Cheers, Jason -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Tuesday, November 01, 2011 8:05 AM To: solr-user@lucene.apache.org Subject: Re: Replicating Large Indexes Yes, that's expected behavior.

Re: Replicating Large Indexes

2011-11-01 Thread Robert Stewart
sults. > > Bob > > On Nov 1, 2011, at 12:46 AM, Jason Biggin wrote: > >> Wondering if anyone has experience with replicating large indexes. We have >> a Solr deployment with 1 master, 1 master/slave and 5 slaves. Our index >> contains 15+ million articles and i

Re: Replicating Large Indexes

2011-11-01 Thread Jason Biggin
. Bob On Nov 1, 2011, at 12:46 AM, Jason Biggin wrote: > Wondering if anyone has experience with replicating large indexes. We have a > Solr deployment with 1 master, 1 master/slave and 5 slaves. Our index > contains 15+ million articles and is ~55GB in size. > > Performance

Re: Replicating Large Indexes

2011-11-01 Thread Robert Stewart
. Bob On Nov 1, 2011, at 12:46 AM, Jason Biggin wrote: > Wondering if anyone has experience with replicating large indexes. We have a > Solr deployment with 1 master, 1 master/slave and 5 slaves. Our index > contains 15+ million articles and is ~55GB in size. > > Performance

Re: Replicating Large Indexes

2011-11-01 Thread Erick Erickson
2011 at 12:46 AM, Jason Biggin wrote: > Wondering if anyone has experience with replicating large indexes.  We have a > Solr deployment with 1 master, 1 master/slave and 5 slaves.  Our index > contains 15+ million articles and is ~55GB in size. > > Performance is great on all systems.

Re: Replicating Large Indexes

2011-10-31 Thread Floyd Wu
Hi Jason, I'm very curious about how you build( rebuild ) such a big index efficiently? Sorry that hijack this topic. Floyd 2011/11/1 Jason Biggin : > Wondering if anyone has experience with replicating large indexes.  We have a > Solr deployment with 1 master, 1 master/slave a

Replicating Large Indexes

2011-10-31 Thread Jason Biggin
Wondering if anyone has experience with replicating large indexes. We have a Solr deployment with 1 master, 1 master/slave and 5 slaves. Our index contains 15+ million articles and is ~55GB in size. Performance is great on all systems. Debian Linux Apache-Tomcat 100GB disk 6GB RAM 2 proc on