Re: Maximum index size on single instance of Solr

2012-09-04 Thread Michael Brandt
Thanks everyone! On Thu, Aug 30, 2012 at 11:11 AM, pravesh wrote: > We have a 48GB index size on a single shard. 20+ million documents. > Recently > migrated to SOLR 3.5 > But we have a cluster of SOLR servers for hosting searches. But i do see to > migrate to SOLR sharding going forward. > > >

Re: Maximum index size on single instance of Solr

2012-08-30 Thread pravesh
We have a 48GB index size on a single shard. 20+ million documents. Recently migrated to SOLR 3.5 But we have a cluster of SOLR servers for hosting searches. But i do see to migrate to SOLR sharding going forward. Thanx Pravesh -- View this message in context: http://lucene.472066.n3.nabble.

Re: Maximum index size on single instance of Solr

2012-08-30 Thread Erick Erickson
Here's a blog outlining why this is so hard to answer: http://searchhub.org/dev/2012/07/23/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/ Just one example from your post, you mention index size as a metric. It's often useless. Stored data ('stored="true" ') is placed in file

Re: Maximum index size on single instance of Solr

2012-08-29 Thread Michael Della Bitta
Unfortunately the answer for this can vary quite a bit based on a number of factors: 1. Whether or not fields are stored, 2. Document size, 3. Total term count, 4. Solr version etc. We have two major indexes, one for servicing online queries, and one for batch processing. Our batch index is perf