Re: Maximum solr processes per machine

2013-09-29 Thread adfel70
Bram Van Dam wrote > On 09/29/2013 04:03 PM, adfel70 wrote: > If you're doing real time on a 5TB index then you'll probably want to > throw your money at the fastest storage you can afford (SSDs vs spinning > rust made a huge difference in our benchmarks) and the fastest CPUs you > can get your

Re: Maximum solr processes per machine

2013-09-29 Thread Shawn Heisey
On 9/29/2013 7:21 AM, adfel70 wrote: > Hi, > I'm thinking of solr cluster architecture before purchasing machines. > > > My total index size is around 5TB. I want to have replication factor of 3. > total 15TB. > I've understood that I should have 50-100% of the index size as ram, for OS > cache.

Re: Maximum solr processes per machine

2013-09-29 Thread Bram Van Dam
On 09/29/2013 04:03 PM, adfel70 wrote: How can I configure the disk storage so that disk access is optimized? I'm considering having RAID-10 and I think I'll have arround 4-8 disks per machine. Should I run each solr jvm to point on a datadir on differnet disks, or is there some other way to opti

Re: Maximum solr processes per machine

2013-09-29 Thread adfel70
How can I configure the disk storage so that disk access is optimized? I'm considering having RAID-10 and I think I'll have arround 4-8 disks per machine. Should I run each solr jvm to point on a datadir on differnet disks, or is there some other way to optimize this? Erick Erickson wrote > bq:

Re: Maximum solr processes per machine

2013-09-29 Thread Erick Erickson
bq: is there an upper limit of amount of solr processes per machine, No, assuming they're all in separate JVMs. I've see reports, though, that increasing the number of JVMs past the number of CPU cores gets into "iffy" territory. And, depending on your disk storage they may all be contending for