Re: SolrCloud performance in VM environment

2013-10-23 Thread Erick Erickson
Be a bit careful here. 128G is lots of memory, you may encounter very long garbage collection pauses. Just be aware that this may be happening later. Best, Erick On Tue, Oct 22, 2013 at 5:04 PM, Tom Mortimer wrote: > Just tried it with no other changes than upping the RAM to 128GB total, and >

Re: SolrCloud performance in VM environment

2013-10-22 Thread Tom Mortimer
Just tried it with no other changes than upping the RAM to 128GB total, and it's flying. I think that proves that RAM is good. =) Will implement suggested changes later, though. cheers, Tom On 22 October 2013 09:04, Tom Mortimer wrote: > Boogie, Shawn, > > Thanks for the replies. I'm going to

Re: SolrCloud performance in VM environment

2013-10-22 Thread Tom Mortimer
Boogie, Shawn, Thanks for the replies. I'm going to try out some of your suggestions today. Although, without more RAM I'm not that optimistic.. Tom On 21 October 2013 18:40, Shawn Heisey wrote: > On 10/21/2013 9:48 AM, Tom Mortimer wrote: > >> Hi everyone, >> >> I've been working on an inst

Re: SolrCloud performance in VM environment

2013-10-21 Thread Shawn Heisey
On 10/21/2013 9:48 AM, Tom Mortimer wrote: Hi everyone, I've been working on an installation recently which uses SolrCloud to index 45M documents into 8 shards on 2 VMs running 64-bit Ubuntu (with another 2 identical VMs set up for replicas). The reason we're using so many shards for a relativel

RE: SolrCloud performance in VM environment

2013-10-21 Thread Boogie Shafer
some basic tips. -try to create enough shards that you can get the size of each index portion on the shard closer to the amount of RAM you have on each node (e.g. if you are ~140GB index on 16GB nodes, try doing 12-16 shards) -start with just the initial shards, add replicas later when you have