We have 4 shards with 14GB index on each of them Each shard has a master and 3 slaves(each of them with 32GB RAM)
We're expecting that the index size will grow to double or triple in near future. So we thought of merging our indexes to 28GB index so that each shard has 28GB index and also increased our RAM on each slave to 48GB. We made this changes locally and tested the server by sending same 10K realistic queries to each server with 14GB & 28GB index, we found that 1. For server with 14GB index(48GB RAM): search time was 480ms, number of index hits: 3.8GB 2. For server with 28GB index(48GB RAM): search time was 900ms, number of index hits: 7.2GB. So we saw that having the whole index in RAM doesn't help in sustaining the performance in terms of search time . Search time increased linearly to double when the index size was doubled. We were thinking of keeping only 4 shards configuration but it looks like now we have to add another shard or another slave to each shard. Is there way we can configure our servers so that the performance isn't affected even when index size doubles or triples ? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Index-linear-growth-Performance-degradation-tp4000934.html Sent from the Solr - User mailing list archive at Nabble.com.
