On 9/18/2018 1:11 AM, zhenyuan wei wrote:
I have 6 machines，and each machine run a solr server, each solr server use RAM 18GB. Total document number is 3.2billion，1.4TB ， my collection‘s replica factor is 1。collection shard number is 60，currently each shard is 20~30GB。 15 fields per document。 Query rate is slow now，maybe 100-500 requests per second.
That is NOT a slow query rate. In the recent past, I was the administrator to a Solr install. When things got *REALLY BUSY*, the servers would see as many as five requests per second. Usually the request rate was less than one per second. A high request rate can drastically impact overall performance.
I have heard of big Solr installs that handle thousands of requests per second, which is certainly larger than yours ... but 100-500 is NOT slow. I'm surprised that you can get acceptable performance on an index that big, with that many queries, and only six machines. Congratulations.
Despite appearances, I wasn't actually asking you for this information. I was telling you that those things would all be factors in the decision about how many shards you should have.Perhaps I should have worded the message differently.
See this page for a discussion about how total memory size and index size affect performance:
https://wiki.apache.org/solr/SolrPerformanceProblems Thanks, Shawn
