You have to increase your RAM. We have upgraded our Solr cluster to 12 solr nodes, each with 64G RAM, our shard size is around 25G, each server only hosts either one shard ( leading node or replica), Performance is very good. For better performance, memory needs to be over your shard size.
Kind regards, Daphne Liu BI Architect • Big Data - Matrix SCM CEVA Logistics / 10751 Deerwood Park Blvd, Suite 200, Jacksonville, FL 32256 USA / www.cevalogistics.com T 904.9281448 / F 904.928.1525 / daphne....@cevalogistics.com Making business flow -----Original Message----- From: zhenyuan wei <tins...@gmail.com> Sent: Tuesday, September 18, 2018 3:12 AM To: solr-user@lucene.apache.org Subject: Re: 20180917-Need Apache SOLR support I have 6 machines，and each machine run a solr server, each solr server use RAM 18GB. Total document number is 3.2billion，1.4TB ， my collection‘s replica factor is 1。collection shard number is 60，currently each shard is 20~30GB。 15 fields per document。 Query rate is slow now，maybe 100-500 requests per second. Shawn Heisey <apa...@elyograg.org> 于2018年9月18日周二 下午12:07写道： > On 9/17/2018 9:05 PM, zhenyuan wei wrote: > > Is that means： Small amount of shards gains better performance？ > > I also have a usecase which contains 3 billion documents，the > > collection contains 60 shard now. Is that 10 shard is better than 60 shard? > > There is no definite answer to this question. It depends on a bunch > of things. How big is each shard once it's finally built? What's > your query rate? How many machines do you have, and how much memory > do those machines have? > > Thanks, > Shawn > > NVOCC Services are provided by CEVA as agents for and on behalf of Pyramid Lines Limited trading as Pyramid Lines. This e-mail message is intended for the above named recipient(s) only. It may contain confidential information that is privileged. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail by error, please immediately notify the sender by replying to this e-mail and deleting the message including any attachment(s) from your system. Thank you in advance for your cooperation and assistance. Although the company has taken reasonable precautions to ensure no viruses are present in this email, the company cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
