Re: Seeing very low ingestion performance for a single non-cloud Solr core

2017-09-25 Thread saiks
Hi All, Thanks for the response. Increasing hard/soft commit intervals did not help. But by changing "text" field in the ingestion input from the same message to random messages of similar length gave 60% improved performance. Im able to ingest 40k - 45k messages per second, earlier I did 26k.

Re: Seeing very low ingestion performance for a single non-cloud Solr core

2017-09-21 Thread Walter Underwood
5 seconds and 10 seconds is very short for auto commit. 20 Gb is probably too much heap. Sending the exact same message for every update will create a few very long posting lists. Not sure if that is slow, but it is not realistic. Finally, 26,000 per second is not that slow. That is over 1.5 mi

Re: Seeing very low ingestion performance for a single non-cloud Solr core

2017-09-21 Thread Emir Arnautović
Hi, What are your commit configs? Maybe you are committing too frequently. Thanks, Emir > On 21 Sep 2017, at 06:19, saiks wrote: > > Hi, > > Environment: > - Solr is running in non-cloud mode on 6.4.2, Sun Java8, Linux > 4.4.0-31-generic x86_64 > - Ingesting into a single core > - SoftCommit