hi, we are sending about 100 documents per request for indexing? we have autocmmit set to false and commit only when 10000 documents are present.solr and the machine sending request are in same pool.
On Tue, Aug 16, 2016 at 4:51 PM, Emir Arnautovic < emir.arnauto...@sematext.com> wrote: > Hi, > > Do you send one doc per request? How frequently do you commit? Where is > Solr running? What is network connection between your machine and Solr? > What are JVM settings? Is 10-30s for entire indexing or single doc? > > Regards, > Emir > > > On 16.08.2016 11:34, kshitij tyagi wrote: > >> Hi alexandre, >> >> 1 document of 400kb size is taking approx 10-30 sec and this is varying. I >> am posting document using curl >> >> On Tue, Aug 16, 2016 at 2:11 PM, Alexandre Rafalovitch < >> arafa...@gmail.com> >> wrote: >> >> How many records is that and what is 'slow'? Also is this standalone or >>> cluster setup? >>> >>> On 16 Aug 2016 6:33 PM, "kshitij tyagi" <kshitij.shopcl...@gmail.com> >>> wrote: >>> >>> Hi, >>>> >>>> I am indexing a lot of data about 8GB, but it is taking a lot of time. I >>>> have read about maxBufferedDocs, ramBufferSizeMB, merge policy ,etc in >>>> solrconfig file. >>>> >>>> It would be helpful if someone could help me out tune the segtting for >>>> faster indexing speeds. >>>> >>>> *I have read the docs but not able to get what exactly means changing >>>> >>> these >>> >>>> configs.* >>>> >>>> >>>> *Regards,* >>>> *Kshitij* >>>> >>>> > -- > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > Solr & Elasticsearch Support * http://sematext.com/ > >
