Usually collecting whole array hurts client's jvm JVM, sending doc-by-doc bloats sever by huge number of small requests. You need just rewrite your code from the eager loop to pulling iterator to be able to submit all docs via single http request http://wiki.apache.org/solr/Solrj#Streaming_documents_for_an_update Then if you wouldn't be happy with low utilization due to using single thread, post your problem and numbers here again.
http://wiki.apache.org/solr/SolrReplication http://lucidworks.lucidimagination.com/display/solr/Index+Replication On Sat, Jul 28, 2012 at 11:21 PM, Sohail Aboobaker <sabooba...@gmail.com>wrote: > We have auto commit on and will basically send it in a loop after > validating each record, we send it to search service. And keep doing it in > a loop. Mikhail / Lan, are you suggesting that instead of sending it in a > loop, we should collect them in an array and do a commit at the end? Is > this better than doing it in a loop with auto commit. > > Also, where can I find some reference on Master / Slave configuration. > > Thanks. > -- Sincerely yours Mikhail Khludnev Tech Lead Grid Dynamics <http://www.griddynamics.com> <mkhlud...@griddynamics.com>
