Re: Solr-Batch Update

2019-04-26 Thread Erick Erickson
The benefit falls off fairly rapidly as the batch size increases. I did some crude benchmarking here: https://lucidworks.com/2015/10/05/really-batch-updates-solr-2/ If I were going to pick a number, I’d say 100 docs _per shard_. So if you have 10 shards, batch 1,000 docs if possible. Note, the

RE: Solr-Batch Update

2019-04-25 Thread Markus Jelsma
Hello, There is no definitive rule for this, it depends on your situation such as size of documents, resource constraints and possible heavy analysis chain. And in case of (re)indexing a large amount, your autocommit time/limit is probably more important. In our case, some collections are fine