Thanks Eric. I will profile and check it out.
On Saturday, December 5, 2015, Erick Erickson
wrote:
> bq: What adds bottleneck in the indexing flow? Is it the buffering and
> flushing
> out to disk ?
>
> It Depends (tm). What do the Solr logs show when one of these two things
> happens?
>
> You p
bq: What adds bottleneck in the indexing flow? Is it the buffering and flushing
out to disk ?
It Depends (tm). What do the Solr logs show when one of these two things
happens?
You pretty much have to put a profiler on the Solr instance to see where it's
spending the time, but timeouts are very of
I have an extremely large indexing load (per doc size of 4-5 Mb with over
100M docs). I have auto commit settings to flush to disk (with open
searcher as false) every 20 seconds. Even with that the update sometime
fails or timed out. The goal is to improve the indexing throughput and
hence trying t
I'm pretty sure that max indexing threads is per core, but just looked
and it's not supported in Solr 5.3 and above so I wouldn't worry about
it at all.
I've never seen much in the way of benefit for bumping this past 128M
or maybe 256M. This is just how much memory is filled up before the
buffer
