I've seen best throughput while indexing by sending in batches of documents
rather than individual documents per request. You might try queueing on your
indexing machines for a bit then sending off a batch every N documents.
Thanks,
Greg
On Feb 1, 2014, at 6:49 PM, Software Dev wrote:
> Also,
Also, if we are seeing a huge cpu spike on the leader when doing a bulk
index, would changing any of the options help?
On Sat, Feb 1, 2014 at 2:59 PM, Software Dev wrote:
> Out use case is we have 3 indexing machines pulling off a kafka queue and
> they are all sending individual updates.
>
>
>
Out use case is we have 3 indexing machines pulling off a kafka queue and
they are all sending individual updates.
On Fri, Jan 31, 2014 at 12:54 PM, Mark Miller wrote:
> Just make sure parallel updates is set to true.
>
> If you want to load even faster, you can use the bulk add methods, or if
Just make sure parallel updates is set to true.
If you want to load even faster, you can use the bulk add methods, or if you
need more fine grained responses, use the single add from multiple threads
(though bulk add can also be done via multiple threads if you really want to
try and push the m
Which of any of these settings would be beneficial when bulk uploading?
On Fri, Jan 31, 2014 at 11:05 AM, Mark Miller wrote:
>
>
> On Jan 31, 2014, at 1:56 PM, Greg Walters
> wrote:
>
> > I'm assuming you mean CloudSolrServer here. If I'm wrong please ignore
> my response.
> >
> >> -updatesToL
On Jan 31, 2014, at 1:56 PM, Greg Walters wrote:
> I'm assuming you mean CloudSolrServer here. If I'm wrong please ignore my
> response.
>
>> -updatesToLeaders
>
> Only send documents to shard leaders while indexing. This saves cross-talk
> between slaves and leaders which results in more e
I'm assuming you mean CloudSolrServer here. If I'm wrong please ignore my
response.
> -updatesToLeaders
Only send documents to shard leaders while indexing. This saves cross-talk
between slaves and leaders which results in more efficient document routing.
> shutdownLBHttpSolrServer
CloudSolrS
