Don’t use DIH. DIH has a lot of limitations and problems, as you are 
discovering.

Write a simple program that fetches from the database and sends documents 
in batches to Solr. I did this before DIH was invented (Solr 1.3) and I’m doing 
it
now.

You can send the updates to the load balancer for the Solr Cloud cluster. The
updates will be automatically routed to the right leader. It is very fast.

My loader is written in Python and I don’t even bother with a special Solr 
library.
It just sends JSON to the update handler with the right options.

We do this for all of our clusters. Our biggest one is 48 hosts with 55 million
documents.

wunder
Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)

> On Oct 11, 2020, at 8:40 PM, yaswanth kumar <yaswanth...@gmail.com> wrote:
> 
> Hi wunder 
> 
> Thanks for replying on this..
> 
> I did setup solr cloud with 4 nodes being one node having DIH configured that 
> pulls data from ms sql every minute.. if I install DIH on rest of the nodes 
> it’s causing connection issues on the source dB which I don’t want and manage 
> with only one sever polling dB while rest are used as replicas for search.
> 
> So now everything works fine but when the severs are rebooted for maintenance 
> and once they come back and if the leader is not the one that doesn’t have 
> DIH it stops pulling data from sql , so that’s the reason why I want always 
> to force a node as leader
> 
> Sent from my iPhone
> 
>> On Oct 11, 2020, at 11:05 PM, Walter Underwood <wun...@wunderwood.org> wrote:
>> 
>> That requirement is not necessary. Let Solr choose a leader.
>> 
>> Why is someone making this bad requirement?
>> 
>> wunder
>> Walter Underwood
>> wun...@wunderwood.org
>> http://observer.wunderwood.org/  (my blog)
>> 
>>> On Oct 11, 2020, at 8:01 PM, yaswanth kumar <yaswanth...@gmail.com> wrote:
>>> 
>>> Can someone pls help me to know if there is any solr api /config where we 
>>> can make sure to always opt leader on a particular solr node in solr cloud??
>>> 
>>> Using solr 8.2 and zoo 3.4
>>> 
>>> I have four nodes and my requirement is to always make a particular node as 
>>> leader
>>> 
>>> Sent from my iPhone
>> 

Reply via email to