Re: Scaling data extractor with Solr

2016-10-03 Thread Erick Erickson
You can have as many clients indexing to Solr (either Cloud or stand-alone) as you want, limited only by the load you put on Solr. I.e. if your indexing throughput is so great that it makes querying too slow then you have to scale back... I know of setups with 100+ separate clients all indexing to

Scaling data extractor with Solr

2016-10-03 Thread Steven White
Hi everyone, I'm up to speed about Solr on how it can be setup to provide high availability (if one Solr server goes down, the backup one takes over). My question is how do I make my custom crawler to play "nice" with Solr in this environment. Let us say I setup Solr with 3 servers so that if on