I'm curious, could you elaborate on the issue and the partial fix?
Thanks!
On 10/27/14 11:31, Markus Jelsma wrote:
It is an ancient issue. One of the major contributors to the issue was resolved
some versions ago but we are still seeing it sometimes too, there is nothing to
see in the logs. We ignore it and just reindex.
-----Original message-----
From:S.L <simpleliving...@gmail.com>
Sent: Monday 27th October 2014 16:25
To: solr-user@lucene.apache.org
Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out of
synch.
Thank Otis,
I have checked the logs , in my case the default catalina.out and I dont
see any OOMs or , any other exceptions.
What others metrics do you suggest ?
On Mon, Oct 27, 2014 at 9:26 AM, Otis Gospodnetic <
otis.gospodne...@gmail.com> wrote:
Hi,
You may simply be overwhelming your cluster-nodes. Have you checked
various metrics to see if that is the case?
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Oct 26, 2014, at 9:59 PM, S.L <simpleliving...@gmail.com> wrote:
Folks,
I have posted previously about this , I am using SolrCloud 4.10.1 and
have
a sharded collection with 6 nodes , 3 shards and a replication factor
of 2.
I am indexing Solr using a Hadoop job , I have 15 Map fetch tasks , that
can each have upto 5 threds each , so the load on the indexing side can
get
to as high as 75 concurrent threads.
I am facing an issue where the replicas of a particular shard(s) are
consistently getting out of synch , initially I thought this was
beccause I
was using a custom component , but I did a fresh install and removed the
custom component and reindexed using the Hadoop job , I still see the
same
behavior.
I do not see any exceptions in my catalina.out , like OOM , or any other
excepitions, I suspecting thi scould be because of the multi-threaded
indexing nature of the Hadoop job . I use CloudSolrServer from my java
code
to index and initialize the CloudSolrServer using a 3 node ZK ensemble.
Does any one know of any known issues with a highly multi-threaded
indexing
and SolrCloud ?
Can someone help ? This issue has been slowing things down on my end for
a
while now.
Thanks and much appreciated!
