eory
- Zookeeper logs.
From: S.L [mailto:simpleliving...@gmail.com]
Sent: Monday, October 27, 2014 1:42 PM
To: solr-user@lucene.apache.org
Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1
replicas out of synch.
Please find the clusterstate.json attached.
Also in this
he said you've
>>> saturated your environment. In AWS people just auto-scale up and don't
>>> worry about where the load comes from; its dumb if it happens more than 2
>>> times. Capacity planning is tough, let's hope it doesn't disappear
>>> a
AWS people just auto-scale up and don't
>>> worry about where the load comes from; its dumb if it happens more than 2
>>> times. Capacity planning is tough, let's hope it doesn't disappear
>>> altogether.
>>>
>>> G'luck
>>>
nt: Monday, October 27, 2014 9:25 PM
To: solr-user@lucene.apache.org
Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas
out of synch.
Good point about ZK logs , I do see the following exceptions
intermittently in the ZK log.
2014-10-27 06:54:14,621 [myid:1] - INFO [NIOServerCx
hope it doesn't disappear
> altogether.
>
> G'luck
>
>
> -Original Message-
> From: S.L [mailto:simpleliving...@gmail.com]
> Sent: Monday, October 27, 2014 9:25 PM
> To: solr-user@lucene.apache.org
> Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1
, let's hope it doesn't disappear altogether.
G'luck
-Original Message-
From: S.L [mailto:simpleliving...@gmail.com]
Sent: Monday, October 27, 2014 9:25 PM
To: solr-user@lucene.apache.org
Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out of
sy
line.
Fwiw.
-Original Message-
From: S.L [mailto:simpleliving...@gmail.com]
Sent: Monday, October 27, 2014 9:25 PM
To: solr-user@lucene.apache.org
Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out of
synch.
Good point about ZK logs , I do see the following exceptions inte
onday, October 27, 2014 1:42 PM
> To: solr-user@lucene.apache.org
> Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas
> out of synch.
>
>
>
> Please find the clusterstate.json attached.
>
> Also in this case atleast the Shard1 replicas are out of
2 naïve comments, of course.
- Queuing theory
- Zookeeper logs.
From: S.L [mailto:simpleliving...@gmail.com]
Sent: Monday, October 27, 2014 1:42 PM
To: solr-user@lucene.apache.org
Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out of
synch
gt; markus.jel...@openindex.io>
> > wrote:
> >
> > > Hi - if there is a very large discrepancy, you could consider to purge
> > the
> > > smallest replica, it will then resync from the leader.
> > >
> > >
> > > -Original message
eader.
> >
> >
> > -Original message-
> > > From:S.L
> > > Sent: Monday 27th October 2014 16:41
> > > To: solr-user@lucene.apache.org
> > > Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1
> replicas
> > out of synch.
iginal message-
> > From:S.L
> > Sent: Monday 27th October 2014 16:41
> > To: solr-user@lucene.apache.org
> > Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas
> out of synch.
> >
> > Markus,
> >
> > I would like to ignor
t; > > From:S.L
> > > Sent: Monday 27th October 2014 16:25
> > > To: solr-user@lucene.apache.org
> > > Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas
> > out of synch.
> > >
> > > Thank Otis,
> > >
> >
olved some versions ago but we are still seeing it sometimes too, there
> > is nothing to see in the logs. We ignore it and just reindex.
> >
> > -Original message-
> >> From:S.L
> >> Sent: Monday 27th October 2014 16:25
> >> To: solr-user@
are still seeing it sometimes too, there
> is nothing to see in the logs. We ignore it and just reindex.
>
> -Original message-
> > From:S.L
> > Sent: Monday 27th October 2014 16:25
> > To: solr-user@lucene.apache.org
> > Subject: Re: Heavy Multi-threaded i
logs. We ignore it and just reindex.
-Original message-
From:S.L
Sent: Monday 27th October 2014 16:25
To: solr-user@lucene.apache.org
Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out of
synch.
Thank Otis,
I have checked the logs , in my case the de
5
> To: solr-user@lucene.apache.org
> Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out
> of synch.
>
> Thank Otis,
>
> I have checked the logs , in my case the default catalina.out and I dont
> see any OOMs or , any other exceptions.
>
>
Thank Otis,
I have checked the logs , in my case the default catalina.out and I dont
see any OOMs or , any other exceptions.
What others metrics do you suggest ?
On Mon, Oct 27, 2014 at 9:26 AM, Otis Gospodnetic <
otis.gospodne...@gmail.com> wrote:
> Hi,
>
> You may simply be overwhelming your
Hi,
You may simply be overwhelming your cluster-nodes. Have you checked
various metrics to see if that is the case?
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
> On Oct 26, 2014, at 9:59 PM, S.L wrote:
>
>
OK, clarify a bit more what you're doing with Hadoop. Are you using
the MapReduceIndexerTool? Or are your Hadoop jobs writing directly to
SolrCloud?
How are you measuring "out of sync"? Are you sure that you've
committed? Does "out of synch" mean reporting different result counts?
Different order?
Folks,
I have posted previously about this , I am using SolrCloud 4.10.1 and have
a sharded collection with 6 nodes , 3 shards and a replication factor of 2.
I am indexing Solr using a Hadoop job , I have 15 Map fetch tasks , that
can each have upto 5 threds each , so the load on the indexing si
21 matches
Mail list logo
