The fact that the load remains even after indexing is stopped suggests that it
might be related to merges, but puzzling part is why single node. Your index
size is not trivial - 500GB/8 shards = ~60GB/shard, but that should be the case
on the other node as well. Maybe you could use some tool to
It takes more time after I stopped the indexing.
The load firstly was with the first node and after I restarted the indexing
process the load with changed to the second node the first node worked
properly.
Thanks,
Mahmoud
On Mon, Oct 16, 2017 at 5:29 PM, Emir Arnautović <
emir.arnauto...@semate
Does the load stops when you stop indexing or it last for some more time? Is it
always one node that behaves like this and it starts as soon as you start
indexing? Is load different between nodes when you are doing lighter indexing?
--
Monitoring - Log Management - Alerting - Anomaly Detection
S
The transition of the load happened after I restarted the bulk insert
process.
The size of the index on each server about 500GB.
There are about 8 warnings on each server for "Not found segment file" like
that
Error getting file length for [segments_2s4]
java.nio.file.NoSuchFileException:
/medi
I did not look at graph details - now I see that it is over 3h time span. It
seems that there was a load on the other server before this one and ended with
14GB read spike and 10GB write spike, just before load started on this server.
Do you see any errors or suspicious logs lines?
How big is yo
Yes, it's constantly since I started this bulk indexing process.
As you see the write operations on the loaded server are 3x the normal
server despite Disk writes not 3x times.
Mahmoud
On Mon, Oct 16, 2017 at 12:32 PM, Emir Arnautović <
emir.arnauto...@sematext.com> wrote:
> Hi Mahmoud,
> Is th
Hi Mahmoud,
Is this something that you see constantly? Network charts suggests that your
servers are loaded equally and as you said - you are not using routing so
expected. Disk read/write and CPU are not equal and it is expected to not be
equal during heavy indexing since it also triggers segme
Here are the screen shots for the two server metrics on Amazon
https://ibb.co/kxBQam
https://ibb.co/fn0Jvm
https://ibb.co/kUpYT6
On Mon, Oct 16, 2017 at 11:37 AM, Mahmoud Almokadem
wrote:
> Hi Emir,
>
> We doesn't use routing.
>
> Servers is already balanced and the number of documents on eac
Hi Emir,
We doesn't use routing.
Servers is already balanced and the number of documents on each shard are
approximately the same.
Nothing running on the servers except Solr and ZooKeeper.
I initialized the client as
String zkHost = "192.168.1.89:2181,192.168.1.99:2181";
CloudSolrClient solrC
Hi Mahmoud,
Do you use routing? Are your servers equally balanced - do you end up having
approximately the same number of documents hosted on both servers (counted all
shards)?
Do you have anything else running on those servers?
How do you initialise your SolrJ client?
Are documents of similar si
We've installed SolrCloud 7.0.1 with two nodes and 8 shards per node.
The configurations and the specs of the two servers are identical.
When running bulk indexing using SolrJ we see one of the servers is fully
loaded as you see on the images and the other is normal.
Images URLs:
https://ibb.co
11 matches
Mail list logo
