Hi, observing lots of these errors with SolrCloud
Here is the instruction I am using to run services:
zookeeper:
1: cd /opt/zookeeper/
2: sudo bin/zkServer.sh start zoo1.cfg
3: sudo bin/zkServer.sh start zoo2.cfg
4: sudo bin/zkServer.sh start zoo3.cfg
shards:
1: cd /opt/solr-cluster/shard1/
sudo su solr -c "java -Xmx4096M
-DzkHost=localhost:2181,localhost:2182,localhost:2183
-Dbootstrap_confdir=./solr/conf -Dcollection.configName=Carmen -DnumShards=2
-jar start.jar etc/jetty.xml etc/jetty-logging.xml &"
2: cd ../shard2/
sudo su solr -c "java -Xmx4096M
-DzkHost=localhost:2181,localhost:2182,localhost:2183 -jar start.jar
etc/jetty.xml etc/jetty-logging.xml &"
replicas:
1: cd ../replica1/
sudo su solr -c "java -Xmx4096M
-DzkHost=localhost:2181,localhost:2182,localhost:2183 -jar start.jar
etc/jetty.xml etc/jetty-logging.xml &"
2: cd ../replica2/
sudo su solr -c "java -Xmx4096M
-DzkHost=localhost:2181,localhost:2182,localhost:2183 -jar start.jar
etc/jetty.xml etc/jetty-logging.xml &"
zoo1.cfg:
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
dataDir=/opt/zookeeper/data/1
# the port at which the clients will connect
clientPort=2181
server.1=localhost:2888:3888
server.2=localhost:2889:3889
server.3=localhost:2890:3890
zoo2.cfg and zoo3.cfg are the same except dataDir and client port
respectively.
Also very often I see: org.apache.solr.common.SolrException: No registered
leader was found and lots of other errors. Just updated jetty.xml and set
org.eclipse.jetty.server.Request.maxFormContentSize to 10MB and restarted
the cluster — half of errors gone, but this one about IOException still
here.
I am re-indexing a few models (rails application), they have from 1 000 000
to 20 000 000 of records. For indexing I have a queue (mongodb) and a few
workers which process it in batches of 200-500 records.
All Solr and Zookeeper instances are launched on the same server: 2 intel
xenon processors, 8 total cores, 32Gb of memory and rapid RAID storage.
Please help me to figure out what could be the reason for those errors and
how can fix them. Please tell me if I can provide some more information
about the server setup, logs, errors, etc.
Best,
Alex
<http://lucene.472066.n3.nabble.com/file/n4061831/Topology.png>
Shard 1:
<http://lucene.472066.n3.nabble.com/file/n4061831/Shard1.png>
Replica 1:
<http://lucene.472066.n3.nabble.com/file/n4061831/Replica1.png>
Shard 2:
<http://lucene.472066.n3.nabble.com/file/n4061831/Shard2.png>
Replica 2:
<http://lucene.472066.n3.nabble.com/file/n4061831/Replica2.png>
--
View this message in context:
http://lucene.472066.n3.nabble.com/ColrCloud-IOException-occured-when-talking-to-server-at-tp4061831.html
Sent from the Solr - User mailing list archive at Nabble.com.
