Thanks Eric,
This is what we did to the zookeeper and solr settings.. Still, we are
not seeing the improvement in the collection creation.. it takes lot of
time to see the collection on the Solrcloud.
added the following line in zkServer.sh
export JVMFLAGS="$JVMFLAGS -Xms256m -Xmx1g -Djute.maxBuffer=10485760"
added the following into catalina.sh
JAVA_OPTS="$JAVA_OPTS -Dsolr.solr.home=/opt/apache_solr/installed/solr
-Dport=8080 -DhostContext=solr -Dsolr.Data.dir=/solr/dataidx
-Djute.maxBuffer=10485760 -DzkClientTimeout=200000
-DzkHost=x.x.x.x:2181,y.y.y.y:2181,z.z.z.z:2181
-Dcollection.configname=collection_configuration_v1"
Here is my zoo.cfg settings
# The number of milliseconds of each tick
tickTime=3000
# The number of ticks that the initial synchronization phase can take
initLimit=200
maxClientCnxns=0
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=50
# the directory where the snapshot is stored.
# Choose appropriately for your environment
dataDir=/opt/apache_solr/solrcloud/zookeeper_data
# the port at which the clients will connect
clientPort=2181
# the directory where transaction log is stored.
# this parameter provides dedicated log device for ZooKeeper
dataLogDir=/opt/apache_solr/solrcloud/zookeeper_log
# ZooKeeper server and its port no.
# ZooKeeper ensemble should know about every other machine in the ensemble
# specify server id by creating 'myid' file in the dataDir
# use hostname instead of IP address for convenient maintenance
server.1=x.x.x.x:2888:3888
server.2=y.y.y.y:2888:3888
server.3=z.z.z.z:2888:3888
Thanks,
Venkat Paranjothi
Kenexa 2xB Software Engineering Team
Phone: 1-978-899-2746
E-mail: vpara...@us.ibm.com
From: Erick Erickson <erickerick...@gmail.com>
To: solr-user <solr-user@lucene.apache.org>
Date: 12/11/2015 01:16 PM
Subject: Re: Unable to create lot of cores -- Failing after 100 cores
A quick Google search shows the following:
"you must set -Djute.maxbuffer in zookeeper and solr..."
What have you tried? What were the results?
What version of Solr are you using? 5.x defaults to
an individual state.json file per collection rather than
one big one for all collections, that will also help.
Best,
Erick
On Fri, Dec 11, 2015 at 8:40 AM, Venkat Paranjothi <vpara...@us.ibm.com>
wrote:
> Hello all,
>
> We need to create around 300 collections with replication factor 2. But
> after creating 100, we couldn't create more and most of them are in RED
> state in the solrcloud.
>
> Is this issue related to zookeeper jute.maxBuffer issue? If so, how can
> we increase the size of zookeeper maxbuffer and memory size.
>
> Thanks
> Venkat
