Thanks shalin..
Sorry i forgot to mention the verison.. 4.6.1 + tomcat6 + zookeeper 3.4.5
Thanks,
Venkat Paranjothi
Kenexa 2xB Software Engineering Team
Phone: 1-978-899-2746
E-mail: vpara...@us.ibm.com
From: Shalin Shekhar Mangar <shalinman...@gmail.com>
To: solr-user@lucene.apache.org
Date: 12/11/2015 03:18 PM
Subject: Re: Unable to create lot of cores -- Failing after 100 cores
Which version of Solr are you using? As Erick, said, use the latest 5.3.1
release, it is much more better in handling many collections.
On Sat, Dec 12, 2015 at 1:39 AM, Venkat Paranjothi <vpara...@us.ibm.com>
wrote:
> Thanks Eric,
>
> This is what we did to the zookeeper and solr settings.. Still, we are
not
> seeing the improvement in the collection creation.. it takes lot of time
to
> see the collection on the Solrcloud.
>
> added the following line in zkServer.sh
>
> export JVMFLAGS="$JVMFLAGS -Xms256m -Xmx1g -Djute.maxBuffer=10485760"
>
> added the following into catalina.sh
> JAVA_OPTS="$JAVA_OPTS -Dsolr.solr.home=/opt/apache_solr/installed/solr
> -Dport=8080 -DhostContext=solr -Dsolr.Data.dir=/solr/dataidx
> -Djute.maxBuffer=10485760 -DzkClientTimeout=200000
> -DzkHost=x.x.x.x:2181,y.y.y.y:2181,z.z.z.z:2181
> -Dcollection.configname=collection_configuration_v1"
>
>
> *Here is my zoo.cfg settings*
>
> # The number of milliseconds of each tick
> tickTime=3000
>
> # The number of ticks that the initial synchronization phase can take
> initLimit=200
>
> maxClientCnxns=0
>
> # The number of ticks that can pass between
> # sending a request and getting an acknowledgement
> syncLimit=50
>
> # the directory where the snapshot is stored.
> # Choose appropriately for your environment
> dataDir=/opt/apache_solr/solrcloud/zookeeper_data
>
> # the port at which the clients will connect
> clientPort=2181
>
> # the directory where transaction log is stored.
> # this parameter provides dedicated log device for ZooKeeper
> dataLogDir=/opt/apache_solr/solrcloud/zookeeper_log
>
> # ZooKeeper server and its port no.
> # ZooKeeper ensemble should know about every other machine in the
ensemble
> # specify server id by creating 'myid' file in the dataDir
> # use hostname instead of IP address for convenient maintenance
> server.1=x.x.x.x:2888:3888
> server.2=y.y.y.y:2888:3888
> server.3=z.z.z.z:2888:3888
>
>
>
> Thanks,
>
> *Venkat Paranjothi*
> Kenexa 2xB Software Engineering Team
> ------------------------------
> *Phone:* 1-978-899-2746
> *E-mail:* *vpara...@us.ibm.com* <vpara...@us.ibm.com>
>
>
>
>
> [image: Inactive hide details for Erick Erickson ---12/11/2015 01:16:57
> PM---A quick Google search shows the following: "you must set -]Erick
> Erickson ---12/11/2015 01:16:57 PM---A quick Google search shows the
> following: "you must set -Djute.maxbuffer in zookeeper and solr..."
>
> From: Erick Erickson <erickerick...@gmail.com>
> To: solr-user <solr-user@lucene.apache.org>
> Date: 12/11/2015 01:16 PM
> Subject: Re: Unable to create lot of cores -- Failing after 100 cores
> ------------------------------
>
>
>
> A quick Google search shows the following:
>
> "you must set -Djute.maxbuffer in zookeeper and solr..."
>
> What have you tried? What were the results?
>
> What version of Solr are you using? 5.x defaults to
> an individual state.json file per collection rather than
> one big one for all collections, that will also help.
>
> Best,
> Erick
>
> On Fri, Dec 11, 2015 at 8:40 AM, Venkat Paranjothi <vpara...@us.ibm.com>
> wrote:
> > Hello all,
> >
> > We need to create around 300 collections with replication factor 2.
But
> > after creating 100, we couldn't create more and most of them are in RED
> > state in the solrcloud.
> >
> > Is this issue related to zookeeper jute.maxBuffer issue? If so, how
can
> > we increase the size of zookeeper maxbuffer and memory size.
> >
> > Thanks
> > Venkat
>
>
>
>
--
Regards,
Shalin Shekhar Mangar.
