Hi,

 

Any help on this please?

 

Thanks & Regards

Vijay

 

From: Vijay Bhoomireddy [mailto:vijaya.bhoomire...@whishworks.com] 
Sent: 14 August 2015 18:03
To: solr-user@lucene.apache.org
Subject: Issue while setting Solr on Slider / YARN

 

Hi,

 

We have a requirement of setting up of Solr Cloud to work along with Hadoop.
Earlier, I could setup a SolrCloud cluster separately alongside the Hadoop
cluster i.e. it looks like two logical  clusters sitting next to each other,
both relying on HDFS.

 

However, the experiment now I am trying to do is to install SolrCloud on
YARN using Apache Slider. I am following LucidWorks blog at
https://github.com/LucidWorks/solr-slider for the same. I already have a
Hortonworks HDP cluster. When I try to setup Solr on my HDP cluster using
Slider, I am facing some issues.

 

As per the blog, I have performed the below steps:

 

1.       I have setup a single node HDP cluster for which the hostname is
myhdpcluster.com with all the essential services including ZooKeeper and
Slider running on it.

2.       Updated the resource manager address and port in slider-client.xml
present under /var/hdp/current/slider/conf

<property>

        <name>yarn.resourcemanager.address</name>

<value> myhdpcluster.com:8032</value>

</property>

3.       Cloned the LucidWorks git and moved it under /user/hdfs/solr-slider

4.       Downloaded solr latest stable distribution and renamed it as
solr.tgz and placed it under /user/hdfs/solr-slider/package/files/solr.tgz

5.       Next ran the following command from within the
/user/hdfs/solr-slider folder

zip -r solr-on-yarn.zip metainfo.xml package/

6.       Next ran the following command as hdfs user

slider install-package --replacepkg --name solr --package
/user/hdfs/solr-slider/solr-on-yarn.zip

7.       Modified the following settings in the
/user/hdfs/solr-slider/appConfig-default.json file

"java_home": MY_JAVA_HOME_LOCATION

    "site.global.app_root": "${AGENT_WORK_ROOT}/app/install/solr-5.2.1",
(Should this be changed to any other value?)

    "site.global.zk_host": " myhdpcluster.com:2181",

8.       Set yarn.component.instances to 1 in resources-default.json file

9.       Next ran the following command

slider create solr --template /user/hdfs/solr-slider/appConfig-default.json
--resources /user/hdfs/solr-slider/resources-default.json

 

During this step, I am seeing an message INFO client.RMProxy - Connecting to
ResourceManager at myhdpcluster.com/10.0.2.15:8032 

 
INFO ipc.Client - Retrying connect to server:
myhdpcluster.com/10.0.2.15:8032. Already tried 0 time(s); 

 

This message keeps repeating for 50 times and then pauses for a couple of
seconds and then prints the same message in a loop eternally. Not sure on
where the problem is.

 

Can anyone please help me out to get away from this issue and help me setup
Solr on Slider/YARN?

 

Thanks & Regards

Vijay


-- 
The contents of this e-mail are confidential and for the exclusive use of 
the intended recipient. If you receive this e-mail in error please delete 
it from your system immediately and notify us either by e-mail or 
telephone. You should not copy, forward or otherwise disclose the content 
of the e-mail. The views expressed in this communication may not 
necessarily be the view held by WHISHWORKS.

Reply via email to