Hey Sameer,
I tried using the tool on hadoop master node (AWS EMR) like:
hadoop jar cloudera-search-1.0.0-cdh5.2.0-jar-with-dependencies.jar \
org.apache.solr.hadoop.MapReduceIndexerTool \
-D 'mapred.child.java.opts=-Xmx500m' \
--log4j ~/log4j.properties \
--morphline-file /home/hadoop/morphlines1.conf \
--output-dir hdfs://172.31.77.5:8020/tmp/outdir \
--input-list hdfs://172.31.77.5:8020/index_files/index_1.txt \
--verbose \
--solr-home-dir /home/hadoop/friending \
--shards 1 \
--dry-run
I have few doubts:
1) does the tool require solr to be installed on the machine? I see error
coming:
Exception in thread "main" org.apache.solr.common.SolrException: Error
loading class 'solr.NoOpRegenerator'
at
org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:449)
at
org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:471)
at
org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:467)
at org.apache.solr.search.CacheConfig.getConfig(CacheConfig.java:100)
at
org.apache.solr.search.CacheConfig.getMultipleConfigs(CacheConfig.java:73)
at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:198)
at
org.kitesdk.morphline.solr.SolrLocator.getIndexSchema(SolrLocator.java:168)
at
org.apache.solr.hadoop.morphline.MorphlineMapRunner.<init>(MorphlineMapRunner.java:134)
at
org.apache.solr.hadoop.MapReduceIndexerTool.setupMorphline(MapReduceIndexerTool.java:1154)
at
org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:794)
My content of friending/conf looks like:
hadoop@ip-172-31-77-5 22:42:18 ~ ls -ltr /home/hadoop/friending/conf/
total 80
-rw-r--r-- 1 hadoop hadoop 1119 Jan 29 20:34 synonyms.txt
-rw-r--r-- 1 hadoop hadoop 781 Jan 29 20:34 stopwords.txt
-rw-r--r-- 1 hadoop hadoop 873 Jan 29 20:34 protwords.txt
-rw-r--r-- 1 hadoop hadoop 1348 Jan 29 20:34 elevate.xml
-rw-r--r-- 1 hadoop hadoop 3974 Jan 29 20:34 currency.xml
-rw-r--r-- 1 hadoop hadoop 2572 Jan 29 20:39 schema.xml
drwxr-xr-x 2 hadoop hadoop 4096 Jan 29 20:42 lang
-rw-r--r-- 1 hadoop hadoop 49806 Jan 29 22:22 solrconfig.xml
I have been struggling to get this tool working. Any help would be
appreciated.
--
Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html
