Re: Confusion when using go-live and MapReduceIndexerTool

2014-04-23 Thread Mark Miller
Currently, go-live is only supported when you are running Solr on HDFS. bq. The indexes must exist on the disk of the Solr host This does not apply when you are running Solr on HDFS. It’s a shared filesystem, so local does not matter here. "no writes should be allowed on either core until the m

Re: Confusion when using go-live and MapReduceIndexerTool

2014-04-22 Thread Brett Hoerner
I think I'm just misunderstanding the use of go-live. From mergeindexes docs: "The indexes must exist on the disk of the Solr host, which may make using this in a distributed environment cumbersome." I'm guessing I'll have to write some sort of tool that pulls each completed index out of HDFS and

Re: Confusion when using go-live and MapReduceIndexerTool

2014-04-22 Thread Brett Hoerner
Anyone have any thoughts on this? In general, am I expected to be able to go-live from an unrelated cluster of Hadoop machines to a SolrCloud that isn't running off of HDFS? intput: HDFS output: HDFS go-live cluster: SolrCloud cluster on different machines running on plain MMapDirectory I'm back

Re: Confusion when using go-live and MapReduceIndexerTool

2014-04-17 Thread Brett Hoerner
https://gist.github.com/bretthoerner/0dc6bfdbf45a18328d4b On Thu, Apr 17, 2014 at 11:31 AM, Mark Miller wrote: > Odd - might be helpful if you can share your sorlconfig.xml being used. > > -- > Mark Miller > about.me/markrmiller > > On April 17, 2014 at 12:18:37 PM, Brett Hoerner (br...@brettho

Re: Confusion when using go-live and MapReduceIndexerTool

2014-04-17 Thread Mark Miller
Odd - might be helpful if you can share your sorlconfig.xml being used. --  Mark Miller about.me/markrmiller On April 17, 2014 at 12:18:37 PM, Brett Hoerner (br...@bretthoerner.com) wrote: I'm doing HDFS input and output in my job, with the following: hadoop jar /mnt/faas-solr.jar \ -D mapr