Re: Questions about integrateing SolrCloud with HDFS

2013-12-29 Thread Mark Miller
We have a few ideas we may end up working on. I'm going to start the implementation of the first idea pretty soon - I'll create a JIRA issue which will be the best way to keep tabs on the progress. I don't expect an initial implementation to take long. That's for something akin to the HBase region

Re: Questions about integrateing SolrCloud with HDFS

2013-12-29 Thread YouPeng Yang
Hi Mark Are there have roadmap or plan about your futher work on Solr and with. I do anticipate your great work. Regards 2013/12/27 Mark Miller > 1. The exception and change in experience on the move to 4.6 seems like it > could be a bug we want to investigate. > > 2. Solr storing data on

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Mark Miller
1. The exception and change in experience on the move to 4.6 seems like it could be a bug we want to investigate. 2. Solr storing data on hdfs in other ways seems like a different issue / improvement. 3. You shouldn't try and force more than one core to use the same index on hdfs. This would

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Greg Walters
Mark, I'd be happy to but some clarification first; should this issue be about creating cores with overlapping names and the stack trace that YouPeng initially described, Solr's behavior when storing data on HDFS or YouPeng's other thread (Maybe a bug for solr 4.6 when create a new core) that l

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Mark Miller
Cloudera has plans here. I'll be working on further hdfs / Solrcloud options in the near future. - Mark > On Dec 26, 2013, at 11:33 AM, Greg Walters wrote: > > YouPeng, > > While I'm unable to help you with the issue that you're seeing I did want to > comment here and say that I have previo

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Mark Miller
Can you file a JIRA issue? - Mark > On Dec 24, 2013, at 2:57 AM, YouPeng Yang wrote: > > Hi users > > Solr supports for writing and reading its index and transaction log files > to the HDFS distributed filesystem. > **I am curious about that there are any other futher improvement about > the

Re: Questions about integrateing SolrCloud with HDFS

2013-12-26 Thread Greg Walters
YouPeng, While I'm unable to help you with the issue that you're seeing I did want to comment here and say that I have previously brought up the same goal that you're trying to accomplish on this mailing list but received no feedback or input. I think it makes sense that Solr should not try to