Dear Jack, Thank you. I am aware of datastax but I am looking for integrating accumulo with solr. This is something like what sqrrl guys offer. Regards.
On Thu, Jul 24, 2014 at 7:27 PM, Jack Krupansky <j...@basetechnology.com> wrote: > If you are not a "true hard-core gunslinger" who is willing to dive in and > integrate the code yourself, instead you should give serious consideration > to a product such as DataStax Enterprise that fully integrates and packages > a NoSQL database (Cassandra) and Solr for search. The security aspects are > still a work in progress, but certainly headed in the right direction. And > it has Hadoop and Spark integration as well. > > See: > http://www.datastax.com/what-we-offer/products-services/ > datastax-enterprise > > -- Jack Krupansky > > -----Original Message----- From: Ali Nazemian > Sent: Thursday, July 24, 2014 10:30 AM > To: solr-user@lucene.apache.org > Subject: Re: integrating Accumulo with solr > > > Thank you very much. Nice Idea but how can Solr and Accumulo can be > synchronized in this way? > I know that Solr can be integrated with HDFS and also Accumulo works on the > top of HDFS. So can I use HDFS as integration point? I mean set Solr to use > HDFS as a source of documents as well as the destination of documents. > Regards. > > > On Thu, Jul 24, 2014 at 4:33 PM, Joe Gresock <jgres...@gmail.com> wrote: > > Ali, >> >> Sounds like a good choice. It's pretty standard to store the primary >> storage id as a field in Solr so that you can search the full text in Solr >> and then retrieve the full document elsewhere. >> >> I would recommend creating a document structure in Solr with whatever >> fields you want indexed (most likely as text_en, etc.), and then store a >> "string" field named "content_id", which would be the Accumulo row id that >> you look up with a scan. >> >> One caveat -- Accumulo will be protected at the cell level, but if you >> need >> your Solr search results to be protected by complex authorization strings >> similar to Accumulo, you will need to write your own QParserPlugin and use >> post filtering: >> http://java.dzone.com/articles/custom-security-filtering-solr >> >> The code you see in that article is written for an earlier version of >> Solr, >> but it's not too difficult to adjust it for the latest (we've done so in >> our project). Once you've implemented this, you would store an >> "authorizations" string field in each Solr document, and pass in the >> authorizations that the user has access to in the fq parameter of every >> query. It's also not too bad to write something that parses the Accumulo >> authorizations string (like A&B&(C|D|E|F)) and interpret it accordingly in >> the QParserPlugin. >> >> This will give you true row level security in Solr and Accumulo, and it >> performs quite well in Solr. >> >> Let me know if you have any other questions. >> >> Joe >> >> >> On Thu, Jul 24, 2014 at 4:07 AM, Ali Nazemian <alinazem...@gmail.com> >> wrote: >> >> > Dear Joe, >> > Hi, >> > I am going to store the crawl web pages in accumulo as the main storage >> > part of my project and I need to give these data to solr for indexing > >> and >> > user searches. I need to do some social and web analysis on my data as >> well >> > as having some security features. Therefore accumulo is my choice for > >> the >> > database part and for index and search I am going to use Solr. Would you >> > please guide me through that? >> > >> > >> > >> > On Thu, Jul 24, 2014 at 1:28 AM, Joe Gresock <jgres...@gmail.com> >> wrote: >> > >> > > We store data in both Solr and Accumulo -- do you have more details >> about >> > > what kind of data and indexing you want? Is there a reason you're >> > thinking >> > > of using both databases in particular? >> > > >> > > >> > > On Wed, Jul 23, 2014 at 5:17 AM, Ali Nazemian <alinazem...@gmail.com> >> > > wrote: >> > > >> > > > Dear All, >> > > > Hi, >> > > > I was wondering is there anybody out there that tried to integrate >> Solr >> > > > with Accumulo? I was thinking about using Accumulo on top of HDFS > >> > > and >> > > using >> > > > Solr to index data inside Accumulo? Do you have any idea how can I >> > > > do >> > > such >> > > > integration? >> > > > >> > > > Best regards. >> > > > >> > > > -- >> > > > A.Nazemian >> > > > >> > > >> > > >> > > >> > > -- >> > > I know what it is to be in need, and I know what it is to have plenty. >> I >> > > have learned the secret of being content in any and every situation, >> > > whether well fed or hungry, whether living in plenty or in want. I > >> > can >> > do >> > > all this through him who gives me strength. *-Philippians 4:12-13* >> > > >> > >> > >> > >> > -- >> > A.Nazemian >> > >> >> >> >> -- >> I know what it is to be in need, and I know what it is to have plenty. I >> have learned the secret of being content in any and every situation, >> whether well fed or hungry, whether living in plenty or in want. I can do >> all this through him who gives me strength. *-Philippians 4:12-13* >> >> > > > -- > A.Nazemian > -- A.Nazemian
