Re: Solr feasibility with terabyte-scale data

2008-05-10 Thread Marcus Herou
Thanks Ken. I will take a look be sure of that :) Kindly //Marcus On Fri, May 9, 2008 at 10:26 PM, Ken Krugler <[EMAIL PROTECTED]> wrote: > Hi Marcus, > > It seems a lot of what you're describing is really similar to MapReduce, >> so I think Otis' suggestion to look at Hadoop is a good one: i

Re: Solr feasibility with terabyte-scale data

2008-05-10 Thread Marcus Herou
Hi Otis. Thanks for the insights. Nice to get feedback from a technorati guy. Nice to see that the snippet of yours is almost a copy of mine, gives me the right stomach feeling about this :) I'm quite familiar with Hadoop as you can see if you check out the code of my OS project AbstractCache-> h

Re: token concat filter?

2008-05-10 Thread Chris Hostetter
: I guess not. I've been reading the wiki, but the trouble with wiki's always : seems to be (for me) finding stuff. can you point it out? just search the wiki for "synonyms" (admitedly, the fact that by default it only searches titles and you have to click "text" to search the full wiki is an

Re: Multicore and SolrResourceLoader

2008-05-10 Thread Chris Hostetter
: I've been digging around in multicore and I am curious as to how to force a : reload of the sharedLib classloader. I can reload a given core, which : instantiates a new SolrResourceLoader for that core, but I want to be able to : reload the classloader for the sharedLib. that seems really dang

Re: exceeded limit of maxWarmingSearchers

2008-05-10 Thread Chris Hostetter
: On a solr instance where I am in the process of indexing moderately large : number of documents (300K+). There is no querying of the index taking place : at all. : I don't understand what operations are causing new searchers to warm, or how : to stop them from doing so. I'd be happy to provide

Re: Missing content Stream

2008-05-10 Thread Chris Hostetter
1) Posting the exact same question twice because you didn't get a reply in the first 8 hours isn't going to encourage people to reply faster. best case scenerio: you waste people's time they could be spending reading another email; worst case scnerio: you irk people and put them in a bad mood

Re: JSON updates?

2008-05-10 Thread Chris Hostetter
: I was wondering if xml is the only format used for updating Solr documents : or can JSON or Ruby be used as well ? Solr ships with two "RequestHandlers" for processing updates -- the XMLRequestHandler and the CSVRequestHandler. some others are in Jira (RichDocumentUpdateHandler and DateImpor

Re: Simple Solr POST using java

2008-05-10 Thread Chris Hostetter
: please post a snippet of Java code to add a document to the Solr index that : includes the URL reference as a String? you mean like this one... :) http://svn.apache.org/viewvc/lucene/solr/trunk/src/java/org/apache/solr/util/SimplePostTool.java?view=markup FWIW: if you want to talk to Solr f

Field Filtering that Varies per Query

2008-05-10 Thread Nathan Woodhull
I have an interesting query filter problem. The application that I am working on contains a directory of user profiles that acts a lot like a social networking site. Each user profile is composed of a set of fields (first_name, last_name, bio, phone_number, etc). Every user profile field is associ

Re: Simple Solr POST using java

2008-05-10 Thread climbingrose
Agree. I've been using Solrj on product site for 9 months without any problem at all. You should probably give it a try instead of dealing with all those low level details. On Sun, May 11, 2008 at 4:14 AM, Chris Hostetter <[EMAIL PROTECTED]> wrote: > > : please post a snippet of Java code to add