Transfer of Index Vs HTTP GET Vs Embedded Solr -- Urgent Help

2009-08-05 Thread Ninad Raut
Hi, I have a search engine on Solr. Also I have a remote web application which will be using the Solr Indexes for search. I have three scenarios: 1) Transfer the Indexes to the Remote Application. - This will reduce load on the actual solr server and make seraches faster. - Need to write

Re: 99.9% uptime requirement

2009-08-05 Thread Shalin Shekhar Mangar
On Thu, Aug 6, 2009 at 4:10 AM, Robert Petersen wrote: > Maintenance Questions: In a two slave one master setup where the two > slaves are behind load balancers what happens if I have to restart solr? > If I have to restart solr say for a schema update where I have added a > new field then what

Re: enablereplication does not work

2009-08-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
how is the replicationhandler configured? if there was no commit/optimize thhen it would show the version as '0' On Thu, Aug 6, 2009 at 5:50 AM, solr jay wrote: > Hi, > > http://localhost:8549/solr/replication?command=enablereplication > > does not seem working. After making the request, I run > >

Re: Limit of Index size per machine..

2009-08-05 Thread Silent Surfer
Hi, We initially went with Hadoop path, but as it is one more software based file system on top of the OS file system, we didn't get a buy in from our system Engineers. i.e In case if we run into any HDFS issues, SEs won't be supporting us :( Regards, sS --- On Thu, 8/6/09, Walter Underwood

Re: Limit of Index size per machine..

2009-08-05 Thread Walter Underwood
That is why people don't use search engines to manage logs. Look at a Hadoop cluster. wunder On Aug 5, 2009, at 10:08 PM, Silent Surfer wrote: Hi, That means we need approximately 3000 GB (Index Size)/24 GB (RAM) = 125 servers. It would be very hard to convince my org to go for 125 ser

Re: Limit of Index size per machine..

2009-08-05 Thread Silent Surfer
Hi, That means we need approximately 3000 GB (Index Size)/24 GB (RAM) = 125 servers. It would be very hard to convince my org to go for 125 servers for log management of 3 Terabytes of indexes. Has any one used, solr for processing and handling of the indexes of the order of 3 TB ? If so h

enablereplication does not work

2009-08-05 Thread solr jay
Hi, http://localhost:8549/solr/replication?command=enablereplication does not seem working. After making the request, I run http://localhost:8549/solr/replication?command=indexversion and here is the response: 0 0 0 0 Notice the indexversion is 0, which is the value after you disable re

RE: 99.9% uptime requirement

2009-08-05 Thread Robert Petersen
Maintenance Questions: In a two slave one master setup where the two slaves are behind load balancers what happens if I have to restart solr? If I have to restart solr say for a schema update where I have added a new field then what is the recommended procedure? If I can guarantee no commits or o

Re: Limit of Index size per machine..

2009-08-05 Thread Ian Connor
I try to keep the index directory size less than the amount of RAM and rely on the OS to cache as it needs. Linux does a pretty good job here and I am sure OS X will do a good job also. Distributed search here will be your friend so you can chunk it up to a number of servers to keep your cost down

Re: sole 1.3: bug in phps response writer

2009-08-05 Thread Poohneat
Hey Otis, I don't think this issue has been solved yet. I am working with Solr 1.3 release and yet i get the same exception as the original post. I have Solr 1.3 release with the localsolr jars. Any advice is helpful ... for now i will use the json response writer and work around this bug. T

Limit of Index size per machine..

2009-08-05 Thread Silent Surfer
Hi , We are planning to use Solr for indexing the server log contents. The expected processed log file size per day: 100 GB We are expecting to retain these indexes for 30 days (100*30 ~ 3 TB). Can any one provide what would be the optimal size of the index that I can store on a single server,

Re: THIS WEEK: PNW Hadoop, HBase / Apache Cloud Stack Users' Meeting, Wed Jul 29th, Seattle

2009-08-05 Thread Bradford Stephens
A big "thanks" to everyone who came out despite the heat! Hope to see you again the last week of August, probably at UW. On Wed, Jul 29, 2009 at 4:52 PM, Bradford Stephens wrote: > Don't forget this is tonight! Excited to see everyone there. > > On Tue, Jul 28, 2009 at 11:25 AM, Bradford > Stephen

Re: Wild card search does not return any result

2009-08-05 Thread Mohamed Parvez
looks like earlier schema.xml, has some typo. below is the correct schema.xml 3] schema.xml .. .. .. .. wrote: > Thanks O

Re: Wild card search does not return any result

2009-08-05 Thread Mohamed Parvez
Thanks Otis and Avlesh, Below is the configuration I have 1] solrconfig.xml . explicit false false 1 spellcheck . . data-import.xml .. .. textSpell default SPELL

Re: Index rebuilding.

2009-08-05 Thread Shalin Shekhar Mangar
On Wed, Aug 5, 2009 at 8:21 PM, caezar wrote: > > Hi All, > > Am I right, when I say, that solr index is rebuild, when 'commit' command > send? > Let's suppose yes. For instance, I have solr index with 1M document, and > then I'm committing one more million documents. Here is some questions: > -

Re: DisMax - fetching dynamic fields

2009-08-05 Thread Alexey Serba
My bad! Please disregard this post. Alex On Tue, Aug 4, 2009 at 9:21 PM, Alexey Serba wrote: > Solr 1.4 built from trunk revision 790594 ( 02 Jul 2009 ) > > On Tue, Aug 4, 2009 at 9:19 PM, Alexey Serba wrote: >> Hi everybody, >> >> I have a couple of dynamic fields in my schema, e.g. rating_* pop

Index rebuilding.

2009-08-05 Thread caezar
Hi All, Am I right, when I say, that solr index is rebuild, when 'commit' command send? Let's suppose yes. For instance, I have solr index with 1M document, and then I'm committing one more million documents. Here is some questions: - will this (second) commit took longer then first one? much lon

SolrJ and ISO-8859-1

2009-08-05 Thread Schilperoort , René
Hello, Is it possible to change the encoding of the SolrJ request and response? Regards, Rene

help getting started with spell check dictionary

2009-08-05 Thread Ian Connor
Hi, I have downloaded a dictionary in plane text format from http://icon.shef.ac.uk/Moby/mwords.html and added it to my /mnt directory. When I tried to add: external org.apache.solr.spelling.FileBasedSpellChecker /mnt/dictionary.txt text

mergeContiguous for multiple search terms

2009-08-05 Thread Hachmann, Bjoern
Hello, we would like to use the highlightingComponent with the mergeContiguous parameter set to true. We have a field with value: Ökonom Charles Goodhart. If we search for all three words, they are found correctly: Ökonom Charles Goodhart But, as I set the mergeContiguous parameter to tr

Re: ClassCastException from custom request handler

2009-08-05 Thread James Brady
OK, problem solved! Well, worked around. I gave up on the new style plugin loading in a multicore Jetty setup, and packaged up my plugin in a rebuilt solr.war. I had tried this before, but only putting the class files in WEB-INF/lib. If I put a jar file in there, it works. 2009/8/4 Chantal Acker

query matching issue

2009-08-05 Thread Radha C.
Hello list, I have documents contain word "Richard Nass". I need to match the "Richard Nass" documents for the query strings "richard", "nass", "rich". The search works for the following queries , http://localhost:8983/solr/select?q=auth

Re: DataImportHandler: Partial Delete and Update (Hacking "deleteQuery" in SOLR 1.3?)

2009-08-05 Thread Chantal Ackermann
Thanks, Paul! :-) The wiki doesn't mark $deleteDocByQuery (and the other special commands) as 1.4, as it usually does. Maybe it's worth correcting that? Noble Paul നോബിള്‍ नोब्ळ् schrieb: ok, writing an EntityProcessor/Transofrmer may help here use the special command http://wiki.apache.org/s

Re: DataImportHandler: Partial Delete and Update (Hacking "deleteQuery" in SOLR 1.3?)

2009-08-05 Thread Chantal Ackermann
Hi Paul, yes, I did and I just verified in the code. The deletedPkQuery is used to collect all primary keys of the root entity that shall be deleted from the index. The deletion is done on the SOLR writer by unique ID: writer.deleteDoc(deletedKey.get(root.pk)); //DocBuilder delCm

query matching issue

2009-08-05 Thread Radha C.
Hello list, I have documents contains word "Richard Nass". I need to match the "Richard Nass" documents for the query strings "richard", "nass", "rich". The search works for the following query , http://localhost:8983/solr/select?q=author:Richard

Re: change sort order for MoreLikeThis

2009-08-05 Thread Renz Daluz
Oh and yes, I tried to sort that is not mlt field and it's not taking effect: Here the whole parameters that I'm using: mlt.fl=text,title&tie=0.01&mlt.mintf=1&mlt.match.include=true&fl=tagged_bucket,tagged_entities&bf=recip(rord(time_published),1,1000,165)^1500&qt=mlt&mlt.minwl=3&mm=5&mlt.boost=tr

Re: change sort order for MoreLikeThis

2009-08-05 Thread Renz Daluz
Thanks guys. I tried to boost it instead (as sort looks like not supported) but it's not taking effect. Here are the parameters that I'm using: I want to boost by time_published field and I enable mlt.boost &bf=recip(rord(time_published),1,1000,165)^1500&qt=mlt&mlt.boost=true Regards, /Renz 2