Detailed Steps for Scaling Solr

2011-02-11 Thread Bing Li
Dear all, I need to construct a site which supports searching for a large index. I think scaling Solr is required. However, I didn't get a tutorial which helps me do that step by step. I only have two resources as references. But both of them do not tell me the exact operations. 1) http://www.luc

Re: Title index to wiki

2011-02-11 Thread Dennis Gearon
Please show me this link: http://wiki.apache.org/solr/TitleIndex On this page: http://wiki.apache.org/solr/ (where I said it would be a good idea) Or this page: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters (selected at random) It's one thing to know that the tit

more like this

2011-02-11 Thread lee carroll
Hi a MLT query with a q parameter which returns multiple matches such as q=id:45 id:34 id:54&mlt.fl=filed1&mlt.mindf=1&mlt.mintf=1&mlt=true&fl=id,name seems to return the results of three seperate mlt queries ie q=id:45 &mlt.fl=filed1&mlt.mindf=1&mlt.mintf=1&mlt=true&fl=id,name + q=id:34 &mlt.fl

Re: Monitor the QTime.

2011-02-11 Thread Stijn Vanhoorelbeke
2011/2/11 Ryan McKinley > You may want to check the stats via JMX. For example, > > > http://localhost:8983/solr/core/admin/mbeans?stats=true&key=org.apache.solr.handler.StandardRequestHandler > > shows some basic stats info for the handler. > ryan Can you access this URL from a web browser (t

Re: help with dismax query

2011-02-11 Thread Tanner Postert
I think I found the answer here: http://www.mail-archive.com/solr-user@lucene.apache.org/msg04433.html I think the title and description fields did not have the stopword filter applied to it, so it was causing an error. When I

Re: Monitor the QTime.

2011-02-11 Thread Stijn Vanhoorelbeke
> QTime is, of course, specific to the query, but it is returned in the > response XML, so one could run occasional queries to figure it out. > Please see http://wiki.apache.org/solr/SearchHandler > > Regards, > Gora > Yes, this could be a possibility. But then the Solr cache jumps back into the p

Re: help with dismax query

2011-02-11 Thread Tanner Postert
looks like that might be the case, if I just do a search for "with" including the dismax parameters, it returns no results, as opposed to a search for 'obsessed' does return results. Is there any way I can get around this behavior? or do I have something configured wrong? > > Might "with" be a sto

Re: boosting results by a query?

2011-02-11 Thread Sujit Pal
We are currently a Lucene shop, the way we do it (currently) is to have these results come from a database table (where it is available in rank order). We want to move to Solr, so what I plan on doing to replicate this functionality is to write a custom request handler that will do the database que

Re: Solr design decisions

2011-02-11 Thread Bill Bell
Thanks. If you do 2 commits should it do anything? Are people using it to clear caches? Bill Bell Sent from mobile On Feb 11, 2011, at 9:55 AM, Yonik Seeley wrote: > On Fri, Feb 11, 2011 at 10:47 AM, Bill Bell wrote: >> You could commit on a time schedule. Like every 5 mins. If there is no

Re: Monitor the QTime.

2011-02-11 Thread Ryan McKinley
You may want to check the stats via JMX. For example, http://localhost:8983/solr/core/admin/mbeans?stats=true&key=org.apache.solr.handler.StandardRequestHandler shows some basic stats info for the handler. If you are running nagios or similar, they have tools that can log values from JMX. this

boosting results by a query?

2011-02-11 Thread Ryan McKinley
I have an odd need, and want to make sure I am not reinventing a wheel... Similar to the QueryElevationComponent, I need to be able to move documents to the top of a list that match a given query. If there were no sort, then this could be implemented easily with BooleanQuery (i think) but with so

help with dismax query

2011-02-11 Thread Tanner Postert
I'm having a problem using the dismax query. For example: for the term "obsessed with winning" I use: http://localhost:8983/solr/core1/select?q=obsessed+with+winning&fq=code:xyz&shards=localhost:8983/solr/core1,localhost:8983/solr/core2,&rows=10&start=0&defType=dismax&qf=title ^10+description^4+te

Re: help with dismax query

2011-02-11 Thread Erik Hatcher
Might "with" be a stop word removed by one of those qf fields? That'd explain why mm=3 doesn't work, I think. Erik On Feb 11, 2011, at 15:43 , Tanner Postert wrote: > I'm having a problem using the dismax query for the term "obsessed with > winning" > > http://localhost:8983/solr/core

help with dismax query

2011-02-11 Thread Tanner Postert
I'm having a problem using the dismax query for the term "obsessed with winning" http://localhost:8983/solr/core1/select?q=obsessed+with+winning&fq=code:xyz&shards=localhost:8983/solr/core1,localhost:8983/solr/core2,&rows=10&start=0&defType=dismax&qf=title ^10+description^4+text^1&debugQuery=true

solr1.4 replication question

2011-02-11 Thread Mike Franon
Hi, I am fairly new to solr, and have setup two servers, one with master, other as a slave. I have a load balancer in front with 2 different VIP, one to do gets/reads distributed evenly on the master and slave, and another VIP to do posts/updates just to the master. If the master fails I have th

Re: Monitor the QTime.

2011-02-11 Thread Gora Mohanty
On Fri, Feb 11, 2011 at 3:40 AM, Stijn Vanhoorelbeke wrote: > Hi, > > Is it possible to monitor the QTime of the queries. > I know I could enable logging - but then all of my requests are logged, > making big&nasty logs. > > I just want to log the QTime periodically, lets say once every minute. >

Re: Fatal error when posting to Solr

2011-02-11 Thread Erik Hatcher
That's an incorrect way to POST PDF files (though maybe the latest work on post.jar makes it possible, but would require additional parameters). In order to index PDF files, you'll need to script an iteration over all files and POST them in (or stream them however is most reasonable for your en

Re: Faceting Query

2011-02-11 Thread Gora Mohanty
On Thu, Feb 10, 2011 at 12:21 PM, Isha Garg wrote: > What is facet.pivot field? PLz explain with example Does http://wiki.apache.org/solr/SimpleFacetParameters#facet.pivot not help? Regards, Gora

Re: Faceting Query

2011-02-11 Thread Gora Mohanty
On Thu, Feb 10, 2011 at 12:00 PM, Isha Garg wrote: > Hi, >      What is the significance of copy field  when used in faceting . plz > explain with example. Not sure what you mean here. Could you provide details? Regards, Gora

Fatal error when posting to Solr

2011-02-11 Thread McGibbney, Lewis John
Hi list, Was attempting to check out the VelocityResponseWriter before I progress with customising it for my own usage, I seem to have opened a can of worms when posting documents to Solr. Using simple post command I get the following output. lewis@lewis-01:~/Downloads/apache-solr-1.4.1/example

Re: Solr design decisions

2011-02-11 Thread Yonik Seeley
On Fri, Feb 11, 2011 at 10:47 AM, Bill Bell wrote: > You could commit on a time schedule. Like every 5 mins. If there is nothing > to commit it doesn't do anything anyway. It does do something! A new searcher is opened and caches are invalidated, etc. I'd recommend normally using commitWithin i

RE: Alternative to Solrj

2011-02-11 Thread McGibbney, Lewis John
Hi Erik, This sounds much more like it. I have had a look at the wiki and it sounds like a logical approach to UI customisation. Thank you for this From: Erik Hatcher [erik.hatc...@gmail.com] Sent: 11 February 2011 14:12 To: solr-user@lucene.apache.org Sub

Re: Difference between Solr and Lucidworks distribution

2011-02-11 Thread Markus Jelsma
It is not free for production environments. http://www.lucidimagination.com/lwe/subscriptions-and-pricing On Friday 11 February 2011 17:31:22 Greg Georges wrote: > Hello all, > > I just started watching the webinars from Lucidworks, and they mention > their distribution which has an installer, et

Difference between Solr and Lucidworks distribution

2011-02-11 Thread Greg Georges
Hello all, I just started watching the webinars from Lucidworks, and they mention their distribution which has an installer, etc.. Is there any other differences? Is it a good idea to use this free distribution? Greg

Re: Solr design decisions

2011-02-11 Thread Bill Bell
You could commit on a time schedule. Like every 5 mins. If there is nothing to commit it doesn't do anything anyway. Bill Bell Sent from mobile On Feb 11, 2011, at 8:22 AM, Greg Georges wrote: > Hello all, > > I have just finished to book "Solr 1.4 Enterprise Search Server". I now > underst

Re: Title index to wiki

2011-02-11 Thread Markus Jelsma
What do you mean, there are two links to the Frontpage on each page. On Friday 11 February 2011 16:56:41 Dennis Gearon wrote: > I think it would be an improvement to the wikis if the link to the title > index were at the top of the index page of the wikis :-) I looked on that > index page & did no

Title index to wiki

2011-02-11 Thread Dennis Gearon
I think it would be an improvement to the wikis if the link to the title index were at the top of the index page of the wikis :-) I looked on that index page & did not see that link on that page. Who's got write access to wikis pages? Sent from Yahoo! Mail on Android

Re: Solr design decisions

2011-02-11 Thread Erick Erickson
Your users will have to accept some latency between changed permissions and those permissions being reflected in the results. The length of that latency is determined by two things: 1> the interval between when you send the change to Solr (i.e. re-index the doc) and issue a commit AND 2> the time i

Solr design decisions

2011-02-11 Thread Greg Georges
Hello all, I have just finished to book "Solr 1.4 Enterprise Search Server". I now understand most of the basics of Solr and also how we can scale the solution. Our goal is to have a centralized search service for a multitude of apps. Our first application which we want to index, is a system in

RE: Solr suggestions

2011-02-11 Thread Thumuluri, Sai
Please let me know if there is any other information that could help. My request handler config is - - edismax explicit - - - edismax explicit 0.01 body^1.0 title^20.0 ts_vid_9_names^10.0 ts_vid_10_names^10.0 name^3.0 taxonomy_names^2.0 tags_h1^5.0 tags_h2_h3^3.0 tags

Re: Any contribs available for Range field type?

2011-02-11 Thread kenf_nc
True. And that's my temporary solution. But it's ugly code, even uglier queries. I may have several such fields in a single query. A PolyField solution would be so much more elegant and useful. I'm actually shocked more people don't need/want something like it. -- View this message in context:

Re: Solr suggestions

2011-02-11 Thread Erick Erickson
Well, you have to tell us how you're accessing the info and what's in your index. Please include the relevant schema file definitions and the calls you're making to get spelling suggestions. Best Erick On Fri, Feb 11, 2011 at 8:55 AM, Thumuluri, Sai wrote: > Good Morning, > I have implemented S

Re: Any contribs available for Range field type?

2011-02-11 Thread Erick Erickson
You can solve this as is by having a start and end field, rather than a range field. Then add a clause like +(+start:[* TO target] +end:[target TO *]) Best Erick On Fri, Feb 11, 2011 at 8:49 AM, kenf_nc wrote: > > I have a huge need for a new field type. It would be a Poly field, similar to > P

Re: solr admin result page error

2011-02-11 Thread Markus Jelsma
No i haven't located the issue. It might be Solr but it could also be Xerces having trouble with it. You can possibly work around the problem by using the JSONResponseWriter. On Friday 11 February 2011 15:45:23 Bernd Fehling wrote: > Hi Markus, > > yes it looks like the same issue. There is als

Re: solr admin result page error

2011-02-11 Thread Bernd Fehling
Hi Markus, yes it looks like the same issue. There is also a \u utf8-code in your dump. Till now I followed it into XMLResponseWriter. Some steps before the result in a buffer looks good and the utf8-code is correct. Really hard to debug this freaky problem. Have you looked deeper into this

FW: Alternative to Solrj

2011-02-11 Thread McGibbney, Lewis John
Only a thought, but maybe a better approach to me finding a solution would be for someone to explain the process undertaken by Solr after a query has been passed and how results are displayed. Hopefully this would enable me to think more laterally about how I may implement my ideas. It would be

Re: Alternative to Solrj

2011-02-11 Thread Erik Hatcher
Sounds like you just described the VelocityResponseWriter. On trunk (or 3.x I believe), try out http://localhost:8983/solr/browse and look at what makes that tick. Erik On Feb 11, 2011, at 08:40 , McGibbney, Lewis John wrote: > Hi list, > > I have been looking at an alternative UI co

Solr suggestions

2011-02-11 Thread Thumuluri, Sai
Good Morning, I have implemented Solr 1.4.1 in our UAT environment and I get weird suggestions for any misspellings. For instance when I search for "cabinet award winders" as opposed to "cabinet award winners", I get a suggestion of "cabinet abarc pindeks

Any contribs available for Range field type?

2011-02-11 Thread kenf_nc
I have a huge need for a new field type. It would be a Poly field, similar to Point or Payload. It would take 2 data elements and a search would return a hit if the search term fell within the range of the elements. For example let's say I have a document representing an Employment record. I may w

Alternative to Solrj

2011-02-11 Thread McGibbney, Lewis John
Hi list, I have been looking at an alternative UI config displaying retrieved results from Solr after a query has been passed. At this point, I am not interested in Solrj as all I wish to change is the default responseWriter (line 1007 of Solrconfig). I've also noticed a snippet of default CSS

RE: Turn off caching

2011-02-11 Thread Jagdish Vasani IN
I don't think there is option to disable cache in solrconfig.xml in Solr 1.4..You need to modify/change code at time of creating SolrIndexSearcher instance in class SorlCore. Thanks, Jagdish -Original Message- From: Isan Fulia [mailto:isan.fu...@germinait.com] Sent: Tuesday, February 08

Re: solr admin result page error

2011-02-11 Thread Markus Jelsma
It looks like you hit the same issue as i did a while ago: http://www.mail-archive.com/solr-user@lucene.apache.org/msg46510.html On Friday 11 February 2011 08:59:27 Bernd Fehling wrote: > Dear list, > > after loading some documents via DIH which also include urls > I get this yellow XML error pa

Re: solr admin result page error

2011-02-11 Thread Bernd Fehling
Results so far. I could locate and isolate the document causing trouble. I've checked the document with xmllint again. It is valid, well-formed utf8. I've loaded the single document and get the XML error if displaying the search result. This is through solr admin search and also JSON interface, p

Question about QueryParser and StandardAnalyzer

2011-02-11 Thread Ahsan |qbal
Hi All I am writing a custom QueryParserPlugin for solr to fulfill a specific requirement. Now when I Build query object, I need to feed that object with terms, for that I get analyzer from the request as Analyzer analyzer = req.getSchema().getField("TextField").getType().getAnalyzer() now in sc

Re: Turn off caching

2011-02-11 Thread Li Li
besides fieldCache, there is also a cache for termInfo. I don't know how to turn it off in both lucene and solr. codes in TermInfosReader /** Returns the TermInfo for a Term in the set, or null. */ TermInfo get(Term term) throws IOException { return get(term, true); } /** Returns the

solr admin result page error

2011-02-11 Thread Bernd Fehling
Dear list, after loading some documents via DIH which also include urls I get this yellow XML error page as search result from solr admin GUI after a search. It says XML processing error "not well-formed". The code it argues about is: http://eprints.soton.ac.uk/43350/ http://dx.doi.org/doi:10.11