Large Query Strings and performance
I am using Solr 1.4 with large query strings with 20+ terms and faceting on a single multi-valued field in a 1 million record system. I am using Solr to categorize text, that why the query strings are big. The performance get's worse the more search terms are used. Is there any way I can improve performance? I've tried several shingling but it had no effect and tried everything in here http://wiki.apache.org/solr/SolrPerformanceFactors Is there anything else I can try? Will sharding help? -- View this message in context: http://old.nabble.com/Large-Query-Strings-and-performance-tp27233477p27233477.html Sent from the Solr - User mailing list archive at Nabble.com.
MoreLikeThis - How to pass in external text?
How can I have the MoreLikeThis query process a piece of text that is passed into the query. Currently I can only get it MoreLikeThis to work only for pieces of text that are already indexed by Solr. For example here is a query that works for using MoreLikeThis for document with id:134847893. http://localhost:8983/solr/select?mlt=true&q=id:134847893&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on How can I pass in some external text like 'Solr Rocks'. Below is an example of how it would look like. http://localhost:8983/solr/select?mlt=true&external.text=Solr Rocks&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on -- View this message in context: http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27266316.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: MoreLikeThis - How to pass in external text?
I want to use MoreLikeThis since i want to find text in the Solr data that is similar to the input text. I want to see how will this works against just a standard keyword search. I want to do something similar to the article below. http://www.bbc.co.uk/blogs/radiolabs/2008/06/wikipedia_plus_lucene_morelikethis.shtml In the article the author uses MoreLikeThis to classifiy text according into pre-existing categories. Otis Gospodnetic wrote: > > Hi, > > if you have text to pass in, why do you need MoreLikeThis? The text you > speak of can be used as a normal query, so pass it in as a regular > multi-word query. > > Otis > -- > Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch > > > > - Original Message >> From: ldung >> To: solr-user@lucene.apache.org >> Sent: Thu, January 21, 2010 8:08:41 PM >> Subject: MoreLikeThis - How to pass in external text? >> >> >> How can I have the MoreLikeThis query process a piece of text that is >> passed >> into the query. Currently I can only get it MoreLikeThis to work only for >> pieces of text that are already indexed by Solr. >> >> For example here is a query that works for using MoreLikeThis for >> document >> with id:134847893. >> >> http://localhost:8983/solr/select?mlt=true&q=id:134847893&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on >> >> How can I pass in some external text like 'Solr Rocks'. Below is an >> example >> of how it would look like. >> >> http://localhost:8983/solr/select?mlt=true&external.text=Solr >> Rocks&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on >> >> >> -- >> View this message in context: >> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27266316.html >> Sent from the Solr - User mailing list archive at Nabble.com. > > > -- View this message in context: http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27268777.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: MoreLikeThis - How to pass in external text?
David, thank you. This was what I was looking for! David Stuart-6 wrote: > > The MoreLikeThisHandler allows external text to be streamed to it see > http://wiki.apache.org/solr/MoreLikeThisHandler#Using_ContentStreams. The > url feature is quite good if you have a lot of text and start hitting the > character limit in the url > > Regards, > > Dave > > > On 22 Jan 2010, at 05:24, Otis Gospodnetic wrote: > >> Hi, >> >> Try what I suggested, please. >> >> Or, if you want, go to that (or any other) web page, copy a large chunk >> of its content, and paste it into Google/Yahoo/Bing. I just did that. >> Google said my query was too long, but Yahoo took it. Guess what hit #1 >> was? The page I copied the text from! Very much "more like this"-like. >> >> Otis >> -- >> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch >> >> >> >> - Original Message >>> From: ldung >>> To: solr-user@lucene.apache.org >>> Sent: Fri, January 22, 2010 12:08:26 AM >>> Subject: Re: MoreLikeThis - How to pass in external text? >>> >>> >>> I want to use MoreLikeThis since i want to find text in the Solr data >>> that is >>> similar to the input text. I want to see how will this works against >>> just a >>> standard keyword search. >>> >>> I want to do something similar to the article below. >>> http://www.bbc.co.uk/blogs/radiolabs/2008/06/wikipedia_plus_lucene_morelikethis.shtml >>> >>> In the article the author uses MoreLikeThis to classifiy text according >>> into >>> pre-existing categories. >>> >>> >>> >>> >>> Otis Gospodnetic wrote: >>>> >>>> Hi, >>>> >>>> if you have text to pass in, why do you need MoreLikeThis? The text >>>> you >>>> speak of can be used as a normal query, so pass it in as a regular >>>> multi-word query. >>>> >>>> Otis >>>> -- >>>> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch >>>> >>>> >>>> >>>> - Original Message >>>>> From: ldung >>>>> To: solr-user@lucene.apache.org >>>>> Sent: Thu, January 21, 2010 8:08:41 PM >>>>> Subject: MoreLikeThis - How to pass in external text? >>>>> >>>>> >>>>> How can I have the MoreLikeThis query process a piece of text that is >>>>> passed >>>>> into the query. Currently I can only get it MoreLikeThis to work only >>>>> for >>>>> pieces of text that are already indexed by Solr. >>>>> >>>>> For example here is a query that works for using MoreLikeThis for >>>>> document >>>>> with id:134847893. >>>>> >>>>> >>> http://localhost:8983/solr/select?mlt=true&q=id:134847893&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on >>>>> >>>>> How can I pass in some external text like 'Solr Rocks'. Below is an >>>>> example >>>>> of how it would look like. >>>>> >>>>> http://localhost:8983/solr/select?mlt=true&external.text=Solr >>>>> Rocks&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on >>>>> >>>>> >>>>> -- >>>>> View this message in context: >>>>> >>> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27266316.html >>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>> >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27268777.html >>> Sent from the Solr - User mailing list archive at Nabble.com. >> > > > -- View this message in context: http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27279187.html Sent from the Solr - User mailing list archive at Nabble.com.
