Re: spell checking on query

Hi Midas, You can use Solr's spellcheck component: https://cwiki.apache.org/confluence/display/solr/Spell+Checking Emir On 14.11.2016 08:37, Midas A wrote: How can we do the query time spell checking with help of solr . -- Monitoring * Alerting * Anomaly Detection * Centralized Log Manag

Re: Spell checking the synonym list?

Thanks both! James, I like that approach. I'll give it a try. I forgot to mention I was only using query-time synonyms but shouldn't be a problem in my case to add synonyms during index-time. Ryan On Thu, 9 Jul 2015 at 22:07 Dyer, James wrote: > Ryan, > > If you use index-time synonyms on th

RE: Spell checking the synonym list?

Ryan, If you use index-time synonyms on the spellcheck field, this will give you what you want. For instance, if the document has "lawyer" and you index both terms "lawyer","attorney", then the spellchecker will see that "atorney" is 1 edit away from an indexed term and will suggest "attorney"

RE: Spell checking the synonym list?

One of the uses of synonyms is to replace a mis-spelled query term with a correctly spelled value. The "2 sided" synonym file format allows you to control which values "survive" into the actual query. lawyer, attorney, ambulance chaser, atorney, lowyor => lawyer, attorney I am not aware, howev

RE: spell checking and filtering in the same query

Mark, I'm not as familiar with the Suggester, but with normal spellcheck if you set "spellcheck.maxCollationTries" to something greater than 0 it will check the collations with the index. This checking includes any "fq" params you had. So in this sense the SpellCheckComponent does work with "

Re: Spell Checking a multi word phrase

am...@jaunter.com] > Sent: Monday, January 17, 2011 1:41 PM > To: solr-user@lucene.apache.org > Subject: Re: Spell Checking a multi word phrase > > James, > > Thank you, but I'm not sure that will work for my needs. I'm very > interested in contextual spell checking

RE: Spell Checking a multi word phrase

ems Ingram Content Group (615) 213-4311 -Original Message- From: Camden Daily [mailto:cam...@jaunter.com] Sent: Monday, January 17, 2011 1:41 PM To: solr-user@lucene.apache.org Subject: Re: Spell Checking a multi word phrase James, Thank you, but I'm not sure that will work for my needs. I&#x

Re: Spell Checking a multi word phrase

James, Thank you, but I'm not sure that will work for my needs. I'm very interested in contextual spell checking. Take for example the author "stephenie meyer". "stephenie" is a far less popular spelling than "stephanie", but in this context it's the correct option. I feel like shingles with a

RE: Spell Checking a multi word phrase

Camden, You may also want to be aware that there is a new feature added to Spell Check's "collate" functionality that will guarantee the collations will return hits. It also is able to return more than one collation and tell you how many hits each one would result in if re-queried. This might

Re: Spell checking question from a Solr novice

On Mon, Oct 18, 2010 at 5:24 PM, Jason Blackerby wrote: > If you know the misspellings you could prevent them from being added to the > dictionary with a StopFilterFactory like so: > Or, you know, correct the data :-) -- Bill Dueber Library Systems Programmer University of Michigan Library

Re: Spell checking question from a Solr novice

The first question to ask is will it work for you. The SECOND question is do you want google to know what's in your data? Dennis Gearon Signature Warning It is always a good idea to learn from your own mistakes. It is usually a better idea to learn from others’ mistakes, so yo

Re: Spell checking question from a Solr novice

You can cross the new words against a dictionary and keep them in the file as Jason described... What Pradeep said is true, is always better to have "suggestions" related to your index that have suggestions with no results... On Mon, Oct 18, 2010 at 6:24 PM, Jason Blackerby wrote: > If you know

Re: Spell checking question from a Solr novice

If you know the misspellings you could prevent them from being added to the dictionary with a StopFilterFactory like so: where misspelled_words.txt contains the misspellings. On Mon, Oct 18, 2010 at 5:14 PM, Pradeep Singh wrot

Re: Spell checking question from a Solr novice

I think a spellchecker based on your index has clear advantages. You can spellcheck words specific to your domain which may not be available in an outside dictionary. You can always dump the list from wordnet to get a starter english dictionary. But then it also means that misspelled words from yo

Re: Spell checking question from a Solr novice

In general, the benefit of the built-in Solr spellcheck is that it can use a dictionary based on your actual index. If you want to use some external API, you certainly can, in your actual client app -- but it doesn't really need to involve Solr at all anymore, does it? Is there any benefit I'

Re: Spell checking question from a Solr novice

I haven't yet but I was going to use the spell checker in the lucene contrib module. That spellchecker is ngram based and previously I have noticed that I get better results from ngram based spellcheck rather than fuzzy string match based ones. On Mon, Oct 18, 2010 at 12:43 PM, Xin Li wrote: > H

RE: Spell checking question from a Solr novice

Oops, never mind. Just read Google API policy. 1000 queries per day limit & for non-commercial use only. -Original Message- From: Xin Li Sent: Monday, October 18, 2010 3:43 PM To: solr-user@lucene.apache.org Subject: Spell checking question from a Solr novice Hi, I am looking for a

Re: Spell checking and keyword tokenizer

Nevermind this one... With a bit more research I discovered I can use spellcheck.q to provide the correct suggestion. On 14 September 2010 16:02, Glen Stampoultzis wrote: > Hi, > > I'm trying to spell check a whole field using a lowercasing keyword > tokenizer [1]. > > for example if I query for

Re: spell checking....

This is in solrconfig.xml::: default solr.IndexBasedSpellChecker spell ./spellchecker 0.7 true true jarowinkler lowerfilt org.apache.lucene.search.spell.JaroWinklerDistance ./spellchecker

Re: spell checking....

It's almost impossible to analyze this kind of thing without seeing your schema and debug output. You might want to review: http://wiki.apache.org/solr/UsingMailingLists Best Erick On Mon, Jul 26, 2010 at 9:56 AM, satya swaroop wrote: > hi all, >i am a new one to solr and able to implem

Re: Spell checking not working

A typo, I think is the reason ... positionIncrementGap="100"> multiValued="true"/> > In the fieldType definition the field name is "testSpell" but the field called "spell" uses a type called "textSpell". Please revert back if this is not the reason. Cheers Avlesh On Thu, Sep 17, 2009 at 7:10

Re: Spell checking: Is there a way to exclude words known to be wrong?

On Tue, Jul 14, 2009 at 6:37 PM, Erik Hatcher wrote: > Use the stopwords feature with a custom mispeled_words.txt and a > StopFilterFactory on the spell check field ;) > > Very cool! :) -- Regards, Shalin Shekhar Mangar.

Re: Spell checking: Is there a way to exclude words known to be wrong?

Use the stopwords feature with a custom mispeled_words.txt and a StopFilterFactory on the spell check field ;) Erik On Jul 13, 2009, at 8:27 PM, Jay Hill wrote: We're building a spell index from a field in our main index with the following configuration: textSpell default spel

Re: Spell checking: Is there a way to exclude words known to be wrong?

I don't think there is a way currently, but it might make a nice patch. Or you could just implement a custom SolrSpellChecker - both FileBasedSpellChecker and IndexBasedSpellChecker are actually like maybe 50 lines of code or less. It would be fairly quick to just plug a custom version in as a plug

Re: spell checking

On Thu, Jun 4, 2009 at 7:26 PM, Walter Underwood wrote: > "query suggest" --wunder > > How about DidYouMeanComponent? -- Regards, Shalin Shekhar Mangar.

Re: spell checking

Walter Underwood schrieb: "query suggest" --wunder That's very good. On the other hand, I noticed how the term "spellcheck" is spread all over the place, and that would be a massive renaming orgy. An explanation at the appropriate place in the documentation is less invasive. I added two senten

Re: spell checking

"query suggest" --wunder On 6/4/09 1:25 AM, "Michael Ludwig" wrote: > Yao Ge schrieb: > >> Maybe we should call this "alternative search terms" or >> "suggested search terms" instead of spell checking. It is >> misleading as there is no right or wrong in spelling, there >> is only popular (term

Re: spell checking

Yao Ge schrieb: Maybe we should call this "alternative search terms" or "suggested search terms" instead of spell checking. It is misleading as there is no right or wrong in spelling, there is only popular (term frequency?) alternatives. I had exactly the same difficulty in understanding the c

Re: spell checking

ssage > From: Yao Ge > To: solr-user@lucene.apache.org > Sent: Tuesday, June 2, 2009 9:42:48 PM > Subject: Re: spell checking > > > Excellent. Now everything make sense to me. :-) > > The spell checking suggestion is the closest variance of user input that > act

Re: spell checking

Message >> From: Yao Ge >> To: solr-user@lucene.apache.org >> Sent: Tuesday, June 2, 2009 5:34:07 PM >> Subject: Re: spell checking >> >> >> Sorry for not be able to get my point across. >> >> I know the syntax that leads to a index buil

Re: spell checking

> Subject: Re: spell checking > > > Sorry for not be able to get my point across. > > I know the syntax that leads to a index build for spell checking. I actually > run the command saw some additional file created in data\spellchecker1 > directory. What I don't unders

Re: spell checking

Sorry for not be able to get my point across. I know the syntax that leads to a index build for spell checking. I actually run the command saw some additional file created in data\spellchecker1 directory. What I don't understand is what is in there as I can not trick Solr to make spell suggestion

Re: spell checking

to work for us. Hope it helps -- Jeff Newburn Software Engineer, Zappos.com jnewb...@zappos.com - 702-943-7562 > From: Yao Ge > Reply-To: > Date: Tue, 2 Jun 2009 14:03:24 -0700 (PDT) > To: > Subject: Re: spell checking > > > Yes. I did. I was not able to grasp the

Re: spell checking

> Sent: Tuesday, June 2, 2009 5:03:24 PM > Subject: Re: spell checking > > > Yes. I did. I was not able to grasp the concept of making spell checking > work. > For example, the wiki page says an spell check index need to be built. But > did not say how to do it. Does Solr buid

Re: spell checking

Yes. I did. I was not able to grasp the concept of making spell checking work. For example, the wiki page says an spell check index need to be built. But did not say how to do it. Does Solr buid the index out of thin air? Or the index is buit from the main index? or index is built form a dictionar

Re: spell checking

Have you gone through: http://wiki.apache.org/solr/SpellCheckComponent On Jun 2, 2009, at 8:50 AM, Yao Ge wrote: Can someone help providing a tutorial like introduction on how to get spell-checking work in Solr. It appears many steps are requires before the spell-checkering functions can be

Re: Spell checking not returning "full" terms

On Feb 4, 2009, at 7:54 PM, Rupert Fiasco wrote: Awesome! After reading up on the links you sent me I got it all working. Thanks! FYI - I did previously come across one of the links you sent over: http://wiki.apache.org/solr/SpellCheckerRequestHandler But what threw me off is that when I s

Re: Spell checking not returning "full" terms

Awesome! After reading up on the links you sent me I got it all working. Thanks! FYI - I did previously come across one of the links you sent over: http://wiki.apache.org/solr/SpellCheckerRequestHandler But what threw me off is that when I started reading about that yesterday, in the first parag

Re: Spell checking not returning "full" terms

I'm guessing the field you are checking against is being stemmed. The field you spell check against should have minimal analysis done to it, i.e. tokenization and probably downcasing. See http://wiki.apache.org/solr/SpellCheckComponent and http://wiki.apache.org/solr/SpellCheckerRequestHand