Re: Multi-word Synonyms not working properly with Edismax

Yes, we tried that and it worked. We removed only for query analyzer and it is working properly now. On Wed, Sep 9, 2020 at 2:24 AM Dominique Bejean wrote: > Hi, > > Can you try to remove the RemoveDuplicatesTokenFilter ? > > Dominique > > Le mar. 8 sept. 2020 à 13:52, Manish Bafna a > écrit :

Re: Multi-word Synonyms not working properly with Edismax

Hi, Can you try to remove the RemoveDuplicatesTokenFilter ? Dominique Le mar. 8 sept. 2020 à 13:52, Manish Bafna a écrit : > Hi, > > We are using the following configuration: > > > > -- > > *Schema: * > > > positionIncrementGap="100" autoGeneratePhrase

Re: Multi-word Synonyms - how does sow parameter work?

Thanks Andrea for the tip. I wasn't aware of the autoGeneratePhraseQueries option for text fields, will definitely keep it in mind. But I question if this is related to the fix on the query parser which essentially introduces sow parameter and if false (looks like that is the default in Solr 7),

Re: Multi-word Synonyms - how does sow parameter work?

Hi Roy, I think you miss the autoGeneratePhraseQueries=true in the field type definition. I was on a slightly different use case when I met your same issue (I was using synonyms expansion at query time) and honestly I didn't understand why this is not the default and implicit behavior. In other

Re: Multi-word Synonyms - how does sow parameter work?

I am not using edismax (eventually I would like to get there) but I'm just testing with standard query right now. Original posting: I'm trying to figure out why the multi-word synonym expansion is not working correctly (or, at least what I'm misunderstanding). Specifically, when I test a standar

Re: Multi-word Synonyms - how does sow parameter work?

Also share your fieldType settings for myfield as well from your schema On Wed, Aug 15, 2018 at 8:00 PM Doug Turnbull < dturnb...@opensourceconnections.com> wrote: > Aside from the screenshot issue, one thing to check: are you searching > with defType=edismax ? > > As in > q=lcd&qf=myfield&sow=fa

Re: Multi-word Synonyms - how does sow parameter work?

Aside from the screenshot issue, one thing to check: are you searching with defType=edismax ? As in q=lcd&qf=myfield&sow=false&defType=edismax ? Also sow=false should the the default on Solr 7 and above Doug On Wed, Aug 15, 2018 at 6:27 PM Roy Lim wrote: > I'm trying to figure out why the m

Re: Multi-word Synonyms - how does sow parameter work?

Yes please. That way we’ll see the whole thing. -- Steve www.lucidworks.com > On Aug 15, 2018, at 7:20 PM, Roy Lim wrote: > > I've subscribed, shall I re-post it then via email? > > > > -- > Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Multi-word Synonyms - how does sow parameter work?

I've subscribed, shall I re-post it then via email? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Multi-word Synonyms - how does sow parameter work?

Roy, Not sure of the point of Nabble when it strips content before passing messages on to the mailing list. I’ve emailed them about this problem in the past but they have done nothing about it. Updating a post on Nabble will never make it to the mailing list. If you want us to be able to rea

Re: Multi-word Synonyms - how does sow parameter work?

Thanks, updated original post. It just removed what I surrounded with the raw text markup, I've added it back without markup. Not sure of the point of raw text if it's always removed -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Multi-word Synonyms - how does sow parameter work?

The mail server strips pretty much all screenshots and attachments, so I think some of the data you're trying to provide is missing from the e-mail. Best, Erick On Wed, Aug 15, 2018 at 3:27 PM, Roy Lim wrote: > I'm trying to figure out why the multi-word synonym expansion is not working > correc

Re: Multi word synonyms

Fntastic! On Mon, Mar 27, 2017 at 9:56 AM alessandro.benedetti wrote: > In addition to what Doug has already pointed out, i would like to highlight > this contribution in Solr 6.5.0 . > It may seem like a small innocent patch but it actually open a new worlds > for one of the most controversi

Re: Multi word synonyms

In addition to what Doug has already pointed out, i would like to highlight this contribution in Solr 6.5.0 . It may seem like a small innocent patch but it actually open a new worlds for one of the most controversial aspects of Solr Query Parsing : http://issues.apache.org/jira/browse/SOLR-9185

Re: Multi word synonyms

You might have stumbled on all these articles, but you can probably read our orgs progression with this problem as a play in 3 acts Act I Introducing the characters http://opensourceconnections.com/blog/2013/10/27/why-is-multi-term-synonyms-so-hard-in-solr/ Act II Heroes Meet Despair http://open

Re: Multi word synonyms

Sure thing. Post back w what you find! Good luck- On Sun, Mar 26, 2017 at 3:36 PM Sanjana Sridhar wrote: > Hi John, > > Thanks for letting me know what works for you. I'm going to try that out. > Sounds like a suitable solution to my problem. > > Best, > Sanjana > > > > On Sun, Mar 26, 2017 at

Re: Multi word synonyms

Hi John, Thanks for letting me know what works for you. I'm going to try that out. Sounds like a suitable solution to my problem. Best, Sanjana On Sun, Mar 26, 2017 at 12:30 PM, John Blythe wrote: > I use the keyword tokenizer and then pattern replace to transform multi > words into undersco

Re: Multi word synonyms

I use the keyword tokenizer and then pattern replace to transform multi words into underscore connected tokens. For instance, "Burger Joint" transforms to "burger_joint" which then looks in my synonym filter for underscored synonyms. When it matches I then replace underscores with spaces or just to

RE: Multi word synonyms

kenFilter is implemented and the rate of indexing you need to maintain. Depending on your experience, you can do this even if you are new to Solr, as you've mentioned. -Original Message- From: Davis, Daniel (NIH/NLM) [C] Sent: Tuesday, November 15, 2016 10:22 AM To: solr-user@lucene.apa

RE: Multi word synonyms

ubject: Re: Multi word synonyms I am new with solr . How i should solve this problem ? Can we do something at query time ? On Tue, Nov 15, 2016 at 5:35 PM, Vincenzo D'Amore wrote: > Hi Michael, > > an update, reading the article I double checked if at least one of the > is

Re: Multi word synonyms

Wow, that's great news! I didn't notice that. Am 15.11.2016 um 13:05 schrieb Vincenzo D'Amore: > Hi Michael, > > an update, reading the article I double checked if at least one of the > issues were fixed. > The good news is that https://issues.apache.org/jira/browse/LUCENE-2605 has > been closed a

Re: Multi word synonyms

I am new with solr . How i should solve this problem ? Can we do something at query time ? On Tue, Nov 15, 2016 at 5:35 PM, Vincenzo D'Amore wrote: > Hi Michael, > > an update, reading the article I double checked if at least one of the > issues were fixed. > The good news is that https://issu

Re: Multi word synonyms

Hi Michael, an update, reading the article I double checked if at least one of the issues were fixed. The good news is that https://issues.apache.org/jira/browse/LUCENE-2605 has been closed and is available in 6.2. On Tue, Nov 15, 2016 at 12:32 PM, Michael Kuhlmann wrote: > This is a nice readi

Re: Multi word synonyms

This is a nice reading though, but that solution depends on the precondition that you'll already know your synonyms at index time. While having synonyms in the index is mostly the better solution anyway, it's sometimes not feasible. -Michael Am 15.11.2016 um 12:14 schrieb Vincenzo D'Amore: > Hi

Re: Multi word synonyms

Hi Midas, I suggest this interesting reading: https://lucidworks.com/blog/2014/07/12/solution-for-multi-term-synonyms-in-lucenesolr-using-the-auto-phrasing-tokenfilter/ On Tue, Nov 15, 2016 at 11:00 AM, Michael Kuhlmann wrote: > It's not working out of the box, sorry. > > We're using this pl

Re: Multi word synonyms

It's not working out of the box, sorry. We're using this plugin: https://github.com/healthonnet/hon-lucene-synonyms#getting-started It's working nicely, but can lead to OOME when you add many synonyms with multiple terms. And I'm not sure whether it#s still working with Solr 6.0. -Michael Am 15

Re: Multi-word Synonyms Solr 4.3.1 does not work

Hi Reth & All - Thanks for your quick reply. As I can see the work-around link given by you is dealing with the different syntax of the synonyms ... like as below ... big apple new york city city of new york new york new york new york ny ny city ny ny new york But I need the synonyms like as bel

Re: Multi-word Synonyms Solr 4.3.1 does not work

Right, this is a known issue. There is currently an active jira that you may like to watch https://issues.apache.org/jira/browse/SOLR-5379 And other possible workaround is explained here : https://lucidworks.com/blog/2014/07/12/solution-for-multi-term-synonyms-in-lucenesolr-using-the-auto-phrasing

Re: Multi word synonyms

ail.com] > Sent: Sunday, February 05, 2012 8:07 AM > To: solr-user@lucene.apache.org > Subject: Re: Multi word synonyms > > I'm not quite sure what you're trying to do with KeywordTokenizerFactory > in your SynonymFilter definition, but if I use the defaults, the

Re: Multi word synonyms

he time will be ripe to revisit robust query-time multi-word synonym support. (Or, maybe LucidWorks will finally donate their query parser!) -- Jack Krupansky -Original Message- From: Bernd Fehling Sent: Thursday, November 29, 2012 8:19 AM To: solr-user@lucene.apache.org Subject: Re: Mult

Re: Multi word synonyms

There are also other solutions: Multi-word synonym filter (synonym expansion) https://issues.apache.org/jira/browse/LUCENE-4499 Since Solr 3.4 i have my own solution which might be obsolete if LUCENE-4499 will be in a released version. http://www.ub.uni-bielefeld.de/~befehl/base/solr/eurovoc.html

Re: Multi word synonyms

Found an article about the issue of multi word synonyms . Not sure it's the solution I'm looking for, but it may be for someone else. -- View this message in context: http://lucene.472066.n3.nabble.com/Multi-word-synonyms-t

RE: Multi word synonyms

Are you able to explain how I would create another field to fit my scenario? -Original Message- From: O. Klein [mailto:kl...@octoweb.nl] Sent: Tuesday, February 07, 2012 1:28 PM To: solr-user@lucene.apache.org Subject: RE: Multi word synonyms Well, if you want both multi word and single

RE: Multi word synonyms

Well, if you want both multi word and single words I guess you will have to create another field :) Or make queries like you suggested. -- View this message in context: http://lucene.472066.n3.nabble.com/Multi-word-synonyms-tp3716292p3724009.html Sent from the Solr - User mailing list archive at

RE: Multi word synonyms

using edismax and solr 3.5 and multi word values can only be matched when using quotes. -Original Message- From: O. Klein [mailto:kl...@octoweb.nl] Sent: Tuesday, February 07, 2012 12:49 PM To: solr-user@lucene.apache.org Subject: RE: Multi word synonyms Isn't that what autoGeneratePhr

RE: Multi word synonyms

Isn't that what autoGeneratePhraseQueries="true" is for? -- View this message in context: http://lucene.472066.n3.nabble.com/Multi-word-synonyms-tp3716292p3723886.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Multi word synonyms

Zac Smith Sent: Sunday, February 05, 2012 7:28 PM To: solr-user@lucene.apache.org Subject: RE: Multi word synonyms Thanks for the response. This almost worked, I created a new field using the KeywordTokenizerFactory as you suggested. The only problem was that searches only found documents when q

RE: Multi word synonyms

om] Sent: Sunday, February 05, 2012 8:07 AM To: solr-user@lucene.apache.org Subject: Re: Multi word synonyms I'm not quite sure what you're trying to do with KeywordTokenizerFactory in your SynonymFilter definition, but if I use the defaults, then the all-phrase form works just fine.

RE: Multi word synonyms

am using dismax and solr 3.5.0. Thanks Zac -Original Message- From: O. Klein [mailto:kl...@octoweb.nl] Sent: Sunday, February 05, 2012 5:22 AM To: solr-user@lucene.apache.org Subject: Re: Multi word synonyms Your query analyser will tokenize "simple sirup" into "simple&quo

Re: Multi word synonyms

I'm not quite sure what you're trying to do with KeywordTokenizerFactory in your SynonymFilter definition, but if I use the defaults, then the all-phrase form works just fine. So the question is "what problem are you trying to address by using KeywordTokenizerFactory?" Best Erick On Sun, Feb 5,

Re: Multi word synonyms

Your query analyser will tokenize "simple sirup" into "simple" and "sirup" and wont match on "simple syrup" in the synonyms.txt So you have to change the query analyzer into KeywordTokenizerFactory as well. It might be idea to make a field for synonyms only with this tokenizer and another field t

RE: Multi-word synonyms containing commas

onyms at index time) -Original Message- From: Ahmet Arslan [mailto:iori...@yahoo.com] Sent: Montag, 08. Februar 2010 18:48 To: solr-user@lucene.apache.org Subject: Re: Multi-word synonyms containing commas > Hi, > > is it possible to have a synonym file where single syn

Re: Multi-word synonyms containing commas

> Hi, > > is it possible to have a synonym file where single synonyms > can also contain commas, e.g. names like "Washington, > George". Sure, you just need to escape that comma. e.g. Washington\, George, wg a\,a => b\,b

Re: multi-word synonyms and analysis.jsp vs real field analysis (query, index)

Thanks Hoss, after your hints that had partially confirmed my considerations, I had made some tests with the FieldQParser. At the beginning, I had have some problems, but finally, I was able to solve the problem of multi-word synonyms at query time in a way that is suitable for us - and possibly f

Re: multi-word synonyms and analysis.jsp vs real field analysis (query, index)

: The cause of my problem should be the query parsing, but I don't know, : if there is any solution for it. I need a possibility that works like : the analysis/query parsing within /admin/analysis.jsp view. The behavior you are describing is very well documented on the wiki... http://wiki.apache.

Re: multi-word synonyms and analysis.jsp vs real field analysis (query, index)

Hi Koji, the problem is, that this doesn't fit all of our requirements. We have some Solr documents that must not be matched by "foo" or "bar" but by "foo bar" as part of the query. Also, we have some other documents that could be matched by "foo" and "foo bar" or "bar" and "foo bar". The best wa

Re: multi-word synonyms and analysis.jsp vs real field analysis (query, index)

Hi Patrick, Why don't you define: foo bar, foo_bar (and expand="true") instead of: foo bar=>foo_bar in only indexing side? Doesn't it make a change for the better? Koji Patrick Jungermann wrote: Hi Koji, using phrase queries is no alternative for us, because all query parts has to be opt

Re: multi-word synonyms and analysis.jsp vs real field analysis (query, index)

Hi Chantal, yes, I'm using the SynonymFilter at index and query chain. Using it only at query time or only at index time was part of former considerations, but both don't fit all of our requirements. But as I wrote in my first mail, it works only within the /admin/analysis.jsp view and not at "re

Re: multi-word synonyms and analysis.jsp vs real field analysis (query, index)

Hi Patrick, have you added that SynonymFilter to the index chain and the query chain? You have to add it to both if you want to have it replaced at index and query time. It might also be enough to add it to the query chain only. Than your index still preserves the original data. Cheers, Chan

Re: multi-word synonyms and analysis.jsp vs real field analysis (query, index)

Hi Koji, using phrase queries is no alternative for us, because all query parts has to be optional parts. The phrase query workaround will work for a query "foo bar", but only for this exact query. If the user queries for "foo bar baz", it will be changed to "foo_bar baz", but it will not match th

Re: multi-word synonyms and analysis.jsp vs real field analysis (query, index)

Patrick, > parsedQueryString was something similar to "field:foo field:bar". At > index time, it works like expected. I guess because you are searching q=foo bar, this causes OR query. Use q="foo bar", instead. Koji Patrick Jungermann wrote: Hi list, I worked on a field type and its analyzi

RE: multi-word synonyms with multiple matches

> You haven't given us the full details on how you are using the > SynonymFilterFactory ("expand" true or false?) but in general: yes the > SynonymFilter finds the longest match it can. Sorry - doing expansion at index time: > > if every svp is also a vp, then being explict in your synonyms (whe

Re: multi-word synonyms with multiple matches

: vp,vice president : svp,senior vice president : : However, a search for "vp" does not return results where the title is : "senior vice president". It appears that the term "vp" is not indexed : when there is a longer string that matches a different synonym. Is this : by design, and is ther