Re: Arabic words search in solr

Hi Aman Deep Singh, Thanks for the information. We tried with EdgeNGramFilterFactory but it's not workingWe are not getting expected results. Can you please suggest us alternative possible ways.. Thanks, -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Arabic words search in solr

Try the edge ngram filter https://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.EdgeNGramFilterFactory I think it will help you solve the problem On Sun, Aug 13, 2017 at 7:08 PM mohanmca01 wrote: > Hi Aman Deep Singh, > > Thanks for your update... I will update the status after compl

RE: Arabic words search in solr

Hi Aman Deep Singh, Thanks for your update... I will update the status after complete the testing. I need one more help from your end,can you check below scenario: we are getting the results while using AND operator in between the words. Below is the example: Scenario 1: { "responseHeade

RE: Arabic words search in solr

You can configure mm either in the request handler sorconfig.xml or pass as a request parameter along side the user query For more detail refer https://cwiki.apache.org/confluence/display/solr/The+DisMax+Query+Parser example of sample handler is 10 searchFields 100% dismax

Re: Arabic words search in solr

Any one help me on below use case. -- View this message in context: http://lucene.472066.n3.nabble.com/Arabic-words-search-in-solr-tp4317733p4350390.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Arabic words search in solr

Hi Aman Deep, Thanks for the information, In order to add mm=100% in the request handler, in which place ?..Can you please share me sample snap. thanks in advance. -- View this message in context: http://lucene.472066.n3.nabble.com/Arabic-words-search-in-solr-tp4317733p4350389.html Sent fro

RE: Arabic words search in solr

Use mm=100% in the request handler It will give the same AND functionality On 06-Aug-2017 11:59 AM, "mohanmca01" wrote: hello Allison. thank you for the information. i referred to your slide "33", yes we are looking for same kind of results and solution. would you please guide us on how to a

RE: Arabic words search in solr

hello Allison. thank you for the information. i referred to your slide "33", yes we are looking for same kind of results and solution. would you please guide us on how to achieve this? also, we would like to know Instead of putting AND operator in between the words if there is another way of do

Re: Arabic words search in solr

Hi Dave, Yes we are getting the results while using AND operator in between the words. Below is the example: *Scenario 1:* { "responseHeader": { "status": 0, "QTime": 1, "params": { "indent": "true", "q": "bizNameAr:(مسقط AND الاتصال)", "_": "1501998206658",

Re: Arabic words search in solr

g need to index Arabic words. > > -Original Message- > From: mohanmca01 [mailto:mohanmc...@gmail.com] > Sent: Thursday, 3 August 2017 12:58 a.m. > To: solr-user@lucene.apache.org > Subject: RE: Arabic words search in solr > > Hi Phil Scadden, > > Thank you for

RE: Arabic words search in solr

:58 a.m. To: solr-user@lucene.apache.org Subject: RE: Arabic words search in solr Hi Phil Scadden, Thank you for your reply, we tried your suggested solution by removing hyphen while indexing, but it was getting wrong results. i was searching for "شرطة ازكي" and it was showing me

RE: Arabic words search in solr

tballison/share/blob/master/slides/TextProcessingAndAdvancedSearch_tallison_MITRE_201510_final_abbrev.pdf -Original Message- From: David Hastings [mailto:hastings.recurs...@gmail.com] Sent: Wednesday, August 2, 2017 9:00 AM To: solr-user@lucene.apache.org Subject: Re: Arabic words search in

Re: Arabic words search in solr

perhaps change your default operator to AND instead of OR if thats what you are expecting for a result On Wed, Aug 2, 2017 at 8:57 AM, mohanmca01 wrote: > Hi Phil Scadden, > > Thank you for your reply, > > we tried your suggested solution by removing hyphen while indexing, but it > was getting

RE: Arabic words search in solr

Hi Phil Scadden, Thank you for your reply, we tried your suggested solution by removing hyphen while indexing, but it was getting wrong results. i was searching for "شرطة ازكي" and it was showing me the result that am looking for, plus irrelevant result which either have the first or second word

RE: Arabic words search in solr

terms to find the text. -Original Message- From: mohanmca01 [mailto:mohanmc...@gmail.com] Sent: Tuesday, 1 August 2017 1:18 a.m. To: solr-user@lucene.apache.org Subject: Re: Arabic words search in solr Please help me on this... -- View this message in context: http://lucene.472066.n3

RE: Arabic words search in solr

terms to find the text. -Original Message- From: mohanmca01 [mailto:mohanmc...@gmail.com] Sent: Tuesday, 1 August 2017 1:18 a.m. To: solr-user@lucene.apache.org Subject: Re: Arabic words search in solr Please help me on this... -- View this message in context: http://lucene.472066.n3

Re: Arabic words search in solr

Please help me on this... -- View this message in context: http://lucene.472066.n3.nabble.com/Arabic-words-search-in-solr-tp4317733p4348372.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Arabic words search in solr

Hi Steve, thank you for your reply, it been quite long time to reply to you back. i have tried what you suggested, and there were some improvements in terms of searching and getting the results. however, the team is facing some difficulty in searching using shortcut of the indexed names which fo

Re: Arabic words search in solr

Hi Mohan, Your examples refer to documents I don’t have in my 9 document set, so I recast the problem to a query/doc combo I have from earlier in this thread, and I was able to restrict hits to only documents that contained all terms from the query. If I use the query “name_ar:(شرطة ازكي)” I ge

Re: Arabic words search in solr

Hi Stave, Thanks for the support, I tried below cases but still i'm not able to get the expected results. Case 1 : Input : bizNameAr:شرطة + ازكي Output : { "responseHeader": { "status": 0, "QTime": 1, "params": { "indent": "true", "q": " bizNameAr:شرطة + ازكي",

Re: Arabic words search in solr

Hi Mohan, > On Feb 26, 2017, at 1:37 AM, mohanmca01 wrote: > > i searched with (bizNameAr: شرطة ازكي), and am getting: > […] > > the expected result is: "id": "82", > "bizNameAr": "شرطة عمان السلطانية - قيادة > شرطة محافظة الداخلية - - مركز *شرطة إزكي*", > >

Re: Arabic words search in solr

Hi Stave, Any update on this. -- View this message in context: http://lucene.472066.n3.nabble.com/Arabic-words-search-in-solr-tp4317733p4323005.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Arabic words search in solr

Hi Stave, Thank for your continues investigation.. This has improved the search little bit, but am facing another issue where am getting a record doesn't have a specific word in my query. Plz note that you have indexed only 9 records where i have shared you more than 76 sample records (please r

Re: Arabic words search in solr

Hi Mohan, I indexed your 9 examples as simple documents after mapping dynamic field “*_ar” to the “text_ar” field type: - [{"id":"1", "name_ar":"المؤسسة التجارية العمانية"}, {"id":"2", "name_ar":"شركة التأمين الأهلية ش.م.ع.م"}, {"id":"3", "name_ar":"شرطة عمان السلطانية - قيادة شرطة محافظة شم

Re: Arabic words search in solr

Hi Stave, As per your suggestion I added ICU folding filter and I re-indexed entire solr data, but still am unable to find the expected results which i highlighted earlier. attached excel sheet with examples of Arabic names for your investigation & reproducing the issue. Arabic_Characters2.xlsx <

Re: Arabic words search in solr

Hi Mohan, It looks to me like the example query should match, since the analyzed query terms look like a subset of the analyzed document terms. Did you re-index your docuemnts after you changed your schema? If not, then the indexed documents won’t have the same terms as the ones you see on the

Re: Arabic words search in solr

Hi Steve, I changed ICU folding filter order and re-index entire Arabic content. But still problem is present. I am not able to get the expected result. I attached screen shot for your references.

Re: Arabic words search in solr

Hi Mohan, When I said "the ICU folding filter should be the last filter, to allow the Arabic normalization and stemming filters to see the original words”, I meant that no filter should follow it. You did not make that change. Here’s what I mean:

Re: Arabic words search in solr

Hi Steve, As per your suggestion,I added ICUFoldingFilterFactory in schema.xml as below: I attached expecting result document in previous mail thread for your references. Kindly check and let me know. Thanks -- View this mess

Re: Arabic words search in solr

Hi Mohan, Did you change the order of the filters as I suggested? -- Steve eww.lucidworks.com On Tue, Feb 14, 2017 at 8:05 AM mohanmca01 wrote: > Hi Steve, > > any update on this .???.. I am waiting for your inputs.. > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.c

Re: Arabic words search in solr

Hi Steve, any update on this .???.. I am waiting for your inputs.. -- View this message in context: http://lucene.472066.n3.nabble.com/Arabic-words-search-in-solr-tp4317733p4320253.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Arabic words search in solr

Hi Mohan, I haven’t looked at the latest problems, but the ICU folding filter should be the last filter, to allow the Arabic normalization and stemming filters to see the original words. -- Steve www.lucidworks.com > On Feb 8, 2017, at 10:58 PM, mohanmca01 wrote: > > Hi Steve, > > Thanks fo

Re: Arabic words search in solr

Hi Steve, Thanks for your continues investigation on this issue. I added ICU Folding Filter in schema.xml file and re-indexed all the data again. i noticed some improvements in search but its not really as expected. below is the configuration changed in schema file: -

Re: Arabic words search in solr

Hi Mohan, I ran your Case #1 through Solr 4.9.0’s Admin UI Analysis pane and I can see the analyzer for the field type “text_ar" analyzer does not remove all diacritics: Indexed original: المؤسسة التجارية العمانية Indexed analyzed: مؤسس تجار عمان Query original: الموسسة التجارية Query analyzed

Re: Arabic words search in solr

Dear Steve,Thanks for investigating our problem. Our project is basically business directory search platform, and we have more than 100+ K business details information. I’m providing you some examples of Arabic words to reproduce the problem. please find attached word file where i explained everyth

Re: Arabic words search in solr

Mohan, I downloaded and started Solr 4.9.0 and entered your example indexed and queried words into the Admin UI’s Analysis pane using the text_ar field type. You can see the results here: . Each of the indexed words and the quer

Re: Arabic words search in solr

If you look in the upper-lerf corner of any reference guide page you'll see a link to previous versions of the docs and can download whatever version you are working with back to 4.7 IIRC. I'd download that and see if there's similar functionality. On Mon, Jan 30, 2017 at 10:19 PM, mohan sundaram

Re: Arabic words search in solr

Hi Steve, Thanks for sharing the information. I went through the solr references document which you shared in the link. Your shared references document pointing to solr version 6.4.0. The implemented Solr version in my project is 4.9.0. As I mentioned earlier In my solr schema.xml I defined pr

Re: Arabic words search in solr

Hi Mohan, The analyzer in your text_ar field type looks like an expanded version of the one suggested in the Solr Reference Guide[1]. Can you give an example of a query and the indexed text you expect to match but doesn't? ArabicNormalizationFilterFactory, which uses Lucene’s ArabicNormalizer[