RE: multi language search engine in solr

2017-09-12 Thread Mugeesh Husain
thanks Junte Zhang, its really helpful for me -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

RE: multi language search engine in solr

2017-09-11 Thread Junte Zhang
-Original Message- From: Mugeesh Husain [mailto:muge...@gmail.com] Sent: Monday, September 11, 2017 3:46 AM To: solr-user@lucene.apache.org Subject: Re: multi language search engine in solr Thank you rick for your response. The document document have sepearte of the lanaguage instead of

Re: multi language search engine in solr

2017-09-11 Thread Tommaso Teofili
another thing to consider is what users would expect, would english user search over english docs only ? if yes, the most important task would be to correctly set up / create accurate per language analyzers, otherwise you may consider to also adopt machine translation, either on the search queries

Re: multi language search engine in solr

2017-09-10 Thread Mugeesh Husain
Thank you rick for your response. The document document have sepearte of the lanaguage instead of mix of Arabic, English, Bengali, Hindi, Malay. I coul not find any tokenizer for Malay, can you suggest me if you know please. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.ht

Re: multi language search engine in solr

2017-09-10 Thread Rick Leir
orking on multi language search engine for english,bangla, hindi >and >indonesia language. can anybody guide me how to configure solr >schema. > >1.) should i need to configure all the language in a single >shard/collection. ? >2.)should I need to configure separate shard/co

multi language search engine in solr

2017-09-10 Thread Mugeesh Husain
Hi I am working on multi language search engine for english,bangla, hindi and indonesia language. can anybody guide me how to configure solr schema. 1.) should i need to configure all the language in a single shard/collection. ? 2.)should I need to configure separate shard/collection for

Re: Tokenizing Chinese & multi-language search

2011-03-15 Thread Andy
ue, 3/15/11, Otis Gospodnetic wrote: > From: Otis Gospodnetic > Subject: Re: Tokenizing Chinese & multi-language search > To: solr-user@lucene.apache.org > Date: Tuesday, March 15, 2011, 11:51 PM > Hi Andy, > > Is the "I don't know what language the query i

Re: Tokenizing Chinese & multi-language search

2011-03-15 Thread Otis Gospodnetic
ext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Andy > To: solr-user@lucene.apache.org > Sent: Tue, March 15, 2011 9:07:36 PM > Subject: Tokenizing Chinese & multi-language search > > Hi, > > I rem

Tokenizing Chinese & multi-language search

2011-03-15 Thread Andy
string. If I just use the standard analyzer on the query string, any query that's in Chinese won't be tokenized correctly. So would the whole system still work in this case? This must be a pretty common use case, handling multi-language search. What is the recommended way of dealing with this problem? Thanks. Andy

Re: multi-language search

2009-08-25 Thread Erik Hatcher
On Aug 25, 2009, at 10:34 AM, Elaine Li wrote: I am still looking for help on chinese language search. I tried chinesetokenizerfactory as my analyzer, but it did not help. Only word with white space, comma and etc around them can be found. Try using the StandardTokenizerFactory - it handles Ch

Re: multi-language search

2009-08-25 Thread Elaine Li
Uri, Thanks a lot! I don't need to do cross language search. So Option 2 sounds better, coz my corpus is very large. I am still looking for help on chinese language search. I tried chinesetokenizerfactory as my analyzer, but it did not help. Only word with white space, comma and etc around them c

Re: multi-language search

2009-08-24 Thread Uri Boness
I can think of ways to tackle your problem: Option 1: each document will have a field indicating its language. Then, when searching, you can simply filter the query on the language you're searching on. Advantages: everything is in one index, so if in the future you will need to do a cross lang

multi-language search

2009-08-24 Thread Elaine Li
Hi, I have two questions. 1) Can solr be configured so all my english docs will be saved in a group, say group-en? My chinese docs will be saved in group-cn. So my search will only be conducted in the intended group, instead of everywhere. 2) I posted some chinese docs to the server. The query o

Re: Multi language search help

2008-12-19 Thread Sujatha Arun
Thanks Grant, The requirement from the user end is to only search in that particular language and not across languages. Also going forward we will be adding more languages. so if i have separate fields for each language ,then we need to change the schema everytime and that will not scale very we

Re: Multi language search help

2008-12-18 Thread Grant Ingersoll
On Dec 18, 2008, at 6:25 AM, Sujatha Arun wrote: Hi, I am prototyping lanuage search using solr 1.3 .I have 3 fields in the schema -id,content and language. I am indexing 3 pdf files ,the languages are foroyo,chinese and japanese. I use xpdf to convert the content of pdf to text and pu

Multi language search help

2008-12-18 Thread Sujatha Arun
Hi, I am prototyping lanuage search using solr 1.3 .I have 3 fields in the schema -id,content and language. I am indexing 3 pdf files ,the languages are foroyo,chinese and japanese. I use xpdf to convert the content of pdf to text and push the text to solr in the content field. What is the anal

Re: Multi Language Search

2008-12-04 Thread Grant Ingersoll
On Dec 2, 2008, at 4:52 AM, tushar kapoor wrote: 1. AND This is the way the query should look, but there's no reason why you can't let you're users input AND in Russian and then you substitute it when you create the query. or rather, 2 . Now over to solr specific question. In

Re: Multi Language Search

2008-12-03 Thread Shalin Shekhar Mangar
the Language anallyzers > but I m not too sure how exactly it works. > > Regards, > Tushar. > -- > View this message in context: > http://www.nabble.com/Multi-Language-Search-tp20789025p20789025.html > Sent from the Solr - User mailing list archive at Nabble.com. > > -- Regards, Shalin Shekhar Mangar.

Multi Language Search

2008-12-02 Thread tushar kapoor
ific question. In case the answer to above is either 1. or 2. how does one do it using Solr. I tried using the Language anallyzers but I m not too sure how exactly it works. Regards, Tushar. -- View this message in context: http://www.nabble.com/Multi-Language-Search-tp20789025p20789025.html