RE: Highlight results in Arabic are backword

2014-02-08 Thread Fatima Issawi
Thank you. I will look into that. > -Original Message- > From: Alexandre Rafalovitch [mailto:arafa...@gmail.com] > Sent: Sunday, February 09, 2014 9:35 AM > To: solr-user@lucene.apache.org > Subject: Re: Highlight results in Arabic are backword > > You will most probably put your English

Re: Highlight results in Arabic are backword

2014-02-08 Thread Alexandre Rafalovitch
You will most probably put your English and Arabic content into different fields. Mostly because you will want to apply different field type definitions to your English and Arabic text (tokenizers, etc). Also, I would search around the web for articles on multilingual approach to Solr, if you are

RE: Highlight results in Arabic are backword

2014-02-08 Thread Fatima Issawi
Thank you both for responding. Is there a way to specify to Solr to add those attributes on the field when it returns results (e.g. Language is Arabic, English. Or direction is LTR or RTL.)? Right now I only have Arabic content indexed, but we plan to add English in the near future. I don'

Re: Max Limit to Schema Fields - Solr 4.X

2014-02-08 Thread Shawn Heisey
On 2/8/2014 12:12 PM, Mike L. wrote: > Im going to try loading all 3000 fields in the schema and see how that goes. > Only concern is doing boolean searches and whether or not Ill run into URL > length issues but I guess Ill find out soon. It will likely work without a problem. As already menti

Re: A bit lost in the land of schemaless Solr

2014-02-08 Thread Jack Krupansky
File a Jira? (Really!) Yeah, the absolute separation of field and field type can be a bit annoying in some of these dynamic cases. It might be nice to have a hybrid - like a dynamic field with type details as nested content. I mean it does seems like one of the common use cases of dynamic fiel

Re: Max Limit to Schema Fields - Solr 4.X

2014-02-08 Thread Jack Krupansky
It's safe to say that you are on thin ice - try it and if it works well for your specific data and requirements, great. But if it eventually fails, you can't say we didn't warn you! Generally, I would say that "a few hundred" fields is the recommended limit - not that more will definitely caus

(lack) of error for missing library?

2014-02-08 Thread Benson Margulies
is the comment, but when I put a completely missing path in there -- no error. Should I file a JIRA?

A bit lost in the land of schemaless Solr

2014-02-08 Thread Benson Margulies
Say that I have 10 fieldTypes for 10 languages. Is there a way to associate a naming convention from field names to field types so that I can avoid bothering with all those dynamic fields?

Re: Commit Issue in Solr 3.4

2014-02-08 Thread Roman Chyla
Thanks for the links. I think it would be worth getting more detailed info. Because it could be the performance threshold, or it could be st else /such as updated java version or st else, loosely related to ram, eg what is held in memory before the commit, what is cached, leaked custom query object

Re: Max Limit to Schema Fields - Solr 4.X

2014-02-08 Thread Mike L.
That was the original plan. However its important to preserve the originating field that loaded the value. The data is very fine and granular and each field stores a particular value. When searching the data against solr - it would be important to know what docs contain that particular data fr

Re: Commit Issue in Solr 3.4

2014-02-08 Thread Shawn Heisey
On 2/8/2014 11:02 AM, Roman Chyla wrote: > I would be curious what the cause is. Samarth says that it worked for over > a year /and supposedly docs were being added all the time/. Did the index > grew considerably in the last period? Perhaps he could attach visualvm > while it is in the 'black hole

Re: Commit Issue in Solr 3.4

2014-02-08 Thread Roman Chyla
I would be curious what the cause is. Samarth says that it worked for over a year /and supposedly docs were being added all the time/. Did the index grew considerably in the last period? Perhaps he could attach visualvm while it is in the 'black hole' state to see what is actually going on. I don't

Re: Commit Issue in Solr 3.4

2014-02-08 Thread Shawn Heisey
On 2/8/2014 10:22 AM, Shawn Heisey wrote: > Can you share your solrconfig.xml file? I may be able to confirm a > couple of things I suspect, and depending on what's there, may be able > to offer some ideas to help a little bit. It's best if you use a file > sharing site like dropbox - the list do

Re: Commit Issue in Solr 3.4

2014-02-08 Thread Shawn Heisey
On 2/8/2014 1:40 AM, samarth s wrote: > Yes it is amazon ec2 indeed. > > To expqnd on that, > This solr deployment was working fine, handling the same load, on a 34 GB > instance on ebs storage for quite some time. To reduce the time taken by a > commit, I shifted this to a 30 GB SSD instance. It

Re: After upgrading indexer to SolrJ 4.6.1: o.a.solr.servlet.SolrDispatchFilter - Unknown type 19

2014-02-08 Thread Brett Hoerner
Mark, you were correct. I realized I was still running a prerelease of 4.6.1 (by a handful of commits). Bounced them with proper 4.6.1 and we're all good, sorry for the spam. :) On Sat, Feb 8, 2014 at 10:29 AM, Brett Hoerner wrote: > Oh, I was talking about my indexer. That stack is from my Solr

Re: After upgrading indexer to SolrJ 4.6.1: o.a.solr.servlet.SolrDispatchFilter - Unknown type 19

2014-02-08 Thread Brett Hoerner
Oh, I was talking about my indexer. That stack is from my Solr servers, very weird since it's *supposed* to be 4.6.1 . I'll dig in more, thanks. On Sat, Feb 8, 2014 at 10:21 AM, Mark Miller wrote: > If you look at the stack trace, the line numbers match 4.6.0 in the src, > but not 4.6.1. That c

Re: After upgrading indexer to SolrJ 4.6.1: o.a.solr.servlet.SolrDispatchFilter - Unknown type 19

2014-02-08 Thread Mark Miller
If you look at the stack trace, the line numbers match 4.6.0 in the src, but not 4.6.1. That code couldn’t have been 4.6.1 it seems. - Mark http://about.me/markrmiller On Feb 8, 2014, at 11:12 AM, Brett Hoerner wrote: > Hmmm, I'm assembling into an uberjar that forces uniqueness of classes. I

Re: After upgrading indexer to SolrJ 4.6.1: o.a.solr.servlet.SolrDispatchFilter - Unknown type 19

2014-02-08 Thread Brett Hoerner
Hmmm, I'm assembling into an uberjar that forces uniqueness of classes. I verified 4.6.1 is definitely winning and included alone when it breaks. On Sat, Feb 8, 2014 at 9:44 AM, Mark Miller wrote: > If that is the case we really have to dig in. Given the error, the first > thing I would assume

Re: Tf-Idf for a specific query

2014-02-08 Thread Erick Erickson
David: If you're, say, faceting on fields with lots of unique values, this will be quite expensive. No idea whether you can tolerate slower queries or not, just sayin' Erick On Fri, Feb 7, 2014 at 5:35 PM, David Miller wrote: > Thanks Mikhai, > > It seems that, this was what I was looking f

Re: SolrCloud: problems with delete

2014-02-08 Thread Erick Erickson
What version of Solr? If it works with commit=true, then it's working just fine. Index changes aren't visible for searchers until a commit occurs. How are you determining whether the doc is gone or not? A Solr search (which depends on commits) or examining the index from a low level? If the latte

Re: After upgrading indexer to SolrJ 4.6.1: o.a.solr.servlet.SolrDispatchFilter - Unknown type 19

2014-02-08 Thread Mark Miller
If that is the case we really have to dig in. Given the error, the first thing I would assume is that you have an old solrj jar or something before 4.6.1 involved with a 4.6.1 solrj jar or install. - Mark http://about.me/markrmiller On Feb 7, 2014, 7:15:24 PM, Mark Miller wrote: Hey, yea

Re: Solr Composite Unique key from existing fields in schema

2014-02-08 Thread tamanjit.bin...@yahoo.co.in
Also take a look at http://wiki.apache.org/solr/UniqueKey#Use_cases_which_require_a_unique_key_generated_from_data_in_the_document -- View this message in context: http://lucene.

Re: Solr Composite Unique key from existing fields in schema

2014-02-08 Thread tamanjit.bin...@yahoo.co.in
You could use a combination of all your composite key columns and put them in a field in solr which can then be used as the unique key. As in if you have two columns c1 and c2, you could have a field in solr which have the value as c1_c2 or something on those lines. -- View this message in cont

Re: Index a new record in MySQL

2014-02-08 Thread tamanjit.bin...@yahoo.co.in
The config seems ok. Have you checked the date in the properties file before a delta-import? MySql does give issues with date format. Also, check your webcontainer/solr logs; whether they give any exception when you call a delta-import. -- View this message in context: http://lucene.472066.n3.n

Re: Index a new record in MySQL

2014-02-08 Thread PeriS
Hi, Version of SOLR is 4.6 and here is my db-import-config.xml On Feb 8, 2014, at 7:29 AM, tamanjit.bin...@yahoo.co.in wrote: > But delta indexing is supposed to do that. Please share details of your > datatimport-config.xml an

Re: Index a new record in MySQL

2014-02-08 Thread tamanjit.bin...@yahoo.co.in
But delta indexing is supposed to do that. Please share details of your datatimport-config.xml and version of Solr for further help. -- View this message in context: http://lucene.472066.n3.nabble.com/Index-a-new-record-in-MySQL-tp4116164p4116184.html Sent from the Solr - User mailing list arch

Re: Commit Issue in Solr 3.4

2014-02-08 Thread samarth s
Yes it is amazon ec2 indeed. To expqnd on that, This solr deployment was working fine, handling the same load, on a 34 GB instance on ebs storage for quite some time. To reduce the time taken by a commit, I shifted this to a 30 GB SSD instance. It performed better in writes and commits for sure. B