Re: Solr Query Slowliness

Thank you guys for your replies, Sorry that I forgot to mention that I have allocated 10 GB of memory to the Java Heap. 2013/12/26 Shawn Heisey > On 12/26/2013 3:38 AM, Jilal Oussama wrote: > > Solr was hosted on an Amazon ec2 m1.large (2 vCPU with 4 ECU, 7.5 GB > memory > > & 840 GB storage)

lots of tlog.

Hi There is a failed core in my solrcloud cluster(solr 4.6 with hdfs 2.2) when I start my solrcloud . I noticed that there are lots of tlog files [1] . The start proccess was stuck ,it need to do log replay.However it encountered error[2]. I do think that it is abnormal that there are still

Re: How to use Solr in my project

Highlighting can be done as three step process: Pre-requisite: Get the pdf with text after the OCR of the image pdf. Step 1: For sending the extracted text content from text pdf to solr, use a low level pdf converter such as poppler-utils (pdftotext or pdftohtml) to correctly get the coordinates

Disable caching on sorting to improve performance

I'm getting a lot of java heap memory full errors. I've now been reading into solr performance (in the meantime also configuring the sematext tools to try to drill down to the cause) I already increased the memory available to Solr: bash -c "cd /cygdrive/c/Databases/solr-4.3.1/example/;java -Dsolr

Re: Possible memory leak after segment merge? (related to DocValues?)

Likely this is for field norms, which use doc values under the hood. Mike McCandless http://blog.mikemccandless.com On Thu, Dec 26, 2013 at 5:03 PM, Greg Preston wrote: > Does anybody with knowledge of solr internals know why I'm seeing > instances of Lucene42DocValuesProducer when I don't hav

RE: Disable caching on sorting to improve performance

Hi, Sorting uses Lucene FieldCache which you cannot disable. If you have lots of documents and sort on three fields, you must increase the heap space. Also, note that you have defined Xmx twice here, i don't know what effect that will have. Cheers -Original message- > From:PeterKer

RE: Disable caching on sorting to improve performance

Thanks and good call, that has been there for quite some time! I've changed it to: -Xms200m -Xmx1500m I'll look into the effect of this first. -- View this message in context: http://lucene.472066.n3.nabble.com/Disable-caching-on-sorting-to-improve-performance-tp4108356p4108362.html Sent from

Query time join with conditions

Hello, I have one physical Solr collection and multiple logical collections in it. The separation is done by using the "type" field (Ruby on Rails application). So I have 2 logical collections: Profile and RssEntry and would not want to add RssEntries content to Profiles index. When I want to sear

Error -please help

Hi, I am running into below errors when running checkindex utility : /java -cp /apps/search/tomcat/webapps/solr/WEB-INF/lib/lucene-core-4.4.0.jar org.apache.lucene.index.CheckIndex .// // //NOTE: testing will be more thorough if you run java with '-ea:org.apache.lucene...', so assertions ar

Re: Possible memory leak after segment merge? (related to DocValues?)

Interesting. I'm not using score at all (all searches have an explicit sort defined). I'll try setting omit norms on all my fields and see if I can reproduce. Thanks. -Greg On Fri, Dec 27, 2013 at 4:25 AM, Michael McCandless wrote: > Likely this is for field norms, which use doc values under

Re: Solr - Match whole word only in text fields

Hi Haya, Yes you are correct, "myName=aaa bbb" will produce index terms: "myName", "aaa", "bbb". You can verify this at admin analysis page. You can test your analyzer by entering sample text in  an user interface.  Your query "myName aaa" will be a Phrase Query and will match with above settin

adding wild card at the end of the text and search(like sql like search)

My field type is text and i am using WhitespaceTokenizer. I want to search like SQL like search ie I want to search for ORGANIZATION_NAME field ORGANIZATION_NAM:"JOHNSON & SO"* should return "JOHNSON & SON", "JOHNSON & SONS", "JOHNSON & SONS COMPANY"... I tried ORGANIZATION_NAM:"JOHNSON &" AND

Re: adding wild card at the end of the text and search(like sql like search)

Hi Suren, With https://issues.apache.org/jira/browse/SOLR-1604 it is possible but it requires re-packaging solr.war. Your query will be : ORGANIZATION_NAM:"JOHNSON & SO*" Ahmet On Friday, December 27, 2013 9:03 PM, suren wrote: My field type is text and i am using WhitespaceTokenizer. I wan

Re: adding wild card at the end of the text and search(like sql like search)

Hi Suren, You could try a textfield with a WordDelimiter filter + EdgeNGram filter (this latter only in the index analyzer). In this way your heading will be indexed as Jo Joh John Johns Johnsonso Johnsonson Johnsonsons and a query for Johnson & so Will be translated into Johnsonso Therf

Re: lots of tlog.

Do you have auto commit (not softAutoCommit) on? At what value? Are you ever opening a new searcher? - Mark On 12/27/2013 05:17 AM, YouPeng Yang wrote: > Hi > There is a failed core in my solrcloud cluster(solr 4.6 with hdfs 2.2) > when I start my solrcloud . I noticed that there are lots of t

Trigger event on change of a field in a document

I am experimenting with implementing a price drop feature. Can I register some document's fields and trigger some sort of events if the values change in those fields? For example: 1. Price of itemX is $10 2. Say the price changes to $17 or $5 (increases or decreases) when the new data loads. 3. Tr

Re: Trigger event on change of a field in a document

Hi, This sounds like it would be best implemented outside the search engine. Otis Solr & ElasticSearch Support http://sematext.com/ On Dec 27, 2013 4:29 PM, "Utkarsh Sengar" wrote: > I am experimenting with implementing a price drop feature. > Can I register some document's fields and trigger s

Re: Trigger event on change of a field in a document

And if you really really really wanted that in Solr then have a look at UpdateRequestProcessors. Otis Solr & ElasticSearch Support http://sematext.com/ On Dec 27, 2013 6:19 PM, "Otis Gospodnetic" wrote: > Hi, > > This sounds like it would be best implemented outside the search engine. > > Otis >

Re: Trigger event on change of a field in a document

Thanks! I think, I will explore how to implement it outside solr. -Utkarsh On Fri, Dec 27, 2013 at 3:20 PM, Otis Gospodnetic < otis.gospodne...@gmail.com> wrote: > And if you really really really wanted that in Solr then have a look at > UpdateRequestProcessors. > > Otis > Solr & ElasticSearch

Re: lots of tlog.

Hi Mark Yes i have auto commit on just as other cores. All of my core are with the same configuration.the maxtime is 60s, max number is 10. Have not new searcher opening. On contrast with others , only this core is abnormal. Even it cannot relay the log,because of the exceptio

Re: how to best convert some term in q to a fq

what if you add your country field to qf with a strong boost? the search experience would be slightly different than if you filter on country, but maybe still good enough for your users and certainly simpler to implement and maintain. You'd likely only want exact matches. Assuming you are using edi