out of memory during indexing do to large incoming queue

2013-06-02 Thread Yoni Amir
Hello, I am receiving OutOfMemoryError during indexing, and after investigating the heap dump, I am still missing some information, and I thought this might be a good place for help. I am using Solr 4.0 beta, and I have 5 threads that send update requests to Solr. Each request is a bulk of 100

RE: out of memory during indexing do to large incoming queue

2013-06-02 Thread Yoni Amir
ecessary to avoid such a large number of segments? Is it possible? Thanks again, Yoni -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: Sunday, June 02, 2013 18:05 To: solr-user@lucene.apache.org Subject: Re: out of memory during indexing do to large incoming queue

RE: out of memory during indexing do to large incoming queue

2013-06-03 Thread Yoni Amir
xing do to large incoming queue On 6/2/2013 12:25 PM, Yoni Amir wrote: > Hi Shawn and Shreejay, thanks for the response. > Here is some more information: > 1) The machine is a virtual machine on ESX server. It has 4 CPUs and > 8GB of RAM. I don't remember what CPU but something mod

statistics about segments

2013-06-11 Thread Yoni Amir
In the Solr UI, there is the number of segments in the core. Is there information in Solr (in the UI or in xml responses) about their histogram? I.e., their size, how many are there in each size level? Are there any that are currently being merged, etc.? Thanks, Yoni Confidentiality: This commun

RE: out of memory during indexing do to large incoming queue

2013-06-17 Thread Yoni Amir
n, Yoni -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: Monday, June 03, 2013 17:08 To: solr-user@lucene.apache.org Subject: Re: out of memory during indexing do to large incoming queue On 6/3/2013 1:06 AM, Yoni Amir wrote: > Solrconfig.xml -> http://apaste.info/d

highlighting tint fields

2012-08-05 Thread Yoni Amir
Hello, (sorry for the empty message earlier, that was by mistake) I am experiencing a strange problem with highlighting. I have a simple configuration roughly as follows: edismax all_text ... on * false I run the search on a single catch-all field calle

hl.fl is ignored in solr 4 beta?

2012-08-26 Thread Yoni Amir
I have a setup for /select handler which, regarding highlighting, looks roughly like this: edismax all_text ... id, module, identifier, type, category, ... , score

RE: hl.fl is ignored in solr 4 beta?

2012-08-26 Thread Yoni Amir
I managed to narrow it down to the presence of dynamic field "*_custom_txt" in the hl.fl list. If the list contains only regular fields the highlighting works fine. However, I also want to highlight some dynamic fields. Is this a bug? Thanks, Yoni -Original Message----- From:

RE: hl.fl is ignored in solr 4 beta?

2012-08-27 Thread Yoni Amir
fl, glob is only supported using the vertical bar as a list delimiter. -- Jack Krupansky -Original Message- From: Yoni Amir Sent: Sunday, August 26, 2012 5:07 AM To: solr-user@lucene.apache.org Subject: RE: hl.fl is ignored in solr 4 beta? I managed to narrow it down to the presence of dy

RE: hl.fl is ignored in solr 4 beta?

2012-08-27 Thread Yoni Amir
lr/highlight/SolrHighlighter.java?view=markup -- Jack Krupansky -Original Message- From: Yoni Amir Sent: Monday, August 27, 2012 3:31 AM To: solr-user@lucene.apache.org Subject: RE: hl.fl is ignored in solr 4 beta? Thanks for this information. Can you please send me to the right place in

solrj api for partial document update

2012-08-29 Thread Yoni Amir
Is there a solrj api for partial document update in solr 4. It is described here: http://solr.pl/en/2012/07/09/solr-4-0-partial-documents-update/ That article explains how the xml structure should be. I want to use solrj api, but I can't figure out if it is supported. Thanks, Yoni -Origin

RE: solrj api for partial document update

2012-09-01 Thread Yoni Amir
Any word on this? I inspected the solrj code an found nothing. It's a shame if the GA version comes out without such an api. Thanks again, Yoni -Original Message- From: Yoni Amir [mailto:yoni.a...@actimize.com] Sent: Thursday, August 30, 2012 8:48 AM To: solr-user@lucene.apach

RE: solrj api for partial document update

2012-09-02 Thread Yoni Amir
but it doesn't work. Solr doesn't update the field as I expected. According to this link: http://solr.pl/en/2012/07/09/solr-4-0-partial-documents-update/ valid values are "set" and "add". Any idea? Thanks, Yoni -Original Message- From: Yoni Amir [mailto:yoni

exception in highlighter when using phrase search

2012-09-04 Thread Yoni Amir
I got this problem with solr 4 beta and the highlighting component. When I search for a phrase, such as "foo bar", everything works ok. When I add highlighting, I get this exception below. You can see according to the first log line that I am searching only one field (all_text), but what is not

RE: exception in highlighter when using phrase search

2012-09-05 Thread Yoni Amir
I think I found the cause for this. It is partially my fault, because I sent solr a field with empty value, but this is also a configuration problem. https://issues.apache.org/jira/browse/SOLR-3792 -Original Message- From: Yoni Amir [mailto:yoni.a...@actimize.com] Sent: Tuesday

RE: Solr 4.0alpha: edismax complaints on certain characters

2012-09-06 Thread Yoni Amir
As far as I understand, / is a special character and needs to be escaped. Maybe "foo\/bar" should work? I found this when I looked at the code of ClientUtils.escapeQueryChars: // These characters are part of the query syntax and must be escaped if (c == '\\' || c == '+' || c == '-' || c ==

problem with hl.mergeContinuous

2012-10-04 Thread Yoni Amir
I am using a configuration roughly as follows (with solr 4 beta): true true 4 true The fragment/snippet size is 100 by default. I found a strange case as follows: The word that I search for appears in a field somewhere between the 300th and 400th characters. Solr, in