Yeah, you aren't going to be able to do highlighting on a very very
large field without terrible performance. I believe it's just the
nature of the algorithm used by the highlighting component. I don't know
of any workaround. Other than inventing a new algorithm for
highlighting and writing a component for it.
Even with an AJAX call, you don't want to wait 3 minutes. Plus the load
on your server.
On 3/23/2011 3:52 PM, Paul wrote:
I looked into the search that I'm doing a little closer and it seems
like the highlighting is slowing it down. If I do the query without
requesting highlighting it is fast. (BTW, I also have faceting and
pagination in my query. Faceting doesn't seem to change the response
time much, adding&rows= and&start= does, but not prohibitively.)
The field in question needs to be stored=true, because it is needed
for highlighting.
I'm thinking of doing this in two searches: first without highlighting
and put a progress spinner next to each result, then do an ajax call
to repeat the search with highlighting that can take its time to
finish.
(I, too, have seen random really long response times that seem to be
related to not enough RAM, but this isn't the problem because the
results here are repeatable.)
On Wed, Mar 23, 2011 at 2:30 PM, Sascha Szott<sz...@zib.de> wrote:
On 23.03.2011 18:52, Paul wrote:
I increased maxFieldLength and reindexed a small number of documents.
That worked -- I got the correct results. In 3 minutes!
Did you mark the field in question as stored = false?
-Sascha
I assume that if I reindex all my documents that all searches will
become even slower. Is there any way to get all the results in a way
that is quick enough that my user won't get bored waiting? Is there
some optimization of this coming in solr 3.0?
On Wed, Mar 23, 2011 at 12:15 PM, Sascha Szott<sz...@zib.de> wrote:
Hi Paul,
did you increase the value of the maxFieldLength parameter in your
solrconfig.xml?
-Sascha
On 23.03.2011 17:05, Paul wrote:
I'm using solr 1.4.1.
I have a document that has a pretty big field. If I search for a
phrase that occurs near the start of that field, it works fine. If I
search for a phrase that appears even a little ways into the field, it
doesn't find it. Is there some limit to how far into a field solr will
search?
Here's the way I'm doing the search. All I'm changing is the text I'm
searching on to make it succeed or fail:
http://localhost:8983/solr/my_core/select/?q=%22search+phrase%22&hl=on&hl.fl=text
Or, if it is not related to how large the document is, what else could
it possibly be related to? Could there be some character in that field
that is stopping the search?
