The 1.4 highlighter is Now slower if you have multi term queries or
phrase queries. You can get the old behavior (which is faster) if you
pass usePhraseHighlighter=false - but you will not get correct phrase
highlighting and multi term queries won't highlight - eg prefix/
wildcard/range.
- Mark
http://www.lucidimagination.com (mobile)
On Nov 3, 2009, at 8:18 PM, Jake Brownell <ja...@benetech.org> wrote:
Hi,
The fix MarkM provided yesterday for the problem I reported
encountering with the highlighter appears to be working--I installed
the Lucene 2.9.1 rc4 artifacts.
Now I'm running into an oddity regarding performance. Our
integration test is running slower than it used to. I've placed some
average timings below. I'll try to describe what the test does in
the hopes that someone will have some insight.
The indexing time represents the time it takes to load and index/
commit ~43 books. The test then does two sets of searches.
A basic search is a dismax search across several fields including
the text of the book. It searches either the exact title (in quotes)
or the ISBN. Highlighting is enabled on the field that holds the
text of the book.
An advanced search uses a nested dismax (inside a normal Lucene), to
search for either the exact title (in quotes) or the ISBN. The main
difference is that the title is only matched against fields related
to titles, not authors, text of the book, etc. Highlighting is
enabled against the text of the book.
The indexing time remained fairly constant. I ran with and without
highlighting enabled, to see how much it was contributing. I am most
interested in the jumps in time between 1.3 and 1.4 for the
highlighting time.
with highlighting enabled
solr 1.3
Indexing: 40161ms
Basic: 12407ms
Advanced: 1106ms
solr 1.4 rc
Indexing: 41734ms
Basic: 26346ms
Advanced: 17067ms
without any highlighting
solr 1.3
Indexing: 41186ms
Basic: 1024ms
Advanced: 265ms
solr 1.4 rc
Indexing: 40981ms
Basic: 883ms
Advanced: 356ms
FWIW, the integration test uses an embedded solr server.
I supposed I should also ask if there are any general tips to speed
up highlighting?
Thanks,
Jake
