Re: Very basic questions: Indexing text - working, but slow!

2010-06-29 Thread Lance Norskog
To highlight a field, Solr needs some extra Lucene values. If these are not configured for the field in the schema, Solr has to re-analyze the field to highlight it. If you want faster highlighting, you have to add term vectors to the schema. Here is the grand map of such things: http://wiki.apach

Re: Very basic questions: Indexing text - working, but slow!

2010-06-29 Thread Erick Erickson
What are you actual highlighting requirements? you could try things like maxAnalyzedChars, requireFieldMatch, etc http://wiki.apache.org/solr/HighlightingParameters has a good list, but you've probably already seen that page Best Erick On Tue, Jun 29, 2010 at 9:11 PM, Peter Spam wrote:

Re: Very basic questions: Indexing text - working, but slow!

2010-06-29 Thread Peter Spam
To follow up, I've found that my queries are very fast (even with &fq=), until I add &hl=true. What can I do to speed up highlighting? Should I consider injecting a line at a time, rather than the entire file as a field? -Pete On Jun 29, 2010, at 11:07 AM, Peter Spam wrote: > Thanks for eve

Re: Very basic questions: Indexing text - working, but slow!

2010-06-29 Thread Peter Spam
Thanks for everyone's help - I have this working now, but sometimes the queries are incredibly slow!! For example, 461360. Also, I had to bump up the min/max RAM size to 1GB/3.5GB for things to inject without throwing heap memory errors. However, my data set is very small! 36 text files, fo