Re: highlighting performance

[ravi.gidwani]

Hey Matt:
 I have been facing the same issue. I have a text field that I
highlight along with other fields (may be 10 others fields). But If I enable
highlighting on this text field that contains large number of
characters/words ( > 100 000 characters) , highlighting suffers performance.
Queries return in about 15/20 seconds with this field enabled in highlights
as compared to less than a second WITHOUT this enabled in highlight.
I did try termvector=true , but I did not see any performance
gain either. 

Just wondering if you were able to solve your issue OR tweak the performance
in any other way. 

BTW , I use solr 1.3.

~Ravi .

goodieboy wrote:
> 
> Thanks Otis. I added termVector="true" for those fields, but there isn't a
> noticeable difference. So, just to be a little more clear, the dynamic
> fields I'm adding... there might be hundreds. Do you see this as a
> problem?
> 
> Thanks,
> Matt
> 
> On Fri, May 15, 2009 at 7:48 PM, Otis Gospodnetic <
> otis_gospodne...@yahoo.com> wrote:
> 
>>
>> Matt,
>>
>> I believe indexing those fields that you will use for highlighting with
>> term vectors enabled will make things faster (and your index a bit
>> bigger).
>>
>>
>> Otis --
>> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>>
>>
>>
>> - Original Message 
>> > From: Matt Mitchell 
>> > To: solr-user@lucene.apache.org
>> > Sent: Friday, May 15, 2009 5:08:23 PM
>> > Subject: highlighting performance
>> >
>> > Hi,
>> >
>> > I'm experimenting with highlighting and am noticing a big drop in
>> > performance with my setup. I have documents that use quite a few
>> dynamic
>> > fields (20-30). The fields are multiValued stored/indexed text fields,
>> each
>> > with a few paragraphs worth of text. My hl.fl param is set to *_t
>> >
>> > What kinds of things can I tweak to make this faster? Is it because I'm
>> > highlighting so many different fields?
>> >
>> > Thanks,
>> > Matt
>>
>>
> 
> 
Quoted from: 
http://www.nabble.com/highlighting-performance-tp23567323p23713406.html



goodieboy wrote:
> 
> Thanks Otis. I added termVector="true" for those fields, but there isn't a
> noticeable difference. So, just to be a little more clear, the dynamic
> fields I'm adding... there might be hundreds. Do you see this as a
> problem?
> 
> Thanks,
> Matt
> 
> On Fri, May 15, 2009 at 7:48 PM, Otis Gospodnetic <
> otis_gospodne...@yahoo.com> wrote:
> 
>>
>> Matt,
>>
>> I believe indexing those fields that you will use for highlighting with
>> term vectors enabled will make things faster (and your index a bit
>> bigger).
>>
>>
>> Otis --
>> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>>
>>
>>
>> - Original Message 
>> > From: Matt Mitchell 
>> > To: solr-user@lucene.apache.org
>> > Sent: Friday, May 15, 2009 5:08:23 PM
>> > Subject: highlighting performance
>> >
>> > Hi,
>> >
>> > I'm experimenting with highlighting and am noticing a big drop in
>> > performance with my setup. I have documents that use quite a few
>> dynamic
>> > fields (20-30). The fields are multiValued stored/indexed text fields,
>> each
>> > with a few paragraphs worth of text. My hl.fl param is set to *_t
>> >
>> > What kinds of things can I tweak to make this faster? Is it because I'm
>> > highlighting so many different fields?
>> >
>> > Thanks,
>> > Matt
>>
>>
> 
> 

-- 
View this message in context: 
http://www.nabble.com/highlighting-performance-tp23567323p24713543.html
Sent from the Solr - User mailing list archive at Nabble.com.

refering/alias other Solr documents

[ravi.gidwani]

Hi all:
Is in solr, that will allow documents referring each other ? In
other words, if a search for "abc" matches on document 1 , I should be able
to return document 2 even though the index does any fields matching "abc".
Here is the scenario with some more details:

Solr version:1.3

Scenario:
1) Solr Document 1 with say some field title="abc" and Solr Document 2 with
its own data.
2) User searches for "abc" and gets Document 1 as it matches on title field

Expected results:
When the user searches for "abc"  he it also get Document 2 along with
Document 1. 

I understand one way of doing this is to make sure Document 2 has all the
contents of Document 1. But this introduces a issue of keeping the two
documents (and hence their solr index) in sync with each other. 

I think I am looking for a mechanism like this:

Document 1 refers => document 2, Document 3. 

Hence whenever document 1 in part of search results, document 2 and document
3 will also be returned as search results .

I may be totally off on this expectation but am trying to solve a "Contains"
problem where lets say a book (represented as Document 1 in solr) "contains"
Chapters (represented by Document 2,3,4..) in solr. 

I hope this is not too confusing ;) 

TIA
~Ravi Gidwani
-- 
View this message in context: 
http://www.nabble.com/refering-alias-other-Solr-documents-tp24713855p24713855.html
Sent from the Solr - User mailing list archive at Nabble.com.