Re: Slow faceting performance on a docValues field

2019-05-10 Thread gulats
maybe quite late to the party but for the benefit of future readers, experimentation with facet.range.method might be helpful (for solr versions 6 and above) as it allows us to use docValues as well for range faceting -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Slow faceting performance on a docValues field

2015-01-13 Thread David Smith
Shawn, I've been thinking along your lines, and continued to run tests through the day.  The results surprised me. For my index, Solr range faceting time is most closely related to the total number of documents in the index for the range specified.  The number of "buckets" in the range is a sec

Re: Slow faceting performance on a docValues field

2015-01-13 Thread Shawn Heisey
On 1/13/2015 11:44 AM, David Smith wrote: > I looked at Interval faceting. My required interval is 1 day. I cannot > change that requirement. Unless I am mis-reading the doc, that means to > facet a 10 year range, the query needs to specify over 3,600 intervals ?? I am very ignorant of how th

Re: Slow faceting performance on a docValues field

2015-01-13 Thread Tomás Fernández Löbbe
"fc", "fcs" and "enum" only apply for field faceting, not range faceting. Tomás On Tue, Jan 13, 2015 at 11:24 AM, David Smith wrote: > What is stumping me is that the search result has 3 hits, yet faceting > those 3 hits takes 24 seconds. The documentation for facet.method=fc is > quite explic

Re: Slow faceting performance on a docValues field

2015-01-13 Thread David Smith
What is stumping me is that the search result has 3 hits, yet faceting those 3 hits takes 24 seconds.  The documentation for facet.method=fc is quite explicit about how Solr does faceting: "fc (stands for Field Cache) The facet counts are calculated by iterating over documents that match the q

Re: Slow faceting performance on a docValues field

2015-01-13 Thread Alexandre Rafalovitch
Could probably write a custom SearchComponent to prepend and expand the query for the required use case. Though if something then has to parse that query back, it would still be an issue. Regards, Alex Sign up for my Solr resources newsletter at http://www.solr-start.com/ On 13 January 201

Re: Slow faceting performance on a docValues field

2015-01-13 Thread Tomás Fernández Löbbe
Just a side question. In your first example you have dates set with time but in the second (where you set intervals) time is not set. Is this something that can be resolved having a field that only sets date (without time), and then use regular field faceting and facet.sort=index? If that's possibl

Re: Slow faceting performance on a docValues field

2015-01-13 Thread Tomás Fernández Löbbe
No, you are not misreading, right now there is no automatic way of generating the intervals on the server side similar to range faceting... I guess it won't work in your case. Maybe you should create a Jira to add this feature to interval faceting. Tomás On Tue, Jan 13, 2015 at 10:44 AM, David Sm

Re: Slow faceting performance on a docValues field

2015-01-13 Thread David Smith
Tomás, Thanks for the response -- the performance of my query makes perfect sense in light of your information. I looked at Interval faceting.  My required interval is 1 day.  I cannot change that requirement.  Unless I am mis-reading the doc, that means to facet a 10 year range, the query nee

Re: Slow faceting performance on a docValues field

2015-01-13 Thread David Smith
Shawn, Thanks for the suggestion, but experimentally, in my case the same query with facet.method=enum returns in almost the same amount of time. Regards David On Tuesday, January 13, 2015 12:02 PM, Shawn Heisey wrote: On 1/13/2015 10:35 AM, David Smith wrote: > I have a query aga

Re: Slow faceting performance on a docValues field

2015-01-13 Thread Tomás Fernández Löbbe
Range Faceting won't use the DocValues even if they are there set, it translates each gap to a filter. This means that it will end up using the FilterCache, which should cause faster followup queries if you repeat the same gaps (and don't commit). You may also want to try interval faceting, it will

Re: Slow faceting performance on a docValues field

2015-01-13 Thread Shawn Heisey
On 1/13/2015 10:35 AM, David Smith wrote: > I have a query against a single 50M doc index (175GB) using Solr 4.10.2, that > exhibits the following response times (via the debugQuery option in Solr > Admin): > "process": { > "time": 24709, > "query": { "time": 54 }, "facet": { "time": 24574 }, >