Filter query cache issues
Hi, I'm working with an index that contains 4,447,390 documents. The response time for querying using facets is pretty darn slow. I'm fairly new to more advanced Solr usage and today have started looking into the solrconfig.xml. In the solr admin app, I noticed that the filterCache evictions were around 14,194,010 - is this saying that 14,194,010 items that were supposed to be cached were not? Here are the stats as they stand currently. Would someone mind looking at this and giving me an analysis of sorts? Thank you - matt filterCache - STATS: ** lookups : 14576040 hits : 49737 hitratio : 0.00 inserts : 14526389 evictions : 14194010 size : 2048 cumulative_lookups : 14576040 cumulative_hits : 49737 cumulative_hitratio : 0.00 cumulative_inserts : 14526389 cumulative_evictions : 14194010
Facet numFound for facet values?
Hi, I'm trying to find a way to paginate through facet values. But it seems that there is not a way to get the total number of values (numFound) under a given facet field? For example, if I have a facet field called "composition_era_facet" and the values are: 15th Century 16th Century 17th Century 18th Century 19th Century 20th Century and I want pagination with 3 of those values per page, how do I calculate the total pages? Or get the "numFound"? Thank you, Matt
Re: Facet numFound for facet values?
Hi, So if my facet fields (and values) are changing depending on the query/filters I have set, it sounds like it is not currently possible to paginate through a single, facet field's values using a "total pages" value? Thanks, Matt On Fri, Feb 29, 2008 at 6:09 PM, Yonik Seeley <[EMAIL PROTECTED]> wrote: > On Fri, Feb 29, 2008 at 5:37 PM, Matt M. <[EMAIL PROTECTED]> wrote: > > I'm trying to find a way to paginate through facet values. But it seems > that > > there is not a way to get the total number of values (numFound) under a > > given facet field? > > If you include zero counts, it's the same for every query, and you > could get the total number of terms in a field from the luke handler. > Otherwise, that info is not calculated, and would be much more > expensive to calculate. > > -Yonik >
Re: Facet numFound for facet values?
OK no problem. Thanks for explaining that to me. Actually it makes my life easier :) Matt On Sat, Mar 1, 2008 at 5:53 PM, Yonik Seeley <[EMAIL PROTECTED]> wrote: > On Sat, Mar 1, 2008 at 5:43 PM, Matt M. <[EMAIL PROTECTED]> wrote: > > So if my facet fields (and values) are changing depending on the > > query/filters I have set, it sounds like it is not currently possible > to > > paginate through a single, facet field's values using a "total pages" > value? > > Right. > > A feature like that could be developed, but the cost is not simply a > counter... it would mean extra CPU since the current facet code > short-circuits evaluation of some facets, and that would not be > possible if one is trying to calculate that exact number. > > -Yonik >
Solr-ruby response structure inconsistent
Hi,
I've just noticed while switching connections between two different solr
instances (different servers) that their facet response structures are not
the same. But the Solr version is identical; 1.2. I've pasted in the
significant part of the response. Note the facet_fields in the first is a
Hash, but in the second, a simple list. Is there a known fix for this? I've
tried the stable solr-ruby gem and the trunk.
'facet_fields'=>{'recording_format_facet'=>{'LP'=>220,'Cassette'=>87,'CD'=>1,''=>34685
'facet_fields'=>{'collection_facet'=>['UVa Library Text',5396,'Art and
Architecture',4629,'UVa Image Collection',4014,'Jackson Davis
Collection',2996,'Chadwyk Healey Poetry',1771,'Chadwyk Healey American
Poetry',1288,nil,4422330]}}}
Thanks!
Matt
Re: Solr-ruby response structure inconsistent
Just wanted to mention... the solr-ruby package has nothing to do with this.
These are responses straight out of the solr/select handler.
Matt
On Mon, Mar 10, 2008 at 12:07 PM, Matt M. <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I've just noticed while switching connections between two different solr
> instances (different servers) that their facet response structures are not
> the same. But the Solr version is identical; 1.2. I've pasted in the
> significant part of the response. Note the facet_fields in the first is a
> Hash, but in the second, a simple list. Is there a known fix for this? I've
> tried the stable solr-ruby gem and the trunk.
>
>
> 'facet_fields'=>{'recording_format_facet'=>{'LP'=>220,'Cassette'=>87,'CD'=>1,''=>34685
>
> 'facet_fields'=>{'collection_facet'=>['UVa Library Text',5396,'Art and
> Architecture',4629,'UVa Image Collection',4014,'Jackson Davis
> Collection',2996,'Chadwyk Healey Poetry',1771,'Chadwyk Healey American
> Poetry',1288,nil,4422330]}}}
>
> Thanks!
> Matt
>
>
Re: Solr-ruby response structure inconsistent
I (and Erik) solved my problem! It was from a setting in the
solrconfig.xmlfile. Under the settings for the standard request. I
ended up copying the
schema from the acts_as_solr library, and didn't notice this one little
change:
map
That tells Solr to return the json result (or Ruby or Python) in a mapped
hash. Other types are available as well. More information on this can be
found here:
http://wiki.apache.org/solr/SolJSON
One thing that still seems to be a problem though. The sort order doesn't
seem to work correctly when using the "map" (hash) type. I solved this by
sorting the facet values result in in my Ruby code.
Thanks for your help Erik.
Matt
In context:
explicit
map
On Mon, Mar 10, 2008 at 12:35 PM, Matt M. <[EMAIL PROTECTED]> wrote:
> Just wanted to mention... the solr-ruby package has nothing to do with
> this. These are responses straight out of the solr/select handler.
>
> Matt
>
>
> On Mon, Mar 10, 2008 at 12:07 PM, Matt M. <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > I've just noticed while switching connections between two different solr
> > instances (different servers) that their facet response structures are not
> > the same. But the Solr version is identical; 1.2. I've pasted in the
> > significant part of the response. Note the facet_fields in the first is a
> > Hash, but in the second, a simple list. Is there a known fix for this? I've
> > tried the stable solr-ruby gem and the trunk.
> >
> >
> > 'facet_fields'=>{'recording_format_facet'=>{'LP'=>220,'Cassette'=>87,'CD'=>1,''=>34685
> >
> > 'facet_fields'=>{'collection_facet'=>['UVa Library Text',5396,'Art and
> > Architecture',4629,'UVa Image Collection',4014,'Jackson Davis
> > Collection',2996,'Chadwyk Healey Poetry',1771,'Chadwyk Healey American
> > Poetry',1288,nil,4422330]}}}
> >
> >
> > Thanks!
> > Matt
> >
> >
>
