Nested documents (parent,child,grandchild), multi-select facets

2021-01-26 Thread Lance Snell
chema has a parent document, two child documents(siblings), and a grandchild document. I am using the JSON API . Product -> Item-> Price | \/ ProductCategory I created my schema to represent a multi-store, and multi-customer setup. I am looking for multi-select facets from *eac

Re: nested facets of query and terms type in JSON format

2020-12-10 Thread Arturas Mazeika
t; > "sort": { "t": "asc" }, > > > "start": "2018-05-02T17:00:00.000Z", > > > "end": "2020-11-16T21:00:00.000Z", > > > &q

Re: nested facets of query and terms type in JSON format

2020-12-10 Thread Jason Gerlowski
: "+1HOUR" > > "limit": 1 > > } > > } > > } > > } > > } > > > > On Thu, Dec 3, 2020 at 12:59 PM Arturas Mazeika wrote: > > > > > Hi Michael, > > >

Re: nested facets of query and terms type in JSON format

2020-12-03 Thread Arturas Mazeika
> On Thu, Dec 3, 2020 at 12:59 PM Arturas Mazeika wrote: > > > Hi Michael, > > > > Thanks for helping me to figure this out. > > > > If I fire: > > > > { > > "query" : "*:*", > > "limit" : 0, > >

Re: nested facets of query and terms type in JSON format

2020-12-03 Thread Michael Gibney
1:00:00.000Z", "gap": "+1HOUR" "limit": 1 } } } } } On Thu, Dec 3, 2020 at 12:59 PM Arturas Mazeika wrote: > Hi Michael, > > Thanks for helping me to figure

Re: nested facets of query and terms type in JSON format

2020-12-03 Thread Arturas Mazeika
Hi Michael, Thanks for helping me to figure this out. If I fire: { "query" : "*:*", "limit" : 0, "facet": { "aip": { "query": "cfname2:aip", } } } I get "response": { "num

Re: nested facets of query and terms type in JSON format

2020-12-03 Thread Michael Gibney
quot;, "prefix":"3" }, > "a4": { "query": "cfname2:4" }, > "a5": { "query": "cfname2:5" }, > "a6": { "query": "cfname2:6" }, > > "tt": { >

nested facets of query and terms type in JSON format

2020-12-03 Thread Arturas Mazeika
: "cfname2:5" }, "a6": { "query": "cfname2:6" }, "tt": { "t_buckets": { "type": "range", "field": "t", "sort": { "t": "asc" }, "start": "2018-05-02T17:00:00.000Z", "end": "2020-11-16T21:00:00.000Z", "gap": "+1HOUR" } } } } Single (not nested facets separately on individual queries as well as for range) work in flying colors. Cheers, Arturas

Re: Multiple Facets on Same Field

2020-11-17 Thread Michael Gibney
Ah, ok! The Jira issue mentioned in the mail thread you cited above has some further discussion/detail. (I don't think adding a "{!terms}" query filter would necessarily work ... it'd need to be a group of facets of type "query", sorted client-side ... unless

Re: Multiple Facets on Same Field

2020-11-17 Thread Jason Gerlowski
Thanks Michael, I agree - JSON Facets is a better candidate for the functionality I'm looking for. In my case specifically though, I think I'm pegged to traditional facets because I also want to use the "terms" local params support that doesn't have a native equival

Re: Multiple Facets on Same Field

2020-11-17 Thread Michael Gibney
Answering a slightly different question perhaps, but you can definitely do this with the "JSON Facet" API, where there's much cleaner separation between different facets (and output is assigned to arbitrary keys). Michael On Tue, Nov 17, 2020 at 9:36 AM Jason Gerlowski wrote: >

Multiple Facets on Same Field

2020-11-17 Thread Jason Gerlowski
Hi all, Is it possible to have multiple facets on the same field with different parameters (mincount, limit, prefix, etc.) on each? The ref-guide describes these per-facet parameters as being settable on a "per-field basis" with syntax of "f..facet." [1]. But I wasn't

Re: Simulate facet.exists for json query facets

2020-10-30 Thread Michael Gibney
ntaineering tour, ... > >> * We have hundreds of customers that want to facet their searches to that > >> content types but often with distinct combinations of categories, i.e. > >> customer A wants his facet "tours" to only count hiking tours, customer B > &

Re: Simulate facet.exists for json query facets

2020-10-30 Thread Erick Erickson
which >> themselves may be categorized: A tour may be a hiking tour, a >> mountaineering tour, ... >> * We have hundreds of customers that want to facet their searches to that >> content types but often with distinct combinations of categories, i.e. >> customer A wants h

Re: Simulate facet.exists for json query facets

2020-10-30 Thread Michael Gibney
s" to only count hiking tours, customer B > only mountaineering tours, customer C a combination of both, etc > * We use "query" facets as each facet request will be build dynamically (it > is not feasible to aggregate certain categories and add them as an > additional solr sch

Re: Simulate facet.exists for json query facets

2020-10-30 Thread michael dürr
searches to that content types but often with distinct combinations of categories, i.e. customer A wants his facet "tours" to only count hiking tours, customer B only mountaineering tours, customer C a combination of both, etc * We use "query" facets as each facet request will be b

Re: Simulate facet.exists for json query facets

2020-10-28 Thread Michael Gibney
e in the response, the ability to nest stats and subfacets, etc.) ... just thinking out loud at the moment ... On Wed, Oct 28, 2020 at 9:17 AM Erick Erickson wrote: > > This really sounds like an XY problem. The whole point of facets is > to count the number of documents that have a value in som

Re: Simulate facet.exists for json query facets

2020-10-28 Thread Erick Erickson
This really sounds like an XY problem. The whole point of facets is to count the number of documents that have a value in some number of buckets. So trying to stop your facet query as soon as it matches a hit for the first time seems like an odd thing to do. So what’s the “X”? In other words

Simulate facet.exists for json query facets

2020-10-28 Thread michael dürr
Hi, I use json facets of type 'query'. As these queries are pretty slow and I'm only interested in whether there is a match or not, I'd like to restrict the query execution similar to the standard facetting (like with the facet.exists parameter). My simplified query looks som

Filtering Parent documents based on Child documents Facets selection

2020-10-16 Thread Abhay Kumar
uot;id":"ta-0-NCT04372953", "therapeuticareaname":"Premature Birth", "text_prefixauto":"Premature Birth", "text_suggest":[ "Premature Birth" ], "diseaseareas":[

Solr 8.6.2 Facets query for Nested documents

2020-10-13 Thread Abhay Kumar
t;:[ { "id":"ta-0-NCT04372953", "therapeuticareaname":"Premature Birth", "text_prefixauto":"Premature Birth", "text_suggest":[ "Premature Birth" ], "disea

Re: facets & docValues

2020-05-13 Thread ART GALLERY
spot.com/ > > > On Tue, May 5, 2020 at 5:54 PM Revas wrote: > > > Hi joel, No, we have not, we have softCommit requirement of 2 secs. > > > > On Tue, May 5, 2020 at 3:31 PM Joel Bernstein wrote: > > > > > Have you configured static warming queries for the f

Re: multiple sort terms in json facets sorting

2020-05-13 Thread ART GALLERY
check out the videos on this website TROO.TUBE don't be such a sheep/zombie/loser/NPC. Much love! https://troo.tube/videos/watch/aaa64864-52ee-4201-922f-41300032f219 On Wed, May 13, 2020 at 7:56 AM Saurabh Sharma wrote: > > Hi All, > > I am trying to use two sorting criteria wit

multiple sort terms in json facets sorting

2020-05-13 Thread Saurabh Sharma
Hi All, I am trying to use two sorting criteria with json facets but found that only one of them is working and other one is not getting honoured. sort:{ sortingScore:desc , x:desc} , Here only sortingScore is being used by solr and parameter x is ignored . Is there any way using which I can use

Re: Limiting random results set with facets.

2020-05-12 Thread ART GALLERY
lucky)) > > > &start=0 > > > &rows=0 > > > &fq=channelId:(2 1 3 78 34 35 7 72) > > > &fq=date:([* TO 2020-05-12T03:59:59.999Z]) > > > &facet=true > > > &facet.field=channelId > > > &f.channelId.facet.limit=10

Re: Limiting random results set with facets.

2020-05-12 Thread David Lukowski
;facet.field=channelId > > &f.channelId.facet.limit=10 > > &f.channelId.facet.mincount=1 > > &hl=false > > &fl=id > > &wt=json > > &sort=random_123456 desc > > > > The issue is that I only want 100 random resul

Re: Limiting random results set with facets.

2020-05-12 Thread Srijan
nelId > &f.channelId.facet.limit=10 > &f.channelId.facet.mincount=1 > &hl=false > &fl=id > &wt=json > &sort=random_123456 desc > > The issue is that I only want 100 random results. Sure, I could limit > the results returned to the first 100 by sp

Re: Limiting random results set with facets.

2020-05-12 Thread David Lukowski
cet.limit=10 &f.channelId.facet.mincount=1 &hl=false &fl=id &wt=json &sort=random_123456 desc The issue is that I only want 100 random results. Sure, I could limit the results returned to the first 100 by specifying &rows=100, but the facets would match the query totals and

Re: Limiting random results set with facets.

2020-05-11 Thread Srijan
/faceting.html#tagging-and-excluding-filters On Mon, May 11, 2020 at 3:36 PM David Lukowski wrote: > I'm looking for a way if possible to run a query with random results, where > I limit the number of results I want back, yet still have the facets > accurately reflect the results I'm se

Limiting random results set with facets.

2020-05-11 Thread David Lukowski
I'm looking for a way if possible to run a query with random results, where I limit the number of results I want back, yet still have the facets accurately reflect the results I'm searching. When I run a search I use a filter query to randomize the results based on a modulo of a random

Re: facets & docValues

2020-05-07 Thread Joel Bernstein
Bernstein http://joelsolr.blogspot.com/ On Tue, May 5, 2020 at 5:54 PM Revas wrote: > Hi joel, No, we have not, we have softCommit requirement of 2 secs. > > On Tue, May 5, 2020 at 3:31 PM Joel Bernstein wrote: > > > Have you configured static warming queries for the face

Re: facets & docValues

2020-05-05 Thread Revas
Hi joel, No, we have not, we have softCommit requirement of 2 secs. On Tue, May 5, 2020 at 3:31 PM Joel Bernstein wrote: > Have you configured static warming queries for the facets? This will warm > the cache structures for the facet fields. You just want to make sure you > commits a

Re: facets & docValues

2020-05-05 Thread Joel Bernstein
Have you configured static warming queries for the facets? This will warm the cache structures for the facet fields. You just want to make sure you commits are spaced far enough apart that the warming completes before a new searcher starts warming. Joel Bernstein http://joelsolr.blogspot.com

Re: facets & docValues

2020-05-04 Thread Revas
Hi Erick, Thanks for the explanation and advise. With facet queries, does doc Values help at all ? 1) indexed=true, docValues=true => all facets 2) - indexed=true , docValues=true => only for subfacets - inexed=true, docValues=false=> facet query - docValues=true, inde

Re: facets & docValues

2020-04-16 Thread Erick Erickson
DocValues should help when faceting over fields, i.e. facet.field=blah. I would expect docValues to help with sub facets and, but don’t know the code well enough to say definitely one way or the other. The empirical approach would be to set “uninvertible=true” (Solr 7.6) and turn docValues off

Re: facets & docValues

2020-04-16 Thread Revas
Hi Erick, You are correct, we have only about 1.8M documents so far and turning on the indexing on the facet fields helped improve the timings of the facet query a lot which has (sub facets and facet queries). So does docValues help at all for sub facets and facet query, our tests revealed further

Re: facets & docValues

2020-04-15 Thread Erick Erickson
020, at 11:51 PM, Revas wrote: > > We have faceting fields that have been defined as indexed=false, > stored=false and docValues=true > > However we use a lot of subfacets using json facets and facet ranges > using facet.queries. We see that after every soft-commit our perf

facets & docValues

2020-04-14 Thread Revas
We have faceting fields that have been defined as indexed=false, stored=false and docValues=true However we use a lot of subfacets using json facets and facet ranges using facet.queries. We see that after every soft-commit our performance worsens and performs ideal between commits how is that

Re: Slow quires and facets

2020-02-15 Thread Mikhail Khludnev
I don't have any particular idea. Probably it's worth to start from learning debugQuery=true output. There are caveats: - it takes a while - it's worth to limit shards to a few ones - it used to produce incorrect json, and worked in only in wt=xml At least it let to sneak something about the longes

RE: Slow quires and facets

2020-02-15 Thread Rudenko, Artur
Promoting my question Artur Rudenko -Original Message- From: Rudenko, Artur Sent: Wednesday, February 12, 2020 10:33 PM To: solr-user@lucene.apache.org Subject: Slow quires and facets Hello everyone, I'm am currently investigating a performance issue in our environment: 20M

Slow quires and facets

2020-02-12 Thread Rudenko, Artur
Hello everyone, I'm am currently investigating a performance issue in our environment: 20M large PARENT documents and 800M nested small CHILD documents. The system inserts about 400K PARENT documents and 16M CHILD documents per day. (Currently we stopped the calls insertion to investigate the perf

Re: Solr 8.0 Json Facets are slow - need help

2020-01-23 Thread Mikhail Khludnev
Hello, Kumar. I don't know. 3 / 84 ratio seems reasonable. The only unknown part of the equation was that {!simpleFilter}. Anyway, profiler/sampler might get exact answer. On Fri, Jan 24, 2020 at 8:55 AM kumar gaurav wrote: > HI Mikhail > > Can you please see above debug log and help ? > > Than

Re: Solr 8.0 Json Facets are slow - need help

2020-01-23 Thread kumar gaurav
HI Mikhail Can you please see above debug log and help ? Thanks On Thu, Jan 23, 2020 at 12:05 AM kumar gaurav wrote: > Also > > its not looks like box is slow . because for following query prepare time > is 3 ms but facet time is 84ms on the same box .Don't know why prepare time > was huge fo

Re: Solr 8.0 Json Facets are slow - need help

2020-01-22 Thread kumar gaurav
Also its not looks like box is slow . because for following query prepare time is 3 ms but facet time is 84ms on the same box .Don't know why prepare time was huge for that example :( . debug: { - rawquerystring: "{!parent tag=top which=$pq filters=$child.fq score=max v=$cq}", - queryst

Re: Solr 8.0 Json Facets are slow - need help

2020-01-22 Thread kumar gaurav
't comment on it. > Parsing queries took in millis: - time: 261, usually prepare for query > takes a moment. I suspect the box is really slow per se or encounter heavy > load. > And then facets took about 6 times more - facet_module: { - time: 1122, > that a reasonable rat

Re: Solr 8.0 Json Facets are slow - need help

2020-01-22 Thread Mikhail Khludnev
Initial request refers unknown (to me) query parser {!simpleFilter, I can't comment on it. Parsing queries took in millis: - time: 261, usually prepare for query takes a moment. I suspect the box is really slow per se or encounter heavy load. And then facets took about 6 times

Re: Solr 8.0 Json Facets are slow - need help

2020-01-22 Thread kumar gaurav
; > { > > - productsCount: "uniqueBlock(_root_)" > > }, > > }, > > - size_refine: > > { > > - domain: > > { > > - excludeTags: "rassortment,top,top2,top3,t

Re: Solr 8.0 Json Facets are slow - need help

2020-01-22 Thread Mikhail Khludnev
ne1}) filter({!term f=color_refine v=$qcolor_refine2}) >> > qcolor_refine1=Blue >> > qcolor_refine2=Other clrs >> > cq=+{!simpleFilter v=docType:sku} >> > pq=docType:(product) >> > facet=true >> > facet.mincount=1 >> > facet.limit=-

Re: Solr 8.0 Json Facets are slow - need help

2020-01-21 Thread kumar gaurav
gt; qcolor_refine1=Blue >> > qcolor_refine2=Other clrs >> > cq=+{!simpleFilter v=docType:sku} >> > pq=docType:(product) >> > facet=true >> > facet.mincount=1 >> > facet.limit=-1 >> > facet.missing=false >> > json.facet= {c

Re: Solr 8.0 Json Facets are slow - need help

2020-01-21 Thread kumar gaurav
refine:{ > > domain:{ > > filter:["{!filters param=$child.fq excludeTags=rcolor_refine > > v=$sq}","{!child of=$pq filters=$fq}docType:(product)"] > >}, > > type:terms, > > field:color_refine, > > limit:-1, > > facet:{productsCount:"uni

Re: Solr 8.0 Json Facets are slow - need help

2020-01-21 Thread Mikhail Khludnev
}docType:(product)"] >}, > type:terms, > field:color_refine, > limit:-1, > facet:{productsCount:"uniqueBlock(_root_)"}}} > > schema :- > multiValued="true" docValues="true"/> > > i have observed that json facets are

Solr 8.0 Json Facets are slow - need help

2020-01-21 Thread kumar gaurav
lters param=$child.fq excludeTags=rcolor_refine v=$sq}","{!child of=$pq filters=$fq}docType:(product)"] }, type:terms, field:color_refine, limit:-1, facet:{productsCount:"uniqueBlock(_root_)"}}} schema :- i have observed that json facets are slow . It is taking much t

Re: JSON Facet doesn't allow date range facets

2019-12-12 Thread Joel Bernstein
/joelsolr.blogspot.com/ > >>>> > >>>> > >>>> On Thu, Dec 12, 2019 at 6:28 AM Mel Mason < > mel.ma...@bodleian.ox.ac.uk> > >>>> wrote: > >>>> > >>>>> Hi, > >>>>> > >>>>> I&

Re: JSON Facet doesn't allow date range facets

2019-12-12 Thread Mel Mason
olr/blob/master/solr/core/src/java/org/apache/solr/search/facet/FacetRange.java#L255 It looks like during the change to JSONFacet the range facets have been restricted to only allow Trie or PointField fields. Is this likely to be fixed in future updates, or were there problems with using DateRan

Re: JSON Facet doesn't allow date range facets

2019-12-12 Thread Joel Bernstein
acet system - a quick google turns up several other people with >> the >> >> same problem. When using JSONFacet I get problems with this line of >> >> code: >> >> >> >> >> https://github.com/apache/lucene-solr/blob/master/solr/core/src/j

Re: JSON Facet doesn't allow date range facets

2019-12-12 Thread Joel Bernstein
e with the > >> same problem. When using JSONFacet I get problems with this line of > >> code: > >> > >> > https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/search/facet/FacetRange.java#L255 > >> > >> It look

Re: JSON Facet doesn't allow date range facets

2019-12-12 Thread Mel Mason
oks like during the change to JSONFacet the range facets have been restricted to only allow Trie or PointField fields. Is this likely to be fixed in future updates, or were there problems with using DateRangeFields? I could use the old parameter facet system, but there are features in JSONFac

Re: JSON Facet doesn't allow date range facets

2019-12-12 Thread Joel Bernstein
ems with this line of > code: > > https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/search/facet/FacetRange.java#L255 > > It looks like during the change to JSONFacet the range facets have been > restricted to only allow Trie or PointField fields. Is t

Re: JSON Facet doesn't allow date range facets

2019-12-12 Thread Munendra S N
src/java/org/apache/solr/search/facet/FacetRange.java#L255 > > It looks like during the change to JSONFacet the range facets have been > restricted to only allow Trie or PointField fields. Is this likely to be > fixed in future updates, or were there problems with using > DateRangeFields? I

JSON Facet doesn't allow date range facets

2019-12-12 Thread Mel Mason
is line of code: https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/search/facet/FacetRange.java#L255 It looks like during the change to JSONFacet the range facets have been restricted to only allow Trie or PointField fields. Is this likely to be fixed in future u

RE: creating date facets

2019-06-20 Thread Nightingale, Jonathan A (US)
ld for hour of the day -Original Message- From: Erick Erickson Sent: Wednesday, June 19, 2019 1:34 PM To: solr-user@lucene.apache.org Subject: Re: creating date facets *** WARNING *** EXTERNAL EMAIL -- This message originates from outside our organization. There are two approaches I m

Re: creating date facets

2019-06-20 Thread Joel Bernstein
You might find this useful. If makes creating time series aggregations a little easier. It uses JSON facets under the covers and is very fast. https://lucene.apache.org/solr/guide/7_6/stream-source-reference.html#timeseries Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Jun 19, 2019 at 1

Re: creating date facets

2019-06-19 Thread Erick Erickson
19, 2019, at 10:25 AM, Nightingale, Jonathan A (US) > wrote: > > Hi all, > I'm trying to have a date field automatically generate some facets of itself, > like hour of the day and hour of the week as examples, when its stored. I was > looking at this tutorial and it

creating date facets

2019-06-19 Thread Nightingale, Jonathan A (US)
Hi all, I'm trying to have a date field automatically generate some facets of itself, like hour of the day and hour of the week as examples, when its stored. I was looking at this tutorial and it deemed to almost do what I wanted https://nathanfriend.io/2017/06/26/smart-date-searching

Re: Document IDs instead of count for facets?

2019-04-05 Thread Jan Moszczynski
This is old. Still worth replying, as sometimes somebody might stumble across the same problem. Well I achieved this rather simply by using facet.pivot. If you define your facet.pivot as “n_cellered_diseaseExact,id” you will get in return the data structure containing pivot list of all disease

Re: Solrj, Json Facets, (Date) stats facets

2019-03-11 Thread Jason Gerlowski
But in the meantime, unfortunately your only option is to use the NamedList structures directly to retrieve the stat value. Thanks for bringing it to our attention. Best, Jason On Fri, Mar 8, 2019 at 4:42 AM Andrea Gazzarini wrote: > > Good morning guys, I have a questions about Solrj and JSON

Solrj, Json Facets, (Date) stats facets

2019-03-08 Thread Andrea Gazzarini
Good morning guys, I have a questions about Solrj and JSON facets. I'm using Solr 7.7.1 and I'm sending a request like this: json.facet={x:'max(iterationTimestamp)'} where "iterationTimestamp" is a solr.DatePointField. The JSON response correctly includes wha

Re: Case insensitive query for fetching facets

2018-12-11 Thread Ritesh Kumar
Yes, all the three options (copy fields, using dynamic fields and the SortableTextField) are feasible. Since I am on the 7.5.0 version of Solr, I will go ahead with the SortableTextField option. Thank you team!! On Fri, Dec 7, 2018 at 8:46 PM Alexandre Rafalovitch wrote: > If you are on the la

Re: Case insensitive query for fetching facets

2018-12-07 Thread Alexandre Rafalovitch
If you are on the latest Solr (7.3+), try switching from TextField to SortableTextField in your string_ci definition above. That type implicitly uses docValues and should return original text for faceting purposes, while still allowing analyzers. Regards, Alex. On Thu, 6 Dec 2018 at 08:26, Rit

Re: Case insensitive query for fetching facets

2018-12-07 Thread David Hastings
you could change your indexer to index the values to a dynamic field *_ci for each of the facets. ie, your facet is organization. index to the string field, and also index it to the dynamic organization_ci field but there will not be a short cut way of doing this in the schema itself On Fri

Re: Case insensitive query for fetching facets

2018-12-06 Thread Mikhail Khludnev
Fields need to be copied. You can shorten the schema with using wildcards *. On Fri, Dec 7, 2018 at 9:03 AM Ritesh Kumar wrote: > Yes, it can be used. > But, what if I have other such facets on different other fields. Use of > copyField will require me to create a dedicated copy field

Re: Case insensitive query for fetching facets

2018-12-06 Thread Ritesh Kumar
Yes, it can be used. But, what if I have other such facets on different other fields. Use of copyField will require me to create a dedicated copy field for each such facet. I want to know if there is any other option where I do not have to add multiple copy fields. On Thu, Dec 6, 2018 at 7:06 PM

Re: Case insensitive query for fetching facets

2018-12-06 Thread Mikhail Khludnev
Hello, Ritesh. It's obviously done with copyField. On Thu, Dec 6, 2018 at 4:26 PM Ritesh Kumar wrote: > Hello team, > > I am trying to prepare facet on a field of type string. The facet data will > be shown according to the user's query on this very field. > > required="false" multiValued="fal

Case insensitive query for fetching facets

2018-12-06 Thread Ritesh Kumar
Hello team, I am trying to prepare facet on a field of type string. The facet data will be shown according to the user's query on this very field. As this field is of type string, it works fine with case sensitive query. I want to be able to query on this field irrespective of the case. I tri

Term insight with facets

2018-09-22 Thread John Blythe
Hi all. I’m trying to do some analysis on our data. Specifically hoping to see the top and bottom x% of terms in a particular field. I’d prefer to not loop through all terms by way of an updated offset if I can help it. Is there any cool way to request in the facet query a subset based on a dynam

Re: unique() in the JSON facets doesn’t count all the different values in a field

2018-08-27 Thread Alfonso Muñoz-Pomer Fuentes
> > Hi all, > > We’re running a SolrCloud 7.1 instance in our service and I’ve come across at > a disagreement when trying to find out the different values a field has: > > Using the JSON facets API with unique(): > 3385 > > Using the JSON facets API with te

unique() in the JSON facets doesn’t count all the different values in a field

2018-08-27 Thread Alfonso Muñoz-Pomer Fuentes
Hi all, We’re running a SolrCloud 7.1 instance in our service and I’ve come across at a disagreement when trying to find out the different values a field has: Using the JSON facets API with unique(): 3385 Using the JSON facets API with terms: 3388 Using the stats component: countDistinct

Re: Json Facets in version 7

2018-08-09 Thread Chris Ulicny
ocess of upgrading from version 6.3.0 to version 7.2.1 >> and have found something that doesn't seem to work with the json facets any >> more. The query is below >> >> /select?q=*:*&wt=xml&indent=off&rows=0&fq=groupid:(4572 >> 4573)+AN

Re: Json Facets in version 7

2018-08-09 Thread Chris Ulicny
ing from version 6.3.0 to version 7.2.1 and > have found something that doesn't seem to work with the json facets any > more. The query is below > > /select?q=*:*&wt=xml&indent=off&rows=0&fq=groupid:(4572 > 4573)+AND+gmttimestamp:[2018-08-05T00:00:00Z+TO+2018-

Json Facets in version 7

2018-08-09 Thread Chris Ulicny
Hi all, We are in the process of upgrading from version 6.3.0 to version 7.2.1 and have found something that doesn't seem to work with the json facets any more. The query is below /select?q=*:*&wt=xml&indent=off&rows=0&fq=groupid:(4572 4573)+AND+gmttimestamp:[2018-08-05

Re: Excluding facets - need help

2018-06-27 Thread Shawn Heisey
/faceting.html#Faceting-TaggingandExcludingFilters>). It works as I expect, the facet result are being build correctly with correct facet results, but the response from Solr is very slow and becasue of that I cannot deploy this on production (about 3.5 seconds). I'm going to trim out your actual query. Th

Excluding facets - need help

2018-06-27 Thread nc-tech-user
​Dear Solr User, I develop an online shop which has possibility to search for products and filter the results. I've used Solr as an engine to search through our shop offer. Currently I am trying to rebuild the products filter so it will use Solr search facet result to show its attributes. I am

Re: Facets OutOfMemoryException

2018-02-08 Thread Shawn Heisey
On 2/8/2018 5:36 AM, LOPEZ-CORTES Mariano-ext wrote: > We are just 1 field "status" in facets with a cardinality of 93. > > We realize that increasing memory will work. But, you think it's necessary? > > Thanks in advance. 2GB for 27 million docs seems a little bit s

RE: Facets OutOfMemoryException

2018-02-08 Thread Erick Erickson
First thing I'd try is setting docValues="true". You must blow away your entire index, like I'm -rf data And reindex. On Feb 8, 2018 04:37, "LOPEZ-CORTES Mariano-ext" < mariano.lopez-cortes-...@pole-emploi.fr> wrote: > We are just 1 field "status

RE: Facets OutOfMemoryException

2018-02-08 Thread LOPEZ-CORTES Mariano-ext
We are just 1 field "status" in facets with a cardinality of 93. We realize that increasing memory will work. But, you think it's necessary? Thanks in advance. -Message d'origine- De : Zisis T. [mailto:zist...@runbox.com] Envoyé : jeudi 8 février 2018

Re: Facets OutOfMemoryException

2018-02-08 Thread Zisis T.
I believe that things like the following will affect faceting memory requirements -> how many fields do you facet on -> what is the cardinality of each one of them -> What is you QPS rate but 2GB for 27M documents seems too low. Did you try to increase the memory on Solr's JVM? -- Sent from:

Facets OutOfMemoryException

2018-02-08 Thread LOPEZ-CORTES Mariano-ext
We are experimentig memory problems regarding facets filters (OutOfMemory java heap). If we disable facets, it works ok. Our infrastructure : 3 nodes Solr 2048 MB RAM 3 nodes Zookeeper 1024 MB RAM Size : 27 millions of documents Any ideas ? Thanks in advance !

Performance issues with 'unique' function in json facets over a high cardinality field

2017-12-12 Thread alexpusch
Hi, I have a surprising performance issue with the 'unique' function in a json facet My setup holds large amount of docs (~1B), despite this large number I only facet on a small result set of a query, only a few docs. The query itself returns as fast as expected, but when I try to do a unique cou

Solr 7.1.0 Group Facets Error

2017-12-04 Thread Priya Rodrigues
Facing errors on using groups and facets These queries work fine - http://localhost:8983/solr/urls/select?q=*:*&rows=0&facet=true&facet.field=city_id http://localhost:8983/solr/urls/select?q=*:*&rows=0&facet=true&facet.field=city_id&group=true&group.field=locality_

Re: Facets based on sampling

2017-10-24 Thread Toke Eskildsen
John Davis wrote: > 100M unique values might be across all docs, and unless the faceting > implementation is really naive I cannot see how that can come into play > when the query matches a fraction of those. Solr simple string faceting uses an int-array to hold counts for the different terms in

Re: Facets based on sampling

2017-10-24 Thread John Davis
w even when the query matches hundreds of docs. > >> > >> On Mon, Oct 23, 2017 at 6:53 AM, alessandro.benedetti < > a.benede...@sease.io> > >> wrote: > >> > >>> Hi John, > >>> first of all, I may state the obvious, but have you tr

Re: Facets based on sampling

2017-10-24 Thread Erick Erickson
6:53 AM, alessandro.benedetti >> wrote: >> >>> Hi John, >>> first of all, I may state the obvious, but have you tried docValues ? >>> >>> Apart from that a friend of mine ( Diego Ceccarelli) was discussing a >>> probabilistic implementation simi

Solr 6.6 - JSON Facet API - Unexpected counts returned for child focused facets

2017-10-24 Thread Damien Hawes
"blog_post": "solr", "is_root_document": true, "_childDocuments_": [{ "id": "comment-1", "title": "awesome work", "comment": "this was a great read&qu

Re: Facets based on sampling

2017-10-24 Thread Emir Arnautović
gt; Apart from that a friend of mine ( Diego Ceccarelli) was discussing a >> probabilistic implementation similar to the hyperloglog[1] to approximate >> facets counting. >> I didn't have time to take a look in details / implement anything yet. >> But it is on our To Do list :)

Re: Facets based on sampling

2017-10-23 Thread John Davis
all, I may state the obvious, but have you tried docValues ? > > Apart from that a friend of mine ( Diego Ceccarelli) was discussing a > probabilistic implementation similar to the hyperloglog[1] to approximate > facets counting. > I didn't have time to take a look in details

Re: Facets based on sampling

2017-10-23 Thread alessandro.benedetti
Hi John, first of all, I may state the obvious, but have you tried docValues ? Apart from that a friend of mine ( Diego Ceccarelli) was discussing a probabilistic implementation similar to the hyperloglog[1] to approximate facets counting. I didn't have time to take a look in details / impl

Re: Facets based on sampling

2017-10-20 Thread John Davis
Hi Yonik, Any update on sampling based facets. The current faceting is really slow for fields with high cardinality even with method=uif. Or are there alternative work-arounds to only look at N docs when computing facets? On Fri, Nov 4, 2016 at 4:43 PM, Yonik Seeley wrote: > Sampling has b

Re: Solr facets counts deep paged returns inconsistent counts

2017-10-20 Thread Yonik Seeley
t;discoveres" a new constraint which ranks higher). Regular faceting does more overrequest by default, and does refinement by default. So adding refine:true and a deeper overrequest for json facets should perform equivalently. -Yonik Kenny > > On 20-10-17 17:12, Yonik Seeley wrote: &g

Re: Solr facets counts deep paged returns inconsistent counts

2017-10-20 Thread kenny
Thanks for the clear explanation. A couple of follow up questions - can we tune overrequesting in json API? - we do see conflicting counts but that's when we have offsets different from 0. We have now already tested it in solr 6.6 with json api. We sometimes get the same value in different off

Re: Solr facets counts deep paged returns inconsistent counts

2017-10-20 Thread Yonik Seeley
Facet refinement in Solr guarantees that counts for returned constraints are correct, but does not guarantee that the top N returned isn't missing a constraint. Consider the following shard counts (3 shards) for the following constraints (aka facet values): constraintA: 2 0 0 constraintB: 0 2 0 co

  1   2   3   4   5   6   7   8   9   10   >