We had something similar to be fair, a cluster information field which was
unfortunately optional, so all the documents that didn't have this field set
grouped together.
It isn't Solr's fault, to be fair, we told it to group on the values of
field Z, null is a valid value and lots of documents have that value so they
all group together. We got what we asked for :-)
Our solution was to make that field mandatory, and in our indexing pipeline
we will set that field to some unique value (same as the document key if
necessary) if it isn't set already to ensure that every document has that
field set appropriately.
-----Original Message-----
From: Oussama Jilal
Sent: Friday, February 22, 2013 5:25 PM
To: solr-user@lucene.apache.org
Subject: Re: Solr Grouping and empty fields
OK I'm sorry if I did not explained well my need. I'll try to give a
better explanation.
What I have : Millions of documents that have a field X , another field
Y and another field Z which is not required (So it can be empty in some
documents and not in others).
What I want to do : Search for docs that have the field X equals
something and group them by field Z (so that only 1 document is returned
for every field Z value), BUT I want documents who have field Z as empty
to be included in the results (all of them), and sort the results by
field Y (so I can't separate the request into two requests).
I hope that this is clearer.
On 02/22/2013 03:59 PM, Jack Krupansky wrote:
What?!?! You want them grouped but not grouped together?? What on earth
does that mean?! I mean, either they are included or they are not. All
results will be in some group, so where exactly do you want these "not to
be grouped together" documents to be grouped? In any case, please clarify
what your expectations really are.
-- Jack Krupansky
-----Original Message----- From: Oussama Jilal
Sent: Friday, February 22, 2013 7:17 AM
To: solr-user@lucene.apache.org
Subject: Re: Solr Grouping and empty fields
Thank you Johannes, but I want the documents having the field empty to
be included in the results, just not to be grouped together, and if I
understood your solution correctly, it will simply remove those
documents from the results (Note : The field values are very variable
and unknown to me).
On 02/22/2013 02:53 PM, Johannes Rodenwald wrote:
Hi Oussama,
If you have only a few distinct, unchanging values in the field that you
group upon, you could implement a FilterQuery (query parameter "fq") and
add it to the query, allowing all valid values, but not an empty field.
For example:
fq=my_grouping_string_field:( value_a OR value_b OR value_c OR value_d )
If you use SOLR 4.x, you should be able to group upon an integer field,
allowing a range filter:
(I still work with 3.6 which can only group on string fields, so i didnt
test this one)
fq=my_grouping_integer_field:[1 TO *]
--
Johannes Rodenwald
----- Ursprüngliche Mail -----
Von: "Oussama Jilal" <jilal.ouss...@gmail.com>
An: solr-user@lucene.apache.org
Gesendet: Freitag, 22. Februar 2013 12:32:13
Betreff: Solr Grouping and empty fields
Hi,
I need to group some results in solr based on a field, but I don't want
documents having that field empty to be grouped together, does anyone
know how to achieve that ?
--
Oussama Jilal
