Hi, We've run into a strange issue with our deployment of solrcloud 6.3.0. Essentially, a standard facet query on a string field usually comes back empty when it shouldn't. However, every now and again the query actually returns the correct values. This is only affecting a single shard in our setup.
The behavior pattern generally looks like the query works properly when it hasn't been run recently, and then returns nothing after the query seems to have been cached (< 50ms QTime). Wait a while and you get the correct result followed by blanks. It doesn't matter which replica of the shard is queried; the results are the same. The general query in question looks like /select?q=*:*&facet=true&facet.field=market&rows=0&fq=<some filters> The field is defined in the schema as <field name="market" type="string" docValues="true"/> There are numerous other fields defined similarly, and they do not exhibit the same behavior when used as the facet.field value. They consistently return the right results on the shard in question. If we add facet.method=enum to the query, we get the correct results every time (though slower. So our assumption is that something is sporadically working when the fc method is chosen by default. A few other notes about the collection. This collection is not freshly indexed, but has not had any particularly bad failures beyond follower replicas going down due to PKIAuthentication timeouts (has been fixed). It has also had a full reindex after a schema change added docValues some fields (including the one above), but the collection wasn't emptied first. We are using the composite router to co-locate documents. Currently, our plan is just to reindex all of the documents on the affected shard to see if that fixes the problem. Any ideas on what might be happening or ways to troubleshoot this are appreciated. Thanks, Chris
