On 3/17/2017 9:26 AM, Shawn Heisey wrote:
On 3/17/2017 9:07 AM, Erick Erickson wrote:
"group.ngroups and group.facet require that all documents in each
group must be co-located on the same shard in order for accurate
counts to be returned."
That is not how things work right now. The index has 170 million
documents in it, split into six large cold shards and a very small hot
shard.
Restating the original problem: I cannot paginate through the groups in
a grouped query. The first page works, subsequent pages do not. I have
a distributed index. Co-locating documents in the same group onto the
same shard is going to require a complete redesign of indexing. It's
something that could be done, but not without a LOT of work.
Should it be considered a bug that this doesn't work at all? I call it
a bug. I'd be OK with being told that performance of paginated queries
with grouping is terrible on a distributed index, but I'd like it to at
least function.
Thanks,
Shawn