Hi All,
I have an issue in handling filters for one of our requirements and
liked to get suggestion for the best approaches.
*Use Case:*
1. We have List of groups and the number of groups can increase upto >1
million. Currently we have almost 90 thousand groups in the solr search
system.
2. Just before the user hits a search, He has options to select the no. of
groups he want to retrieve. [the distinct list of these group Names for
display are retrieved from other solr index that has more information about
groups]
*3.User Operation:** *
Say if user selected group 1A - group 10000A. and searches for key:cancer.
The current approach I was thinking is : get search results and filter
query by groupids' list selected by user. But my concern is When these
groups list is increasing to >50k unique Ids, This can cause lot of delay
in getting search results. So wanted to know whether there are different
filtering ways that I can try for?
I was thinking of one more approach as suggested by my colleague to do -
intersection. -
Get the groupIds' selected by user.
Get the list of groupId's from search results,
Perform intersection of both and then get the entire result set of only
those groupid that intersected. Is this better way? Can I use any cache
technique in this case?
- David.
