I have been working extensively on query autocompletion, these blogs should be helpful to you:
https://sease.io/2015/07/solr-you-complete-me.html https://sease.io/2018/06/apache-lucene-blendedinfixsuggester-how-it-works-bugs-and-improvements.html You idea of using search quality evaluation to drive the autocompletion is interesting. How do you currently calculate the NDCG for a query? What's your golden truth? Using that approach you will autocomplete favouring query completion that your search engine is able to process better, not necessarily closer to the user intent, still it could work. We should differentiate here between the suggester dictionary (where the suggestions come from, in your case it could be your extracted data) and the kind of suggestion (that in your case could be the free text suggester lookup) Cheers -------------------------- Alessandro Benedetti Search Consultant, R&D Software Engineer, Director www.sease.io On Mon, 20 Jan 2020 at 17:02, David Hastings <hastings.recurs...@gmail.com> wrote: > Not a bad idea at all, however ive never used an external file before, just > a field in the index, so not an area im familiar with > > On Mon, Jan 20, 2020 at 11:55 AM Audrey Lorberfeld - > audrey.lorberf...@ibm.com <audrey.lorberf...@ibm.com> wrote: > > > David, > > > > Thank you, that is useful. So, would you recommend using a (clean) field > > over an external dictionary file? We have lots of "top queries" and > measure > > their nDCG. A thought was to programmatically generate an external file > > where the weight per query term (or phrase) == its nDCG. Bad idea? > > > > Best, > > Audrey > > > > On 1/20/20, 11:51 AM, "David Hastings" <hastings.recurs...@gmail.com> > > wrote: > > > > Ive used this quite a bit, my biggest piece of advice is to choose a > > field > > that you know is clean, with well defined terms/words, you dont want > an > > autocomplete that has a massive dictionary, also it will make the > > start/reload times pretty slow > > > > On Mon, Jan 20, 2020 at 11:47 AM Audrey Lorberfeld - > > audrey.lorberf...@ibm.com <audrey.lorberf...@ibm.com> wrote: > > > > > Hi All, > > > > > > We plan to incorporate a query autocomplete functionality into our > > search > > > engine (like this: > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__lucene.apache.org_solr_guide_8-5F1_suggester.html&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=_8ViuZIeSRdQjONA8yHWPZIBlhj291HU3JpNIx5a55M&m=L8V-izaMW_v4j-1zvfiXSqm6aAoaRtk-VJXA6okBs_U&s=vnE9KGyF3jky9fSi22XUJEEbKLM1CA7mWAKrl2qhKC0&e= > > > ). And I was wondering if anyone has personal experience with this > > > component and would like to share? Basically, we are just looking > > for some > > > best practices from more experienced Solr admins so that we have a > > starting > > > place to launch this in our beta. > > > > > > Thank you! > > > > > > Best, > > > Audrey > > > > > > > > > >
