Re: POS Tagger

2019-10-25 Thread Nicolas Paris
Also the openNlp solr POS tagger [1] uses the typeAsSynonymFilter to store the POS: " Index the POS for each token as a synonym, after prefixing the POS with @ " Not sure how to deal with POS after such indexing, but this looks interesting approach ? [1] http://lucene.apache.org/

Re: POS Tagger

2019-10-25 Thread Dave
me against teh query >> >> On Fri, Oct 25, 2019 at 12:11 PM Audrey Lorberfeld - >> audrey.lorberf...@ibm.com wrote: >> >>> So then you do run your POS tagger at query-time, Dave? >>> >>> -- >>> Audrey Lorberfeld >>> Data Scientist, w3

Re: Re: Re: POS Tagger

2019-10-25 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
query time against teh query > > On Fri, Oct 25, 2019 at 12:11 PM Audrey Lorberfeld - > audrey.lorberf...@ibm.com wrote: > >> So then you do run your POS tagger at query-time, Dave? >> >> -- >> Audrey Lorberfeld >>

Re: Re: Re: POS Tagger

2019-10-25 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
5, 2019 at 12:11 PM Audrey Lorberfeld - audrey.lorberf...@ibm.com wrote: > So then you do run your POS tagger at query-time, Dave? > > -- > Audrey Lorberfeld > Data Scientist, w3 Search > IBM > audrey.lorberf...@ibm.com > >

Re: POS Tagger

2019-10-25 Thread Nicolas Paris
> Do you use the POS tagger at query time, or just at index time? I have the POS tagger pipeline ready but nothing done yet on the solr part. Right now I am wondering how to use it but still looking for relevant implementation. I guess having the POS information ready before indexation gi

Re: Re: POS Tagger

2019-10-25 Thread David Hastings
d Hastings < hastings.recurs...@gmail.com> wrote: > nope, i boost the fields already tagged at query time against teh query > > On Fri, Oct 25, 2019 at 12:11 PM Audrey Lorberfeld - > audrey.lorberf...@ibm.com wrote: > >> So then you do run your POS tagger at query-time

Re: Re: POS Tagger

2019-10-25 Thread David Hastings
nope, i boost the fields already tagged at query time against teh query On Fri, Oct 25, 2019 at 12:11 PM Audrey Lorberfeld - audrey.lorberf...@ibm.com wrote: > So then you do run your POS tagger at query-time, Dave? > > -- > Audrey Lorberfeld > Data Scientist, w3 Search > IB

Re: Re: POS Tagger

2019-10-25 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
So then you do run your POS tagger at query-time, Dave? -- Audrey Lorberfeld Data Scientist, w3 Search IBM audrey.lorberf...@ibm.com On 10/25/19, 12:06 PM, "David Hastings" wrote: I use them for query boosting, so if someone searches for: i dont want to rush limbau

Re: Re: POS Tagger

2019-10-25 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Nicolas, Do you use the POS tagger at query time, or just at index time? We are thinking of using it to filter the tokens we will eventually perform ML on. Basically, we have a bunch of acronyms in our corpus. However, many departments use the same acronyms but expand those acronyms to

Re: POS Tagger

2019-10-25 Thread David Hastings
that) have 'rush limbaugh' stored in a field, which is boosted on queries. this makes sure results from the second query with him as a person will be boosted above those from the first query On Fri, Oct 25, 2019 at 11:57 AM Nicolas Paris wrote: > Also we are using stanfor

Re: POS Tagger

2019-10-25 Thread Nicolas Paris
Also we are using stanford POS tagger for french. The processing time is mitigated by the spark-corenlp package which distribute the process over multiple node. Also I am interesting in the way you use POS information within solr queries, or solr fields. Thanks, On Fri, Oct 25, 2019 at 10:42

Re: Re: POS Tagger

2019-10-25 Thread David Hastings
or different purposes in solr > -Dave > > On Fri, Oct 25, 2019 at 10:16 AM Audrey Lorberfeld - > audrey.lorberf...@ibm.com wrote: > > > Hi All, > > > > Does anyone use a POS tagger with their Solr instance other than > > OpenN

Re: Re: POS Tagger

2019-10-25 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
, 2019 at 10:16 AM Audrey Lorberfeld - audrey.lorberf...@ibm.com wrote: > Hi All, > > Does anyone use a POS tagger with their Solr instance other than > OpenNLP’s? We are considering OpenNLP, SpaCy, and Watson. > > Thanks! > > -- &g

Re: POS Tagger

2019-10-25 Thread David Hastings
; -Dave > > On Fri, Oct 25, 2019 at 10:16 AM Audrey Lorberfeld - > audrey.lorberf...@ibm.com wrote: > >> Hi All, >> >> Does anyone use a POS tagger with their Solr instance other than >> OpenNLP’s? We are considering OpenNLP, SpaCy, and Watson. >> >>

Re: POS Tagger

2019-10-25 Thread David Hastings
Do you mean for entity extraction? I make a LOT of use from the stanford nlp project, and get out the entities and use them for different purposes in solr -Dave On Fri, Oct 25, 2019 at 10:16 AM Audrey Lorberfeld - audrey.lorberf...@ibm.com wrote: > Hi All, > > Does anyone use a POS ta

POS Tagger

2019-10-25 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Hi All, Does anyone use a POS tagger with their Solr instance other than OpenNLP’s? We are considering OpenNLP, SpaCy, and Watson. Thanks! -- Audrey Lorberfeld Data Scientist, w3 Search IBM audrey.lorberf...@ibm.com