Re: Shingles and Delimiter Help

2010-11-22 Thread Jessy Kate
; The "_"-only tokens you're seeing, which are likely the result of > placeholder tokens where stopwords used to be, is also fixed under > Solr/Lucene 3.x, so that only shingles with at least one "real" token are > output. (This is your #2 issue.) > > Steve

Shingles and Delimiter Help

2010-11-22 Thread Jessy Kate
Hello Solr community, I'm using Solr for an app to index documents, with shingles to index n-grams (right now 2- 3- and 4-grams). this is solr 1.4.1 with lucene 2.9.3. i'm having two challenges: 1. the shingles configuration is not respecting the lower limit set in the config file: I still see