I think this bit is the problem : "I am using a Shingle filter right after the StandardTokenizer, not sure if that has anything to do with it. "
When using the FreeTextLookup approach, you don't need to use shingles in your analyser, shingles are added by the suggester itself. As Erick mentioned, the reason spaces come back is because you produce shingles on your own and then the Lookup approach will add additional shingles. I recommend to read this section of my blog [1] ( you may have read it as there is one comment with a similar problem to you) [1] http://alexbenedetti.blogspot.co.uk/2015/07/solr-you-complete-me.html ----- --------------- Alessandro Benedetti Search Consultant, R&D Software Engineer, Director Sease Ltd. - www.sease.io -- View this message in context: http://lucene.472066.n3.nabble.com/FreeTextSuggester-throwing-error-token-must-not-contain-separator-byte-tp4347406p4347454.html Sent from the Solr - User mailing list archive at Nabble.com.
