The Lucene FST guys made a big improvement in synonym filtering in Lucene/Solr 4.0 using FSTs. Or are you already using that?

Or if you are stuck with pre-4.0, you could do a preprocessor that efficiently generates boolean queries for the synonym expansions. That should give you more decent query times, assuming you develop a decent synonym lookup filter.

Maybe you could backport the 4.0 FST code, or at least use the same techniques for your own preprocessor.

-- Jack Krupansky

-----Original Message----- From: Peyman Faratin
Sent: Friday, August 03, 2012 12:56 AM
To: solr-user@lucene.apache.org
Subject: synonym file

Hi

I have a (23M) synonym file that takes a long time (3 or so minutes) to load and once included seems to adversely affect the QTime of the application by approximately 4 orders of magnitude.

Any advise on how to load faster and lower the QT would be much appreciated.

best

Peyman=

Reply via email to