On 2/17/2016 1:04 PM, Aswath Srinivasan (TMS) wrote: > I’m tyring to upconfig my config files and my synonyms.txt file is > about 2 MB. Whenever I try to do this, I get the following expection. > It’s either a “broken pipe” expection or the following expection. Any > advice for me to fix it?
The default size limit on a zookeeper node is about 1 megabyte. Adjusting this limit is possible, but involves some invasive changes. You will need to add "-Djute.maxbuffer=NNNNNNN" to the command-line of every single java invocation related to Solr and Zookeeper, including the zkcli script, to allow a larger node size. http://zookeeper.apache.org/doc/r3.4.6/zookeeperAdmin.html#Unsafe+Options The zookeeper project calls this an "unsafe" option because zookeeper is not really designed to store large data. I would also expect such a large list of synonyms to slow down analysis. Thanks, Shawn
