On Fri, May 4, 2012 at 12:50 PM, Mark Miller <markrmil...@gmail.com> wrote: >> And how should we detect if data is compressed when >> reading from ZooKeeper? > > I was thinking we could somehow use file extensions? > > eg synonyms.txt.gzip - then you can use different compression algs depending > on the ext, etc. > > We would want to try and make it as transparent as possible though...
At first I thought about adding a marker to the beginning of a file, but file extensions could work too, as long as the resource loader made it transparent (i.e. code would just need to ask for synonyms.txt, but the resource loader would search for synonyms.txt.gzip, etc, if the original name was not found) Hmmm, but this breaks down for things like watches - I guess that's where putting the encoding inside the file would be a better option. -Yonik lucenerevolution.com - Lucene/Solr Open Source Search Conference. Boston May 7-10
