Re: Lucene/Solr Filesystem tunings

2013-06-10 Thread Ryan Zezeski
Just to add to the pile...use the Deadline or NOOP I/O scheduler. -Z On Sat, Jun 8, 2013 at 4:40 PM, Mark Miller wrote: > Turning swappiness down to 0 can have some decent performance impact. > > - http://en.wikipedia.org/wiki/Swappiness > > In the past, I've seen better performance with ext3

Re: Lucene/Solr Filesystem tunings

2013-06-08 Thread Mark Miller
Turning swappiness down to 0 can have some decent performance impact. - http://en.wikipedia.org/wiki/Swappiness In the past, I've seen better performance with ext3 over ext4 around commits/fsync. Test were actually enough slower (lots of these operations), that I made a special ext3 partition w

Re: Lucene/Solr Filesystem tunings

2013-06-07 Thread Tim Vaillancourt
I figured as much for atime, thanks Otis! I haven't ran benchmarks just yet, but I'll be sure to share whatever I find. I plan to try ext4 vs xfs. I am also curious what effect disabling journaling (ext2) would have, relying on SolrCloud to manage 'consistency' over many instances vs FS journalin

Re: Lucene/Solr Filesystem tunings

2013-06-04 Thread Otis Gospodnetic
Hi, You can use noatime, nodiratime, nothing in Solr depends on that as far as I know. We tend to use ext4. Some people love xfs. Want to run some benchmarks and publish the results? :) Otis -- Solr & ElasticSearch Support http://sematext.com/ On Tue, Jun 4, 2013 at 6:48 PM, Tim Vaillanco

Lucene/Solr Filesystem tunings

2013-06-04 Thread Tim Vaillancourt
Hey all, Does anyone have any advice or special filesytem tuning to share for Lucene/Solr, and which file systems they like more? Also, does Lucene/Solr care about access times if I turn them off (I think I doesn't care)? A bit unrelated: What are people's opinions on reducing some consiste