Merge branch '1.5.1-SNAPSHOT' into 1.6.0-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/accumulo/repo Commit: http://git-wip-us.apache.org/repos/asf/accumulo/commit/29223f79 Tree: http://git-wip-us.apache.org/repos/asf/accumulo/tree/29223f79 Diff: http://git-wip-us.apache.org/repos/asf/accumulo/diff/29223f79 Branch: refs/heads/master Commit: 29223f796dbac1d74818bd71db81906e8040c077 Parents: 9b6b9cf 0fd190b Author: Josh Elser <els...@apache.org> Authored: Mon Dec 2 12:45:48 2013 -0500 Committer: Josh Elser <els...@apache.org> Committed: Mon Dec 2 12:45:48 2013 -0500 ---------------------------------------------------------------------- README | 4 ++++ 1 file changed, 4 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/accumulo/blob/29223f79/README ---------------------------------------------------------------------- diff --cc README index b18ab6c,ab6f3fc..70bc18e --- a/README +++ b/README @@@ -129,16 -81,23 +129,20 @@@ You will need to have hadoop installed you must enable HDFS durable sync. How you enable this depends on your version of Hadoop. Please consult the table below for information regarding your version. If you need to set the coniguration, please be sure to restart HDFS. See -ACCUMULO-623 for more information. - -HADOOP RELEASE VERSION SYNC NAME DEFAULT -Apache Hadoop 0.20.205 dfs.support.append false -Apache Hadoop 0.23.x dfs.support.append true -Apache Hadoop 1.0.x dfs.support.append false -Apache Hadoop 1.1.x dfs.durable.sync true -Apache Hadoop 2.0.0-2.0.4 dfs.support.append true -Cloudera CDH 3u0-3u3 ???? true -Cloudera CDH 3u4 dfs.support.append true -Hortonworks HDP `1.0 dfs.support.append false -Hortonworks HDP `1.1 dfs.support.append false +ACCUMULO-623 and ACCUMULO-1637 for more information. + +The following releases of Apache Hadoop require special configuration to ensure +that data is not inadvertently lost; however, in all releases of Apache Hadoop, +`dfs.durable.sync` and `dfs.support.append` should *not* be configured as `false`. + +VERSION NAME=VALUE +0.20.205.0 - dfs.support.append=true +1.0.x - dfs.support.append=true + Additionally, it is strongly recommended that you enable 'dfs.datanode.synconclose' + in your hdfs-site.xml configuration file to ensure that, in the face of unexpected + power loss to a datanode, files are wholly synced to disk. + The example accumulo configuration files are placed in directories based on the memory footprint for the accumulo processes. If you are using native libraries for you tablet server in-memory map, then you can use the files in "native-standalone".