Author: buildbot
Date: Mon Feb 16 21:48:46 2015
New Revision: 940402
Log:
Staging update by buildbot for accumulo
Modified:
websites/staging/accumulo/trunk/content/ (props changed)
websites/staging/accumulo/trunk/content/1.6/accumulo_user_manual.html
Propchange: websites/staging/accumulo/trunk/content/
------------------------------------------------------------------------------
--- cms:source-revision (original)
+++ cms:source-revision Mon Feb 16 21:48:46 2015
@@ -1 +1 @@
-1660210
+1660212
Modified: websites/staging/accumulo/trunk/content/1.6/accumulo_user_manual.html
==============================================================================
--- websites/staging/accumulo/trunk/content/1.6/accumulo_user_manual.html
(original)
+++ websites/staging/accumulo/trunk/content/1.6/accumulo_user_manual.html Mon
Feb 16 21:48:46 2015
@@ -533,93 +533,132 @@ span.icon > [class^="icon-"], span.icon
<li><a href="#_query_services_layer">10.7. Query Services Layer</a></li>
</ul>
</li>
-<li><a href="#_administration">11. Administration</a></li>
+
+<li><a href="#_security">11. SSL</a></li>
+<li>
+<ul class="sectlevel2">
+<li><a href="#_ssl_server_configuration">11.1. Server Configuration</a></li>
+<li><a href="#_ssl_client_configuration">11.2. Client Configuration</a></li>
+<li><a href="#_ssl_generate_ssl_material_openssl">11.3. Generating SSL
material using OpenSSL</a></li>
+<li>
+<ul class="sectlevel3">
+<li><a href="#_ssl_generate_ca">11.3.1. Generate a certificate
authority</a></li>
+<li><a href="#_ssl_generate_certs">11.3.2. Generate a certificate/keystore per
host</a></li>
+</ul>
+</li>
+</ul>
+</li>
+
+<li><a href="#_implementation_details">12. Implementation Details</a></li>
+<li>
+<ul class="sectlevel2">
+<li><a href="#_implementation_fate">12.1. Fault-Tolerant Executor
(FATE)</a></li>
+<ul class="sectlevel3">
+<li><a href="#_implementation_fate_overview">12.1.1. Overview</a></li>
+<li><a href="#_implementation_fate_administration">12.1.2.
Administration</a></li>
+<li><a href="#_implementation_fate_list_print">12.1.3. List/Print</a></li>
+<li><a href="#_implementation_fate_fail">12.1.3. Fail</a></li>
+<li><a href="#_implementation_fate_delete">12.1.3. Delete</a></li>
+</ul>
+</ul>
+</li>
+
+
+<li><a href="#_administration">13. Administration</a></li>
<li>
<ul class="sectlevel2">
-<li><a href="#_hardware">11.1. Hardware</a></li>
-<li><a href="#_network">11.2. Network</a></li>
-<li><a href="#_installation">11.3. Installation</a></li>
-<li><a href="#_dependencies">11.4. Dependencies</a></li>
-<li><a href="#_configuration_2">11.5. Configuration</a></li>
+<li><a href="#_hardware">13.1. Hardware</a></li>
+<li><a href="#_network">13.2. Network</a></li>
+<li><a href="#_installation">13.3. Installation</a></li>
+<li><a href="#_dependencies">13.4. Dependencies</a></li>
+<li><a href="#_configuration_2">12.5. Configuration</a></li>
<li>
<ul class="sectlevel3">
-<li><a href="#_edit_conf_accumulo_env_sh">11.5.1. Edit
conf/accumulo-env.sh</a></li>
-<li><a href="#_native_map">11.5.2. Native Map</a></li>
-<li><a href="#_cluster_specification">11.5.3. Cluster Specification</a></li>
-<li><a href="#_accumulo_settings">11.5.4. Accumulo Settings</a></li>
-<li><a href="#_deploy_configuration">11.5.5. Deploy Configuration</a></li>
-<li><a href="#_sensitive_configuration_values">11.5.6 Sensitive Configuration
Values</a></li>
-<li><a href="#_using_a_javakeystorecredentialprovider_for_storage">11.5.7.
Using a JavaKeyStoreCredentialProvider for storage</a></li>
+<li><a href="#_edit_conf_accumulo_env_sh">13.5.1. Edit
conf/accumulo-env.sh</a></li>
+<li><a href="#_native_map">13.5.2. Native Map</a></li>
+<li>
+<ul class="sectlevel4">
+<li><a href="#_native_map_building">13.5.2.1 Building</a></li>
+</ul>
+</li>
+<li><a href="#_administration_configuration">13.5.3. Configuration</a></li>
+<li><a href="#_cluster_specification">13.5.4. Cluster Specification</a></li>
+<li><a href="#_accumulo_settings">13.5.5. Accumulo Settings</a></li>
+<li><a href="#_deploy_configuration">13.5.6. Deploy Configuration</a></li>
+<li><a href="#_sensitive_configuration_values">13.5.7 Sensitive Configuration
Values</a></li>
+<li><a href="#_using_a_javakeystorecredentialprovider_for_storage">13.5.8.
Using a JavaKeyStoreCredentialProvider for storage</a></li>
</ul>
</li>
-<li><a href="#_initialization">11.6. Initialization</a></li>
-<li><a href="#_running">11.7. Running</a></li>
+<li><a href="#_initialization">13.6. Initialization</a></li>
+<li><a href="#_running">13.7. Running</a></li>
<li>
<ul class="sectlevel3">
-<li><a href="#_starting_accumulo">11.7.1. Starting Accumulo</a></li>
-<li><a href="#_stopping_accumulo">11.7.2. Stopping Accumulo</a></li>
-<li><a href="#_adding_a_node">11.7.3. Adding a Node</a></li>
-<li><a href="#_decomissioning_a_node">11.7.4. Decomissioning a Node</a></li>
+<li><a href="#_starting_accumulo">13.7.1. Starting Accumulo</a></li>
+<li><a href="#_stopping_accumulo">13.7.2. Stopping Accumulo</a></li>
+<li><a href="#_adding_a_node">13.7.3. Adding a Node</a></li>
+<li><a href="#_decomissioning_a_node">13.7.4. Decomissioning a Node</a></li>
+<li><a href="#_restarting_process_on_a_node">13.7.5. Restarting process on a
node</a></li>
</ul>
</li>
-<li><a href="#_monitoring">11.8. Monitoring</a></li>
-<li><a href="#_tracing">11.9. Tracing</a></li>
+<li><a href="#_monitoring">13.8. Monitoring</a></li>
+<li><a href="#_tracing">13.9. Tracing</a></li>
<li>
<ul class="sectlevel3">
-<li><a href="#_tracers">11.9.1. Tracers</a></li>
-<li><a href="#_instrumenting_a_client">11.9.2. Instrumenting a Client</a></li>
-<li><a href="#_viewing_collected_traces">11.9.3. Viewing Collected
Traces</a></li>
-<li><a href="#_tracing_from_the_shell">11.9.4. Tracing from the Shell</a></li>
+<li><a href="#_tracers">13.9.1. Tracers</a></li>
+<li><a href="#_instrumenting_a_client">13.9.2. Instrumenting a Client</a></li>
+<li><a href="#_viewing_collected_traces">13.9.3. Viewing Collected
Traces</a></li>
+<li><a href="#_tracing_from_the_shell">13.9.4. Tracing from the Shell</a></li>
</ul>
</li>
-<li><a href="#_logging">11.10. Logging</a></li>
-<li><a href="#_recovery">11.11. Recovery</a></li>
+<li><a href="#_logging">13.10. Logging</a></li>
+<li><a href="#_recovery">13.11. Recovery</a></li>
+<li><a href="#_migrating_from_non_ha_to_ha">13.12 Migrating Accumulo from
non-HA Namenode to HA Namenode</a></li>
</ul>
</li>
-<li><a href="#_multi_volume_installations">12. Multi-Volume
Installations</a></li>
-<li><a href="#_troubleshooting">13. Troubleshooting</a></li>
+<li><a href="#_multi_volume_installations">14. Multi-Volume
Installations</a></li>
+<li><a href="#_troubleshooting">15. Troubleshooting</a></li>
<li>
<ul class="sectlevel2">
-<li><a href="#_logs">13.1. Logs</a></li>
-<li><a href="#_monitor_2">13.2. Monitor</a></li>
-<li><a href="#_hdfs">13.3. HDFS</a></li>
-<li><a href="#_zookeeper">13.4. Zookeeper</a></li>
+<li><a href="#_logs">15.1. Logs</a></li>
+<li><a href="#_monitor_2">15.2. Monitor</a></li>
+<li><a href="#_hdfs">15.3. HDFS</a></li>
+<li><a href="#_zookeeper">15.4. Zookeeper</a></li>
<li>
<ul class="sectlevel3">
-<li><a href="#_keeping_the_tablet_server_lock">13.4.1. Keeping the tablet
server lock</a></li>
+<li><a href="#_keeping_the_tablet_server_lock">15.4.1. Keeping the tablet
server lock</a></li>
</ul>
</li>
-<li><a href="#_tools">13.5. Tools</a></li>
-<li><a href="#metadata">13.6. System Metadata Tables</a></li>
-<li><a href="#_simple_system_recovery">13.7. Simple System Recovery</a></li>
-<li><a href="#_advanced_system_recovery">13.8. Advanced System
Recovery</a></li>
+<li><a href="#_tools">15.5. Tools</a></li>
+<li><a href="#metadata">15.6. System Metadata Tables</a></li>
+<li><a href="#_simple_system_recovery">15.7. Simple System Recovery</a></li>
+<li><a href="#_advanced_system_recovery">15.8. Advanced System
Recovery</a></li>
<li>
<ul class="sectlevel3">
-<li><a href="#_hdfs_failure">13.8.1. HDFS Failure</a></li>
-<li><a href="#zookeeper_failure">13.8.2. ZooKeeper Failure</a></li>
+<li><a href="#_hdfs_failure">15.8.1. HDFS Failure</a></li>
+<li><a href="#zookeeper_failure">15.8.2. ZooKeeper Failure</a></li>
</ul>
</li>
-<li><a href="#_upgrade_issues">13.9. Upgrade Issues</a></li>
-<li><a href="#_file_naming_conventions">13.10. File Naming Conventions</a></li>
+<li><a href="#_upgrade_issues">15.9. Upgrade Issues</a></li>
+<li><a href="#_file_naming_conventions">15.10. File Naming Conventions</a></li>
</ul>
</li>
-<li><a href="#configuration">14. Appendix A: Configuration Management</a></li>
+<li><a href="#configuration">16. Appendix A: Configuration Management</a></li>
<li>
<ul class="sectlevel2">
-<li><a href="#_configuration_overview">14.1. Configuration Overview</a></li>
+<li><a href="#_configuration_overview">16.1. Configuration Overview</a></li>
<li>
<ul class="sectlevel3">
-<li><a href="#_zookeeper_table_properties">14.1.1. Zookeeper table
properties</a></li>
-<li><a href="#_zookeeper_system_properties">14.1.2. Zookeeper system
properties</a></li>
-<li><a href="#_accumulo_site_xml">14.1.3. accumulo-site.xml</a></li>
-<li><a href="#_default_values">14.1.4. Default Values</a></li>
+<li><a href="#_zookeeper_table_properties">16.1.1. Zookeeper table
properties</a></li>
+<li><a href="#_zookeeper_system_properties">16.1.2. Zookeeper system
properties</a></li>
+<li><a href="#_accumulo_site_xml">16.1.3. accumulo-site.xml</a></li>
+<li><a href="#_default_values">16.1.4. Default Values</a></li>
</ul>
</li>
-<li><a href="#_configuration_in_the_shell">14.2. Configuration in the
Shell</a></li>
-<li><a href="#_available_properties">14.3. Available Properties</a></li>
+<li><a href="#_configuration_in_the_shell">16.2. Configuration in the
Shell</a></li>
+<li><a href="#_available_properties">16.3. Available Properties</a></li>
<li>
<ul class="sectlevel3">
-<li><a href="#RPC_PREFIX">14.3.1. rpc.*</a></li>
+<li><a href="#RPC_PREFIX">16.3.1. rpc.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_rpc_javax_net_ssl_keystore">rpc.javax.net.ssl.keyStore</a></li>
@@ -631,7 +670,7 @@ span.icon > [class^="icon-"], span.icon
<li><a href="#_rpc_usejsse">rpc.useJsse</a></li>
</ul>
</li>
-<li><a href="#INSTANCE_PREFIX">14.3.2. instance.*</a></li>
+<li><a href="#INSTANCE_PREFIX">16.3.2. instance.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_instance_dfs_dir">instance.dfs.dir</a></li>
@@ -648,7 +687,7 @@ span.icon > [class^="icon-"], span.icon
<li><a href="#_instance_zookeeper_timeout">instance.zookeeper.timeout</a></li>
</ul>
</li>
-<li><a href="#GENERAL_PREFIX">14.3.3. general.*</a></li>
+<li><a href="#GENERAL_PREFIX">16.3.3. general.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_general_classpaths">general.classpaths</a></li>
@@ -662,7 +701,7 @@ span.icon > [class^="icon-"], span.icon
<li><a href="#_general_vfs_classpaths">general.vfs.classpaths</a></li>
</ul>
</li>
-<li><a href="#MASTER_PREFIX">14.3.4. master.*</a></li>
+<li><a href="#MASTER_PREFIX">16.3.4. master.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_master_bulk_retries">master.bulk.retries</a></li>
@@ -680,7 +719,7 @@ span.icon > [class^="icon-"], span.icon
<li><a
href="#_master_walog_closer_implementation">master.walog.closer.implementation</a></li>
</ul>
</li>
-<li><a href="#TSERV_PREFIX">14.3.5. tserver.*</a></li>
+<li><a href="#TSERV_PREFIX">16.3.5. tserver.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_tserver_archive_walogs">tserver.archive.walogs</a></li>
@@ -726,13 +765,13 @@ span.icon > [class^="icon-"], span.icon
<li><a href="#_tserver_workq_threads">tserver.workq.threads</a></li>
</ul>
</li>
-<li><a href="#LOGGER_PREFIX">14.3.6. logger.*</a></li>
+<li><a href="#LOGGER_PREFIX">16.3.6. logger.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_logger_dir_walog">logger.dir.walog</a></li>
</ul>
</li>
-<li><a href="#GC_PREFIX">14.3.7. gc.*</a></li>
+<li><a href="#GC_PREFIX">16.3.7. gc.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_gc_cycle_delay">gc.cycle.delay</a></li>
@@ -742,7 +781,7 @@ span.icon > [class^="icon-"], span.icon
<li><a href="#_gc_trash_ignore">gc.trash.ignore</a></li>
</ul>
</li>
-<li><a href="#MONITOR_PREFIX">14.3.8. monitor.*</a></li>
+<li><a href="#MONITOR_PREFIX">16.3.8. monitor.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_monitor_banner_background">monitor.banner.background</a></li>
@@ -753,7 +792,7 @@ span.icon > [class^="icon-"], span.icon
<li><a href="#_monitor_port_log4j">monitor.port.log4j</a></li>
</ul>
</li>
-<li><a href="#TRACE_PREFIX">14.3.9. trace.*</a></li>
+<li><a href="#TRACE_PREFIX">16.3.9. trace.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_trace_password">trace.password</a></li>
@@ -763,8 +802,8 @@ span.icon > [class^="icon-"], span.icon
<li><a href="#_trace_user">trace.user</a></li>
</ul>
</li>
-<li><a href="#TRACE_TOKEN_PROPERTY_PREFIX">14.3.10.
trace.token.property.*</a></li>
-<li><a href="#TABLE_PREFIX">14.3.11. table.*</a></li>
+<li><a href="#TRACE_TOKEN_PROPERTY_PREFIX">16.3.10.
trace.token.property.*</a></li>
+<li><a href="#TABLE_PREFIX">16.3.11. table.*</a></li>
<li>
<ul class="sectlevel4">
<li><a href="#_table_balancer">table.balancer</a></li>
@@ -799,29 +838,29 @@ span.icon > [class^="icon-"], span.icon
<li><a href="#_table_walog_enabled">table.walog.enabled</a></li>
</ul>
</li>
-<li><a href="#TABLE_CONSTRAINT_PREFIX">14.3.12. table.constraint.*</a></li>
-<li><a href="#TABLE_ITERATOR_PREFIX">14.3.13. table.iterator.*</a></li>
-<li><a href="#TABLE_LOCALITY_GROUP_PREFIX">14.3.14. table.group.*</a></li>
-<li><a href="#TABLE_COMPACTION_STRATEGY_PREFIX">14.3.15.
table.majc.compaction.strategy.opts.*</a></li>
-<li><a href="#VFS_CONTEXT_CLASSPATH_PROPERTY">14.3.16.
general.vfs.context.classpath.*</a></li>
+<li><a href="#TABLE_CONSTRAINT_PREFIX">16.3.12. table.constraint.*</a></li>
+<li><a href="#TABLE_ITERATOR_PREFIX">16.3.13. table.iterator.*</a></li>
+<li><a href="#TABLE_LOCALITY_GROUP_PREFIX">16.3.14. table.group.*</a></li>
+<li><a href="#TABLE_COMPACTION_STRATEGY_PREFIX">16.3.15.
table.majc.compaction.strategy.opts.*</a></li>
+<li><a href="#VFS_CONTEXT_CLASSPATH_PROPERTY">16.3.16.
general.vfs.context.classpath.*</a></li>
</ul>
</li>
-<li><a href="#_property_types">14.4. Property Types</a></li>
+<li><a href="#_property_types">16.4. Property Types</a></li>
<li>
<ul class="sectlevel3">
-<li><a href="#_duration">14.4.1. duration</a></li>
-<li><a href="#_date_time">14.4.2. date/time</a></li>
-<li><a href="#_memory">14.4.3. memory</a></li>
-<li><a href="#_host_list">14.4.4. host list</a></li>
-<li><a href="#_port">14.4.5. port</a></li>
-<li><a href="#_count">14.4.6. count</a></li>
-<li><a href="#_fraction_percentage">14.4.7. fraction/percentage</a></li>
-<li><a href="#_path">14.4.8. path</a></li>
-<li><a href="#_absolute_path">14.4.9. absolute path</a></li>
-<li><a href="#_java_class">14.4.10. java class</a></li>
-<li><a href="#_string">14.4.11. string</a></li>
-<li><a href="#_boolean">14.4.12. boolean</a></li>
-<li><a href="#_uri">14.4.13. uri</a></li>
+<li><a href="#_duration">16.4.1. duration</a></li>
+<li><a href="#_date_time">16.4.2. date/time</a></li>
+<li><a href="#_memory">16.4.3. memory</a></li>
+<li><a href="#_host_list">16.4.4. host list</a></li>
+<li><a href="#_port">16.4.5. port</a></li>
+<li><a href="#_count">16.4.6. count</a></li>
+<li><a href="#_fraction_percentage">16.4.7. fraction/percentage</a></li>
+<li><a href="#_path">16.4.8. path</a></li>
+<li><a href="#_absolute_path">16.4.9. absolute path</a></li>
+<li><a href="#_java_class">16.4.10. java class</a></li>
+<li><a href="#_string">16.4.11. string</a></li>
+<li><a href="#_boolean">16.4.12. boolean</a></li>
+<li><a href="#_uri">16.4.13. uri</a></li>
</ul>
</li>
</ul>
@@ -3758,11 +3797,263 @@ Authorizations mechanism.</p>
</div>
</div>
</div>
+
<div class="sect1">
-<h2 id="_administration">11. Administration</h2>
+<h2 id="_ssl">11. SSL</h2>
<div class="sectionbody">
+<p>
+Accumulo, through Thrift's TSSLTransport, provides the ability to encrypt
+wire communication between Accumulo servers and clients using secure
+sockets layer (SSL). SSL certifcates signed by the same certificate authority
+control the "circle of trust" in which a secure connection can be established.
+Typically, each host running Accumulo processes would be given a certificate
+which identifies itself.
+
+Clients can optionally also be given a certificate, when client-auth is
enabled,
+which prevents unwanted clients from accessing the system. The SSL integration
+presently provides no authentication support within Accumulo (an Accumulo
username
+and password are still required) and is only used to establish a means for
+secure communication.
+</p>
+</div>
+<div class="sect2">
+<h3 id="_ssl_server_configuration">11.1. Server Configuration</h3>
+
+<div class="paragraph">
+<p>As previously mentioned, the circle of trust is established by the
certificate
+authority which created the certificates in use. Because of the tight coupling
+of certificate generation with an organization's policies, Accumulo does not
+provide a method in which to automatically create the necessary SSL
components.</p>
+</div>
+
+<div class="paragraph">
+<p>Administrators without existing infrastructure built on SSL are encourage to
+use OpenSSL and the \texttt{keytool} command. An example of these commands are
+included in a section below. Accumulo servers require a certificate and
keystore,
+in the form of Java KeyStores, to enable SSL. The following configuration
assumes
+these files already exist.</p>
+</div>
+
+<div class="paragraph">
+<p>In <code>$ACCUMULO_CONF_DIR/accumulo-site.xml</code>, the following
properties are required:</p>
+</div>
+
+<div class="listingblock">
+<div class="content">
+<pre class="highlight">
+rpc.javax.net.ssl.keyStore=The path on the local filesystem to the keystore
containing the server's certificate
+rpc.javax.net.ssl.keyStorePassword=The password for the keystore containing
the server's certificate
+rpc.javax.net.ssl.trustStore=The path on the local filesystem to the keystore
containing the certificate authority's public key
+rpc.javax.net.ssl.trustStorePassword=The password for the keystore containing
the certificate authority's public key
+instance.rpc.ssl.enabled=true
+</pre>
+</div>
+</div>
+
+<div class="paragraph">
+<p>Optionally, SSL client-authentication (two-way SSL) can also be enabled by
setting
+<code>instance.rpc.ssl.clientAuth=true</code> in
<code>$ACCUMULO_CONF_DIR/accumulo-site.xml</code>.
+This requires that each client has access to valid certificate to set up a
secure connection
+to the servers. By default, Accumulo uses one-way SSL which does not require
clients to have
+their own certificate.</p>
+</div>
+</div>
+
+<div class="sect2">
+<h3 id="_ssl_client_configuration">11.2. Client Configuration</h3>
+
+<div class="paragraph">
+<p>To establish a connection to Accumulo servers, each client must also have
+special configuration. This is typically accomplished through the use of
+the client configuration file whose default location is
<code>~/.accumulo/config</code>.</p>
+</div>
+
+<div class="paragraph">
+<p>The following properties must be set to connect to an Accumulo instance
using SSL:</p>
+</div>
+
+<div class="listingblock">
+<div class="content">
+<pre class="highlight">
+rpc.javax.net.ssl.trustStore=The path on the local filesystem to the keystore
containing the certificate authority's public key
+rpc.javax.net.ssl.trustStorePassword=The password for the keystore containing
the certificate authority's public key
+instance.rpc.ssl.enabled=true</pre>
+</div>
+</div>
+
+<div class="paragraph">
+<p>If two-way SSL if enabled (\texttt{instance.rpc.ssl.clientAuth=true}) for
the instance, the client must also define
+their own certificate and enable client authenticate as well.</p>
+</div>
+
+<div class="listingblock">
+<div class="content">
+<pre class="highlight">
+rpc.javax.net.ssl.keyStore=The path on the local filesystem to the keystore
containing the server's certificate
+rpc.javax.net.ssl.keyStorePassword=The password for the keystore containing
the server's certificate
+instance.rpc.ssl.clientAuth=true</pre>
+</div>
+</div>
+</div>
+<div class="sect3">
+<h3 id="_ssl_generate_ssl_material_openssl">11.3. Generating SSL material
using OpenSSL</h3>
+<div class="paragraph">
+<p>The following is included as an example for generating your own SSL
material (certificate authority and server/client
+certificates) using OpenSSL and Java's KeyTool command.</p>
+</div>
+<div class="sect2">
+<h4 id="_ssl_generate_ca">11.3.1. Generating a certificate authority</h3>
+<div class="literalblock">
+<div class="content">
+<pre>
+# Create a private key
+openssl genrsa -des3 -out root.key 4096
+
+# Create a certificate request using the private key
+openssl req -x509 -new -key root.key -days 365 -out root.pem
+
+# Generate a Base64-encoded version of the PEM just created
+openssl x509 -outform der -in root.pem -out root.der
+
+# Import the key into a Java KeyStore
+keytool -import -alias root-key -keystore truststore.jks -file root.der
+
+# Remove the DER formatted key file (as we don't need it anymore)
+rm root.der
+</pre>
+</div>
+</div>
+
+<div class="paragraph">
+<p>The <code>truststore.jks</code> file is the Java keystore which contains
the certificate authority's public key.</p>
+</div>
+</div>
<div class="sect2">
-<h3 id="_hardware">11.1. Hardware</h3>
+<h4 id="_ssl_generate_certs">11.3.2. Generating a certificate/keystore per
host</h3>
+<div class="paragraph">
+<p>It's common that each host in the instance is issued its own certificate
(notably to ensure that revocation procedures
+can be easily followed). The following steps can be taken for each host.</p>
+</div>
+
+<div class="literalblock">
+<div class="content">
+<pre>
+# Create the private key for our server
+openssl genrsa -out server.key 4096
+
+# Generate a certificate signing request (CSR) with our private key
+openssl req -new -key server.key -out server.csr
+
+# Use the CSR and the CA to create a certificate for the server (a reply to
the CSR)
+openssl x509 -req -in server.csr -CA root.pem -CAkey root.key -CAcreateserial \
+ -out server.crt -days 365
+
+# Use the certificate and the private key for our server to create PKCS12 file
+openssl pkcs12 -export -in server.crt -inkey server.key -certfile server.crt \
+ -name 'server-key' -out server.p12
+
+# Create a Java KeyStore for the server using the PKCS12 file (private key)
+keytool -importkeystore -srckeystore server.p12 -srcstoretype pkcs12
-destkeystore \
+ server.jks -deststoretype JKS
+
+# Remove the PKCS12 file as we don't need it
+rm server.p12
+
+# Import the CA-signed certificate to the keystore
+keytool -import -trustcacerts -alias server-crt -file server.crt -keystore
server.jks
+</pre>
+</div>
+</div>
+
+<div class="paragraph">
+<p>The <code>server.jks</code> file is the Java keystore containing the
certificate for a given host. The above
+methods are equivalent whether the certficate is generate for an Accumulo
server or a client.</p>
+</div>
+</div>
+
+<div class="sect1">
+<h2 id="_implementation_details">12. Implementation Details</h2>
+<div class="sectionbody">
+<div class="sect2">
+<h3 id="_implementation_fate">12.1. Fault-Tolerant Executor (FATE)</h3>
+
+<div class="paragraph">
+<p>Accumulo must implement a number of distributed, multi-step operations to
support
+the client API. Creating a new table is a simple example of an atomic client
call
+which requires multiple steps in the implementation: get a unique table ID,
configure
+default table permissions, populate information in ZooKeeper to record the
table's
+existence, create directories in HDFS for the table's data, etc. Implementing
these
+steps in a way that is tolerant to node failure and other concurrent
operations is
+very difficult to achieve. Accumulo includes a Fault-Tolerant Executor (FATE)
which
+is widely used server-side to implement the client API safely and correctly.
+
+FATE is the implementation detail which ensures that tables in creation when
the
+Master dies will be successfully created when another Master process is
started.
+This alleviates the need for any external tools to correct some bad state --
Accumulo can
+undo the failure and self-heal without any external intervention.</p>
+</div>
+
+<div class="sect3">
+<h4 id="_implementation_fate_overview">12.1.1 Overview</h3>
+<div class="paragraph">
+<p>FATE consists of two primary components: a repeatable, persisted operation
(REPO), a storage
+layer for REPOs and an execution system to run REPOs. Accumulo uses ZooKeeper
as the storage
+layer for FATE and the Accumulo Master acts as the execution system to run
REPOs.
+
+The important characteristic of REPOs are that they implemented in a way that
is idempotent:
+every operation must be able to undo or replay a partial execution of itself.
Requiring the
+implementation of the operation to support this functional greatly simplifies
the execution
+of these operations. This property is also what guarantees safety in light of
failure conditions.</P>
+</div>
+<div class="sect3">
+<h4 id="_implementation_fate_administration">12.1.2 Administration</h3>
+<div class="paragraph">
+<p>Sometimes, it is useful to inspect the current FATE operations, both
pending and executing.
+For example, a command that is not completing could be blocked on the
execution of another
+operation. Accumulo provides an Accumulo shell command to interact with
fate.</p>
+</div>
+
+<div class="paragraph">
+<p>The <code>fate</code> shell command accepts a number of arguments for
different functionality:
+<code>list</code>/<code>print</code>, <code>fail</code>,
<code>delete</code>.</p>
+</div>
+<div class="sect3">
+<h4 id="_implementation_fate_list_print">12.1.3 List/Print</h3>
+<div class="paragraph">
+<p>Without any additional arguments, this command will print all operations
that still exist in
+the FATE store (ZooKeeper). This will include active, pending, and completed
operations (completed
+operations are lazily removed from the store). Each operation includes a
unique "transaction ID", the
+state of the operation (e.g. <code>NEW</code>, <code>IN\_PROGRESS</code>,
<code>FAILED</code>), any locks the
+transaction actively holds and any locks it is waiting to acquire.</p>
+</div>
+
+<div class="paragraph">
+<p>This option can also accept transaction IDs which will restrict the list of
transactions shown. </p>
+</div>
+<div class="sect3">
+<h4 id="_implementation_fate_fail">12.1.4 Fail</h3>
+<div class="paragraph">
+<p>This command can be used to manually fail a FATE transaction and requires a
transaction ID
+as an argument. Failing an operation is not a normal procedure and should only
be performed
+by an administrator who understands the implications of why they are failing
the operation.</p>
+</div>
+<div class="sect3">
+<h4 id="_implementation_fate_delete">12.1.5 Delete</h3>
+<div class="paragraph">
+<p>This command requires a transaction ID and will delete any locks that the
transaction
+holds. Like the fail command, this command should only be used in extreme
circumstances
+by an administrator that understands the implications of the command they are
about to
+invoke. It is not normal to invoke this command.</p>
+</div>
+</div>
+</div>
+
+
+<div class="sect1">
+<h2 id="_administration">13. Administration</h2>
+<div class="sectionbody">
+<div class="sect2">
+<h3 id="_hardware">13.1. Hardware</h3>
<div class="paragraph">
<p>Because we are running essentially two or three systems simultaneously
layered
across the cluster: HDFS, Accumulo and MapReduce, it is typical for hardware to
@@ -3782,7 +4073,7 @@ processes on a machine.</p>
</div>
</div>
<div class="sect2">
-<h3 id="_network">11.2. Network</h3>
+<h3 id="_network">13.2. Network</h3>
<div class="paragraph">
<p>Accumulo communicates via remote procedure calls over TCP/IP for both
passing
data and control messages. In addition, Accumulo uses HDFS clients to
@@ -3861,7 +4152,7 @@ same default ports) on the same hardware
</div>
</div>
<div class="sect2">
-<h3 id="_installation">11.3. Installation</h3>
+<h3 id="_installation">13.3. Installation</h3>
<div class="paragraph">
<p>Choose a directory for the Accumulo installation. This directory will be
referenced
by the environment variable <code>$ACCUMULO_HOME</code>. Run the following:</p>
@@ -3878,7 +4169,7 @@ same <code>$ACCUMULO_HOME</code>.</p>
</div>
</div>
<div class="sect2">
-<h3 id="_dependencies">11.4. Dependencies</h3>
+<h3 id="_dependencies">13.4. Dependencies</h3>
<div class="paragraph">
<p>Accumulo requires HDFS and ZooKeeper to be configured and running
before starting. Password-less SSH should be configured between at least the
@@ -3888,14 +4179,14 @@ sync, which can cause problems with auto
</div>
</div>
<div class="sect2">
-<h3 id="_configuration_2">11.5. Configuration</h3>
+<h3 id="_configuration_2">13.5. Configuration</h3>
<div class="paragraph">
<p>Accumulo is configured by editing several Shell and XML files found in
<code>$ACCUMULO_HOME/conf</code>. The structure closely resembles
Hadoop’s configuration
files.</p>
</div>
<div class="sect3">
-<h4 id="_edit_conf_accumulo_env_sh">11.5.1. Edit conf/accumulo-env.sh</h4>
+<h4 id="_edit_conf_accumulo_env_sh">13.5.1. Edit conf/accumulo-env.sh</h4>
<div class="paragraph">
<p>Accumulo needs to know where to find the software it depends on. Edit
accumulo-env.sh
and specify the following:</p>
@@ -3943,7 +4234,7 @@ within the available memory.</p>
</div>
</div>
<div class="sect3">
-<h4 id="_native_map">11.5.2. Native Map</h4>
+<h4 id="_native_map">13.5.2. Native Map</h4>
<div class="paragraph">
<p>The tablet server uses a data structure called a MemTable to store sorted
key/value
pairs in memory when they are first received from the client. When a minor
compaction
@@ -3953,6 +4244,8 @@ speed up performance by utilizing the me
native map also avoids the performance implications brought on by garbage
collection
in the JVM by causing it to pause much less frequently.</p>
</div>
+<div class="sect4">
+<h5 id="_native_map_building">13.5.2.1 Building</h4>
<div class="paragraph">
<p>32-bit and 64-bit Linux and Mac OS X versions of the native map can be
built from the
Accumulo bin package by executing
<code>$ACCUMULO_HOME/bin/build_native_library.sh</code>.
@@ -3978,10 +4271,50 @@ in this directory for the map library. I
target directory, the tablet server may not be able to find it. The system can
also
locate the native maps shared library by setting <code>LD_LIBRARY_PATH</code>
(or
<code>DYLD_LIBRARY_PATH</code> on Mac OS X) in
<code>$ACCUMULO_HOME/conf/accumulo-env.sh</code></p>
+</div>
+</div>
+
+<div class="sect3">
+<h4 id="_administration_configuration">13.5.3. Configuration</h4>
+<div class="paragraph">
+<p>As mentioned, Accumulo will use the native libraries if they are found in
the expected
+location and if it is not configured to ignore them. Using the native maps
over JVM
+Maps nets a noticable improvement in ingest rates; however, certain
configuration
+variables are important to modify when increasing the size of the native
map.</p>
+</div>
+
+<div class="paragraph">
+<p>To adjust the size of the native map, increase the value of
<code>tserver.memory.maps.max</code>.
+By default, the maximum size of the native map is 1GB. When increasing this
value, it is
+also important to adjust the values of
<code>table.compaction.minor.logs.threshold</code> and
+<code>tserver.walog.max.size</code>.
<code>table.compaction.minor.logs.threshold</code> is the maximum
+number of write-ahead log files that a tablet can reference before they will
be automatically
+minor compacted. <code>tserver.walog.max.size</code> is the maximum size of a
write-ahead log.</p>
+</div>
+
+<div class="paragraph">
+<p>The maximum size of the native maps for a server should be less than the
product
+of the write-ahead log maximum size and minor compaction threshold for log
files:</p>
+</div>
+
+<pre>(table.compaction.minor.logs.threshold * tserver.walog.max.size >=
tserver.memory.maps.max)</pre>
+
+<div class="paragraph">
+<p>This formula ensures that minor compactions won't be automatically
triggered before the native
+maps can be completely saturated.</p>
+</div>
+
+<div class="paragraph">
+<p>Subsequently, when increasing the size of the write-ahead logs, it can also
be important
+to increase the HDFS block size that Accumulo uses when creating the files for
the write-ahead log.
+This is controlled via <code>tserver.wal.blocksize</code>. A basic
recommendation is that when
+<code>tserver.walog.max.size</code> is larger than 2GB in size, set
<code>tserver.wal.blocksize</code>
+to 2GB. Increasing the block size to a value larger than 2GB can result in
decreased write
+performance to the write-ahead log file which will slow ingest.</p>
</div>
</div>
<div class="sect3">
-<h4 id="_cluster_specification">11.5.3. Cluster Specification</h4>
+<h4 id="_cluster_specification">13.5.4. Cluster Specification</h4>
<div class="paragraph">
<p>On the machine that will serve as the Accumulo master:</p>
</div>
@@ -4002,7 +4335,7 @@ of errors.</p>
</div>
</div>
<div class="sect3">
-<h4 id="_accumulo_settings">11.5.4. Accumulo Settings</h4>
+<h4 id="_accumulo_settings">13.5.5. Accumulo Settings</h4>
<div class="paragraph">
<p>Specify appropriate values for the following settings in
<code>$ACCUMULO_HOME/conf/accumulo-site.xml</code> :</p>
@@ -4041,7 +4374,7 @@ some settings require a process restart
</div>
</div>
<div class="sect3">
-<h4 id="_deploy_configuration">11.5.5. Deploy Configuration</h4>
+<h4 id="_deploy_configuration">13.5.6. Deploy Configuration</h4>
<div class="paragraph">
<p>Copy the masters, slaves, accumulo-env.sh, and if necessary,
accumulo-site.xml
from the <code>$ACCUMULO_HOME/conf/</code> directory on the master to all the
machines
@@ -4049,7 +4382,7 @@ specified in the slaves file.</p>
</div>
</div>
<div class="sect3">
-<h4 id="_sensitive_configuration_values">11.5.6. Sensitive Configuration
Values</h4>
+<h4 id="_sensitive_configuration_values">13.5.7. Sensitive Configuration
Values</h4>
<div class="paragraph">
<p>Accumulo has a number of properties that can be specified via the
accumulo-site.xml
file which are sensitive in nature, instance.secret and
trace.token.property.password
@@ -4070,11 +4403,11 @@ when the Configuration object for accumu
</div>
</div>
<div class="sect3">
-<h4 id="_using_a_javakeystorecredentialprovider_for_storage">11.5.7. Using a
JavaKeyStoreCredentialProvider for storage</h4>
+<h4 id="_using_a_javakeystorecredentialprovider_for_storage">13.5.8. Using a
JavaKeyStoreCredentialProvider for storage</h4>
<div class="paragraph">
<p>One of the implementations provided in Hadoop-2.6.0 is a Java KeyStore
CredentialProvider.
Each entry in the KeyStore is the Accumulo Property key name. For example, to
store the
-\texttt{instance.secret}, the following command can be used:</p>
+<code>instance.secret</code>, the following command can be used:</p>
</div>
<div class="literalblock">
<div class="content">
@@ -4113,7 +4446,7 @@ will expect the KeyStore in the same loc
</div>
</div>
<div class="sect2">
-<h3 id="_initialization">11.6. Initialization</h3>
+<h3 id="_initialization">13.6. Initialization</h3>
<div class="paragraph">
<p>Accumulo must be initialized to create the structures it uses internally to
locate
data across the cluster. HDFS is required to be configured and running before
@@ -4132,9 +4465,9 @@ initialized it can be started.</p>
</div>
</div>
<div class="sect2">
-<h3 id="_running">11.7. Running</h3>
+<h3 id="_running">13.7. Running</h3>
<div class="sect3">
-<h4 id="_starting_accumulo">11.7.1. Starting Accumulo</h4>
+<h4 id="_starting_accumulo">13.7.1. Starting Accumulo</h4>
<div class="paragraph">
<p>Make sure Hadoop is configured on all of the machines in the cluster,
including
access to a shared HDFS instance. Make sure HDFS and ZooKeeper are running.
@@ -4149,7 +4482,7 @@ tables via reading the metadata tables.<
</div>
</div>
<div class="sect3">
-<h4 id="_stopping_accumulo">11.7.2. Stopping Accumulo</h4>
+<h4 id="_stopping_accumulo">13.7.2. Stopping Accumulo</h4>
<div class="paragraph">
<p>To shutdown cleanly, run <code>bin/stop-all.sh</code> and the master will
orchestrate the
shutdown of all the tablet servers. Shutdown waits for all minor compactions
to finish, so it may
@@ -4157,7 +4490,7 @@ take some time for particular configurat
</div>
</div>
<div class="sect3">
-<h4 id="_adding_a_node">11.7.3. Adding a Node</h4>
+<h4 id="_adding_a_node">13.7.3. Adding a Node</h4>
<div class="paragraph">
<p>Update your <code>$ACCUMULO_HOME/conf/slaves</code> (or
<code>$ACCUMULO_CONF_DIR/slaves</code>) file to account for the addition.</p>
</div>
@@ -4181,14 +4514,14 @@ but in practice it’s good to ensur
</div>
</div>
<div class="sect3">
-<h4 id="_decomissioning_a_node">11.7.4. Decomissioning a Node</h4>
+<h4 id="_decomissioning_a_node">13.7.4. Decomissioning a Node</h4>
<div class="paragraph">
<p>If you need to take a node out of operation, you can trigger a graceful
shutdown of a tablet
server. Accumulo will automatically rebalance the tablets across the available
tablet servers.</p>
</div>
<div class="literalblock">
<div class="content">
-<pre>$ACCUMULO_HOME/bin/accumulo admin stop <host(s)> {<host>
...}</pre>
+<pre>$ACCUMULO_HOME/bin/accumulo admin stop <host[:port]>
{<host[:port]> ...}</pre>
</div>
</div>
<div class="paragraph">
@@ -4206,9 +4539,37 @@ slaves file automatically, so it will re
recommended that you restart the monitor so that the node list is up to
date.</p>
</div>
</div>
+<div class="sect3">
+<h4 id="_restarting_process_on_a_node">13.7.5. Restarting process on a
node</h4>
+<div class="paragraph">
+<p>Occasionally, it might be necessary to restart the processes on a specific
node. In addition
+to the <code>start-all.sh</code> and <code>stop-all.sh</code> scripts,
Accumulo contains scripts to start/stop all processes
+on a node and start/stop a given process on a node.</p>
+</div>
+
+<div class="paragraph">
+<p><code>start-here.sh</code> and <code>stop-here.sh</code> will start/stop
all Accumulo processes on the current node. The
+necessary processes to start/stop are determined via the "hosts" files (e.g.
slaves, masters, etc).
+These scripts expect no arguments.</p>
+</div>
+
+<div class="paragraph">
+<p><code>start-server.sh</code> can also be useful in starting a given process
on a host.
+The first argument to the process is the hostname of the machine. Use the same
host that
+you specified in hosts file (if you specified FQDN in the masters file, use
the FQDN, not
+the shortname). The second argument is the name of the process to start (e.g.
master, tserver).</>
+</div>
+
+<div class="paragraph">
+<p>The steps described to decomission a node can also be used (without removal
of the host
+from the <code>$ACCUMULO_HOME/conf/slaves</code> file) to gracefully stop a
node. This will
+ensure that the tabletserver is cleanly stopped and recovery will not need to
be performed
+when the tablets are re-hosted.</p>
+</div>
</div>
+
<div class="sect2">
-<h3 id="_monitoring">11.8. Monitoring</h3>
+<h3 id="_monitoring">13.8. Monitoring</h3>
<div class="paragraph">
<p>The Accumulo Master provides an interface for monitoring the status and
health of
Accumulo components. This interface can be accessed by pointing a web browser
to
@@ -4216,7 +4577,7 @@ Accumulo components. This interface can
</div>
</div>
<div class="sect2">
-<h3 id="_tracing">11.9. Tracing</h3>
+<h3 id="_tracing">13.9. Tracing</h3>
<div class="paragraph">
<p>It can be difficult to determine why some operations are taking longer
than expected. For example, you may be looking up items with very low
@@ -4242,7 +4603,7 @@ other table.</p>
<a href="http://research.google.com/pubs/pub36356.html";>Google’s
Dapper</a>.</p>
</div>
<div class="sect3">
-<h4 id="_tracers">11.9.1. Tracers</h4>
+<h4 id="_tracers">13.9.1. Tracers</h4>
<div class="paragraph">
<p>To collect traces, Accumulo needs at least one server listed in
<code>$ACCUMULO_HOME/conf/tracers</code>. The server collects traces
@@ -4258,7 +4619,7 @@ trace.token.property.password</pre>
</div>
</div>
<div class="sect3">
-<h4 id="_instrumenting_a_client">11.9.2. Instrumenting a Client</h4>
+<h4 id="_instrumenting_a_client">13.9.2. Instrumenting a Client</h4>
<div class="paragraph">
<p>Tracing can be used to measure a client operation, such as a scan, as
the operation traverses the distributed system. To enable tracing for
@@ -4337,7 +4698,7 @@ data.</p>
</div>
</div>
<div class="sect3">
-<h4 id="_viewing_collected_traces">11.9.3. Viewing Collected Traces</h4>
+<h4 id="_viewing_collected_traces">13.9.3. Viewing Collected Traces</h4>
<div class="paragraph">
<p>To view collected traces, use the "Recent Traces" link on the Monitor
UI. You can also programmatically access and print traces using the
@@ -4345,7 +4706,7 @@ UI. You can also programmatically access
</div>
</div>
<div class="sect3">
-<h4 id="_tracing_from_the_shell">11.9.4. Tracing from the Shell</h4>
+<h4 id="_tracing_from_the_shell">13.9.4. Tracing from the Shell</h4>
<div class="paragraph">
<p>You can enable tracing for operations run from the shell by using the
<code>trace on</code> and <code>trace off</code> commands.</p>
@@ -4372,14 +4733,14 @@ Time Start Service@Location Name
</div>
</div>
<div class="sect2">
-<h3 id="_logging">11.10. Logging</h3>
+<h3 id="_logging">13.10. Logging</h3>
<div class="paragraph">
<p>Accumulo processes each write to a set of log files. By default these are
found under
<code>$ACCUMULO/logs/</code>.</p>
</div>
</div>
<div class="sect2">
-<h3 id="_recovery">11.11. Recovery</h3>
+<h3 id="_recovery">13.11. Recovery</h3>
<div class="paragraph">
<p>In the event of TabletServer failure or error on shutting Accumulo down,
some
mutations may not have been minor compacted to HDFS properly. In this case,
@@ -4401,10 +4762,86 @@ cases clients will be able to continue p
throwing an exception.</p>
</div>
</div>
+<h3 id="_migrating_from_non_ha_to_ha">12.12. Migrating Accumulo from non-HA
Namenode to HA Namenode</h3>
+<div class="paragraph"><p>
+The following steps will allow a non-HA instance to be migrated to an HA
instance. Consider an HDFS URL
+<code>hdfs://namenode.example.com:8020</code> which is going to be moved to
<code>hdfs://nameservice1</code>.</p>
+</div>
+<div class="paragraph"><p>
+Before moving HDFS over to the HA namenode, use
<code>$ACCUMULO_HOME/bin/accumulo admin volumes</code> to confirm
+that the only volume displayed is the volume from the current namenode's HDFS
URL.</p>
+</div>
+<div class="listingblock">
+<div class="content">
+<pre>
+Listing volumes referenced in zookeeper
+ Volume : hdfs://namenode.example.com:8020/accumulo
+
+Listing volumes referenced in accumulo.root tablets section
+ Volume : hdfs://namenode.example.com:8020/accumulo
+Listing volumes referenced in accumulo.root deletes section (volume
replacement occurrs at deletion time)
+
+Listing volumes referenced in accumulo.metadata tablets section
+ Volume : hdfs://namenode.example.com:8020/accumulo
+
+Listing volumes referenced in accumulo.metadata deletes section (volume
replacement occurrs at deletion time)
+</pre>
+</div>
+</div>
+<div class="paragraph"><p>
+After verifying the current volume is correct, shut down the cluster and
transition HDFS to the HA nameservice.
+
+Edit <code>$ACCUMULO_HOME/conf/accumulo-site.xml</code> to notify accumulo
that a volume is being replaced. First,
+add the new nameservice volume to the <code>instance.volumes</code> property.
Next, add the
+<code>instance.volumes.replacements</code> property in the form of <code>old
new</code>. It's important to not include
+the volume that's being replaced in <code>instance.volumes</code>, otherwise
it's possible accumulo could continue
+to write to the volume.</p>
+</div>
+<div class="listingblock">
+<div class="content">
+<pre class="highlight"><code class="xml language-xml"><!-- instance.dfs.uri
and instance.dfs.dir should not be set-->
+<property>
+ <name>instance.volumes</name>
+ <value>hdfs://nameservice1/accumulo</value>
+</property>
+<property>
+ <name>instance.volumes.replacements</name>
+ <value>hdfs://namenode.example.com:8020/accumulo
hdfs://nameservice1/accumulo</value>
+</property>
+</code></pre>
+</div>
+</div>
+<div class="paragraph">
+<p>Run <code>$ACCUMULO_HOME/bin/accumulo init --add-volumes</code> and start
up the accumulo cluster. Verify that the
+new nameservice volume shows up with <code>$ACCUMULO_HOME/bin/accumulo admin
volumes</code>.</p>
+</div>
+<div class="listingblock">
+<div class="content">
+<pre>
+Listing volumes referenced in zookeeper
+ Volume : hdfs://namenode.example.com:8020/accumulo
+ Volume : hdfs://nameservice1/accumulo
+
+Listing volumes referenced in accumulo.root tablets section
+ Volume : hdfs://namenode.example.com:8020/accumulo
+ Volume : hdfs://nameservice1/accumulo
+Listing volumes referenced in accumulo.root deletes section (volume
replacement occurrs at deletion time)
+
+Listing volumes referenced in accumulo.metadata tablets section
+ Volume : hdfs://namenode.example.com:8020/accumulo
+ Volume : hdfs://nameservice1/accumulo
+Listing volumes referenced in accumulo.metadata deletes section (volume
replacement occurrs at deletion time)
+
+</pre>
+</div>
+</div>
+<div class="paragraph"><p>
+Some erroneous GarbageCollector messages may still be seen for a small period
while data is transitioning to
+the new volumes. This is expected and can usually be ignored.</p>
</div>
</div>
<div class="sect1">
-<h2 id="_multi_volume_installations">12. Multi-Volume Installations</h2>
+<h2 id="_multi_volume_installations">13. Multi-Volume Installations</h2>
<div class="sectionbody">
<div class="paragraph">
<p>This is an advanced configuration setting for very large clusters
@@ -4487,10 +4924,10 @@ NameNode.</p>
</div>
</div>
<div class="sect1">
-<h2 id="_troubleshooting">13. Troubleshooting</h2>
+<h2 id="_troubleshooting">14. Troubleshooting</h2>
<div class="sectionbody">
<div class="sect2">
-<h3 id="_logs">13.1. Logs</h3>
+<h3 id="_logs">14.1. Logs</h3>
<div class="paragraph">
<p><strong>Q</strong>: The tablet server does not seem to be running!? What
happened?</p>
</div>
@@ -4518,7 +4955,7 @@ options, files or permissions, messages
</div>
</div>
<div class="sect2">
-<h3 id="_monitor_2">13.2. Monitor</h3>
+<h3 id="_monitor_2">14.2. Monitor</h3>
<div class="paragraph">
<p><strong>Q</strong>: Accumulo is not working, what’s wrong?</p>
</div>
@@ -4576,7 +5013,7 @@ master is down.</p>
</div>
</div>
<div class="sect2">
-<h3 id="_hdfs">13.3. HDFS</h3>
+<h3 id="_hdfs">14.3. HDFS</h3>
<div class="paragraph">
<p>Accumulo reads and writes to the Hadoop Distributed File System.
Accumulo needs this file system available at all times for normal
operations.</p>
@@ -4624,7 +5061,7 @@ system issues on those nodes.</p>
</div>
</div>
<div class="sect2">
-<h3 id="_zookeeper">13.4. Zookeeper</h3>
+<h3 id="_zookeeper">14.4. Zookeeper</h3>
<div class="paragraph">
<p><strong>Q</strong>: <code>accumulo init</code> is hanging. It says
something about talking to zookeeper.</p>
</div>
@@ -4706,7 +5143,7 @@ already.</p>
zookeeper.</p>
</div>
<div class="sect3">
-<h4 id="_keeping_the_tablet_server_lock">13.4.1. Keeping the tablet server
lock</h4>
+<h4 id="_keeping_the_tablet_server_lock">14.4.1. Keeping the tablet server
lock</h4>
<div class="paragraph">
<p><strong>Q</strong>: My tablet server lost its lock. Why?</p>
</div>
@@ -4791,7 +5228,7 @@ messages to zookeeper.</p>
</div>
</div>
<div class="sect2">
-<h3 id="_tools">13.5. Tools</h3>
+<h3 id="_tools">14.5. Tools</h3>
<div class="paragraph">
<p>The accumulo script can be used to run classes from the command line.
This section shows how a few of the utilities work, but there are many
@@ -5025,7 +5462,7 @@ INFO : Using ZooKeepers localhost:2181
</div>
</div>
<div class="sect2">
-<h3 id="metadata">13.6. System Metadata Tables</h3>
+<h3 id="metadata">14.6. System Metadata Tables</h3>
<div class="paragraph">
<p>Accumulo tracks information about tables in metadata tables. The metadata
for
most tables is contained within the metadata table in the accumulo namespace,
@@ -5172,7 +5609,7 @@ so it has no prev-row (or end row).</p>
</div>
</div>
<div class="sect2">
-<h3 id="_simple_system_recovery">13.7. Simple System Recovery</h3>
+<h3 id="_simple_system_recovery">14.7. Simple System Recovery</h3>
<div class="paragraph">
<p><strong>Q</strong>: One of my Accumulo processes died. How do I bring it
back?</p>
</div>
@@ -5219,9 +5656,9 @@ processes should be stable on the order
</div>
</div>
<div class="sect2">
-<h3 id="_advanced_system_recovery">13.8. Advanced System Recovery</h3>
+<h3 id="_advanced_system_recovery">14.8. Advanced System Recovery</h3>
<div class="sect3">
-<h4 id="_hdfs_failure">13.8.1. HDFS Failure</h4>
+<h4 id="_hdfs_failure">14.8.1. HDFS Failure</h4>
<div class="paragraph">
<p><strong>Q</strong>: I had disasterous HDFS failure. After bringing
everything back up, several tablets refuse to go online.</p>
</div>
@@ -5406,7 +5843,7 @@ resolved. Rebuild the metadata table if
</div>
</div>
<div class="sect3">
-<h4 id="zookeeper_failure">13.8.2. ZooKeeper Failure</h4>
+<h4 id="zookeeper_failure">14.8.2. ZooKeeper Failure</h4>
<div class="paragraph">
<p><strong>Q</strong>: I lost my ZooKeeper quorum (hardware failure), but HDFS
is still intact. How can I recover my Accumulo instance?</p>
</div>
@@ -5478,7 +5915,7 @@ omission of new data.</p>
</div>
</div>
<div class="sect2">
-<h3 id="_upgrade_issues">13.9. Upgrade Issues</h3>
+<h3 id="_upgrade_issues">14.9. Upgrade Issues</h3>
<div class="paragraph">
<p><strong>Q</strong>: I upgrade from 1.4 to 1.5 to 1.6 but still have some
WAL files on local disk. Do I have any way
to recover them?</p>
@@ -5496,7 +5933,7 @@ invoked as follows:</p>
</div>
</div>
<div class="sect2">
-<h3 id="_file_naming_conventions">13.10. File Naming Conventions</h3>
+<h3 id="_file_naming_conventions">14.10. File Naming Conventions</h3>
<div class="paragraph">
<p><strong>Q</strong>: Why are files named like they are? Why do some start
with <code>C</code> and others with <code>F</code>?</p>
</div>
@@ -5549,10 +5986,10 @@ is struggling to keep up with ingest vs
</div>
</div>
<div class="sect1">
-<h2 id="configuration">14. Appendix A: Configuration Management</h2>
+<h2 id="configuration">15. Appendix A: Configuration Management</h2>
<div class="sectionbody">
<div class="sect2">
-<h3 id="_configuration_overview">14.1. Configuration Overview</h3>
+<h3 id="_configuration_overview">15.1. Configuration Overview</h3>
<div class="paragraph">
<p>All accumulo properties have a default value in the source code.
Properties can also be set
in accumulo-site.xml and in zookeeper on per-table or system-wide basis. If
properties are set in more than one location,
@@ -5560,7 +5997,7 @@ accumulo will choose the property with t
below (from highest to lowest):</p>
</div>
<div class="sect3">
-<h4 id="_zookeeper_table_properties">14.1.1. Zookeeper table properties</h4>
+<h4 id="_zookeeper_table_properties">15.1.1. Zookeeper table properties</h4>
<div class="paragraph">
<p>Table properties are applied to the entire cluster when set in zookeeper
using the accumulo API or shell. While table properties take precedent over
system properties, both will override properties set in accumulo-site.xml</p>
</div>
@@ -5574,7 +6011,7 @@ below (from highest to lowest):</p>
</div>
</div>
<div class="sect3">
-<h4 id="_zookeeper_system_properties">14.1.2. Zookeeper system properties</h4>
+<h4 id="_zookeeper_system_properties">15.1.2. Zookeeper system properties</h4>
<div class="paragraph">
<p>System properties are applied to the entire cluster when set in zookeeper
using the accumulo API or shell. System properties consist of all properties
with a <code>yes</code> in the <em>Zookeeper Mutable</em> column in the table
below. They are set with the following shell command:</p>
</div>
@@ -5591,7 +6028,7 @@ below (from highest to lowest):</p>
</div>
</div>
<div class="sect3">
-<h4 id="_accumulo_site_xml">14.1.3. accumulo-site.xml</h4>
+<h4 id="_accumulo_site_xml">15.1.3. accumulo-site.xml</h4>
<div class="paragraph">
<p>Accumulo processes (master, tserver, etc) read their local
accumulo-site.xml on start up. Therefore, changes made to accumulo-site.xml
must rsynced across the cluster and processes must be restarted to apply
changes.</p>
</div>
@@ -5600,7 +6037,7 @@ below (from highest to lowest):</p>
</div>
</div>
<div class="sect3">
-<h4 id="_default_values">14.1.4. Default Values</h4>
+<h4 id="_default_values">15.1.4. Default Values</h4>
<div class="paragraph">
<p>All properties have a default value in the source code. This value has the
lowest precedence and is overriden if set in accumulo-site.xml or zookeeper.</p>
</div>
@@ -5610,7 +6047,7 @@ below (from highest to lowest):</p>
</div>
</div>
<div class="sect2">
-<h3 id="_configuration_in_the_shell">14.2. Configuration in the Shell</h3>
+<h3 id="_configuration_in_the_shell">15.2. Configuration in the Shell</h3>
<div class="paragraph">
<p>The <code>config</code> command in the shell allows you to view the current
system configuration. You can also use the <code>-t</code> option to view a
table’s configuration as below:</p>
</div>
@@ -5653,13 +6090,13 @@ default | table.failures.ignore .......
</div>
</div>
<div class="sect2">
-<h3 id="_available_properties">14.3. Available Properties</h3>
+<h3 id="_available_properties">15.3. Available Properties</h3>
<div class="paragraph">
<p>Jump to:
<a href="#RPC_PREFIX">rpc.*</a> | <a href="#INSTANCE_PREFIX">instance.*</a> |
<a href="#GENERAL_PREFIX">general.*</a> | <a href="#MASTER_PREFIX">master.*</a>
| <a href="#TSERV_PREFIX">tserver.*</a> | <a href="#LOGGER_PREFIX">logger.*</a>
| <a href="#GC_PREFIX">gc.*</a> | <a href="#MONITOR_PREFIX">monitor.*</a> | <a
href="#TRACE_PREFIX">trace.*</a> | <a
href="#TRACE_TOKEN_PROPERTY_PREFIX">trace.token.property.*</a> | <a
href="#TABLE_PREFIX">table.*</a> | <a
href="#TABLE_CONSTRAINT_PREFIX">table.constraint.*</a> | <a
href="#TABLE_ITERATOR_PREFIX">table.iterator.*</a> | <a
href="#TABLE_LOCALITY_GROUP_PREFIX">table.group.*</a> | <a
href="#TABLE_COMPACTION_STRATEGY_PREFIX">table.majc.compaction.strategy.opts.*</a>
| <a
href="#VFS_CONTEXT_CLASSPATH_PROPERTY">general.vfs.context.classpath.*</a></p>
</div>
<div class="sect3">
-<h4 id="RPC_PREFIX">14.3.1. rpc.*</h4>
+<h4 id="RPC_PREFIX">15.3.1. rpc.*</h4>
<div class="paragraph">
<p>Properties in this category related to the configuration of SSL keys for
RPC. See also instance.ssl.enabled</p>
</div>
@@ -5742,7 +6179,7 @@ default | table.failures.ignore .......
</div>
</div>
<div class="sect3">
-<h4 id="INSTANCE_PREFIX">14.3.2. instance.*</h4>
+<h4 id="INSTANCE_PREFIX">15.3.2. instance.*</h4>
<div class="paragraph">
<p>Properties in this category must be consistent throughout a cloud. This is
enforced and servers won’t be able to communicate if these differ.</p>
</div>
@@ -5880,7 +6317,7 @@ default | table.failures.ignore .......
</div>
</div>
<div class="sect3">
-<h4 id="GENERAL_PREFIX">14.3.3. general.*</h4>
+<h4 id="GENERAL_PREFIX">15.3.3. general.*</h4>
<div class="paragraph">
<p>Properties in this category affect the behavior of accumulo overall, but do
not have to be consistent throughout a cloud.</p>
</div>
@@ -6004,7 +6441,7 @@ $HADOOP_PREFIX/share/hadoop/mapreduce/.*
</div>
</div>
<div class="sect3">
-<h4 id="MASTER_PREFIX">14.3.4. master.*</h4>
+<h4 id="MASTER_PREFIX">15.3.4. master.*</h4>
<div class="paragraph">
<p>Properties in this category affect the behavior of the master server</p>
</div>
@@ -6153,7 +6590,7 @@ $HADOOP_PREFIX/share/hadoop/mapreduce/.*
</div>
</div>
<div class="sect3">
-<h4 id="TSERV_PREFIX">14.3.5. tserver.*</h4>
+<h4 id="TSERV_PREFIX">15.3.5. tserver.*</h4>
<div class="paragraph">
<p>Properties in this category affect the behavior of the tablet servers</p>
</div>
@@ -6610,7 +7047,7 @@ $HADOOP_PREFIX/share/hadoop/mapreduce/.*
</div>
</div>
<div class="sect3">
-<h4 id="LOGGER_PREFIX">14.3.6. logger.*</h4>
+<h4 id="LOGGER_PREFIX">15.3.6. logger.*</h4>
<div class="paragraph">
<p>Properties in this category affect the behavior of the write-ahead logger
servers</p>
</div>
@@ -6627,7 +7064,7 @@ $HADOOP_PREFIX/share/hadoop/mapreduce/.*
</div>
</div>
<div class="sect3">
-<h4 id="GC_PREFIX">14.3.7. gc.*</h4>
+<h4 id="GC_PREFIX">15.3.7. gc.*</h4>
<div class="paragraph">
<p>Properties in this category affect the behavior of the accumulo garbage
collector.</p>
</div>
@@ -6688,7 +7125,7 @@ $HADOOP_PREFIX/share/hadoop/mapreduce/.*
</div>
</div>
<div class="sect3">
-<h4 id="MONITOR_PREFIX">14.3.8. monitor.*</h4>
+<h4 id="MONITOR_PREFIX">15.3.8. monitor.*</h4>
<div class="paragraph">
<p>Properties in this category affect the behavior of the monitor web
server.</p>
</div>
@@ -6760,7 +7197,7 @@ $HADOOP_PREFIX/share/hadoop/mapreduce/.*
</div>
</div>
<div class="sect3">
-<h4 id="TRACE_PREFIX">14.3.9. trace.*</h4>
+<h4 id="TRACE_PREFIX">15.3.9. trace.*</h4>
<div class="paragraph">
<p>Properties in this category affect the behavior of distributed tracing.</p>
</div>
@@ -6821,13 +7258,13 @@ $HADOOP_PREFIX/share/hadoop/mapreduce/.*
</div>
</div>
<div class="sect3">
-<h4 id="TRACE_TOKEN_PROPERTY_PREFIX">14.3.10. trace.token.property.*</h4>
+<h4 id="TRACE_TOKEN_PROPERTY_PREFIX">15.3.10. trace.token.property.*</h4>
<div class="paragraph">
<p>The prefix used to create a token for storing distributed traces. For each
propetry required by trace.token.type, place this prefix in front of it.</p>
</div>
</div>
<div class="sect3">
-<h4 id="TABLE_PREFIX">14.3.11. table.*</h4>
+<h4 id="TABLE_PREFIX">15.3.11. table.*</h4>
<div class="paragraph">
<p>Properties in this category affect tablet server treatment of tablets, but
can be configured on a per-table basis. Setting these properties in the site
file will override the default globally for all tables and not any specific
table. However, both the default and the global setting can be overridden per
table using the table operations API or in the shell, which sets the overridden
value in zookeeper. Restarting accumulo tablet servers after setting these
properties in the site file will cause the global setting to take effect.
However, you must use the API or the shell to change properties in zookeeper
that are set on a table.</p>
</div>
@@ -7165,7 +7602,7 @@ CAUTION: If a particular key has an empt
</div>
</div>
<div class="sect3">
-<h4 id="TABLE_CONSTRAINT_PREFIX">14.3.12. table.constraint.*</h4>
+<h4 id="TABLE_CONSTRAINT_PREFIX">15.3.12. table.constraint.*</h4>
<div class="paragraph">
<p>Properties in this category are per-table properties that add constraints
to a table. These properties start with the category prefix, followed by a
number, and their values correspond to a fully qualified Java class that
implements the Constraint interface.
For example:
@@ -7175,7 +7612,7 @@ table.constraint.2 = my.package.constrai
</div>
</div>
<div class="sect3">
-<h4 id="TABLE_ITERATOR_PREFIX">14.3.13. table.iterator.*</h4>
+<h4 id="TABLE_ITERATOR_PREFIX">15.3.13. table.iterator.*</h4>
<div class="paragraph">
<p>Properties in this category specify iterators that are applied at various
stages (scopes) of interaction with a table. These properties start with the
category prefix, followed by a scope (minc, majc, scan, etc.), followed by a
period, followed by a name, as in table.iterator.scan.vers, or
table.iterator.scan.custom. The values for these properties are a number
indicating the ordering in which it is applied, and a class name such as:
table.iterator.scan.vers =
10,org.apache.accumulo.core.iterators.VersioningIterator
@@ -7184,7 +7621,7 @@ For example, table.iterator.minc.vers.op
</div>
</div>
<div class="sect3">
-<h4 id="TABLE_LOCALITY_GROUP_PREFIX">14.3.14. table.group.*</h4>
+<h4 id="TABLE_LOCALITY_GROUP_PREFIX">15.3.14. table.group.*</h4>
<div class="paragraph">
<p>Properties in this category are per-table properties that define locality
groups in a table. These properties start with the category prefix, followed by
a name, followed by a period, and followed by a property for that group.
For example table.group.group1=x,y,z sets the column families for a group
called group1. Once configured, group1 can be enabled by adding it to the list
of groups in the table.groups.enabled property.
@@ -7192,22 +7629,22 @@ Additional group options may be specifie
</div>
</div>
<div class="sect3">
-<h4 id="TABLE_COMPACTION_STRATEGY_PREFIX">14.3.15.
table.majc.compaction.strategy.opts.*</h4>
+<h4 id="TABLE_COMPACTION_STRATEGY_PREFIX">15.3.15.
table.majc.compaction.strategy.opts.*</h4>
<div class="paragraph">
<p>Properties in this category are used to configure the compaction
strategy.</p>
</div>
</div>
<div class="sect3">
-<h4 id="VFS_CONTEXT_CLASSPATH_PROPERTY">14.3.16.
general.vfs.context.classpath.*</h4>
+<h4 id="VFS_CONTEXT_CLASSPATH_PROPERTY">15.3.16.
general.vfs.context.classpath.*</h4>
<div class="paragraph">
<p>Properties in this category are define a classpath. These properties start
with the category prefix, followed by a context name. The value is a comma
seperated list of URIs. Supports full regex on filename alone. For example,
general.vfs.context.classpath.cx1=hdfs://nn1:9902/mylibdir/*.jar. You can
enable post delegation for a context, which will load classes from the context
first instead of the parent first. Do this by setting
general.vfs.context.classpath.<name>.delegation=post, where <name>
is your context nameIf delegation is not specified, it defaults to loading from
parent classloader first.</p>
</div>
</div>
</div>
<div class="sect2">
-<h3 id="_property_types">14.4. Property Types</h3>
+<h3 id="_property_types">15.4. Property Types</h3>
<div class="sect3">
-<h4 id="_duration">14.4.1. duration</h4>
+<h4 id="_duration">15.4.1. duration</h4>
<div class="paragraph">
<p>A non-negative integer optionally followed by a unit of time (whitespace
disallowed), as in 30s.
If no unit of time is specified, seconds are assumed. Valid units are
<em>ms</em>, <em>s</em>, <em>m</em>, <em>h</em> for milliseconds, seconds,
minutes, and hours.
@@ -7217,13 +7654,13 @@ Unless otherwise stated, the max value f
</div>
</div>
<div class="sect3">
-<h4 id="_date_time">14.4.2. date/time</h4>
+<h4 id="_date_time">15.4.2. date/time</h4>
<div class="paragraph">
<p>A date/time string in the format: YYYYMMDDhhmmssTTT where TTT is the 3
character time zone</p>
</div>
</div>
<div class="sect3">
-<h4 id="_memory">14.4.3. memory</h4>
+<h4 id="_memory">15.4.3. memory</h4>
<div class="paragraph">
<p>A positive integer optionally followed by a unit of memory (whitespace
disallowed), as in 2G.
If no unit is specified, bytes are assumed. Valid units are <em>B</em>,
<em>K</em>, <em>M</em>, <em>G</em>, for bytes, kilobytes, megabytes, and
gigabytes.
@@ -7233,7 +7670,7 @@ Unless otherwise stated, the max value f
</div>
</div>
<div class="sect3">
-<h4 id="_host_list">14.4.4. host list</h4>
+<h4 id="_host_list">15.4.4. host list</h4>
<div class="paragraph">
<p>A comma-separated list of hostnames or ip addresses, with optional port
numbers.
Examples of valid host lists are
<em>localhost:2000,www.example.com,10.10.1.1:500</em> and <em>localhost</em>.
@@ -7241,19 +7678,19 @@ Examples of invalid host lists are <em>'
</div>
</div>
<div class="sect3">
-<h4 id="_port">14.4.5. port</h4>
+<h4 id="_port">15.4.5. port</h4>
<div class="paragraph">
<p>An positive integer in the range 1024-65535, not already in use or
specified elsewhere in the configuration</p>
</div>
</div>
<div class="sect3">
-<h4 id="_count">14.4.6. count</h4>
+<h4 id="_count">15.4.6. count</h4>
<div class="paragraph">
<p>A non-negative integer in the range of 0-2147483647</p>
</div>
</div>
<div class="sect3">
-<h4 id="_fraction_percentage">14.4.7. fraction/percentage</h4>
+<h4 id="_fraction_percentage">15.4.7. fraction/percentage</h4>
<div class="paragraph">
<p>A floating point number that represents either a fraction or, if suffixed
with the <em>%</em> character, a percentage.
Examples of valid fractions/percentages are <em>10</em>, <em>1000%</em>,
<em>0.05</em>, <em>5%</em>, <em>0.2%</em>, <em>0.0005</em>.
@@ -7261,38 +7698,38 @@ Examples of invalid fractions/percentage
</div>
</div>
<div class="sect3">
-<h4 id="_path">14.4.8. path</h4>
+<h4 id="_path">15.4.8. path</h4>
<div class="paragraph">
<p>A string that represents a filesystem path, which can be either relative or
absolute to some directory. The filesystem depends on the property. The
following environment variables will be substituted: [ACCUMULO_HOME,
ACCUMULO_CONF_DIR]</p>
</div>
</div>
<div class="sect3">
-<h4 id="_absolute_path">14.4.9. absolute path</h4>
+<h4 id="_absolute_path">15.4.9. absolute path</h4>
<div class="paragraph">
<p>An absolute filesystem path. The filesystem depends on the property. This
is the same as path, but enforces that its root is explicitly specified.</p>
</div>
</div>
<div class="sect3">
-<h4 id="_java_class">14.4.10. java class</h4>
+<h4 id="_java_class">15.4.10. java class</h4>
<div class="paragraph">
<p>A fully qualified java class name representing a class on the classpath.
An example is <em>java.lang.String</em>, rather than <em>String</em></p>
</div>
</div>
<div class="sect3">
-<h4 id="_string">14.4.11. string</h4>
+<h4 id="_string">15.4.11. string</h4>
<div class="paragraph">
<p>An arbitrary string of characters whose format is unspecified and
interpreted based on the context of the property to which it applies.</p>
</div>
</div>
<div class="sect3">
-<h4 id="_boolean">14.4.12. boolean</h4>
+<h4 id="_boolean">15.4.12. boolean</h4>
<div class="paragraph">
<p>Has a value of either <em>true</em> or <em>false</em></p>
</div>
</div>
<div class="sect3">
-<h4 id="_uri">14.4.13. uri</h4>
+<h4 id="_uri">15.4.13. uri</h4>
<div class="paragraph">
<p>A valid URI</p>
</div>
@@ -7303,7 +7740,7 @@ An example is <em>java.lang.String</em>,
</div>
<div id="footer">
<div id="footer-text">
-Last updated 2014-05-07 17:01:06 PDT
+Last updated 2015-02-16 14:08:06 EST
</div>
</div>
</body>
