This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/ozone-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new fb222a62 [auto] Generated docs from Apache Ozone master
d38484ef31730e6cedf5159d69a785096dd3a7fd
fb222a62 is described below
commit fb222a62d474b127803e4ff60da2d494d02244c2
Author: Github Actions <[email protected]>
AuthorDate: Sat Jun 14 12:46:08 2025 +0000
[auto] Generated docs from Apache Ozone master
d38484ef31730e6cedf5159d69a785096dd3a7fd
---
docs/edge/en/sitemap.xml | 12 ++++++------
docs/edge/feature/om-ha.html | 25 ++++++++++++++++++++++++-
docs/edge/index.html | 7 ++++---
docs/edge/interface/s3.html | 14 ++++++++++++--
docs/edge/sitemap.xml | 2 +-
docs/edge/start.html | 4 ++--
docs/edge/start/onprem.html | 9 ++++++++-
docs/edge/start/startfromdockerhub.html | 10 ++++++++--
8 files changed, 65 insertions(+), 18 deletions(-)
diff --git a/docs/edge/en/sitemap.xml b/docs/edge/en/sitemap.xml
index cc5cf0a9..39b91051 100644
--- a/docs/edge/en/sitemap.xml
+++ b/docs/edge/en/sitemap.xml
@@ -3,7 +3,7 @@
xmlns:xhtml="http://www.w3.org/1999/xhtml";>
<url>
<loc>/</loc>
- <lastmod>2020-12-05T22:06:34+08:00</lastmod>
+ <lastmod>2025-06-14T00:32:50-07:00</lastmod>
<xhtml:link
rel="alternate"
hreflang="zh"
@@ -68,7 +68,7 @@
/>
</url><url>
<loc>/start.html</loc>
- <lastmod>2019-06-28T18:59:33-04:00</lastmod>
+ <lastmod>2025-06-14T00:32:50-07:00</lastmod>
<xhtml:link
rel="alternate"
hreflang="zh"
@@ -81,7 +81,7 @@
/>
</url><url>
<loc>/feature/om-ha.html</loc>
- <lastmod>2025-02-05T15:47:32+05:30</lastmod>
+ <lastmod>2025-06-14T00:08:47-07:00</lastmod>
<xhtml:link
rel="alternate"
hreflang="zh"
@@ -256,7 +256,7 @@
/>
</url><url>
<loc>/interface/s3.html</loc>
- <lastmod>2024-12-04T15:41:48-05:00</lastmod>
+ <lastmod>2025-06-13T19:28:59-07:00</lastmod>
<xhtml:link
rel="alternate"
hreflang="zh"
@@ -514,7 +514,7 @@
<lastmod>2022-03-07T12:09:51-08:00</lastmod>
</url><url>
<loc>/start/startfromdockerhub.html</loc>
- <lastmod>2025-06-11T04:54:00-07:00</lastmod>
+ <lastmod>2025-06-14T00:32:50-07:00</lastmod>
<xhtml:link
rel="alternate"
hreflang="zh"
@@ -558,7 +558,7 @@
<lastmod>2025-06-08T04:07:31-07:00</lastmod>
</url><url>
<loc>/start/onprem.html</loc>
- <lastmod>2024-06-03T08:09:31-07:00</lastmod>
+ <lastmod>2025-06-14T00:32:50-07:00</lastmod>
<xhtml:link
rel="alternate"
hreflang="zh"
diff --git a/docs/edge/feature/om-ha.html b/docs/edge/feature/om-ha.html
index b899770b..14ad0b2d 100644
--- a/docs/edge/feature/om-ha.html
+++ b/docs/edge/feature/om-ha.html
@@ -578,10 +578,33 @@ they receive a bootstrap request from the bootstrapping
node.</p>
using the <em>force</em> option. The <em>force</em> option allows to continue
with the bootstrap when one of the existing OMs is down or not responding.</p>
<div class="highlight"><pre tabindex="0"
style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code
class="language-shell" data-lang="shell"><span
style="display:flex;"><span>ozone om <span style="color:#f92672">[</span>global
options <span style="color:#f92672">(</span>optional<span
style="color:#f92672">)]</span> --bootstrap --force
</span></span></code></pre></div><p>Note that using the <em>force</em> option
during bootstrap could crash the OM process if it does not have updated
configurations.</p>
+<h2 id="automatic-snapshot-installation-for-stale-ozone-managers">Automatic
Snapshot Installation for Stale Ozone Managers</h2>
+<p>Sometimes an OM follower node may be offline or fall far behind the OM
leader’s raft log.
+Then, it cannot easily catch up by replaying individual log entries.
+The OM HA implementation includes an automatic snapshot installation
+and recovery process for such cases.</p>
+<p>How it works:</p>
+<ol>
+<li>Leader determines that the follower is too far behind.</li>
+<li>Leader notifies the follower to install a snapshot.</li>
+<li>The follower downloads and installs the latest snapshot from the
leader.</li>
+<li>After installing the snapshot, the follower OM resumes normal operation
and log replication from the new state.</li>
+</ol>
+<p>This logic is implemented in the
<code>OzoneManagerStateMachine.notifyInstallSnapshotFromLeader()</code>;
+see the <a
href="https://github.com/apache/ozone/blob/ozone-2.0.0/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerStateMachine.java#L520-L531";>code</a>
+in Release 2.0.0.</p>
+<p>Note that this <code>Raft Snapshot</code>, used for OM HA state
synchronization, is distinct from <code>Ozone Snapshot</code>, which is used
for data backup and recovery purposes.</p>
+<p>In most scenarios, stale OMs will recover automatically, even if they have
missed a large number of operations.
+Manual intervention (such as running <code>ozone om --bootstrap</code>) is
only required when adding a new OM node to the cluster.</p>
+<p><strong>Important Note on Ozone Manager (OM) Disk Space for
Snapshots</strong></p>
+<p>When an Ozone Manager (OM) acts as a follower in an HA setup, it downloads
snapshot tarballs from the leader to its
+local metadata directory. Therefore, always ensure your OM disks have at least
2x the current OM database size to
+accommodate the existing data and incoming snapshots, preventing disk space
issues and maintaining cluster stability.</p>
<h2 id="references">References</h2>
<ul>
<li>Check <a href="../design/omha.html">this page</a> for the links to the
original design docs</li>
<li>Ozone distribution contains an example OM HA configuration, under the
<code>compose/ozone-om-ha</code> directory which can be tested with the help of
<a href="../start/runningviadocker.html">docker-compose</a>.</li>
+<li><a
href="https://github.com/apache/ratis/blob/ratis-3.1.3/ratis-server-api/src/main/java/org/apache/ratis/statemachine/StateMachine.java";>Apache
Ratis State Machine API documentation</a></li>
</ul>
@@ -602,7 +625,7 @@ using the <em>force</em> option. The <em>force</em> option
allows to continue wi
<footer class="footer">
<div class="container">
<span class="small text-muted">
- Version: 2.1.0-SNAPSHOT, Last Modified: February 5, 2025 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/1a9cf6cfe0f288da76d5adbe7066998bae39ba33";>1a9cf6cfe0</a>
+ Version: 2.1.0-SNAPSHOT, Last Modified: June 14, 2025 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/7e770586bde545f32fd7723694f309ae925de3c9";>7e770586bd</a>
</span>
</div>
</footer>
diff --git a/docs/edge/index.html b/docs/edge/index.html
index 95e3965d..561254d2 100644
--- a/docs/edge/index.html
+++ b/docs/edge/index.html
@@ -510,10 +510,10 @@ s=d.getElementsByTagName('script')[0];
<figure class="ozone-usage"><img src="./ozone-usage.png" width="60%">
</figure>
-<p><em><em>Ozone is a scalable, redundant, and distributed object store for
Hadoop. <p>
+<p><em><em>Ozone is a scalable, redundant, and distributed object store for
Big data workloads. <p>
Apart from scaling to billions of objects of varying sizes,
Ozone can function effectively in containerized environments
-like Kubernetes.</em></em> <p></p>
+like Kubernetes.</em></em></p>
<p>Applications like Apache Spark, Hive and YARN, work without any
modifications when using Ozone. Ozone comes with a <a
href="./interface/javaapi.html">Java client library</a>, <a
href="./interface/s3.html">S3 protocol support</a>, and a <a
href="./interface/cli.html">command line interface</a> which makes it easy to
use Ozone.</p>
<p>Ozone consists of volumes, buckets, and keys:</p>
<ul>
@@ -521,6 +521,7 @@ like Kubernetes.</em></em> <p></p>
<li>Buckets are similar to directories. A bucket can contain any number of
keys, but buckets cannot contain other buckets.</li>
<li>Keys are similar to files.</li>
</ul>
+<p>Check out the <a href="./start.html">Getting Started</a> guide to dive
right in and learn how to run Ozone on your machine or in the cloud.</p>
</div>
</div>
@@ -533,7 +534,7 @@ like Kubernetes.</em></em> <p></p>
<footer class="footer">
<div class="container">
<span class="small text-muted">
- Version: 2.1.0-SNAPSHOT, Last Modified: December 5, 2020 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/e7cb0fb027236bf036e463a49e35fa8ab086d135";>e7cb0fb027</a>
+ Version: 2.1.0-SNAPSHOT, Last Modified: June 14, 2025 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/a9271131c7dd94238f18aa2bb853ed6490c31677";>a9271131c7</a>
</span>
</div>
</footer>
diff --git a/docs/edge/interface/s3.html b/docs/edge/interface/s3.html
index cdadf280..36268666 100644
--- a/docs/edge/interface/s3.html
+++ b/docs/edge/interface/s3.html
@@ -666,7 +666,17 @@ s=d.getElementsByTagName('script')[0];
<div class="highlight"><pre tabindex="0"
style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code
class="language-bash" data-lang="bash"><span style="display:flex;"><span>aws
s3api --endpoint http://localhost:9878 create-bucket --bucket buckettest
</span></span></code></pre></div><p>Or</p>
<div class="highlight"><pre tabindex="0"
style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code
class="language-bash" data-lang="bash"><span style="display:flex;"><span>aws
s3 ls --endpoint http://localhost:9878 s3://buckettest
-</span></span></code></pre></div>
+</span></span></code></pre></div><h2
id="compatible-third-party-applications">Compatible third-party
applications</h2>
+<p>Ozone’s S3 Gateway enables integration with a wide range of
cloud-native and analytics applications. Here are some examples of tools and
platforms known to work with Ozone (in alphabetical order):</p>
+<ul>
+<li><a
href="https://clickhouse.com/docs/en/integrations/s3";>Clickhouse</a></li>
+<li><a href="https://docs.fluentd.org/output/s3";>Fluentd</a> can send logs
directly to Ozone via the S3 Gateway.</li>
+<li><a href="https://juicefs.com/docs/community/s3_gateway/";>JuiceFS</a></li>
+<li><a
href="https://docs.starburst.io/latest/connector/starburst-ozone.html";>Starburst</a>
(Starburst also supports Ozone <code>ofs://</code>)</li>
+<li><a
href="https://docs.teradata.com/r/Enterprise_IntelliFlex_VMware/Teradata-VantageTM-Native-Object-Store-Getting-Started-Guide-17.20";>Teradata
NOS</a></li>
+</ul>
+<p>This list is not exhaustive—any application that supports the S3 protocol
can potentially connect to Ozone, making it easy to adopt Ozone in modern data
pipelines and cloud-native workflows.</p>
+
<a class="btn btn-success btn-lg" href="../interface/cli.html">Next
>></a>
@@ -685,7 +695,7 @@ s=d.getElementsByTagName('script')[0];
<footer class="footer">
<div class="container">
<span class="small text-muted">
- Version: 2.1.0-SNAPSHOT, Last Modified: December 4, 2024 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/cb0a402bea59da76fe51c51cd61ab4bfe99417cb";>cb0a402bea</a>
+ Version: 2.1.0-SNAPSHOT, Last Modified: June 13, 2025 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/3ecf3450b3e0fa0500ca990a672c9c103566c8f3";>3ecf3450b3</a>
</span>
</div>
</footer>
diff --git a/docs/edge/sitemap.xml b/docs/edge/sitemap.xml
index 9f2b3ed2..8039606e 100644
--- a/docs/edge/sitemap.xml
+++ b/docs/edge/sitemap.xml
@@ -4,7 +4,7 @@
<sitemap>
<loc>/en/sitemap.xml</loc>
- <lastmod>2025-06-11T04:54:00-07:00</lastmod>
+ <lastmod>2025-06-14T00:32:50-07:00</lastmod>
</sitemap>
diff --git a/docs/edge/start.html b/docs/edge/start.html
index 1d72823f..0a8cb8a5 100644
--- a/docs/edge/start.html
+++ b/docs/edge/start.html
@@ -580,7 +580,7 @@ Kubernetes or bare-metal.
Ozone on a physical cluster
</h4>
-Ozone is designed to work concurrently with HDFS. The physical cluster
instructions explain each component of Ozone and how to deploy with maximum
control.
+Ozone is optimized for physical hosts. The physical cluster instructions
explain each component of Ozone and how to deploy with maximum control.
<p><a href="./start/onprem.html" class=" btn btn-primary
btn-lg">On-Prem Ozone Cluster</a></p>
@@ -714,7 +714,7 @@ If you are a Hadoop ninja, and wise in the ways of Apache,
you already know that
<footer class="footer">
<div class="container">
<span class="small text-muted">
- Version: 2.1.0-SNAPSHOT, Last Modified: June 28, 2019 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/d2a8ee30236210e11c2e8268757b5c4614fcc07e";>d2a8ee3023</a>
+ Version: 2.1.0-SNAPSHOT, Last Modified: June 14, 2025 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/a9271131c7dd94238f18aa2bb853ed6490c31677";>a9271131c7</a>
</span>
</div>
</footer>
diff --git a/docs/edge/start/onprem.html b/docs/edge/start/onprem.html
index 4f640007..d033f417 100644
--- a/docs/edge/start/onprem.html
+++ b/docs/edge/start/onprem.html
@@ -667,6 +667,13 @@ The <code>init</code> command is similar to Namenode
format. Init command is exe
configuration that allows ssh-ing to all data nodes. This is the same as the
HDFS configuration, so please refer to HDFS documentation on how to set this
up.</p>
+<h2 id="see-also">See Also</h2>
+<ul>
+<li><a href="../concept/overview.html">Overview</a></li>
+<li><a href="../concept/ozonemanager.html">Ozone Manager</a></li>
+<li><a href="../concept/storagecontainermanager.html">Storage Container
Manager</a></li>
+<li><a href="../concept/datanodes.html">Datanodes</a></li>
+</ul>
@@ -686,7 +693,7 @@ up.</p>
<footer class="footer">
<div class="container">
<span class="small text-muted">
- Version: 2.1.0-SNAPSHOT, Last Modified: June 3, 2024 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/ce5bbb0f4a079b11fa397a7ab6b57c1ee2829c13";>ce5bbb0f4a</a>
+ Version: 2.1.0-SNAPSHOT, Last Modified: June 14, 2025 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/a9271131c7dd94238f18aa2bb853ed6490c31677";>a9271131c7</a>
</span>
</div>
</footer>
diff --git a/docs/edge/start/startfromdockerhub.html
b/docs/edge/start/startfromdockerhub.html
index b09ae039..04c5c4d6 100644
--- a/docs/edge/start/startfromdockerhub.html
+++ b/docs/edge/start/startfromdockerhub.html
@@ -619,7 +619,13 @@ Since this example starts three DataNodes, this parameter
is optional.
We can now verify that file got uploaded by running the list command against
our bucket.
<div class="highlight"><pre tabindex="0"
style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code
class="language-bash" data-lang="bash"><span style="display:flex;"><span>aws
s3 --endpoint http://localhost:9878 ls s3://bucket1/testfile
-</span></span></code></pre></div>
+</span></span></code></pre></div><p>For more information on using the S3
protocol with Ozone, S3 developers may be interested in the following pages:</p>
+<ul>
+<li><a href="../interface/s3.html">S3 Protocol</a></li>
+<li><a href="../security/securings3.html">Securing S3</a></li>
+<li><a href="../recipe/boto3tutorial.html">Access Ozone using Boto3 (Docker
Quickstart)</a></li>
+</ul>
+
<a class="btn btn-success btn-lg" href="../start/onprem.html">Next
>></a>
@@ -638,7 +644,7 @@ our bucket.
<footer class="footer">
<div class="container">
<span class="small text-muted">
- Version: 2.1.0-SNAPSHOT, Last Modified: June 11, 2025 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/8c32363072e7c1757946ffff7d0de6fb1f255fc0";>8c32363072</a>
+ Version: 2.1.0-SNAPSHOT, Last Modified: June 14, 2025 <a
class="hide-child link primary-color"
href="https://github.com/apache/ozone/commit/a9271131c7dd94238f18aa2bb853ed6490c31677";>a9271131c7</a>
</span>
</div>
</footer>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
