This is an automated email from the ASF dual-hosted git repository.
ctubbsii pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/accumulo-website.git
The following commit(s) were added to refs/heads/main by this push:
new ad383e6e Update release notes for 2.1.2 and 3.0.0
ad383e6e is described below
commit ad383e6e0dedb28f4311fd5b46ccccb795a6d33b
Author: Christopher Tubbs <ctubb...@apache.org>
AuthorDate: Tue Aug 22 03:55:10 2023 -0400
Update release notes for 2.1.2 and 3.0.0
---
_posts/release/2023-06-19-accumulo-2.1.1.md | 4 +-
_posts/release/2023-08-21-accumulo-2.1.2.md | 98 +++++++++-----------
_posts/release/2023-08-21-accumulo-3.0.0.md | 135 ++++++++++++++++------------
3 files changed, 126 insertions(+), 111 deletions(-)
diff --git a/_posts/release/2023-06-19-accumulo-2.1.1.md
b/_posts/release/2023-06-19-accumulo-2.1.1.md
index e5dc3f80..0aaf01fa 100644
--- a/_posts/release/2023-06-19-accumulo-2.1.1.md
+++ b/_posts/release/2023-06-19-accumulo-2.1.1.md
@@ -2,10 +2,11 @@
title: Apache Accumulo 2.1.1
sortableversion: '02.01.01'
LTM: true
+archived: true
---
## About
-Apache Accumulo 2.1.1 is a patch release of the 2.1.0 LTM line. It contains
+Apache Accumulo 2.1.1 is a patch release of the 2.1 LTM line. It contains
many bug fixes and minor enhancements, including a critical fix. This version
supersedes 2.1.0. Users upgrading to 2.1 should upgrade directly to this
version instead of 2.1.0.
@@ -100,7 +101,6 @@ View the [Upgrading Accumulo documentation][upgrade] for
guidance.
[All tickets related to 2.1.1.][project]
-[LTM]: {{ site.baseurl }}/contributor/versioning#LTM
[upgrade]: /docs/2.x/administration/upgrading
[project]: https://github.com/apache/accumulo/projects/25
[HDFS-16864]: https://issues.apache.org/jira/browse/HDFS-16864
diff --git a/_posts/release/2023-08-21-accumulo-2.1.2.md
b/_posts/release/2023-08-21-accumulo-2.1.2.md
index c0aaf0f7..c26c7d67 100644
--- a/_posts/release/2023-08-21-accumulo-2.1.2.md
+++ b/_posts/release/2023-08-21-accumulo-2.1.2.md
@@ -2,77 +2,68 @@
title: Apache Accumulo 2.1.2
sortableversion: '02.01.02'
LTM: true
-draft: true
---
## About
-Apache Accumulo 2.1.2 is a patch release of the 2.1.0 LTM line. It contains
-bug fixes and minor enhancements. This version supersedes 2.1.1. Users
-upgrading to 2.1 should upgrade directly to this version instead of 2.1.1.
+Apache Accumulo 2.1.2 is a patch release of the 2.1 LTM line. It contains bug
+fixes and minor enhancements. This version supersedes 2.1.1. Users upgrading to
+2.1 should upgrade directly to this version instead of 2.1.1.
-Included here are some highlights of the most interesting bugs fixed and
features
-added in 2.1.2. For the full set of changes, please see the commit history
-or issue tracker.
-
-NOTE: This 2.1 release also includes any applicable bug fixes and improvements
-that occurred in 1.10.3 and earlier.
+Included here are some highlights of the most interesting bugs fixed and
+features added in 2.1.2. For the full set of changes, please see the commit
+history or issue tracker.
### Notable Improvements
Improvements that affect performance:
-* {% ghi 3499 %}, {% ghi 3543 %} {% ghi 3549 %} Made some optimizations around
the processing of file
-references in the GC code.
-
-* {% ghi 3500 %}, {% ghi 3509 %} TabletFile constructor was calling
Path.getParent() which was spending
-a lot of time performing Path validation. Modified the constructor to reduce
the calls to Path.getParent.
-
-* {% ghi 3541 %}, {% ghi 3542 %} The TabletGroupWatcher threads in the Manager
are responsible for tablet
-state and for making sure that tablets are balanced and assigned. The
TabletGroupWatcher's iterate over
-all of the tablets, then wait for 60s before beginning the next iteration.
Backported a new property,
-MANAGER_TABLET_GROUP_WATCHER_INTERVAL, to make this wait time configurable.
+* {% ghi 3499 %}, {% ghi 3543 %}, {% ghi 3549 %}, {% ghi 3500 %}, {% ghi 3509
%}
+ Made some optimizations around the processing of file references in the
+ accumulo-gc code, including optimizing a constructor in a class called
+ `TabletFile` used to track file references.
+* {% ghi 3541 %}, {% ghi 3542 %} Added a new property,
+ {% plink manager.tablet.watcher.interval %}, to make the time to wait between
+ scanning the metadata table for outstanding tablet actions (such as assigning
+ tablets, etc.) to be configurable.
Improvements that help with administration:
-* {% ghi 3678 %}, {% ghi 3683 %} Added validation of property
table.class.loader.context when it is set.
-If the context name is null, an empty string, results in an exception creating
the classloader for the
-context, or if the resulting classloader is null, then an exception will be
returned and the property
-will not be set.
-
-* {% ghi 3548 %}, {% ghi 3561 %} Added a banner to the manager page in the
Monitor that displays the
-manager state and goal state when they are not normal.
-
-* {% ghi 3383 %}, {% ghi 3680 %} Prompt the user for confirmation when they
attempt to set a deprecated
-property in the Shell as a way to get them to use the non-deprecated property.
-
-* {% ghi 3488 %}, {% ghi 3612 %} Made tserver scans and compaction columns
numerically sortable on the
-Monitor UI.
-
-* {% ghi 3233 %}, {% ghi 3562 %} Added copy-properties option to
createnamespace and createtable shell
-commands.
+* {% ghi 3678 %}, {% ghi 3683 %} Added extra validation of property
+ {% plink table.class.loader.context %} at the time it is set, to prevent
+ invalid contexts from being set on a table.
+* {% ghi 3548 %}, {% ghi 3561 %} Added a banner to the manager page in the
+ Monitor that displays the manager state and goal state when they are not
+ normal.
+* {% ghi 3383 %}, {% ghi 3680 %} Prompt the user for confirmation when they
+ attempt to set a deprecated property in the Shell as a way to get them to use
+ the non-deprecated property.
+* {% ghi 3233 %}, {% ghi 3562 %} Add option to `--exclude-parent` to allow
+ creating a table or namespace in the shell initialized with only the
+ properties set on another table or namespace, but not those the other table
+ or namespace were inheriting from their parent.
+* {% ghi 3600 %} Normalized metric labels and structure.
### Notable Bug Fixes
-* {% ghi 3674 %}, {% ghi 3677 %}, {% ghi 3685 %} An invalid context
classloader property was preventing
-a minor compaction output file from being created, because the volume chooser
class could not be loaded,
-which failed the minor compaction thread. Once the minor compaction thread is
dead, it will prevent future minor compactions from starting, subsequently
preventing the tablet from being closed normally. The fixes here
-include catching a broader range of exceptions in the minor compaction thread
in an attempt to save it
-from dying and initiating a minor compaction before closing the compactable
object in the tablet.
-
-* {% ghi 3630 %}, {% ghi 3631 %} A bug where ClientContext was incorrectly
converting BatchWriter
-latency and timeout values was fixed.
-
-* {% ghi 3617 %}, {% ghi 3622 %} Close LocalityGroupReader when IOException is
thrown to release reference
-to a possibly corrupted stream in a cached block file.
-
+* {% ghi 3488 %}, {% ghi 3612 %} Fixed sorting of some columns on the monitor
+* {% ghi 3674 %}, {% ghi 3677 %}, {% ghi 3685 %} Prevent an invalid table
+ context and other errors from killing the minor compaction thread and
+ preventing a tablet from being closed and shutting down normally.
+* {% ghi 3630 %}, {% ghi 3631 %} Fix a bug where BatchWriter latency and
+ timeout values were incorrectly converted to the wrong time unit..
+* {% ghi 3617 %}, {% ghi 3622 %} Close LocalityGroupReader when IOException is
+ thrown to release reference to a possibly corrupted stream in a cached block
+ file.
* {% ghi 3570 %}, {% ghi 3571 %} Fixed the TabletGroupWatcher shutdown order.
+* {% ghi 3569 %}, {% ghi 3579 %} {% ghi 3644 %} Changes to ensure that scan
+ sessions are cleaned up.
+* {% ghi 3553 %}, {% ghi 3555 %} A bug where a failed user compaction would not
+ retry and would hang was fixed.
-* {% ghi 3569 %}, {% ghi 3579 %} {% ghi 3644 %} Changes to ensure that scan
sessions are cleaned up.
-
-* {% ghi 3553 %}, {% ghi 3555 %} A bug where a failed user compaction would
not retry and would hang
-was fixed.
+### Other Notable Changes
-* {% ghi 3600 %} Normalized metric labels and structure.
+* {% ghi 3550 %} The contents of the contrib directory have been moved to more
+ appropriate locations for build-related resources
## Upgrading
@@ -83,6 +74,5 @@ View the [Upgrading Accumulo documentation][upgrade] for
guidance.
[All tickets related to 2.1.2.][project]
-[LTM]: {{ site.baseurl }}/contributor/versioning#LTM
[upgrade]: /docs/2.x/administration/upgrading
[project]: https://github.com/apache/accumulo/projects/29
diff --git a/_posts/release/2023-08-21-accumulo-3.0.0.md
b/_posts/release/2023-08-21-accumulo-3.0.0.md
index 2970364c..278f0832 100644
--- a/_posts/release/2023-08-21-accumulo-3.0.0.md
+++ b/_posts/release/2023-08-21-accumulo-3.0.0.md
@@ -1,67 +1,92 @@
---
title: Apache Accumulo 3.0.0
-sortableversion: '03.00.00-final'
-draft: true
+sortableversion: '03.00.00'
---
-
-Apache Accumulo 3.0.0 contains significant changes from 2.1 and earlier
versions.
-
-## Notable Changes
-
-### Arguments to server processes were removed in favor of configuration
properties
-
-The server process arguments (`-a`, `-g`, `-q`, etc.) were removed in {% ghi
3192 %}
-in favor of configuration properties that can be specified in the Accumulo
configuration
-files or supplied on a per-process basis using the `-o` argument.
-
-### Support for the replication feature has been removed
-
-The replication feature was marked as deprecated in 2.0.0 and was removed in
{% ghi 3080 %}.
-TODO - Need to discuss what happens to the replication table
-
-### BulkImport v1 was removed
-
-BulkImport v1 was removed in 3.0.0 ({% ghi 3313 %}). Bulk Import v1 users
should reference the
-2.0.0 [bulk import release notes].
-
-### FileSystem monitor will no longer stop the TabletServer
-
-In {% ghi 1328 %} the `tserver.monitor.fs` property has been marked as
deprecated
-and the background thread in the TabletServer was modified to *not* halt the
TabletServer
-when one of the local disks becomes read-only.
-
-### GarbageCollectionLogger renamed to LowMemoryDetector, is no longer passive
-
-The GarbageCollectionLogger would run in a Thread in the server components
every 5 seconds
-and print a message to the log when the amount of free memory was less than 5%
of the heap.
-{% ghi 3161 %} renamed the class to LowMemoryDetector, adds new properties for
the threshold,
-interval, and passivity. When operating in a passive mode, the
LowMemoryDetector will log a
-message just like its predecessor. See the new GENERAL_LOW_MEM_*_PROTECTION
properties for a
-description of the behavior change when these properties are enabled. {% ghi
3288 %} added a
-new metric, accumulo.detected.low.memory, that reports a value of 1 when the
server is low on
-memory.
-
-### Other Notable Changes
-
+## About
+
+Apache Accumulo 3.0.0 is a non-LTM major version release. While it
+primarily contains the 2.1 codebase, including all patches through
+2.1.2, it has also removed a substantial number of deprecated features
+and code, in an attempt to clean up several years of accrued technical
+debt, and lower the maintenance burden to make way for future
+improvements. It also contains a few other minor improvements.
+
+## Notable Removals
+
+* {% ghi 1328 %} The FileSystem monitor has been removed and will no
+ longer watch for problems with local file systems and self-terminate.
+ System administrators are encouraged to use whatever systems health
+ monitoring is appropriate for their deployments, rather than depend on
+ Accumulo to monitor these.
+* {% ghi 2443 %} The MapReduce APIs embedded in the accumulo-core module
+ were removed. The separate `accumulo-hadoop-mapreduce` jar is their
+ replacement.
+* {% ghi 3073 %} The legacy Connector and Instance client classes were removed.
+ The AccumuloClient is their replacement.
+* {% ghi 3080 %} The cross-data center replication feature was removed without
+ replacement due to lack of being maintained, having numerous outstanding
+ unfixed issues with no volunteer to maintain it since it was deprecated, and
+ substantial code complexity. The built-in replication table it used for
+ tracking replication metadata will be removed on upgrade.
+* {% ghi 3114 %}, {% ghi 3115 %}, {% ghi 3116 %}, {% ghi 3117 %} Removed
+ deprecated VolumeChooser, TabletBalancer, Constraint, and other APIs, in
+ favor of their SPI replacements.
+* {% ghi 3106 %} Remove deprecated configuration properties (see 2.1 property
+ documentation for which ones were deprecated)
+* {% ghi 3112 %} Remove CompactionStrategy class in favor of CompactionSelector
+ and CompactionConfigurer.
+* {% ghi 3160 %} Remove upgrade code for versions prior to 2.1 (minimum version
+ to upgrade from is now 2.1.
+* {% ghi 3192 %} Remove arguments to server processes, such as (`-a`, `-g`,
+ `-q`, etc.) were removed in favor of configuration properties that can be
+ specified in the Accumulo configuration files or supplied on a per-process
+ basis using the `-o` argument. The provided cluster management reference
+ scripts were updated in {% ghi 3197 %} to use the `-o` method.
+* {% ghi 3136 %} Remove the built-in VFS classloader support. To use a custom
+ classloader, users must now set the ContextClassLoaderFactory implementation
+ in the properties. The default is now the URLContextClassLoaderFactory.
+* {% ghi 3318 %} Remove the old bulk import implementation, replaced by the new
+ bulk import API added [in 2.0.0][bulk import release notes].
+* {% ghi 3265 %} Remove scan interpreter and scan formatter from the shell
+* {% ghi 3361 %} Remove all remaining references to the old "master" service
+ (renamed to "manager").
+* {% ghi 3360 %} Remove checks and code related to the old password hashing
+ mechanism in Accumulo. This will discontinue warnings about users passwords
+ that are still out of date. Instead, those outdated passwords will simply
+ become invalid. If the user authenticated to Accumulo at any time prior to
+ upgrading, their password will have been converted. So this only affects
+ accounts that were never used with 2.1 at all. As mitigation, such users will
+ be able to have their password reset by the root user. If the root user never
+ authenticated (and neither had another admin user) while on 2.1 (very very
+ unlikely), an administrator can reset the entire user database through the
+ normal init step to reset security.
+* {% ghi 3378 %} Remove broken support for old map files. (RFiles have been in
+ use for a long time, so this should not impact any users; if users had been
+ trying to use map files, they would have found that they were broken anyway)
+
+## Notable Additions
+
+* {% ghi 3088 %} New methods were added to compaction-related APIs to share
+ information about the current tablet being compacted to user code
+* {% ghi 3107 %} Decompose internal thrift services by function to make RPC
+ functionality more modular by server instances
* {% ghi 3189 %} Standardized server lock data structure in ZooKeeper
-* {% ghi 3115 %}, {% ghi 3116 %}, {% ghi 3117 %} Removed deprecated
TabletBalancer, Constraint, and other APIs.
-* {% ghi 3114 %} The VolumeChooser API, deprecated in 2.1.0 in favor of an SPI
implementation, was removed.
-* {% ghi 3111 %} The CompactionStrategy class, deprecated in favor of
CompactionSelector and
- CompactionConfigurer, was removed.
-* {% ghi 3105 %} Removed deprecated properties
-* {% ghi 3074 %} The ClientConfiguration class, deprecated in 2.0.0, was
removed.
-* {% ghi 3073 %} The Connector and Instance client classes, deprecated in
2.0.0, were removed.
-* {% ghi 2443 %} The MapReduce APIs, deprecated in 2.0.0, were removed.
-
-where applicable. Removed tserver TLevel logging class.
-* {% jira ACCUMULO-1787 %} - Two tier compaction strategy. Support compacting
small files with snappy and large files with gzip.
+* {% ghi 3206 %} Internal caches now use Caffeine instead of Guava's Cache
+* {% ghi 3161 %}, {% ghi 3288 %} The internal service (renamed from
+ GarbageCollectionLogger to LowMemoryDetector) that was previously used only
+ to report low memory in servers, was made configurable to allow pausing
+ certain operations like scanning, minor compactions, or major compactions,
+ when memory is low. See the server properties for `general.low.mem.*`.
## Upgrading
View the [Upgrading Accumulo documentation][upgrade] for guidance.
+## 3.0.0 GitHub Project
+
+[All tickets related to 3.0.0.][project]
+
-[#634]: https://github.com/apache/accumulo/issues/634
[upgrade]: /docs/2.x/administration/upgrading
-[website-repo]: https://github.com/apache/accumulo-website
[bulk import release notes]:
https://accumulo.apache.org/release/accumulo-2.0.0/#new-bulk-import-api
+[project]: https://github.com/apache/accumulo/projects/11
