This is an automated email from the ASF dual-hosted git repository.
abhi pushed a change to branch ranger-upgrade-workflow
in repository https://gitbox.apache.org/repos/asf/ranger.git
discard 85a442327 Update .github/scripts/dot_env_util.py
discard 3d7fbc244 Fix last update to .env before upgrade
discard 6fe57d604 Update test-upgrade.yaml
discard dc28730f3 Update test-upgrade.yaml
discard 19c7febe3 Create dot_env_util.py
discard 4e0b444d4 Refactor install to build and increase sleep time before
docker logs.
discard 35fc98286 Add oracle and refactor file.
discard 13bb4cfd1 RANGER-5126: Add coverage for testing ranger upgrades
add 852d89486 RANGER-5124 : The policy and tag active time are not in sync
with the last update and policy download
add c334ba80a RANGER-5111: Enhance Datashare Summary API to Include
Labels, Keywords, and Share Counts for Actionable Filters
add cbe579ab3 RANGER-5138: Docker setup: updated Ubuntu version to 22.04
(#529)
add 8adbf7f47 RANGER-5130: DatSet policies fail to authorize when
condition expression is present
add 8c543062f RANGER-5129: Enhance Dataset Filtering by Validity Schedule
and Expiration Date Range
add 0a1461ec8 RANGER-4846:Update Apache Ranger website with 2.5.0
add 33b80efd7 RANGER-5100: Update Apache Ranger website with 2.6.0 (#532)
add 90fb28713 RANGER-5145:Ranger plugin should skip building GDSInfos
which are disabled
add ff36aabe3 RANGER-5146: 500 API Error When Deleting TagDef with a
Linked Tag
add bcf39e202 RANGER-5151: fix for error while writing audit logs to HDFS
(#535)
add 7d553f1e8 RANGER-5147: Modernize some Python scripts now that Python 3
is a requirement (#533)
add 324d5dbca RANGER-5153: fix for intermittent unit test failure in
RangerJSONAuditWriterTest (#536)
add 87666d306 RANGER-5102: Add config param for writing audits to HDFS in
append mode (#513)
add a6f7b58d0 RANGER-5049: checkstyle compliance updates - plugin-solr
module - #2 (#539)
add 0c9bb81f6 RANGER-5113: API to delete multiple policies including
policy name prefix filter
add e5e18ac01 RANGER-5161: Docker setup updated to use Hive 4.0.1 (#540)
add 399dce25e RANGER-5166: Expose ports for all databases in docker
compose (#543)
add dee3106af RANGER-5165: Update notification settings in .asf.yaml (#541)
add f857b1c8b RANGER-5156:Filter Ranger access audit by DataSet
add e32dfa047 RANGER-5168:DataShare created as a part adding resources to
DataSet should be in Active status
add e93c017c6 RANGER-5134: Fix policy label processing in concurrent
sessions (#545)
add e68e4ad22 RANGER-5174: fix for script engine instantiation failure
(#546)
add 12556182b RANGER-4587: blog: dynamic expressions - fixed attributes
details for USER expression
add 5f5b26ff3 RANGER-5164 : Ranger: Upgrade Swagger-UI to the latest
V5.20.1 (#549)
add 38e762f32 RANGER-5167: Merge all database compose files and use
extends (#542)
add dbaad69de RANGER-5154: Functionality to delete records from
x_auth_sess table via api is not working
add ae43615f8 RANGER-5189: modified to remove external site references
from doc site
add 4c8c2025e RANGER-5189: fixed a delimitor issue and logic to identify
the url
add 7878cedf9 RANGER-5189: found few more external sites and fixed
relative path for local css/js files
add c5e04517a RANGER-5162 : Tag Allowed policy is not being enforced
add 2517c1d68 RANGER-5183:Federated User getting created with wrong user
source
add 1b8482a02 RANGER-5169: Error while migrating Masterkey from older
format to external key store (#556)
add ad7da3a11 RANGER-5197: moved to use ubuntu image instead of centos
add dfaba89d8 RANGER-5184 : Enhance Access audit to be filtered by
Federated user (#560)
add 014da9402 RANGER-5198 : Prevent selected long string values from
getting truncated in the react-select control
add 8d20a4458 RANGER-5201: Retry GET request on server error in
RangerRESTClient (#565)
add c583641a1 RANGER-5185: fix potential NPE in references to
RangerBasePlugin.policyEngine (#555)
add dd35db06b RANGER-5202: Tag deny policy is not getting enforced on scan
table command for hbase
add 5c634b6f2 RANGER-5170: enhanced GDS admin audits to record the changes
on impacted objects as well
add a82ec7b49 RANGER-5199 : Connection to Ranger KMS DB fails with secure
MySQL/maria DB (#562)
add af248cf64 RANGER-5182 : Ranger: Upgrade axios version 1.7.4 to latest
1.8.4
add 42f7c064e RANGER-5199 : Fixing checkstyle issue (#574)
add 2176584ab RANGER-5170: PMD issue fix (#576)
add 8b1d10863 RANGER-5211 : KMS Metric collection thread safety check
should not parse config every time (#575)
add 58109859f RANGER-5187: Getting 404 instead of 400 when we try to edit
user without id
add 39805972b RANGER-5204: RangerBasePlugin test (#568)
add a1dbe9822 RANGER-5123: handle transaction log migration failure in
fresh install
add c1f915e5e RANGER-5214 : Fix for KMS throwing IOException instead of
AccessControlException (#579)
add 44e27a4fe RANGER-5213: Add Support for isEnabled Filter and
Full/Partial Text Search on Labels and Keywords in Dataset Search
add 109dc779e RANGER-5216: added unit tests for Atlas authorizer (#581)
add 35dd720d8 RANGER-5191: Fix typo in the log message in RangerRESTClient
(#557)
add 30b1988fc RANGER-5180: GDS feature support on Oracle database
add dd85a691a RANGER-5155 : Service Definition with empty configs causes
Ranger UI rendering issues (#577)
add 1e03bcaa7 RANGER-5223: Audit logs not generated for Dataset
modifications (Labels, Keywords, isEnabled)
add c377b6bd7 RANGER-5208: refactor agents-audit module to move audit
destination implementations to separate projects (#570)
add a179612b2 RANGER-5228: Bump jacoco to 0.8.13 (#589)
add afe56fe7b RANGER-5209 : User source is not getting updated on the
Ranger Access Audit page
add 32c90a3ec RANGER-5078: Set ranger.usersync.ldap.referral=follow as
default config (#530)
add 506de5826 RANGER-4351 : Resource policies side bar takes more time
even user is available on policymanager resource page
add 9a647f854 RANGER-4351 : [addendum] Resource policies side bar takes
more time even user is available on policymanager resource page
add 89b7130fc RANGER-5229: CI - Generate Code Coverage Report with JaCoCo
(#590)
add 2661bc874 Revert "RANGER-5209 : User source is not getting updated on
the Ranger Access Audit page"
add b42cf58e6 RANGER-5177: For tagresourcemaps api, resourceId search
filter does not work
add 4d56c7fcf RANGER-5224: dedupTags removes the valid tags while
deduplicating tags (#592)
add 787639a01 RANGER-3636: updated plugin classloader to use classloader
of shim class as parent (#548)
add 5dd493412 RANGER-5221 : Adding test cases for class
RangerKeyStoreProvider (#599)
add bf2ca0f19 RANGER-3174: Support for strong cryptography
algorithm-PBKDF2WithHmacSHA256 (#593)
add f6d1b72e2 Revert "RANGER-5184 : Enhance Access audit to be filtered by
Federated user (#560)" (#596)
add d008ae319 RANGER-5207 : Update jquery file naming to prevent version
disclosure. (#597)
add 4202848a3 RANGER-5234: Audit logs not generated for Dataset
description modifications
add c324fba5a RANGER-5225: Override policy should take precedence over
normal deny policy (#588)
add 7831f6cd5 RANGER-5241: Update all docker images to use
apache/ranger-base from DockerHub (#601)
add 18a03b9f3 RANGER-5126: Updates to upgrade workflow
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (85a442327)
\
N -- N -- N refs/heads/ranger-upgrade-workflow (18a03b9f3)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 13 +-
.github/scripts/dot_env_util.py | 58 -
.github/workflows/{maven.yml => ci.yml} | 17 +-
.github/workflows/test-upgrade.yaml | 167 ---
.github/workflows/upgrade-ranger.yaml | 109 ++
{ranger-tools => agents-audit/core}/pom.xml | 94 +-
.../ranger/audit/destination/AuditDestination.java | 0
.../audit/destination/FileAuditDestination.java | 0
.../apache/ranger/audit/model/AuditEventBase.java | 0
.../ranger/audit/model/AuditIndexRecord.java | 0
.../apache/ranger/audit/model/AuthzAuditEvent.java | 0
.../ranger/audit/model/EnumRepositoryType.java | 0
.../ranger/audit/model/SPOOL_FILE_STATUS.java | 0
.../ranger/audit/provider/AsyncAuditProvider.java | 0
.../audit/provider/AuditFileCacheProvider.java | 0
.../apache/ranger/audit/provider/AuditHandler.java | 0
.../audit/provider/AuditMessageException.java | 0
.../audit/provider/AuditProviderFactory.java | 93 +-
.../ranger/audit/provider/AuditWriterFactory.java | 0
.../ranger/audit/provider/BaseAuditHandler.java | 0
.../audit/provider/BufferedAuditProvider.java | 0
.../apache/ranger/audit/provider/DebugTracer.java | 0
.../ranger/audit/provider/DummyAuditProvider.java | 0
.../apache/ranger/audit/provider/Log4jTracer.java | 0
.../apache/ranger/audit/provider/LogBuffer.java | 0
.../ranger/audit/provider/LogDestination.java | 0
.../org/apache/ranger/audit/provider/MiscUtil.java | 0
.../audit/provider/MultiDestAuditProvider.java | 0
.../provider/StandAloneAuditProviderFactory.java | 0
.../apache/ranger/audit/queue/AuditAsyncQueue.java | 0
.../apache/ranger/audit/queue/AuditBatchQueue.java | 0
.../audit/queue/AuditFileCacheProviderSpool.java | 0
.../apache/ranger/audit/queue/AuditFileQueue.java | 0
.../ranger/audit/queue/AuditFileQueueSpool.java | 0
.../apache/ranger/audit/queue/AuditFileSpool.java | 0
.../org/apache/ranger/audit/queue/AuditQueue.java | 0
.../ranger/audit/queue/AuditSummaryQueue.java | 0
.../org/apache/ranger/audit/test/TestEvents.java | 0
.../ranger/audit/utils/AbstractKerberosUser.java | 0
.../audit/utils/AbstractRangerAuditWriter.java | 88 +-
.../audit/utils/InMemoryJAASConfiguration.java | 0
.../apache/ranger/audit/utils/KerberosAction.java | 0
.../ranger/audit/utils/KerberosJAASConfigUser.java | 0
.../apache/ranger/audit/utils/KerberosUser.java | 0
.../ranger/audit/utils/RangerAuditWriter.java | 0
.../ranger/audit/utils/RangerJSONAuditWriter.java | 40 +-
.../apache/ranger/audit/utils/RollingTimeUtil.java | 0
.../src/main/resources/META-INF/persistence.xml | 0
.../audit/utils/RangerJSONAuditWriterTest.java | 182 +++
.../dest-cloudwatch}/pom.xml | 29 +-
.../AmazonCloudWatchAuditDestination.java | 0
agents-audit/{ => dest-es}/pom.xml | 211 +--
.../destination/ElasticSearchAuditDestination.java | 0
{agents-cred => agents-audit/dest-hdfs}/pom.xml | 61 +-
.../audit/destination/HDFSAuditDestination.java | 0
.../ranger/audit/provider/LocalFileLogBuffer.java | 0
.../audit/provider/hdfs/HdfsAuditProvider.java | 4 -
.../audit/provider/hdfs/HdfsLogDestination.java | 0
.../dest-kafka}/pom.xml | 44 +-
.../audit/provider/kafka/KafkaAuditProvider.java | 0
.../dest-log4j}/pom.xml | 24 +-
.../audit/destination/Log4JAuditDestination.java | 0
.../ranger/audit/provider/Log4jAuditProvider.java | 4 -
{agents-cred => agents-audit/dest-solr}/pom.xml | 102 +-
.../audit/destination/SolrAuditDestination.java | 0
.../audit/provider/solr/SolrAuditProvider.java | 0
.../org/apache/ranger/audit/utils/SolrAppUtil.java | 0
.../orc-util}/pom.xml | 77 +-
.../org/apache/ranger/audit/utils/ORCFileUtil.java | 0
.../ranger/audit/utils/RangerORCAuditWriter.java | 0
agents-audit/pom.xml | 411 +-----
.../audit/utils/RangerJSONAuditWriterTest.java | 123 --
agents-common/pom.xml | 7 +-
agents-common/scripts/upgrade-plugin.py | 5 +-
.../org/apache/ranger/plugin/model/RangerGds.java | 51 +-
.../apache/ranger/plugin/model/RangerGrant.java | 115 +-
.../RangerAuditPolicyEvaluator.java | 4 +-
.../RangerDefaultPolicyEvaluator.java | 14 +-
.../RangerValidityScheduleEvaluator.java | 2 +-
.../ranger/plugin/service/RangerBasePlugin.java | 26 +-
.../ranger/plugin/store/AbstractPredicateUtil.java | 31 +
.../java/org/apache/ranger/plugin/store/PList.java | 22 +
.../plugin/util/CachedResourceEvaluators.java | 4 +-
.../plugin/util/GraalScriptEngineCreator.java | 2 +-
.../plugin/util/JavaScriptEngineCreator.java | 2 +-
.../plugin/util/NashornScriptEngineCreator.java | 2 +-
.../ranger/plugin/util/RangerRESTClient.java | 11 +-
.../ranger/plugin/util/ScriptEngineCreator.java | 14 +
.../apache/ranger/plugin/util/SearchFilter.java | 7 +
.../org/apache/ranger/plugin/util/ServiceTags.java | 5 +
.../plugin/policyengine/RangerAdminClientImpl.java | 78 ++
.../RangerBasePluginTest.java} | 152 +-
.../apache/ranger/plugin/util/TestServiceTags.java | 93 ++
.../policyengine/hbase-test-policies.json | 489 +++++++
.../policyengine/ranger-hbase-security.xml | 19 +-
.../policyengine/ranger-servicedef-hbase.json | 83 ++
.../policyengine/ranger-servicedef-tag.json | 70 +
.../policyengine/test_base_plugin_hbase.json | 1445 ++++++++++++++++++++
.../policyengine/test_policyengine_tag_hdfs.json | 42 +-
.../policyengine/test_policyengine_tag_hive.json | 18 +-
.../policyengine/updated-hbase-test-policies.json | 193 +++
build_ranger_using_docker.sh | 52 +-
dev-support/checks/coverage.sh | 56 +
dev-support/ranger-docker/.env | 34 +-
dev-support/ranger-docker/Dockerfile.ranger | 12 +-
dev-support/ranger-docker/Dockerfile.ranger-base | 62 -
.../ranger-docker/Dockerfile.ranger-base-ubi | 84 --
dev-support/ranger-docker/Dockerfile.ranger-build | 17 +-
dev-support/ranger-docker/Dockerfile.ranger-hadoop | 9 +-
dev-support/ranger-docker/Dockerfile.ranger-hbase | 9 +-
dev-support/ranger-docker/Dockerfile.ranger-hive | 6 +-
dev-support/ranger-docker/Dockerfile.ranger-kafka | 4 +-
dev-support/ranger-docker/Dockerfile.ranger-kms | 17 +-
dev-support/ranger-docker/Dockerfile.ranger-knox | 4 +-
.../ranger-docker/Dockerfile.ranger-tagsync | 10 +-
.../ranger-docker/Dockerfile.ranger-usersync | 9 +-
dev-support/ranger-docker/README.md | 39 +-
.../docker-compose.ranger-base-ubi.yml | 18 -
.../ranger-docker/docker-compose.ranger-base.yml | 18 -
.../ranger-docker/docker-compose.ranger-build.yml | 5 +-
.../docker-compose.ranger-db-mounted.yml | 11 +
.../ranger-docker/docker-compose.ranger-db.yml | 86 ++
.../ranger-docker/docker-compose.ranger-hadoop.yml | 2 +
.../ranger-docker/docker-compose.ranger-hbase.yml | 2 +
.../ranger-docker/docker-compose.ranger-hive.yml | 2 +
.../ranger-docker/docker-compose.ranger-kafka.yml | 2 +
.../ranger-docker/docker-compose.ranger-kms.yml | 2 +
.../ranger-docker/docker-compose.ranger-knox.yml | 2 +
.../ranger-docker/docker-compose.ranger-mysql.yml | 23 -
.../ranger-docker/docker-compose.ranger-oracle.yml | 21 -
.../docker-compose.ranger-postgres-mounted.yml | 22 -
.../docker-compose.ranger-postgres.yml | 21 -
.../docker-compose.ranger-sqlserver.yml | 25 -
.../docker-compose.ranger-tagsync.yml | 2 +
.../docker-compose.ranger-usersync.yml | 2 +
.../ranger-docker/docker-compose.ranger.yml | 8 +-
.../ranger-trino.sh => download-ranger.sh} | 24 +-
.../{scripts/ranger-usersync.sh => lib.sh} | 45 +-
dev-support/ranger-docker/scripts/ranger-hadoop.sh | 11 +-
dev-support/ranger-docker/scripts/ranger-hbase.sh | 12 +-
.../scripts/ranger-usersync-install.properties | 4 +-
distro/pom.xml | 42 +-
distro/src/main/assembly/admin-web.xml | 3 +-
distro/src/main/assembly/hbase-agent.xml | 4 +-
distro/src/main/assembly/hdfs-agent.xml | 4 +-
distro/src/main/assembly/hive-agent.xml | 4 +-
distro/src/main/assembly/kms.xml | 4 +-
distro/src/main/assembly/knox-agent.xml | 4 +-
distro/src/main/assembly/plugin-atlas.xml | 4 +-
distro/src/main/assembly/plugin-elasticsearch.xml | 4 +-
distro/src/main/assembly/plugin-kafka.xml | 4 +-
distro/src/main/assembly/plugin-kms.xml | 4 +-
distro/src/main/assembly/plugin-kylin.xml | 4 +-
distro/src/main/assembly/plugin-ozone.xml | 4 +-
distro/src/main/assembly/plugin-presto.xml | 4 +-
distro/src/main/assembly/plugin-solr.xml | 4 +-
distro/src/main/assembly/plugin-sqoop.xml | 4 +-
distro/src/main/assembly/plugin-trino.xml | 4 +-
distro/src/main/assembly/plugin-yarn.xml | 4 +-
distro/src/main/assembly/ranger-tools.xml | 4 +-
distro/src/main/assembly/sample-client.xml | 4 +-
distro/src/main/assembly/storm-agent.xml | 4 +-
docs/README.txt | 1 +
docs/fix-external-site-reference.sh | 69 +
.../site/resources/blogs/dynamic_expressions.html | 7 +-
docs/src/site/resources/css/custom.css | 4 +-
docs/src/site/resources/swagger-ui-bundle.js | 2 +-
.../site/resources/swagger-ui-es-bundle-core.js | 2 +-
docs/src/site/resources/swagger-ui-es-bundle.js | 2 +-
.../site/resources/swagger-ui-standalone-preset.js | 2 +-
docs/src/site/resources/swagger-ui.css | 2 +-
docs/src/site/resources/swagger-ui.js | 7 +-
docs/src/site/site.xml | 2 +
docs/src/site/xdoc/download.xml | 82 +-
embeddedwebserver/pom.xml | 12 +-
hbase-agent/pom.xml | 17 +-
hdfs-agent/pom.xml | 7 +-
hive-agent/pom.xml | 7 +-
kms/scripts/db_setup.py | 42 +-
kms/scripts/dba_script.py | 86 +-
.../org/apache/hadoop/crypto/key/RangerKMSDB.java | 24 +-
.../org/apache/hadoop/crypto/key/RangerKMSMKI.java | 6 +-
.../apache/hadoop/crypto/key/RangerKeyStore.java | 145 +-
.../hadoop/crypto/key/RangerKeyStoreProvider.java | 37 +-
.../apache/hadoop/crypto/key/RangerMasterKey.java | 214 ++-
.../hadoop/crypto/key/SupportedPBECryptoAlgo.java | 74 +
.../apache/hadoop/crypto/key/kms/server/KMS.java | 4 +-
.../hadoop/crypto/key/kms/server/KMSWebApp.java | 4 +-
.../key/kms/server/RangerKeyStoreProviderTest.java | 849 +++++++++++-
knox-agent/pom.xml | 10 +-
plugin-atlas/pom.xml | 19 +-
.../authorizer/TestRangerAtlasAuthorizer.java | 522 +++++++
.../atlas/testutil}/RangerAdminClientImpl.java | 10 +-
.../test/resources/atlas-application.properties | 5 +-
.../src/test/resources/atlas-policies.json | 181 +++
.../src/test/{resource => resources}/logback.xml | 0
.../src/test/resources/ranger-atlas-security.xml | 36 +-
plugin-elasticsearch/pom.xml | 7 +-
plugin-kafka/pom.xml | 7 +-
plugin-kms/pom.xml | 9 +-
plugin-kudu/pom.xml | 7 +-
plugin-kylin/pom.xml | 7 +-
plugin-nifi-registry/pom.xml | 7 +-
plugin-nifi/pom.xml | 7 +-
plugin-ozone/pom.xml | 7 +-
plugin-presto/pom.xml | 7 +-
plugin-solr/pom.xml | 7 +-
.../solr/authorizer/RangerSolrAuthorizer.java | 16 +-
.../services/solr/client/ServiceSolrClient.java | 142 +-
plugin-sqoop/pom.xml | 7 +-
plugin-trino/pom.xml | 113 +-
plugin-yarn/pom.xml | 7 +-
pom.xml | 3 +-
ranger-atlas-plugin-shim/pom.xml | 5 -
.../distro/src/main/assembly/plugin-sampleapp.xml | 2 +-
.../distro/src/main/assembly/sample-client.xml | 2 +-
ranger-examples/plugin-sampleapp/pom.xml | 7 +-
ranger-hbase-plugin-shim/pom.xml | 5 -
ranger-hdfs-plugin-shim/pom.xml | 5 -
ranger-kafka-plugin-shim/pom.xml | 5 -
ranger-kms-plugin-shim/pom.xml | 5 -
ranger-knox-plugin-shim/pom.xml | 5 -
ranger-kylin-plugin-shim/pom.xml | 5 -
ranger-ozone-plugin-shim/pom.xml | 5 -
.../classloader/RangerPluginClassLoader.java | 28 +-
ranger-solr-plugin-shim/pom.xml | 5 -
ranger-sqoop-plugin-shim/pom.xml | 5 -
ranger-storm-plugin-shim/pom.xml | 5 -
ranger-tools/pom.xml | 5 -
ranger-yarn-plugin-shim/pom.xml | 5 -
ranger_in_docker | 41 +-
.../optimized/current/ranger_core_db_oracle.sql | 243 ++++
.../db/oracle/patches/067-create-gds-tables.sql | 274 ++++
.../db/oracle/patches/070-add-gds-perm.sql | 64 +
...fo.sql => 071-alter-x_service_version_info.sql} | 16 +-
security-admin/pom.xml | 22 +
security-admin/scripts/changepasswordutil.py | 4 +-
security-admin/scripts/changeusernameutil.py | 4 +-
security-admin/scripts/db_setup.py | 24 +-
security-admin/scripts/dba_script.py | 96 +-
.../ranger-admin-transaction-log-migrate.sh | 0
security-admin/scripts/restrict_permissions.py | 4 +-
.../scripts/updateUserAndGroupNamesInJson.py | 4 +-
security-admin/scripts/upgrade_admin.py | 14 +-
security-admin/src/bin/ranger_install.py | 14 +-
.../org/apache/ranger/AccessAuditsService.java | 1 +
.../main/java/org/apache/ranger/biz/AssetMgr.java | 205 ++-
.../java/org/apache/ranger/biz/GdsDBStore.java | 147 +-
.../java/org/apache/ranger/biz/ServiceDBStore.java | 77 +-
.../main/java/org/apache/ranger/biz/XUserMgr.java | 3 +-
.../org/apache/ranger/common/RESTErrorUtil.java | 1 +
.../org/apache/ranger/common/RangerSearchUtil.java | 7 +
.../apache/ranger/common/ServiceGdsInfoCache.java | 18 +-
.../RangerTransactionSynchronizationAdapter.java | 32 +-
.../org/apache/ranger/common/view/VTrxLogAttr.java | 13 +-
.../org/apache/ranger/db/XXAuthSessionDao.java | 6 +-
.../java/org/apache/ranger/db/XXGdsDatasetDao.java | 17 +
.../apache/ranger/db/XXGdsDatasetPolicyMapDao.java | 16 +
.../java/org/apache/ranger/db/XXGdsProjectDao.java | 29 +
.../apache/ranger/db/XXGdsProjectPolicyMapDao.java | 16 +
.../org/apache/ranger/db/XXPolicyLabelMapDao.java | 18 +-
.../patch/cliutil/TrxLogV2MigrationUtil.java | 14 +-
.../java/org/apache/ranger/rest/AssetREST.java | 46 +-
.../main/java/org/apache/ranger/rest/GdsREST.java | 94 +-
.../java/org/apache/ranger/rest/PublicAPIsv2.java | 20 +
.../java/org/apache/ranger/rest/ServiceREST.java | 115 ++
.../main/java/org/apache/ranger/rest/TagREST.java | 2 +
.../ranger/service/RangerAuditedModelService.java | 151 +-
.../ranger/service/RangerGdsDatasetService.java | 50 +-
.../main/resources/META-INF/jpa_named_queries.xml | 43 +-
.../conf.dist/security-applicationContext.xml | 2 +-
.../jquery/js/{jquery-3.5.1.js => core-lib.js} | 0
security-admin/src/main/webapp/login.jsp | 2 +-
.../src/main/webapp/react-webapp/package-lock.json | 15 +-
.../src/main/webapp/react-webapp/package.json | 2 +-
.../src/components/CommonComponents.jsx | 25 +-
.../react-webapp/src/components/CreatableField.jsx | 6 +-
.../react-webapp/src/components/Editable.jsx | 16 +-
.../main/webapp/react-webapp/src/styles/style.css | 4 -
.../src/views/AuditEvent/AuditLayout.jsx | 11 +-
.../src/views/Encryption/KeyManager.jsx | 45 +-
.../src/views/PermissionsModule/EditPermission.jsx | 16 +-
.../views/PolicyListing/AddUpdatePolicyForm.jsx | 15 +-
.../views/PolicyListing/PolicyConditionsComp.jsx | 10 +-
.../views/PolicyListing/PolicyListingTabView.jsx | 24 +-
.../views/PolicyListing/PolicyPermissionItem.jsx | 4 +-
.../PolicyListing/PolicyValidityPeriodComp.jsx | 14 +-
.../views/PolicyListing/TagBasePermissionItem.jsx | 18 +-
.../src/views/Reports/SearchPolicyTable.jsx | 4 +-
.../src/views/Reports/UserAccessLayout.jsx | 17 +-
.../src/views/Resources/ResourceComp.jsx | 4 +-
.../src/views/Resources/ResourceSelectComp.jsx | 5 +-
.../src/views/SecurityZone/SecurityZoneForm.jsx | 65 +-
.../src/views/SecurityZone/ZoneListing.jsx | 14 +-
.../src/views/ServiceManager/ExportPolicy.jsx | 9 +-
.../src/views/ServiceManager/ImportPolicy.jsx | 6 +-
.../views/ServiceManager/ServiceAuditFilter.jsx | 19 +-
.../src/views/ServiceManager/ServiceDefinition.jsx | 352 +----
.../views/ServiceManager/ServiceDefinitions.jsx | 21 +-
.../src/views/ServiceManager/ServiceForm.jsx | 13 +-
.../views/ServiceManager/ServiceViewDetails.jsx | 219 ++-
.../src/views/SideBar/ResourceTagContent.jsx | 4 +-
.../react-webapp/src/views/SideBar/SideBar.jsx | 54 +-
.../react-webapp/src/views/SideBar/SideBarBody.jsx | 19 +-
.../react-webapp/src/views/SideBar/TopNavBar.jsx | 37 +-
.../UserGroupRoleListing/role_details/RoleForm.jsx | 17 +-
.../users_details/UserFormComp.jsx | 15 +-
.../users_details/UserListing.jsx | 3 +-
.../org/apache/ranger/biz/TestServiceDBStore.java | 229 ++++
.../java/org/apache/ranger/rest/TestAssetREST.java | 40 +-
.../java/org/apache/ranger/rest/TestGdsREST.java | 163 ++-
storm-agent/pom.xml | 23 -
tagsync/scripts/setup.py | 19 +-
.../unixusersync/config/UserGroupSyncConfig.java | 2 +-
unixauthservice/scripts/install.properties | 4 +-
unixauthservice/scripts/setup.py | 27 +-
316 files changed, 8957 insertions(+), 3470 deletions(-)
delete mode 100644 .github/scripts/dot_env_util.py
rename .github/workflows/{maven.yml => ci.yml} (95%)
delete mode 100644 .github/workflows/test-upgrade.yaml
create mode 100644 .github/workflows/upgrade-ranger.yaml
copy {ranger-tools => agents-audit/core}/pom.xml (62%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/destination/AuditDestination.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/destination/FileAuditDestination.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/model/AuditEventBase.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/model/AuditIndexRecord.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/model/AuthzAuditEvent.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/model/EnumRepositoryType.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/model/SPOOL_FILE_STATUS.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/AsyncAuditProvider.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/AuditFileCacheProvider.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/AuditHandler.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/AuditMessageException.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/AuditProviderFactory.java
(83%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/AuditWriterFactory.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/BaseAuditHandler.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/BufferedAuditProvider.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/DebugTracer.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/DummyAuditProvider.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/Log4jTracer.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/LogBuffer.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/LogDestination.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/MiscUtil.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/MultiDestAuditProvider.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/provider/StandAloneAuditProviderFactory.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/queue/AuditAsyncQueue.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/queue/AuditBatchQueue.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/queue/AuditFileCacheProviderSpool.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/queue/AuditFileQueue.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/queue/AuditFileQueueSpool.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/queue/AuditFileSpool.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/queue/AuditQueue.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/queue/AuditSummaryQueue.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/test/TestEvents.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/utils/AbstractKerberosUser.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/utils/AbstractRangerAuditWriter.java
(83%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/utils/InMemoryJAASConfiguration.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/utils/KerberosAction.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/utils/KerberosJAASConfigUser.java
(100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/utils/KerberosUser.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/utils/RangerAuditWriter.java (100%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/utils/RangerJSONAuditWriter.java
(85%)
rename agents-audit/{ =>
core}/src/main/java/org/apache/ranger/audit/utils/RollingTimeUtil.java (100%)
rename agents-audit/{ => core}/src/main/resources/META-INF/persistence.xml
(100%)
create mode 100644
agents-audit/core/src/test/java/org/apache/ranger/audit/utils/RangerJSONAuditWriterTest.java
copy {ranger-plugin-classloader => agents-audit/dest-cloudwatch}/pom.xml (66%)
rename agents-audit/{ =>
dest-cloudwatch}/src/main/java/org/apache/ranger/audit/destination/AmazonCloudWatchAuditDestination.java
(100%)
copy agents-audit/{ => dest-es}/pom.xml (52%)
rename agents-audit/{ =>
dest-es}/src/main/java/org/apache/ranger/audit/destination/ElasticSearchAuditDestination.java
(100%)
copy {agents-cred => agents-audit/dest-hdfs}/pom.xml (70%)
rename agents-audit/{ =>
dest-hdfs}/src/main/java/org/apache/ranger/audit/destination/HDFSAuditDestination.java
(100%)
rename agents-audit/{ =>
dest-hdfs}/src/main/java/org/apache/ranger/audit/provider/LocalFileLogBuffer.java
(100%)
rename agents-audit/{ =>
dest-hdfs}/src/main/java/org/apache/ranger/audit/provider/hdfs/HdfsAuditProvider.java
(93%)
rename agents-audit/{ =>
dest-hdfs}/src/main/java/org/apache/ranger/audit/provider/hdfs/HdfsLogDestination.java
(100%)
copy {ranger-yarn-plugin-shim => agents-audit/dest-kafka}/pom.xml (68%)
rename agents-audit/{ =>
dest-kafka}/src/main/java/org/apache/ranger/audit/provider/kafka/KafkaAuditProvider.java
(100%)
copy {ranger-plugin-classloader => agents-audit/dest-log4j}/pom.xml (72%)
rename agents-audit/{ =>
dest-log4j}/src/main/java/org/apache/ranger/audit/destination/Log4JAuditDestination.java
(100%)
rename agents-audit/{ =>
dest-log4j}/src/main/java/org/apache/ranger/audit/provider/Log4jAuditProvider.java
(88%)
copy {agents-cred => agents-audit/dest-solr}/pom.xml (56%)
rename agents-audit/{ =>
dest-solr}/src/main/java/org/apache/ranger/audit/destination/SolrAuditDestination.java
(100%)
rename agents-audit/{ =>
dest-solr}/src/main/java/org/apache/ranger/audit/provider/solr/SolrAuditProvider.java
(100%)
rename agents-audit/{ =>
dest-solr}/src/main/java/org/apache/ranger/audit/utils/SolrAppUtil.java (100%)
copy {ranger-sqoop-plugin-shim => agents-audit/orc-util}/pom.xml (63%)
rename agents-audit/{ =>
orc-util}/src/main/java/org/apache/ranger/audit/utils/ORCFileUtil.java (100%)
rename agents-audit/{ =>
orc-util}/src/main/java/org/apache/ranger/audit/utils/RangerORCAuditWriter.java
(100%)
delete mode 100644
agents-audit/src/test/java/org/apache/ranger/audit/utils/RangerJSONAuditWriterTest.java
create mode 100644
agents-common/src/test/java/org/apache/ranger/plugin/policyengine/RangerAdminClientImpl.java
copy
agents-common/src/test/java/org/apache/ranger/plugin/{service/TestRangerBasePlugin.java
=> policyengine/RangerBasePluginTest.java} (59%)
create mode 100644
agents-common/src/test/resources/policyengine/hbase-test-policies.json
copy plugin-trino/src/test/resources/ranger-trino-security.xml =>
agents-common/src/test/resources/policyengine/ranger-hbase-security.xml (78%)
create mode 100644
agents-common/src/test/resources/policyengine/ranger-servicedef-hbase.json
create mode 100644
agents-common/src/test/resources/policyengine/ranger-servicedef-tag.json
create mode 100644
agents-common/src/test/resources/policyengine/test_base_plugin_hbase.json
create mode 100644
agents-common/src/test/resources/policyengine/updated-hbase-test-policies.json
create mode 100755 dev-support/checks/coverage.sh
delete mode 100644 dev-support/ranger-docker/Dockerfile.ranger-base
delete mode 100644 dev-support/ranger-docker/Dockerfile.ranger-base-ubi
delete mode 100644 dev-support/ranger-docker/docker-compose.ranger-base-ubi.yml
delete mode 100644 dev-support/ranger-docker/docker-compose.ranger-base.yml
create mode 100644
dev-support/ranger-docker/docker-compose.ranger-db-mounted.yml
create mode 100644 dev-support/ranger-docker/docker-compose.ranger-db.yml
delete mode 100644 dev-support/ranger-docker/docker-compose.ranger-mysql.yml
delete mode 100644 dev-support/ranger-docker/docker-compose.ranger-oracle.yml
delete mode 100644
dev-support/ranger-docker/docker-compose.ranger-postgres-mounted.yml
delete mode 100644 dev-support/ranger-docker/docker-compose.ranger-postgres.yml
delete mode 100644
dev-support/ranger-docker/docker-compose.ranger-sqlserver.yml
copy dev-support/ranger-docker/{scripts/ranger-trino.sh => download-ranger.sh}
(64%)
mode change 100644 => 100755
copy dev-support/ranger-docker/{scripts/ranger-usersync.sh => lib.sh} (52%)
mode change 100755 => 100644
create mode 100755 docs/fix-external-site-reference.sh
create mode 100644
kms/src/main/java/org/apache/hadoop/crypto/key/SupportedPBECryptoAlgo.java
create mode 100644
plugin-atlas/src/test/java/org/apache/ranger/authorization/atlas/authorizer/TestRangerAtlasAuthorizer.java
copy
{plugin-presto/src/test/java/org/apache/ranger/authorization/presto/authorizer
=>
plugin-atlas/src/test/java/org/apache/ranger/authorization/atlas/testutil}/RangerAdminClientImpl.java
(82%)
copy security-admin/db/mysql/init/create_dev_backup_mysql.sh =>
plugin-atlas/src/test/resources/atlas-application.properties (91%)
mode change 100755 => 100644
create mode 100644 plugin-atlas/src/test/resources/atlas-policies.json
rename plugin-atlas/src/test/{resource => resources}/logback.xml (100%)
copy storm-agent/src/test/resources/ranger-storm-security.xml =>
plugin-atlas/src/test/resources/ranger-atlas-security.xml (58%)
create mode 100644 security-admin/db/oracle/patches/067-create-gds-tables.sql
create mode 100644 security-admin/db/oracle/patches/070-add-gds-perm.sql
copy
security-admin/db/oracle/patches/{044-add-role-version-in-serviceVersionInfo.sql
=> 071-alter-x_service_version_info.sql} (71%)
rename {embeddedwebserver =>
security-admin}/scripts/ranger-admin-transaction-log-migrate.sh (100%)
rename security-admin/src/main/webapp/libs/bower/jquery/js/{jquery-3.5.1.js =>
core-lib.js} (100%)
