This is an automated email from the ASF dual-hosted git repository. xxyu pushed a change to branch kylin5 in repository https://gitbox.apache.org/repos/asf/kylin.git
from c0290399fc KYLIN-5368 Fix when stop ke job on yarn are not be killed for yarn cluster mode new 60a2b5b4fa KYLIN-5342 upgrade spark version 3.2.0-kylin-4.6.1.0 before Release Candidate new f241d43dca KYLIN-5343 Add column datatype check when import model new dea257ad3b KYLIN-5344 Fix epoch update when epoch checker disabled new 4af690015c KYLIN-5345 remove non existent user/usergroup in recommand advice list new bda0206639 KYLIN-5346 add monitor metrics for long running jobs new 1edec930c1 Revert KYLIN-5372 due to this fix cannot override snapshot build scenarios new 7bd187ae0d KYLIN-5347 use spark session hadoop config when aws serverless environment on build snapshot for partition table new eade3c6e1e KYLIN-5348 add server.servlet.encoding.force=true to enable setting UTF-8 new 5bca044690 KYLIN-5349 Support project-level configuration of concurrent task limits new be5e5fa209 KYLIN-5356 Backend configuration of users supports the project administrator role new 236172adec KYLIN-5357 fix snyk vulnerabilities new f760606ff3 remove unused profile The 12 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: pom.xml | 24 +-- .../apache/kylin/rest/config/MetricsConfig.java | 1 + .../rest/config/initialize/MetricsRegistry.java | 63 +++++++- ...sResponse.java => OpenAccessGroupResponse.java} | 16 +- ...rsResponse.java => OpenAccessUserResponse.java} | 16 +- .../config/initialize/MetricsRegistryTest.java | 65 ++++++--- .../apache/kylin/common/metrics/MetricsTag.java | 2 + .../metrics/prometheus/PrometheusMetrics.java | 1 + .../job/impl/threadpool/NDefaultScheduler.java | 19 ++- .../apache/kylin/job/runners/FetcherRunner.java | 27 +++- .../job/impl/threadpool/NDefaultSchedulerTest.java | 79 +++++++++- .../kylin/metadata/epoch/EpochOrchestrator.java | 8 +- .../org/apache/kylin/metadata/model/TableDesc.java | 18 --- .../metadata/model/schema/ModelImportChecker.java | 31 ++-- .../model/schema/SchemaChangeCheckResult.java | 99 +++++++------ .../kylin/metadata/model/schema/SchemaUtil.java | 24 ++- .../schema/strategy/ComputedColumnStrategy.java | 37 +++-- .../schema/strategy/MultiplePartitionStrategy.java | 8 +- .../schema/strategy/OverWritableStrategy.java | 16 +- .../schema/strategy/SchemaChangeStrategy.java | 32 ++-- .../model/schema/strategy/TableColumnStrategy.java | 27 ++-- .../model/schema/strategy/TableStrategy.java | 9 +- .../schema/strategy/UnOverWritableStrategy.java | 18 ++- .../org/apache/kylin/rest/constant/Constant.java | 2 +- .../metadata/epoch/EpochOrchestratorTest.java | 13 +- .../apache/kylin/metadata/model/TableDescTest.java | 55 ------- .../metadata/model/schema/SchemaUtilTest.java | 14 ++ .../kylin/rest/service/ModelBuildService.java | 17 ++- .../kylin/rest/service/ModelServiceBuildTest.java | 46 ++++++ .../localmeta/data/tableDesc/SSB.CUSTOMER_NEW.json | 14 +- src/kylin-it/pom.xml | 5 - .../rest/controller/open/OpenUserController.java | 10 +- .../rest/controller/v2/NAccessControllerV2.java | 124 ++++++++++++++-- .../rest/controller/NAccessControllerV2Test.java | 125 +++++++++++++++- .../kylin/rest/service/MetaStoreService.java | 158 ++++++++++---------- .../kylin/rest/service/MetaStoreServiceTest.java | 161 ++++----------------- .../org/apache/kylin/query/schema/OLAPTable.java | 18 --- src/server/pom.xml | 3 +- src/server/src/main/resources/application.yaml | 3 +- .../engine/spark/application/SparkApplication.java | 5 - .../engine/spark/builder/SnapshotBuilder.scala | 4 + .../org/apache/spark/application/JobWorker.scala | 8 +- .../apache/spark/application/TestJobMonitor.scala | 2 +- .../apache/spark/application/TestJobWorker.scala | 141 +----------------- 44 files changed, 909 insertions(+), 659 deletions(-) copy src/common-service/src/main/java/org/apache/kylin/rest/response/{ServersResponse.java => OpenAccessGroupResponse.java} (79%) copy src/common-service/src/main/java/org/apache/kylin/rest/response/{ServersResponse.java => OpenAccessUserResponse.java} (79%)