This is an automated email from the ASF dual-hosted git repository.
xxyu pushed a change to branch kylin-on-parquet-v2
in repository https://gitbox.apache.org/repos/asf/kylin.git.
from bb54a2a KYLIN-4926 Optimize Global Dict building: replace operation
'mapPartitions.count()' with 'foreachPartitions'
new 04e2169 KYLIN-4927 Forbid to use AE when building Global Dict
new 1d5f176 KYLIN-4937 Verify the uniqueness of the global dictionary
after building global dictionary
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../features/step_impl/auto_config/auto_config.py | 17 ++++++++
.../features/step_impl/happy_path/happy_path.py | 17 ++++++++
.../features/step_impl/project_model/model.py | 17 ++++++++
.../features/step_impl/project_model/project.py | 17 ++++++++
.../org/apache/kylin/common/KylinConfigBase.java | 4 ++
.../spark/dict/NGlobalDictBuilderAssist.scala | 30 +++++++++++++
.../apache/spark/sql/common/LocalMetadata.scala | 10 +----
.../spark/builder/CubeDictionaryBuilder.scala | 26 +++++++++--
.../engine/spark/builder/TestCreateFlatTable.scala | 2 +-
.../engine/spark/builder/TestGlobalDictBuild.scala | 50 ++++++++++++----------
10 files changed, 154 insertions(+), 36 deletions(-)
