This is an automated email from the ASF dual-hosted git repository. nic pushed a change to branch dynamic-measure in repository https://gitbox.apache.org/repos/asf/kylin.git.
omit 648cbbc KYLIN-3986 Add hint about the absent measures after a successful query. Generate the GridTable according to MeasureInstance metadata omit 5ebcee6 KYLIN-3983 Add extra metadata for measure. Add test case and example/test_case_data for MeasureManager. Add measure metadata in sample cube add 20fa8b1 Add unit tests (#639) add 6efcd79 KYLIN-3978 InternalErrorException: null with precise count distinct add bb44678 #KYLIN-3977 Aviod mistaken deleting dicts by storage cleanup while building jobs are running add ee95242 Small performance improvements add e09d9d7 KYLIN-4001 Allow user-specified time format using real-time for backend add 876d420 KYLIN-4001 Allow user-specified time format using real-time for ui add 79a2fc2 Add tests for LookupExecutableUtil and JobInfoConverter (#640) add b48de90 Add unit tests (#645) add 4e7b242 minor, switch to openjdk8 for travis add f15b1f8 KYLIN-3958 MrHive-Dict support build by livy add 47431ba KYLIN-3958 Add quote for backtick new 29122d9 KYLIN-3983 Add extra metadata for measure. Add test case and example/test_case_data for MeasureManager. Add measure metadata in sample cube new 9f21f0c KYLIN-3986 Add hint about the absent measures after a successful query. Generate the GridTable according to MeasureInstance metadata This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (648cbbc) \ N -- N -- N refs/heads/dynamic-measure (9f21f0c) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .travis.yml | 2 +- .../cache/cachemanager/MemcachedCacheManager.java | 4 +- .../apache/kylin/common/livy/LivyRestClient.java | 9 +- .../common/persistence/FileResourceStore.java | 31 +++- .../common/persistence/HDFSResourceStore.java | 31 +++- .../kylin/common/persistence/JDBCResourceSQL.java | 6 +- .../common/persistence/JDBCResourceStore.java | 48 +++++- .../common/persistence/PushdownResourceStore.java | 15 ++ .../kylin/common/persistence/ResourceStore.java | 106 ++++++++++--- .../java/org/apache/kylin/common/util/Bytes.java | 2 +- .../apache/kylin/common/util/ClasspathScanner.java | 6 +- .../apache/kylin/common/util/HiveCmdBuilder.java | 4 + .../org/apache/kylin/common/util/MailService.java | 2 +- .../src/main/resources/kylin-defaults.properties | 6 + .../common/persistence/ResourceStoreTest.java | 120 +++++++++++++-- .../java/org/apache/kylin/cube/CubeManager.java | 52 ++++--- .../kylin/cube/cli/DictionaryGeneratorCLI.java | 77 +++++++++- .../org/apache/kylin/dict/DictionaryManager.java | 141 ++++++++++------- .../apache/kylin/dict/lookup/SnapshotManager.java | 89 +++++++---- .../apache/kylin/dict/DictionaryManagerTest.java | 53 +++++-- .../kylin/dict/lookup/SnapshotManagerTest.java | 171 +++++++++++++++++++++ .../apache/kylin/job/engine/JobEngineConfig.java | 2 +- .../storage/gtrecord/GTCubeStorageQueryBase.java | 5 +- .../apache/kylin/storage/StorageContextTest.java | 64 ++++++++ .../kylin/storage/hybrid/HybridInstanceTest.java | 86 +++++++++++ .../translate}/FuzzyValueCombinationTest.java | 6 +- .../kylin/engine/mr/common/AbstractHadoopJob.java | 12 +- .../engine/mr/common/HadoopJobStatusChecker.java | 2 +- .../kylin/engine/mr/steps/CreateDictionaryJob.java | 10 +- .../mr/steps/lookup/LookupExecutableUtil.java | 4 +- .../mr/common/DefaultX509TrustManagerTest.java | 36 +++-- .../engine/mr/common/HadoopCmdOutputTest.java} | 43 +++--- .../engine/mr/common/JobInfoConverterTest.java | 159 ++++++++++++++++++- .../mr/steps/lookup/LookupExecutableUtilTest.java | 63 ++++++++ .../apache/kylin/cube/ITDictionaryManagerTest.java | 13 +- .../apache/kylin/rest/job/MetadataCleanupJob.java | 136 +++++++++++----- .../kylin/rest/job/MetadataCleanupJobTest.java | 16 +- .../source/hive/CreateFlatHiveTableByLivyStep.java | 50 +----- .../kylin/source/hive/CreateMrHiveDictStep.java | 17 +- .../apache/kylin/source/hive/MRHiveDictUtil.java | 61 +++++++- .../hive/RedistributeFlatHiveTableByLivyStep.java | 17 +- .../kylin/storage/hbase/HBaseResourceStore.java | 82 ++++++++-- .../hbase/cube/v2/CubeHBaseEndpointRPC.java | 1 + .../stream/core/source/MessageParserInfo.java | 22 +++ .../stream}/source/kafka/AbstractTimeParser.java | 8 +- .../kylin/stream}/source/kafka/DateTimeParser.java | 25 ++- .../kylin/stream/source/kafka/LongTimeParser.java | 24 ++- .../stream/source/kafka/TimedJsonStreamParser.java | 24 ++- webapp/app/js/controllers/sourceMeta.js | 8 +- .../partials/tables/loadStreamingTableConfig.html | 16 +- webapp/app/partials/tables/table_detail.html | 8 + 51 files changed, 1585 insertions(+), 410 deletions(-) create mode 100644 core-dictionary/src/test/java/org/apache/kylin/dict/lookup/SnapshotManagerTest.java create mode 100644 core-storage/src/test/java/org/apache/kylin/storage/StorageContextTest.java create mode 100644 core-storage/src/test/java/org/apache/kylin/storage/hybrid/HybridInstanceTest.java rename {storage-hbase/src/test/java/org/apache/kylin/storage/hbase/common => core-storage/src/test/java/org/apache/kylin/storage/translate}/FuzzyValueCombinationTest.java (97%) copy core-common/src/test/java/org/apache/kylin/common/util/DateFormatTest.java => engine-mr/src/test/java/org/apache/kylin/engine/mr/common/DefaultX509TrustManagerTest.java (50%) copy engine-mr/src/{main/java/org/apache/kylin/engine/mr/common/SerializableConfiguration.java => test/java/org/apache/kylin/engine/mr/common/HadoopCmdOutputTest.java} (52%) create mode 100644 engine-mr/src/test/java/org/apache/kylin/engine/mr/steps/lookup/LookupExecutableUtilTest.java copy {source-kafka/src/main/java/org/apache/kylin => stream-source-kafka/src/main/java/org/apache/kylin/stream}/source/kafka/AbstractTimeParser.java (83%) copy {source-kafka/src/main/java/org/apache/kylin => stream-source-kafka/src/main/java/org/apache/kylin/stream}/source/kafka/DateTimeParser.java (82%) copy source-kafka/src/main/java/org/apache/kylin/source/kafka/DefaultTimeParser.java => stream-source-kafka/src/main/java/org/apache/kylin/stream/source/kafka/LongTimeParser.java (67%)