[
https://issues.apache.org/jira/browse/KYLIN-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18069776#comment-18069776
] ASF GitHub Bot commented on KYLIN-4833: --------------------------------------- codecov-commenter commented on PR #1494: URL: https://github.com/apache/kylin/pull/1494#issuecomment-4159844703 ## [Codecov](https://app.codecov.io/gh/apache/kylin/pull/1494?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report :x: Patch coverage is `0%` with `93 lines` in your changes missing coverage. Please review. :white_check_mark: Project coverage is 25.43%. Comparing base ([`3e12b6d`](https://app.codecov.io/gh/apache/kylin/commit/3e12b6d621fe8e5c747a5783f64bc535618c8035?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`d37b1e7`](https://app.codecov.io/gh/apache/kylin/commit/d37b1e7b402cc6fe3412f29c3e9681760bc93686?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)). | [Files with missing lines](https://app.codecov.io/gh/apache/kylin/pull/1494?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines | |---|---|---| | [...ache/kylin/storage/hbase/steps/HFileDistcpJob.java](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&filepath=storage-hbase%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fhbase%2Fsteps%2FHFileDistcpJob.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9IRmlsZURpc3RjcEpvYi5qYXZh) | 0.00% | [39 Missing :warning: ](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | | [...pache/kylin/storage/hbase/steps/HBaseJobSteps.java](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&filepath=storage-hbase%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fhbase%2Fsteps%2FHBaseJobSteps.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9IQmFzZUpvYlN0ZXBzLmphdmE=) | 0.00% | [19 Missing :warning: ](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | | [...che/kylin/storage/hbase/steps/HBaseFlinkSteps.java](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&filepath=storage-hbase%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fhbase%2Fsteps%2FHBaseFlinkSteps.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9IQmFzZUZsaW5rU3RlcHMuamF2YQ==) | 0.00% | [8 Missing :warning: ](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | | [...apache/kylin/storage/hbase/steps/HBaseMRSteps.java](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&filepath=storage-hbase%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fhbase%2Fsteps%2FHBaseMRSteps.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9IQmFzZU1SU3RlcHMuamF2YQ==) | 0.00% | [8 Missing :warning: ](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | | [.../storage/hbase/steps/HBaseMROutput2Transition.java](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&filepath=storage-hbase%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fhbase%2Fsteps%2FHBaseMROutput2Transition.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9IQmFzZU1ST3V0cHV0MlRyYW5zaXRpb24uamF2YQ==) | 0.00% | [6 Missing :warning: ](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | | [...torage/hbase/steps/HBaseFlinkOutputTransition.java](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&filepath=storage-hbase%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fhbase%2Fsteps%2FHBaseFlinkOutputTransition.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9IQmFzZUZsaW5rT3V0cHV0VHJhbnNpdGlvbi5qYXZh) | 0.00% | [4 Missing :warning: ](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | | [...torage/hbase/steps/HBaseSparkOutputTransition.java](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&filepath=storage-hbase%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fhbase%2Fsteps%2FHBaseSparkOutputTransition.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9IQmFzZVNwYXJrT3V0cHV0VHJhbnNpdGlvbi5qYXZh) | 0.00% | [4 Missing :warning: ](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | | [.../java/org/apache/kylin/common/KylinConfigBase.java](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&filepath=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FKylinConfigBase.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9LeWxpbkNvbmZpZ0Jhc2UuamF2YQ==) | 0.00% | [3 Missing :warning: ](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | | [...age/hbase/steps/HDFSPathGarbageCollectionStep.java](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&filepath=storage-hbase%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstorage%2Fhbase%2Fsteps%2FHDFSPathGarbageCollectionStep.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9IREZTUGF0aEdhcmJhZ2VDb2xsZWN0aW9uU3RlcC5qYXZh) | 0.00% | [2 Missing :warning: ](https://app.codecov.io/gh/apache/kylin/pull/1494?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | <details><summary>Additional details and impacted files</summary> ```diff @@ Coverage Diff @@ ## master #1494 +/- ## ============================================ - Coverage 25.51% 25.43% -0.09% + Complexity 6765 6764 -1 ============================================ Files 1505 1508 +3 Lines 93618 93871 +253 Branches 13111 13144 +33 ============================================ - Hits 23886 23873 -13 - Misses 67356 67617 +261 - Partials 2376 2381 +5 ``` </details> [:umbrella: View full report in Codecov by Sentry](https://app.codecov.io/gh/apache/kylin/pull/1494?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache). :loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache). <details><summary> :rocket: New features to boost your workflow: </summary> - :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems. - :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges. </details> > use distcp to control the speed of writting hfile data to hbase cluster > ----------------------------------------------------------------------- > > Key: KYLIN-4833 > URL: https://issues.apache.org/jira/browse/KYLIN-4833 > Project: Kylin > Issue Type: Improvement > Components: Storage - HBase > Affects Versions: v3.1.1 > Reporter: fengpod > Assignee: fengpod > Priority: Minor > Fix For: v3.1.2 > > > When a large data is written to hbase cluster at the same time，the cluster > load will become very high，which will affect the query performance. This pr > allows data to be written data to hadoop hdfs when doing step “Convert Cuboid > Data to HFile”，and then hfile will be transferred to the hbase cluster by > DistCp。DistCp controls the speed of write data so as to reduce the pressure > of cluster。 This pr adds a new step " HFile Distcp To HBase" between “Convert > Cuboid Data to HFile” and "Load HFile to HBase Table" 。As look like this： > !https://user-images.githubusercontent.com/4843586/100835711-013fae00-34a9-11eb-8de8-e69228ba0991.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
