[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

EmmyMiao87 commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295667228 ## File path: gensrc/thrift/FrontendService.thrift ## @@ -581,9 +608,14 @@ ser

[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

EmmyMiao87 commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295664361 ## File path: be/src/util/string_parser.hpp ## @@ -122,6 +123,38 @@ class Stri

[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

EmmyMiao87 commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295657427 ## File path: be/src/http/action/mini_load.cpp ## @@ -318,14 +330,47 @@ int Mi

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295650163 ## File path: be/src/http/action/mini_load.cpp ## @@ -516,4 +602,217 @@ bool LoadHan

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295649854 ## File path: be/src/http/action/mini_load.h ## @@ -84,6 +88,27 @@ class MiniLoadAct

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295650495 ## File path: be/src/http/action/mini_load.cpp ## @@ -516,4 +602,217 @@ bool LoadHan

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295652031 ## File path: gensrc/thrift/FrontendService.thrift ## @@ -443,6 +443,26 @@ struct TL

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295652567 ## File path: gensrc/thrift/FrontendService.thrift ## @@ -581,9 +608,14 @@ service F

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295651085 ## File path: be/src/util/string_parser.hpp ## @@ -122,6 +123,38 @@ class StringPars

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295651853 ## File path: be/src/http/action/mini_load.cpp ## @@ -318,14 +330,47 @@ int MiniLoad

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295650115 ## File path: be/src/http/action/mini_load.cpp ## @@ -516,4 +602,217 @@ bool LoadHan

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295649609 ## File path: be/src/http/action/mini_load.cpp ## @@ -318,14 +330,47 @@ int MiniLoad

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295651124 ## File path: be/src/util/string_parser.hpp ## @@ -122,6 +123,38 @@ class StringPars

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295650388 ## File path: be/src/http/action/mini_load.cpp ## @@ -516,4 +602,217 @@ bool LoadHan

[GitHub] [incubator-doris] imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load

imay commented on a change in pull request #1323: This commit has brought contribution to streaming mini load URL: https://github.com/apache/incubator-doris/pull/1323#discussion_r295650821 ## File path: be/src/runtime/stream_load/stream_load_executor.cpp ## @@ -223,17 +226

[GitHub] [incubator-doris] morningman merged pull request #1335: Fix proc load

morningman merged pull request #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [incubator-doris] chaoyli merged pull request #1339: Place _init_seek_columns() in right place

chaoyli merged pull request #1339: Place _init_seek_columns() in right place URL: https://github.com/apache/incubator-doris/pull/1339 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [incubator-doris] yiguolei commented on a change in pull request #1339: Place _init_seek_columns() in right place

yiguolei commented on a change in pull request #1339: Place _init_seek_columns() in right place URL: https://github.com/apache/incubator-doris/pull/1339#discussion_r295632192 ## File path: be/src/olap/reader.cpp ## @@ -590,15 +590,15 @@ OLAPStatus Reader::_init_params(cons

[GitHub] [incubator-doris] chaoyli opened a new pull request #1339: Place _init_seek_columns() in right place

chaoyli opened a new pull request #1339: Place _init_seek_columns() in right place URL: https://github.com/apache/incubator-doris/pull/1339 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-doris] EmmyMiao87 opened a new pull request #1338: Fix the broker hang when fe restart

EmmyMiao87 opened a new pull request #1338: Fix the broker hang when fe restart URL: https://github.com/apache/incubator-doris/pull/1338 This commit fix the broker hang when fe restart. It also present latest error msg when load task is failed. It also fix the persistent error in StringL

[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #1335: Fix proc load

EmmyMiao87 commented on a change in pull request #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335#discussion_r295590319 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/LoadManager.java ## @@ -314,6 +332,12 @@ public void processTimeo

[GitHub] [incubator-doris] morningman commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

morningman commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295341117 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloBulkLoadTask.scala #

[GitHub] [incubator-doris] morningman commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

morningman commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295342508 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloDfsLoadTask.scala ##

[GitHub] [incubator-doris] morningman commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

morningman commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295338831 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloWriter.scala ##

[GitHub] [incubator-doris] morningman commented on a change in pull request #1335: Fix proc load

morningman commented on a change in pull request #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335#discussion_r295330096 ## File path: fe/src/main/java/org/apache/doris/load/routineload/RoutineLoadManager.java ## @@ -148,9 +149,11 @@ public void

[GitHub] [incubator-doris] morningman commented on a change in pull request #1335: Fix proc load

morningman commented on a change in pull request #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335#discussion_r295328427 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/LoadManager.java ## @@ -90,6 +90,9 @@ public void createLoadJobFr

[GitHub] [incubator-doris] morningman commented on a change in pull request #1335: Fix proc load

morningman commented on a change in pull request #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335#discussion_r295327837 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/LoadJobScheduler.java ## @@ -45,6 +45,8 @@ public class LoadJobS

[GitHub] [incubator-doris] morningman commented on a change in pull request #1335: Fix proc load

morningman commented on a change in pull request #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335#discussion_r295328771 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/LoadJobScheduler.java ## @@ -88,6 +90,10 @@ private void process(

[GitHub] [incubator-doris] morningman commented on a change in pull request #1335: Fix proc load

morningman commented on a change in pull request #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335#discussion_r295329887 ## File path: fe/src/main/java/org/apache/doris/load/routineload/RoutineLoadManager.java ## @@ -57,6 +57,7 @@ public class

[GitHub] [incubator-doris] morningman commented on a change in pull request #1335: Fix proc load

morningman commented on a change in pull request #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335#discussion_r295329250 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/LoadManager.java ## @@ -314,6 +332,12 @@ public void processTimeo

[GitHub] [incubator-doris] wuyunfeng commented on issue #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on issue #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#issuecomment-503585034 This is a good job, I leave some comment This is an automated messag

[GitHub] [incubator-doris] imay merged pull request #1304: Add bitshuffle page

imay merged pull request #1304: Add bitshuffle page URL: https://github.com/apache/incubator-doris/pull/1304 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [incubator-doris] EmmyMiao87 commented on issue #1335: Fix proc load

EmmyMiao87 commented on issue #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335#issuecomment-503553177 The latest commit is not belongs to this branch, so I reset hard the commit and forced pushed.

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new

chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new URL: https://github.com/apache/incubator-doris/pull/1337#discussion_r295262226 ## File path: be/src/tools/meta_tool.cpp ## @@ -29,144 +28,143 @@ #include "olap/tablet_meta_manager.h"

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new

chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new URL: https://github.com/apache/incubator-doris/pull/1337#discussion_r295265491 ## File path: be/src/tools/meta_tool.cpp ## @@ -29,144 +28,143 @@ #include "olap/tablet_meta_manager.h"

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new

chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new URL: https://github.com/apache/incubator-doris/pull/1337#discussion_r295267033 ## File path: be/src/tools/meta_tool.cpp ## @@ -29,144 +28,143 @@ #include "olap/tablet_meta_manager.h"

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new

chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new URL: https://github.com/apache/incubator-doris/pull/1337#discussion_r295266985 ## File path: be/src/tools/meta_tool.cpp ## @@ -29,144 +28,143 @@ #include "olap/tablet_meta_manager.h"

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new

chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new URL: https://github.com/apache/incubator-doris/pull/1337#discussion_r295265862 ## File path: be/src/olap/tablet_meta_manager.cpp ## @@ -157,10 +157,12 @@ OLAPStatus TabletMetaManager::l

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new

chaoyli commented on a change in pull request #1337: Be refactor optimize meta tool new URL: https://github.com/apache/incubator-doris/pull/1337#discussion_r295263947 ## File path: be/src/tools/meta_tool.cpp ## @@ -29,144 +28,143 @@ #include "olap/tablet_meta_manager.h"

[GitHub] [incubator-doris] morningman merged pull request #1334: Modify the max keep time of historical alter jobs.

morningman merged pull request #1334: Modify the max keep time of historical alter jobs. URL: https://github.com/apache/incubator-doris/pull/1334 This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [incubator-doris] kangpinghuang opened a new pull request #1337: Be refactor optimize meta tool new

kangpinghuang opened a new pull request #1337: Be refactor optimize meta tool new URL: https://github.com/apache/incubator-doris/pull/1337 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-doris] imay commented on issue #1336: 建议添加dayofweek函数

imay commented on issue #1336: 建议添加dayofweek函数 URL: https://github.com/apache/incubator-doris/issues/1336#issuecomment-503509453 you can use `select date_format("2019-06-19", "%w");` to get day of week Yes, we should improve our documents, and you can reference some in [here](https:

[GitHub] [incubator-doris] ltylty opened a new issue #1336: 建议添加dayofweek函数

ltylty opened a new issue #1336: 建议添加dayofweek函数 URL: https://github.com/apache/incubator-doris/issues/1336 0.9版本不支持dayofweek函数，建议添加。 还有dayofyear函数已经可用，但是在[文档](https://github.com/apache/incubator-doris/wiki/Sql-Reference)中没有说明，建议更新文档 -

[GitHub] [incubator-doris] EmmyMiao87 opened a new pull request #1335: Fix proc load

EmmyMiao87 opened a new pull request #1335: Fix proc load URL: https://github.com/apache/incubator-doris/pull/1335 Load which is belongs to LoadManger could not be presented in show proc "/jobs/dbId/load". This commit fix this bug. --

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295177010 ## File path: docs/documentation/cn/extending-doris/Spark-sink-for-Doris.md ## @@ -0,0 +1,129 @@

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295175526 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloBulkLoadTask.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295175665 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloBulkLoadTask.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295173682 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloBulkLoadTask.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295168679 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloSinkProvider.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295172868 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloWriter.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295169626 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloSinkProvider.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295168078 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloSinkProvider.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295165575 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloSinkProvider.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295169694 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloSinkProvider.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295170103 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloSink.scala ## @@

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295166926 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloSinkProvider.scala ##

[GitHub] [incubator-doris] morningman opened a new pull request #1334: Modify the max keep time of historical alter jobs.

morningman opened a new pull request #1334: Modify the max keep time of historical alter jobs. URL: https://github.com/apache/incubator-doris/pull/1334 Currently, historical alter jobs will keep for a while before being removed. And this time is configured by label_keep_max_second. Which

[GitHub] [incubator-doris] kangpinghuang commented on issue #1333: create rollup table failed

kangpinghuang commented on issue #1333: create rollup table failed URL: https://github.com/apache/incubator-doris/issues/1333#issuecomment-503451780 use show alter table to see the job, the job history will be deleted in 12 hours, so the history will be missing. And the grep the aud

[GitHub] [incubator-doris] kangpinghuang opened a new issue #1333: create rollup table failed

kangpinghuang opened a new issue #1333: create rollup table failed URL: https://github.com/apache/incubator-doris/issues/1333 **Describe the bug** send the create rollup sql: ALTER TABLE log_driver_invoke ADD ROLLUP log_data_trace_query_rollup ( trace_id,log_date, method_id, l

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295162542 ## File path: extension/spark-sink/src/main/scala/org/apache/spark/sql/palo/PaloClient.scala ##

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming

wuyunfeng commented on a change in pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332#discussion_r295162196 ## File path: extension/spark-sink/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataS

[GitHub] [incubator-doris] LiangchangZ opened a new pull request #1332: Doris sink for Spark Structured Streaming

LiangchangZ opened a new pull request #1332: Doris sink for Spark Structured Streaming URL: https://github.com/apache/incubator-doris/pull/1332 Doris Sink is a type of Structured Streaming sink with exactly-once fault-tolerance guarantees. It now supports two mode: Broker LOAD & Mini LOAD.