[GitHub] [doris] xiaokang merged pull request #22813: [branch2.0](fix) fix varchar len in ctas
xiaokang merged PR #22813: URL: https://github.com/apache/doris/pull/22813 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch branch-2.0 updated: [branch2.0](fix) fix varchar len in ctas (#22813)
This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.0 by this push:
new 44de050734 [branch2.0](fix) fix varchar len in ctas (#22813)
44de050734 is described below
commit 44de050734fc1531ee23953fae414c5cbb38d5c2
Author: Mingyu Chen
AuthorDate: Thu Aug 10 15:01:46 2023 +0800
[branch2.0](fix) fix varchar len in ctas (#22813)
---
.../java/org/apache/doris/analysis/ColumnDef.java | 9 ---
.../analysis/CreateTableAsSelectStmtTest.java | 28 ++
2 files changed, 34 insertions(+), 3 deletions(-)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/analysis/ColumnDef.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/ColumnDef.java
index e65d5c4c9a..2ae7a04335 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/analysis/ColumnDef.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/analysis/ColumnDef.java
@@ -316,11 +316,14 @@ public class ColumnDef {
if (typeDef.getType().isScalarType()) {
final ScalarType targetType = (ScalarType) typeDef.getType();
if (targetType.getPrimitiveType().isStringType() &&
!targetType.isLengthSet()) {
-if (targetType.getPrimitiveType() != PrimitiveType.STRING) {
-targetType.setLength(1);
-} else {
+if (targetType.getPrimitiveType() == PrimitiveType.VARCHAR) {
+// always set varchar length MAX_VARCHAR_LENGTH
+targetType.setLength(ScalarType.MAX_VARCHAR_LENGTH);
+} else if (targetType.getPrimitiveType() ==
PrimitiveType.STRING) {
// always set text length MAX_STRING_LENGTH
targetType.setLength(ScalarType.MAX_STRING_LENGTH);
+} else {
+targetType.setLength(1);
}
}
}
diff --git
a/fe/fe-core/src/test/java/org/apache/doris/analysis/CreateTableAsSelectStmtTest.java
b/fe/fe-core/src/test/java/org/apache/doris/analysis/CreateTableAsSelectStmtTest.java
index 2a5ff740d5..1d2bcdb146 100644
---
a/fe/fe-core/src/test/java/org/apache/doris/analysis/CreateTableAsSelectStmtTest.java
+++
b/fe/fe-core/src/test/java/org/apache/doris/analysis/CreateTableAsSelectStmtTest.java
@@ -576,4 +576,32 @@ public class CreateTableAsSelectStmtTest extends
TestWithFeService {
}
Assert.assertEquals(2, createStmts.size());
}
+
+@Test
+public void testVarcharLength() throws Exception {
+String createSql =
+"create table `test`.`varchar_len1` PROPERTIES
(\"replication_num\" = \"1\")"
++ " as select 'abc', concat('xx', userId), userId from
`test`.`varchar_table`";
+createTableAsSelect(createSql);
+ShowResultSet showResultSet = showCreateTableByName("varchar_len1");
+String showStr = showResultSet.getResultRows().get(0).get(1);
+Assertions.assertEquals(
+"CREATE TABLE `varchar_len1` (\n"
++ " `_col0` varchar(65533) NULL,\n"
++ " `_col1` varchar(65533) NULL,\n"
++ " `userId` varchar(255) NOT NULL\n"
++ ") ENGINE=OLAP\n"
++ "DUPLICATE KEY(`_col0`)\n"
++ "COMMENT 'OLAP'\n"
++ "DISTRIBUTED BY HASH(`_col0`) BUCKETS 10\n"
++ "PROPERTIES (\n"
++ "\"replication_allocation\" =
\"tag.location.default: 1\",\n"
++ "\"is_being_synced\" = \"false\",\n"
++ "\"storage_format\" = \"V2\",\n"
++ "\"light_schema_change\" = \"true\",\n"
++ "\"disable_auto_compaction\" = \"false\",\n"
++ "\"enable_single_replica_compaction\" = \"false\"\n"
++ ");",
+showStr);
+}
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wsjz opened a new pull request, #22814: [fix](multi-catalog)fix jdbc loader
wsjz opened a new pull request, #22814: URL: https://github.com/apache/doris/pull/22814 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] starocean999 merged pull request #22773: [opt](stats) Use single connect context for each olap analyze task
starocean999 merged PR #22773: URL: https://github.com/apache/doris/pull/22773 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [opt](stats) Use single connect context for each olap analyze task
This is an automated email from the ASF dual-hosted git repository.
starocean999 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new ec0cedab51 [opt](stats) Use single connect context for each olap
analyze task
ec0cedab51 is described below
commit ec0cedab5174bf6bb3424e2796595f7d7619b160
Author: AKIRA <33112463+kikyou1...@users.noreply.github.com>
AuthorDate: Thu Aug 10 15:04:28 2023 +0800
[opt](stats) Use single connect context for each olap analyze task
1. add some comment
2. Fix potential NPE caused by deleting a running analyze job
3. Use single connect context for each olap analyze task
---
.../apache/doris/statistics/AnalysisManager.java | 14 +--
.../apache/doris/statistics/OlapAnalysisTask.java | 44 ++
.../doris/statistics/AnalysisTaskExecutorTest.java | 2 +-
3 files changed, 31 insertions(+), 29 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
b/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
index cb4d9eb034..b5c6ebf602 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java
@@ -96,17 +96,23 @@ public class AnalysisManager extends Daemon implements
Writable {
private static final Logger LOG =
LogManager.getLogger(AnalysisManager.class);
-private ConcurrentMap>
analysisJobIdToTaskMap = new ConcurrentHashMap<>();
+// Tracking running manually submitted async tasks, keep in mem only
+private final ConcurrentMap>
analysisJobIdToTaskMap = new ConcurrentHashMap<>();
private StatisticsCache statisticsCache;
private AnalysisTaskExecutor taskExecutor;
+// Store task information in metadata.
private final Map analysisTaskInfoMap =
Collections.synchronizedMap(new TreeMap<>());
+
+// Store job information in metadata
private final Map analysisJobInfoMap =
Collections.synchronizedMap(new TreeMap<>());
+// Tracking system submitted job, keep in mem only
private final Map systemJobInfoMap = new
ConcurrentHashMap<>();
+// Tracking and control sync analyze tasks, keep in mem only
private final ConcurrentMap
ctxToSyncTask = new ConcurrentHashMap<>();
private final Function userJobStatusUpdater = w
-> {
@@ -127,6 +133,10 @@ public class AnalysisManager extends Daemon implements
Writable {
}
info.lastExecTimeInMs = time;
AnalysisInfo job = analysisJobInfoMap.get(info.jobId);
+// Job may get deleted during execution.
+if (job == null) {
+return null;
+}
// Synchronize the job state change in job level.
synchronized (job) {
job.lastExecTimeInMs = time;
@@ -333,8 +343,6 @@ public class AnalysisManager extends Daemon implements
Writable {
if (!isSync) {
persistAnalysisJob(jobInfo);
analysisJobIdToTaskMap.put(jobInfo.jobId, analysisTaskInfos);
-}
-if (!isSync) {
try {
updateTableStats(jobInfo);
} catch (Throwable e) {
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/statistics/OlapAnalysisTask.java
b/fe/fe-core/src/main/java/org/apache/doris/statistics/OlapAnalysisTask.java
index 257708de54..71b1191565 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/statistics/OlapAnalysisTask.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/statistics/OlapAnalysisTask.java
@@ -67,7 +67,7 @@ public class OlapAnalysisTask extends BaseAnalysisTask {
params.put("colName", String.valueOf(info.colName));
params.put("tblName", String.valueOf(info.tblName));
params.put("sampleExpr", getSampleExpression());
-List partitionAnalysisSQLs = new ArrayList<>();
+List sqls = new ArrayList<>();
try {
tbl.readLock();
Set partNames = info.colToPartitions.get(info.colName);
@@ -80,46 +80,40 @@ public class OlapAnalysisTask extends BaseAnalysisTask {
// Avoid error when get the default partition
params.put("partName", "`" + partName + "`");
StringSubstitutor stringSubstitutor = new
StringSubstitutor(params);
-
partitionAnalysisSQLs.add(stringSubstitutor.replace(ANALYZE_PARTITION_SQL_TEMPLATE));
+
sqls.add(stringSubstitutor.replace(ANALYZE_PARTITION_SQL_TEMPLATE));
}
} finally {
tbl.readUnlock();
}
-execSQLs(partitionAnalysisSQLs);
params.remove("partId");
params.put("type", col.getType().toString());
StringSubstitutor stringSubstitutor = new StringSubstitutor(params);
String sql = stringSubstitutor.replace(ANALYZE_COLUMN_SQL_TEMPLATE);
-execSQL(
[GitHub] [doris] wsjz commented on pull request #22814: [fix](multi-catalog)fix jdbc loader for scanner class loader
wsjz commented on PR #22814: URL: https://github.com/apache/doris/pull/22814#issuecomment-1672672717 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22729: [feature](cast) remove some unused in functioncast and support some function in nereids
hello-stephen commented on PR #22729: URL: https://github.com/apache/doris/pull/22729#issuecomment-1672674794 2.0上也有这个问题，需要合入 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] catpineapple opened a new pull request, #22815: [fix](dbt) fix dbt doris user non-root user permission for show sql
catpineapple opened a new pull request, #22815: URL: https://github.com/apache/doris/pull/22815 ## Proposed changes Issue Number: close #xxx fix dbt doris user non-root user permission for show sql at incremental model ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22814: [fix](multi-catalog)fix jdbc loader for scanner class loader
github-actions[bot] commented on PR #22814: URL: https://github.com/apache/doris/pull/22814#issuecomment-1672680289 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] catpineapple commented on pull request #22815: [fix](dbt) fix dbt doris user non-root user permission for show sql
catpineapple commented on PR #22815: URL: https://github.com/apache/doris/pull/22815#issuecomment-1672680381 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yuanchanggang opened a new issue, #22816: [Bug] doris1.2.4.1upgrade1.2.6 Segmentation fault 错误
yuanchanggang opened a new issue, #22816: URL: https://github.com/apache/doris/issues/22816 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version doris 1.2.4.1 os：centos7.9 x64 jdk：11.0.14 node ：3be + 3fe ### What's Wrong? [root@iZwz9eo5hrxzgj3hm885asZ doris-be]# bin/start_be.sh SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/data/doris/doris-be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/data/doris/doris-be/lib/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory] I0810 14:57:28.462283 3068 daemon.cpp:432] version doris-1.2.6-rc03(AVX2) RELEASE (build file://VM-10-6-centos@Unknown) Built on Thu, 13 Jul 2023 14:45:18 UTC by VM-10-6-centos I0810 14:57:28.463495 3068 mem_info.cpp:302] Physical Memory: 61.76 GB, Mem Limit: 49.41 GB, origin config value: 80%, System Mem Available Min Reserve: 1.60 GB, Vm Min Free KBytes: 66.00 MB I0810 14:57:28.464975 3068 daemon.cpp:465] Cpu Info: Model: Intel(R) Xeon(R) Platinum 8369B CPU @ 2.70GHz Cores: 8 Max Possible Cores: 8 L1 Cache: 48.00 KB (Line: 64.00 B) L2 Cache: 1.25 MB (Line: 64.00 B) L3 Cache: 48.00 MB (Line: 64.00 B) Hardware Supports: ssse3 sse4_1 sse4_2 popcnt avx avx2 Numa Nodes: 1 Numa Nodes of Cores: 0->0 | 1->0 | 2->0 | 3->0 | 4->0 | 5->0 | 6->0 | 7->0 | I0810 14:57:28.465071 3068 daemon.cpp:466] Disk Info: Num disks 2: vda, vdb I0810 14:57:28.465080 3068 daemon.cpp:467] Physical Memory: 61.76 GB Memory Limt: 49.41 GB CGroup Info: Process CGroup Info: memory.limit_in_bytes=9223372036854771712, cpu cfs limits: unlimited I0810 14:57:28.466388 3068 backend_options.cpp:88] priority cidrs in conf: 192.168.0.0/24 I0810 14:57:28.466456 3068 backend_options.cpp:76] local host ip=192.168.0.12 I0810 14:57:28.470665 3068 exec_env_init.cpp:108] scan thread pool use PriorityWorkStealingThreadPool I0810 14:57:28.481652 3416 fragment_mgr.cpp:850] FragmentMgr cancel worker start working. I0810 14:57:28.513559 3068 load_path_mgr.cpp:59] Load path configured to [/data/doris/doris-be/doris-be-date/mini_download] I0810 14:57:28.513563 3493 result_buffer_mgr.cpp:149] result buffer manager cancel thread begin. I0810 14:57:28.518159 3068 exec_env_init.cpp:242] Buffer pool memory limit: 9.88 GB, origin config value: 20%. clean pages limit: 4.94 GB, origin config value: 50% I0810 14:57:28.518208 3068 exec_env_init.cpp:259] Storage page cache memory limit: 9.88 GB, origin config value: 20% I0810 14:57:28.518213 3068 exec_env_init.cpp:275] segment_cache_capacity = fd_number / 3 * 2, fd_number: 65536 segment_cache_capacity: 43690 I0810 14:57:28.518383 3068 tmp_file_mgr.cc:113] Using scratch directory /data/doris/doris-be/doris-be-date/doris-scratch on disk 1 I0810 14:57:28.518399 3068 exec_env_init.cpp:296] Chunk allocator memory limit: 0, origin config value: 0 I0810 14:57:28.518750 3068 storage_engine.cpp:97] starting backend using uid:4048dc2e6f8417a7-12e5e2b4ca2c9194 I0810 14:57:28.518852 3647 data_dir.cpp:745] path: /data/doris/doris-be/doris-be-date total capacity: 739688570880, available capacity: 289289785344 I0810 14:57:28.518909 3647 data_dir.cpp:192] path: /data/doris/doris-be/doris-be-date, hash: 15642296719644422594 *** Query id: 0-0 *** *** Aborted at 1691650648 (unix time) try "date -d @1691650648" if you are using GNU date *** *** Current BE git commitID: Unknown *** *** SIGSEGV address not mapped to object (@0x0) received by PID 3068 (TID 0x7fd42bfe0700) from PID 0; stack trace: *** I0810 14:57:28.567337 3105 daemon.cpp:233] OS physical memory 61.76 GB. Process memory usage 406.12 MB, limit 49.41 GB, soft limit 44.47 GB. Sys available memory 59.99 GB, low water mark 1.60 GB, warning water mark 3.20 GB. Refresh interval memory growth 0 B I0810 14:57:28.868630 3105 daemon.cpp:233] OS physical memory 61.76 GB. Process memory usage 523.42 MB, limit 49.41 GB, soft limit 44.47 GB. Sys available memory 59.90 GB, low water mark 1.60 GB, warning water mark 3.20 GB. Refresh interval memory growth 0 B 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420 1# os::Linux::chained_handler(int, siginfo*, void*) in /opt/jdk-11.0.14/lib/server/libjvm.so 2# JVM_handle_linux_signal in /opt/jdk-11.0.14/lib/server/libjvm.so 3# signalHandler(int, siginfo*, void*) in /opt/jdk-11.0.14/lib/server/libj
[GitHub] [doris] github-actions[bot] commented on pull request #22761: [regresstion][external]fix jdbc cases fail external 0809
github-actions[bot] commented on PR #22761: URL: https://github.com/apache/doris/pull/22761#issuecomment-1672682197 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morningman opened a new pull request, #22817: [test](ctas) add some ut for testing varchar length in ctas
morningman opened a new pull request, #22817: URL: https://github.com/apache/doris/pull/22817 ## Proposed changes 1. If derived from a origin column, eg: `create table tbl1 as select col1 from tbl2`, the length will be same os the origin column. 2. If derived from a function, eg: `create table tbl1 as select func(col1) from tbl2`, the length will be 65533. 3. If derived from a constant value, eg: `create table tbl1 as select "abc" from tbl2`, the length will be 65533. ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morningman commented on pull request #22817: [test](ctas) add some ut for testing varchar length in ctas
morningman commented on PR #22817: URL: https://github.com/apache/doris/pull/22817#issuecomment-1672691867 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris-website] luzhijing merged pull request #287: Update invalid pics of 1.1.0 Release Note and delete Release Note of 1.1.x & 1.2.x versions
luzhijing merged PR #287: URL: https://github.com/apache/doris-website/pull/287 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-website] branch master updated: Update invalid pics of 1.1.0 Release Note and delete Release Note of 1.1.x & 1.2.x versions (#287)
This is an automated email from the ASF dual-hosted git repository.
luzhijing pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new b9f294d18f5 Update invalid pics of 1.1.0 Release Note and delete
Release Note of 1.1.x & 1.2.x versions (#287)
b9f294d18f5 is described below
commit b9f294d18f507bd6209e210d7472815c9e835a3c
Author: KassieZ <139741991+kass...@users.noreply.github.com>
AuthorDate: Thu Aug 10 15:21:28 2023 +0800
Update invalid pics of 1.1.0 Release Note and delete Release Note of 1.1.x
& 1.2.x versions (#287)
---
blog/release-1.1.1.md | 80 -
blog/release-1.1.2.md | 87 -
blog/release-1.1.3.md | 95 --
blog/release-1.1.4.md | 72
blog/release-1.1.5.md | 67 ---
blog/release-1.2.1.md | 197 -
blog/release-1.2.3.md | 128 -
blog/release-note-0.15.0.md| 5 +-
blog/release-note-1.0.0.md | 4 +-
blog/{1.1 Release.md => release-note-1.1.0.md} | 10 +-
blog/{release-1.2.0.md => release-note-1.2.0.md} | 6 +-
doris | 1 +
.../images/blogs/1.1.0/release-note-1.1.0-SSB.png | Bin 0 -> 92682 bytes
.../blogs/1.1.0/release-note-1.1.0-TPC-H.png | Bin 0 -> 83881 bytes
static/images/release-note-1.1.0-SSB.png | Bin 0 -> 92682 bytes
static/images/release-note-1.1.0-TPC-H.png | Bin 0 -> 83881 bytes
static/images/release-note-2.0beta-1.png | Bin 0 -> 32512 bytes
static/images/release-note-2.0beta-es-log.png | Bin 0 -> 140213 bytes
static/images/release-note-2.0beta-jdbc.png| Bin 0 -> 15034 bytes
.../release-note-2.0beta-log-queue-group.png | Bin 0 -> 185793 bytes
static/images/release-note-2.0beta-ssb-orc.png | Bin 0 -> 12966 bytes
static/images/release-note-2.0beta-ssb-parquet.png | Bin 0 -> 11536 bytes
static/images/release-note-2.0beta-workload.png| Bin 0 -> 143116 bytes
static/images/release-note-2.0beta-ycsb-qps.png| Bin 0 -> 58271 bytes
24 files changed, 16 insertions(+), 736 deletions(-)
diff --git a/blog/release-1.1.1.md b/blog/release-1.1.1.md
deleted file mode 100644
index 38921c0a658..000
--- a/blog/release-1.1.1.md
+++ /dev/null
@@ -1,80 +0,0 @@
-{
-'title': 'Apache Doris announced the official release of version 1.1.1',
-'summary': 'Dear community, we are pleased to announce that we have
officially released Apache Doris 1.1.1 on July 29, 2022! This release is a
hotfix version of 1.1.0',
-'date': '2022-07-29',
-'author': 'Apache Doris',
-'tags': ['Release Notes'],
-}
-
-
-## Features
-
-### Support ODBC Sink in Vectorized Engine.
-
-This feature is enabled in non-vectorized engine but it is missed in
vectorized engine in 1.1. So that we add back this feature in 1.1.1.
-
-### Simple Memtracker for Vectorized Engine.
-
-There is no memtracker in BE for vectorized engine in 1.1, so that the memory
is out of control and cause OOM. In 1.1.1, a simple memtracker is added to BE
and could control the memory and cancel the query when memory exceeded.
-
-## Improvements
-
-### Cache decompressed data in page cache.
-
-Some data is compressed using bitshuffle and it costs a lot of time to
decompress it during query. In 1.1.1, doris will decompress the data that
encoded by bitshuffle to accelerate query and we find it could reduce 30%
latency for some query in ssb-flat.
-
-## Bug Fix
-
-### Fix the problem that could not do rolling upgrade from 1.0.(Serious)
-
-This issue was introduced in version 1.1 and may cause BE core when upgrade BE
but not upgrade FE.
-
-If you encounter this problem, you can try to fix it with
[#10833](https://github.com/apache/doris/pull/10833).
-
-### Fix the problem that some query not fall back to non-vectorized engine,
and BE will core.
-
-Currently, vectorized engine could not deal with all sql queries and some
queries (like left outer join) will use non-vectorized engine to run. But there
are some cases not covered in 1.1. And it will cause be crash.
-
-### Compaction not work correctly and cause -235 Error.
-
-One rowset multi segments in uniq key compaction, segments rows will be merged
in generic_iterator but merged_rows not increased. Compaction will failed in
check_correctness, and make a tablet with too much versions which lead to -235
load error.
-
-### Some segment fault cases during query.
-
-[#10961](https://github.com/apache/doris/pull/10961)
-[#10954](https://github.com/apache/doris/pull/10954)
-[#10962](https://github.com/apache/doris/pull/10962)
-
-# Thanks
-
-Thanks to everyone who has contributed to this release:
-
-```
-@j
[GitHub] [doris] github-actions[bot] commented on pull request #22804: [docs](docs) Update invalid pics of release note 1.1.0 and 2.0-beta
github-actions[bot] commented on PR #22804: URL: https://github.com/apache/doris/pull/22804#issuecomment-1672694275 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22804: [docs](docs) Update invalid pics of release note 1.1.0 and 2.0-beta
github-actions[bot] commented on PR #22804: URL: https://github.com/apache/doris/pull/22804#issuecomment-1672694328 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt merged pull request #22761: [regresstion][external]fix jdbc cases fail external 0809
BiteThet merged PR #22761: URL: https://github.com/apache/doris/pull/22761 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated (ec0cedab51 -> de5603da6b)
This is an automated email from the ASF dual-hosted git repository. panxiaolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from ec0cedab51 [opt](stats) Use single connect context for each olap analyze task add de5603da6b [regresstion][external]fix jdbc cases fail external 0809 (#22761) No new revisions were added by this update. Summary of changes: .../docker-compose/sqlserver/init/04-insert.sql| 1 + .../docker-compose/sqlserver/sqlserver.yaml.tpl| 27 +- .../pipeline/p0/conf/regression-conf.groovy| 3 ++- .../hive/test_hive_schema_evolution.groovy | 3 ++- .../jdbc/test_clickhouse_jdbc_catalog.groovy | 8 +++ .../jdbc/test_doris_jdbc_catalog.groovy| 8 +++ .../jdbc/test_jdbc_query_mysql.groovy | 8 +++ .../jdbc/test_mysql_jdbc_catalog.groovy| 7 +++--- .../jdbc/test_mysql_jdbc_catalog_nereids.groovy| 6 ++--- .../jdbc/test_oracle_jdbc_catalog.groovy | 6 ++--- .../jdbc/test_pg_jdbc_catalog.groovy | 8 +++ .../jdbc/test_sqlserver_jdbc_catalog.groovy| 6 ++--- .../suites/nereids_p0/show/test_show_where.groovy | 10 +--- .../suites/query_p0/show/test_show_where.groovy| 10 +--- 14 files changed, 74 insertions(+), 37 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] CalvinKirs commented on a diff in pull request #22785: [Feature](Routine Load)Support Partial Update
CalvinKirs commented on code in PR #22785:
URL: https://github.com/apache/doris/pull/22785#discussion_r1289675546
##
fe/fe-core/src/main/java/org/apache/doris/analysis/CreateRoutineLoadStmt.java:
##
@@ -339,6 +353,9 @@ public void checkDBTable(Analyzer analyzer) throws
AnalysisException {
&& !(table.getType() == Table.TableType.OLAP && ((OlapTable)
table).hasDeleteSign())) {
throw new AnalysisException("load by MERGE or DELETE need to
upgrade table to support batch delete.");
}
+if (isPartialUpdate && ((OlapTable) table).getKeysType() !=
KeysType.UNIQUE_KEYS) {
Review Comment:
thx, PTAL again:)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] CalvinKirs commented on pull request #22785: [Feature](Routine Load)Support Partial Update
CalvinKirs commented on PR #22785: URL: https://github.com/apache/doris/pull/22785#issuecomment-1672703848 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dataroaring merged pull request #22700: [fix](tablet report) fix not add replicas when a backend re join the cluster after changing its ip or port
dataroaring merged PR #22700: URL: https://github.com/apache/doris/pull/22700 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [fix](tablet report) fix not add replicas when a backend re join the cluster after changing its ip or port (#22700)
This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 50fbe31f93 [fix](tablet report) fix not add replicas when a backend re
join the cluster after changing its ip or port (#22700)
50fbe31f93 is described below
commit 50fbe31f9311da941abe9c6e6a01cb8446c9c738
Author: yujun
AuthorDate: Thu Aug 10 15:29:28 2023 +0800
[fix](tablet report) fix not add replicas when a backend re join the
cluster after changing its ip or port (#22700)
---
.../org/apache/doris/master/ReportHandler.java | 25 +++---
1 file changed, 22 insertions(+), 3 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/master/ReportHandler.java
b/fe/fe-core/src/main/java/org/apache/doris/master/ReportHandler.java
index 3a9c01eb3c..b78cbddb38 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/master/ReportHandler.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/master/ReportHandler.java
@@ -1188,7 +1188,21 @@ public class ReportHandler extends Daemon {
Pair status =
tablet.getHealthStatusWithPriority(infoService,
visibleVersion, replicaAlloc, aliveBeIds);
-if (isColocateBackend || status.first ==
TabletStatus.VERSION_INCOMPLETE
+// FORCE_REDUNDANT is a specific missing case.
+// So it can add replica when it's in FORCE_REDUNDANT.
+// But must be careful to avoid: delete a replica then add it
back, then repeat forever.
+// If this replica is sched available and existing another replica
is sched unavailable,
+// it's safe to add this replica.
+// Because if the tablet scheduler want to delete a replica, it
will choose the sched
+// unavailable replica and avoid the repeating loop as above.
+boolean canAddForceRedundant = status.first ==
TabletStatus.FORCE_REDUNDANT
+&& infoService.checkBackendScheduleAvailable(backendId)
+&& tablet.getReplicas().stream().anyMatch(
+r ->
!infoService.checkBackendScheduleAvailable(r.getBackendId()));
+
+if (isColocateBackend
+|| canAddForceRedundant
+|| status.first == TabletStatus.VERSION_INCOMPLETE
|| status.first == TabletStatus.REPLICA_MISSING
|| status.first == TabletStatus.UNRECOVERABLE) {
long lastFailedVersion = -1L;
@@ -1264,7 +1278,10 @@ public class ReportHandler extends Daemon {
Env.getCurrentEnv().getEditLog().logAddReplica(info);
-LOG.info("add replica[{}-{}] to catalog. backend[{}]",
tabletId, replicaId, backendId);
+LOG.info("add replica[{}-{}] to catalog. backend[{}], tablet
status {}, tablet size {}, "
++ "is colocate backend {}",
+tabletId, replicaId, backendId, status.first.name(),
tablet.getReplicas().size(),
+isColocateBackend);
return true;
} else {
// replica is enough. check if this tablet is already in meta
@@ -1275,7 +1292,9 @@ public class ReportHandler extends Daemon {
return true;
}
}
-LOG.warn("replica is enough[{}-{}]",
tablet.getReplicas().size(), replicaAlloc.toCreateStmt());
+LOG.warn("no add replica [{}-{}] cause it is enough[{}-{}],
tablet status {}",
+tabletId, replicaId, tablet.getReplicas().size(),
replicaAlloc.toCreateStmt(),
+status.first.name());
return false;
}
} finally {
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22785: [Feature](Routine Load)Support Partial Update
github-actions[bot] commented on PR #22785: URL: https://github.com/apache/doris/pull/22785#issuecomment-1672705094 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22785: [Feature](Routine Load)Support Partial Update
github-actions[bot] commented on PR #22785: URL: https://github.com/apache/doris/pull/22785#issuecomment-1672705202 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt opened a new pull request, #22818: [Bug](decimalv3) fix decimalv3 keyrange set wring number
BiteThet opened a new pull request, #22818: URL: https://github.com/apache/doris/pull/22818 ## Proposed changes wrong:  right:  ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt commented on pull request #22818: [Bug](decimalv3) fix decimalv3 keyrange set wring number
BiteThet commented on PR #22818: URL: https://github.com/apache/doris/pull/22818#issuecomment-1672707742 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22818: [Bug](decimalv3) fix decimalv3 keyrange set wring number
github-actions[bot] commented on PR #22818: URL: https://github.com/apache/doris/pull/22818#issuecomment-1672713920 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22282: [Enhancement](merge-on-write) add correctness check for the calculation of delete bitmap
github-actions[bot] commented on PR #22282: URL: https://github.com/apache/doris/pull/22282#issuecomment-1672713605 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22818: [Bug](decimalv3) fix decimalv3 keyrange set wring number
github-actions[bot] commented on PR #22818: URL: https://github.com/apache/doris/pull/22818#issuecomment-1672713862 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaijchen commented on pull request #22805: [refactor](load) split rowset builder out of delta writer
kaijchen commented on PR #22805: URL: https://github.com/apache/doris/pull/22805#issuecomment-1672714808 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaka11chen opened a new pull request, #22819: [Fix](multi-catalog) Fix decimal precision issue in regression test result.
kaka11chen opened a new pull request, #22819: URL: https://github.com/apache/doris/pull/22819 ## Proposed changes Fix decimal precision issue in regression test result. ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaka11chen commented on pull request #22819: [Fix](multi-catalog) Fix decimal precision issue in regression test result.
kaka11chen commented on PR #22819: URL: https://github.com/apache/doris/pull/22819#issuecomment-1672716457 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22818: [Bug](decimalv3) fix decimalv3 keyrange set wring number
github-actions[bot] commented on PR #22818: URL: https://github.com/apache/doris/pull/22818#issuecomment-1672719525 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen opened a new pull request, #22820: [fix](case) test_big_kv_map，add sync after streamload
hello-stephen opened a new pull request, #22820: URL: https://github.com/apache/doris/pull/22820 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22820: [fix](case) test_big_kv_map，add sync after streamload
hello-stephen commented on PR #22820: URL: https://github.com/apache/doris/pull/22820#issuecomment-1672721813 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wsjz opened a new pull request, #22821: [docs](kerberos)add FAQ cases and enable krb5 debug
wsjz opened a new pull request, #22821: URL: https://github.com/apache/doris/pull/22821 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen closed pull request #22820: [fix](case) test_big_kv_map，add sync after streamload
hello-stephen closed pull request #22820: [fix](case) test_big_kv_map，add sync after streamload URL: https://github.com/apache/doris/pull/22820 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangguoqiang666 opened a new pull request, #22822: [regression]disable p0 case window_function 0810
zhangguoqiang666 opened a new pull request, #22822: URL: https://github.com/apache/doris/pull/22822 ## Proposed changes Issue Number: close #xxx disable p0 case window_function ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wsjz commented on pull request #22821: [docs](kerberos)add FAQ cases and enable krb5 debug
wsjz commented on PR #22821: URL: https://github.com/apache/doris/pull/22821#issuecomment-1672726038 Wait for docs ready -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangguoqiang666 commented on pull request #22822: [regression]disable p0 case window_function 0810
zhangguoqiang666 commented on PR #22822: URL: https://github.com/apache/doris/pull/22822#issuecomment-1672726170 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22805: [refactor](load) split rowset builder out of delta writer
github-actions[bot] commented on PR #22805: URL: https://github.com/apache/doris/pull/22805#issuecomment-1672726474 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wolfboys commented on pull request #22744: [fix](stream_log)fix bug that csv_reader parse line in order to get column
wolfboys commented on PR #22744: URL: https://github.com/apache/doris/pull/22744#issuecomment-1672728523 This PR is very important for migrating data to Doris. Thank you for your contribution! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22790: [fix](regression) fix export case
hello-stephen commented on PR #22790: URL: https://github.com/apache/doris/pull/22790#issuecomment-1672732454 2.0也需要合入 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22504: [feature](partial update) support partial update different columns for each row in one stream load
github-actions[bot] commented on PR #22504: URL: https://github.com/apache/doris/pull/22504#issuecomment-1672732559 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22817: [test](ctas) add some ut for testing varchar length in ctas
github-actions[bot] commented on PR #22817: URL: https://github.com/apache/doris/pull/22817#issuecomment-1672735723 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangguoqiang666 closed pull request #22743: [regresstion][external]skip core external case test_transactional_hive 0808
zhangguoqiang666 closed pull request #22743: [regresstion][external]skip core external case test_transactional_hive 0808 URL: https://github.com/apache/doris/pull/22743 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22791: [fix][alter table property] fix alter table property failed
github-actions[bot] commented on PR #22791: URL: https://github.com/apache/doris/pull/22791#issuecomment-1672741269 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangstar333 opened a new pull request, #22823: [bug](if) fix if function not handle const nullable value
zhangstar333 opened a new pull request, #22823: URL: https://github.com/apache/doris/pull/22823 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22798: [Feature](CCR) Support MoW for CCR
github-actions[bot] commented on PR #22798: URL: https://github.com/apache/doris/pull/22798#issuecomment-1672742240 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22798: [Feature](CCR) Support MoW for CCR
github-actions[bot] commented on PR #22798: URL: https://github.com/apache/doris/pull/22798#issuecomment-1672742339 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangstar333 commented on pull request #22823: [bug](if) fix if function not handle const nullable value
zhangstar333 commented on PR #22823: URL: https://github.com/apache/doris/pull/22823#issuecomment-1672742396 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22811: [fix](Nereids) push agg to meta scan is not work well
hello-stephen commented on PR #22811: URL: https://github.com/apache/doris/pull/22811#issuecomment-1672745475 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 45.45 seconds stream load tsv: 510 seconds loaded 74807831229 Bytes, about 139 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.2 seconds inserted 1000 Rows, about 342K ops/s storage size: 17162164592 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22814: [fix](multi-catalog)fix jdbc loader for scanner class loader
hello-stephen commented on PR #22814: URL: https://github.com/apache/doris/pull/22814#issuecomment-1672746911 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.8 seconds stream load tsv: 512 seconds loaded 74807831229 Bytes, about 139 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.3 seconds inserted 1000 Rows, about 341K ops/s storage size: 17162018398 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22817: [test](ctas) add some ut for testing varchar length in ctas
hello-stephen commented on PR #22817: URL: https://github.com/apache/doris/pull/22817#issuecomment-1672746956 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 46 seconds stream load tsv: 512 seconds loaded 74807831229 Bytes, about 139 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s insert into select: 29.3 seconds inserted 1000 Rows, about 341K ops/s storage size: 17162193034 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaijchen commented on pull request #22805: [refactor](load) split rowset builder out of delta writer
kaijchen commented on PR #22805: URL: https://github.com/apache/doris/pull/22805#issuecomment-1672747432 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22823: [bug](if) fix if function not handle const nullable value
github-actions[bot] commented on PR #22823: URL: https://github.com/apache/doris/pull/22823#issuecomment-1672748694 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22823: [bug](if) fix if function not handle const nullable value
github-actions[bot] commented on PR #22823: URL: https://github.com/apache/doris/pull/22823#issuecomment-1672748761 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Mryange commented on pull request #22824: [fix](case) add order by in test_javaudaf_return_map
Mryange commented on PR #22824: URL: https://github.com/apache/doris/pull/22824#issuecomment-1672750132 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Mryange opened a new pull request, #22824: [fix](case) add order by in test_javaudaf_return_map
Mryange opened a new pull request, #22824: URL: https://github.com/apache/doris/pull/22824 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangstar333 commented on pull request #22823: [bug](if) fix if function not handle const nullable value
zhangstar333 commented on PR #22823: URL: https://github.com/apache/doris/pull/22823#issuecomment-1672751081 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22823: [bug](if) fix if function not handle const nullable value
github-actions[bot] commented on PR #22823: URL: https://github.com/apache/doris/pull/22823#issuecomment-1672753247 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Mryange opened a new pull request, #22825: [feature](cast) remove some unused in functioncast and support some function in nereids
Mryange opened a new pull request, #22825: URL: https://github.com/apache/doris/pull/22825 ## Proposed changes pick from https://github.com/apache/doris/pull/22729 ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22825: [feature](cast) remove some unused in functioncast and support some function in nereids
hello-stephen commented on PR #22825: URL: https://github.com/apache/doris/pull/22825#issuecomment-1672755721 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22805: [refactor](load) split rowset builder out of delta writer
github-actions[bot] commented on PR #22805: URL: https://github.com/apache/doris/pull/22805#issuecomment-1672755751 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] HappenLee opened a new pull request, #22826: [pipeline](exec) Support shared scan in jdbc and odbc scan node
HappenLee opened a new pull request, #22826: URL: https://github.com/apache/doris/pull/22826 ## Proposed changes Support shared scan in jdbc and odbc scan node to improve exec performance ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] HappenLee commented on pull request #22826: [pipeline](exec) Support shared scan in jdbc and odbc scan node
HappenLee commented on PR #22826: URL: https://github.com/apache/doris/pull/22826#issuecomment-1672760811 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22823: [bug](if) fix if function not handle const nullable value
github-actions[bot] commented on PR #22823: URL: https://github.com/apache/doris/pull/22823#issuecomment-1672760835 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22825: [feature](cast) remove some unused in functioncast and support some function in nereids
github-actions[bot] commented on PR #22825: URL: https://github.com/apache/doris/pull/22825#issuecomment-1672763925 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] bobhan1 opened a new pull request, #22827: [fix](autoinc) ignore column property `isAutoInc()` for `create table as select ...` statement
bobhan1 opened a new pull request, #22827: URL: https://github.com/apache/doris/pull/22827 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] bobhan1 commented on pull request #22827: [fix](autoinc) ignore column property `isAutoInc()` for `create table as select ...` statement
bobhan1 commented on PR #22827: URL: https://github.com/apache/doris/pull/22827#issuecomment-1672767766 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] CalvinKirs commented on pull request #22785: [Feature](Routine Load)Support Partial Update
CalvinKirs commented on PR #22785: URL: https://github.com/apache/doris/pull/22785#issuecomment-1672767824 run clickbench-new (clickbench) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22805: [refactor](load) split rowset builder out of delta writer
hello-stephen commented on PR #22805: URL: https://github.com/apache/doris/pull/22805#issuecomment-1672770933 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 48.57 seconds stream load tsv: 541 seconds loaded 74807831229 Bytes, about 131 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.2 seconds inserted 1000 Rows, about 342K ops/s storage size: 17162202966 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22296: [enhance](S3FIleWriter) Add md5 check for small file not suitable for multi part upload
github-actions[bot] commented on PR #22296: URL: https://github.com/apache/doris/pull/22296#issuecomment-1672782800 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] amorynan commented on pull request #22793: [new-feature](complex-type) support read nested parquet and orc file with complex type
amorynan commented on PR #22793: URL: https://github.com/apache/doris/pull/22793#issuecomment-1672784860 run clickbench -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22822: [regression]disable p0 case window_function 0810
github-actions[bot] commented on PR #22822: URL: https://github.com/apache/doris/pull/22822#issuecomment-1672787965 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wangbo opened a new pull request, #22828: (fix)[executor]Fix query hang when query bitmap Orth intersect
wangbo opened a new pull request, #22828:
URL: https://github.com/apache/doris/pull/22828
## Proposed changes
```
drop TABLE if exists test1;
CREATE TABLE test1 (
dt1 date NOT NULL,
dt2 date NOT NULL,
id varchar(256) NULL,
type smallint(6) MAX NULL,
id_bitmap bitmap BITMAP_UNION NULL
) ENGINE = OLAP AGGREGATE KEY(dt1, dt2, id) PARTITION BY RANGE(dt1) (
PARTITION p20230725
VALUES
[('2023-07-25'), ('2023-07-26')))
DISTRIBUTED BY HASH(dt1, dt2) BUCKETS 1 properties("replication_num"="1");
insert into test1
select
str_to_date('2023-07-25','%Y-%m-%d') as dt1,
str_to_date('2023-07-25','%Y-%m-%d') as dt2,
'aa' as id,
1 as type,
BITMAP_HASH64('aa') as id_bitmap;
set experimental_enable_nereids_planner=false;
set experimental_enable_pipeline_engine = true;
select count(distinct id),
bitmap_count(orthogonal_bitmap_intersect(id_bitmap, type, 1)) as count2_bitmap
from test1;
```
Query will hang, because this sql contains two orthogonal_bitmap_intersect,
this is not correct usage.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22823: [bug](if) fix if function not handle const nullable value
hello-stephen commented on PR #22823: URL: https://github.com/apache/doris/pull/22823#issuecomment-1672787326 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 45.91 seconds stream load tsv: 512 seconds loaded 74807831229 Bytes, about 139 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s insert into select: 28.9 seconds inserted 1000 Rows, about 346K ops/s storage size: 17162229221 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22822: [regression]disable p0 case window_function 0810
github-actions[bot] commented on PR #22822: URL: https://github.com/apache/doris/pull/22822#issuecomment-1672787897 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22805: [refactor](load) split rowset builder out of delta writer
hello-stephen commented on PR #22805: URL: https://github.com/apache/doris/pull/22805#issuecomment-1672788369 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 46.65 seconds stream load tsv: 509 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s insert into select: 29.6 seconds inserted 1000 Rows, about 337K ops/s storage size: 17162227564 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22827: [fix](autoinc) ignore column property `isAutoInc()` for `create table as select ...` statement
github-actions[bot] commented on PR #22827: URL: https://github.com/apache/doris/pull/22827#issuecomment-1672791958 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22827: [fix](autoinc) ignore column property `isAutoInc()` for `create table as select ...` statement
github-actions[bot] commented on PR #22827: URL: https://github.com/apache/doris/pull/22827#issuecomment-1672792017 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22566: [enhancement](MOW) refactor delete bitmap calculator and enhance the deletion bitmap calculation for full duplicate load
github-actions[bot] commented on PR #22566: URL: https://github.com/apache/doris/pull/22566#issuecomment-1672792169 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dataroaring merged pull request #22519: [enhance](ColdHeatSeparation) forbid change storage policy to another one with different storage resource
dataroaring merged PR #22519: URL: https://github.com/apache/doris/pull/22519 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [enhance](ColdHeatSeparation) forbid change storage policy to another one with different storage resource (#22519)
This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new fd0c161081 [enhance](ColdHeatSeparation) forbid change storage policy
to another one with different storage resource (#22519)
fd0c161081 is described below
commit fd0c1610812cd033cab3a73626b56e29830ee951
Author: AlexYue
AuthorDate: Thu Aug 10 16:32:09 2023 +0800
[enhance](ColdHeatSeparation) forbid change storage policy to another one
with different storage resource (#22519)
---
.../apache/doris/common/util/PropertyAnalyzer.java | 26 +-
.../java/org/apache/doris/alter/AlterTest.java | 11 -
2 files changed, 35 insertions(+), 2 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/common/util/PropertyAnalyzer.java
b/fe/fe-core/src/main/java/org/apache/doris/common/util/PropertyAnalyzer.java
index 1b8d45f569..f916d13336 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/common/util/PropertyAnalyzer.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/common/util/PropertyAnalyzer.java
@@ -190,7 +190,11 @@ public class PropertyAnalyzer {
TStorageMedium storageMedium = oldDataProperty.getStorageMedium();
long cooldownTimestamp = oldDataProperty.getCooldownTimeMs();
-String newStoragePolicy = oldDataProperty.getStoragePolicy();
+final String oldStoragePolicy = oldDataProperty.getStoragePolicy();
+// When we create one table with table's property set storage policy,
+// the properties wouldn't contain storage policy so the
hasStoragePolicy would be false,
+// then we would just set the partition's storage policy the same as
the table's
+String newStoragePolicy = oldStoragePolicy;
boolean hasStoragePolicy = false;
boolean storageMediumSpecified = false;
@@ -252,6 +256,26 @@ public class PropertyAnalyzer {
}
StoragePolicy storagePolicy = (StoragePolicy) policy;
+// Consider a scenario where if cold data has already been
uploaded to resource A,
+// and the user attempts to modify the policy to upload it to
resource B,
+// the data needs to be transferred from A to B.
+// However, Doris currently does not support cross-bucket data
transfer, therefore,
+// changing the policy to a different policy with different
resource is disabled.
+// As for the case where the resource is the same, modifying the
cooldown time is allowed,
+// as this will not affect the already cooled data, but only the
new data after modifying the policy.
+if (null != oldStoragePolicy &&
!oldStoragePolicy.equals(newStoragePolicy)) {
+// check remote storage policy
+StoragePolicy oldPolicy =
StoragePolicy.ofCheck(oldStoragePolicy);
+Policy p =
Env.getCurrentEnv().getPolicyMgr().getPolicy(oldPolicy);
+if ((p instanceof StoragePolicy)) {
+String newResource = storagePolicy.getStorageResource();
+String oldResource = ((StoragePolicy)
p).getStorageResource();
+if (!newResource.equals(oldResource)) {
+throw new AnalysisException("currently do not support
change origin "
++ "storage policy to another one with
different resource: ");
+}
+}
+}
// check remote storage cool down timestamp
if (storagePolicy.getCooldownTimestampMs() != -1) {
if (storagePolicy.getCooldownTimestampMs() <= currentTimeMs) {
diff --git a/fe/fe-core/src/test/java/org/apache/doris/alter/AlterTest.java
b/fe/fe-core/src/test/java/org/apache/doris/alter/AlterTest.java
index d18f5a57f8..af70ca249a 100644
--- a/fe/fe-core/src/test/java/org/apache/doris/alter/AlterTest.java
+++ b/fe/fe-core/src/test/java/org/apache/doris/alter/AlterTest.java
@@ -160,6 +160,10 @@ public class AlterTest {
"CREATE STORAGE POLICY testPolicy2\n" + "PROPERTIES(\n" + "
\"storage_resource\" = \"remote_s3\",\n"
+ " \"cooldown_ttl\" = \"1\"\n" + ");");
+createRemoteStoragePolicy(
+"CREATE STORAGE POLICY testPolicyAnotherResource\n" +
"PROPERTIES(\n" + " \"storage_resource\" = \"remote_s3_1\",\n"
++ " \"cooldown_ttl\" = \"1\"\n" + ");");
+
createTable("CREATE TABLE test.tbl_remote\n" + "(\n" + "k1
date,\n" + "k2 int,\n" + "v1 int sum\n"
+ ")\n" + "PARTITION BY RANGE(k1)\n" + "(\n" + "PARTITION
p1 values less than('2020-02-01'),\n"
+ "PARTITION p2 values less than('2020-03-01'),\n"
@@ -597,11 +601,16 @@ public class AlterTest {
}
Assert.a
[GitHub] [doris] hello-stephen commented on pull request #22823: [bug](if) fix if function not handle const nullable value
hello-stephen commented on PR #22823: URL: https://github.com/apache/doris/pull/22823#issuecomment-1672795873 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 47.72 seconds stream load tsv: 515 seconds loaded 74807831229 Bytes, about 138 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.2 seconds inserted 1000 Rows, about 342K ops/s storage size: 17162474411 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] mymeiyi opened a new pull request, #22829: [feature](insert) Support group commit insert
mymeiyi opened a new pull request, #22829: URL: https://github.com/apache/doris/pull/22829 ## Proposed changes Now `INSERT INTO ... VALUES ...` in Doris is a seperate load job, which will begin a transaction and write a rowset, this is costly for FE metadata, and BE io to compact many small rowsets. This PR is to solve this problem by making multi inserts be loaded in one job. Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaijchen commented on pull request #22805: [refactor](load) split rowset builder out of delta writer
kaijchen commented on PR #22805: URL: https://github.com/apache/doris/pull/22805#issuecomment-1672796955 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22828: (fix)[executor]Fix query hang when query bitmap Orth intersect
github-actions[bot] commented on PR #22828: URL: https://github.com/apache/doris/pull/22828#issuecomment-1672799477 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhannngchen merged pull request #22599: [fix](compaction) remove check rowset overlapping in base compaction
zhannngchen merged PR #22599: URL: https://github.com/apache/doris/pull/22599 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [fix](compaction) remove check rowset overlapping in base compaction (#22599)
This is an automated email from the ASF dual-hosted git repository.
zhangchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 1c22742a14 [fix](compaction) remove check rowset overlapping in base
compaction (#22599)
1c22742a14 is described below
commit 1c22742a14ef11f441c3833e74ba16108db407c3
Author: huanghaibin <284824...@qq.com>
AuthorDate: Thu Aug 10 16:36:33 2023 +0800
[fix](compaction) remove check rowset overlapping in base compaction
(#22599)
---
be/src/olap/base_compaction.cpp | 14 --
be/src/olap/base_compaction.h | 4
2 files changed, 18 deletions(-)
diff --git a/be/src/olap/base_compaction.cpp b/be/src/olap/base_compaction.cpp
index 5723752d5e..2ad83edfbf 100644
--- a/be/src/olap/base_compaction.cpp
+++ b/be/src/olap/base_compaction.cpp
@@ -122,7 +122,6 @@ void BaseCompaction::_filter_input_rowset() {
Status BaseCompaction::pick_rowsets_to_compact() {
_input_rowsets = _tablet->pick_candidate_rowsets_to_base_compaction();
RETURN_IF_ERROR(check_version_continuity(_input_rowsets));
-RETURN_IF_ERROR(_check_rowset_overlapping(_input_rowsets));
_filter_input_rowset();
if (_input_rowsets.size() <= 1) {
return Status::Error("_input_rowsets.size() is
1");
@@ -216,17 +215,4 @@ Status BaseCompaction::pick_rowsets_to_compact() {
interval_since_last_base_compaction);
}
-Status BaseCompaction::_check_rowset_overlapping(const
std::vector& rowsets) {
-for (auto& rs : rowsets) {
-if (rs->rowset_meta()->is_segments_overlapping()) {
-return Status::Error(
-"There is overlapping rowset before cumulative point,
rowset version={}-{}, "
-"cumulative point={}, tablet={}",
-rs->start_version(), rs->end_version(),
_tablet->cumulative_layer_point(),
-_tablet->full_name());
-}
-}
-return Status::OK();
-}
-
} // namespace doris
diff --git a/be/src/olap/base_compaction.h b/be/src/olap/base_compaction.h
index ecee304449..73aca0d5e1 100644
--- a/be/src/olap/base_compaction.h
+++ b/be/src/olap/base_compaction.h
@@ -52,10 +52,6 @@ protected:
ReaderType compaction_type() const override { return
ReaderType::READER_BASE_COMPACTION; }
private:
-// check if all input rowsets are non overlapping among segments.
-// a rowset with overlapping segments should be compacted by cumulative
compaction first.
-Status _check_rowset_overlapping(const vector& rowsets);
-
// filter input rowset in some case:
// 1. dup key without delete predicate
void _filter_input_rowset();
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22805: [refactor](load) split rowset builder out of delta writer
github-actions[bot] commented on PR #22805: URL: https://github.com/apache/doris/pull/22805#issuecomment-1672801622 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22566: [enhancement](MOW) refactor delete bitmap calculator and enhance the deletion bitmap calculation for full duplicate load
github-actions[bot] commented on PR #22566: URL: https://github.com/apache/doris/pull/22566#issuecomment-1672803648 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] axshor commented on issue #11305: [Bug] Only suffort '\n' for line delimiter when streamload
axshor commented on issue #11305: URL: https://github.com/apache/doris/issues/11305#issuecomment-1672805014 > is there any update for this problem, I found the same problem in 1.0.0 version I my case, if i config the line_delimiter, the streamload task is success, but the data can not be queried。 Even if I use the json format，it is still not effect what does you mean "the data can not be queried"? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22826: [pipeline](exec) Support shared scan in jdbc and odbc scan node
hello-stephen commented on PR #22826: URL: https://github.com/apache/doris/pull/22826#issuecomment-1672805713 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 44.76 seconds stream load tsv: 507 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.4 seconds inserted 1000 Rows, about 340K ops/s storage size: 17162138495 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22829: [feature](insert) Support group commit insert
github-actions[bot] commented on PR #22829: URL: https://github.com/apache/doris/pull/22829#issuecomment-1672805716 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22785: [Feature](Routine Load)Support Partial Update
hello-stephen commented on PR #22785: URL: https://github.com/apache/doris/pull/22785#issuecomment-1672809559 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 45.82 seconds stream load tsv: 508 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.4 seconds inserted 1000 Rows, about 340K ops/s storage size: 17162228900 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] jixxiong commented on pull request #22566: [enhancement](MOW) refactor delete bitmap calculator and enhance the deletion bitmap calculation for full duplicate load
jixxiong commented on PR #22566: URL: https://github.com/apache/doris/pull/22566#issuecomment-1672810672 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] englefly opened a new pull request, #22830: [fix](nereids)disable CostModelV2
englefly opened a new pull request, #22830: URL: https://github.com/apache/doris/pull/22830 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
