chaoyli commented on a change in pull request #1296: Check deserialize result
when save meta
URL: https://github.com/apache/incubator-doris/pull/1296#discussion_r293206659
##
File path: be/src/olap/tablet_meta.h
##
@@ -235,7 +237,7 @@ inline const int16_t TabletMeta::shard
chaoyli merged pull request #1296: Check deserialize result when save meta
URL: https://github.com/apache/incubator-doris/pull/1296
This is an automated message from the Apache Git Service.
To respond to the message, please l
chaoyli opened a new pull request #1297: Add copy function to support storage
migration task
URL: https://github.com/apache/incubator-doris/pull/1297
This is an automated message from the Apache Git Service.
To respond to th
yiguolei commented on a change in pull request #1297: Add copy function to
support storage migration task
URL: https://github.com/apache/incubator-doris/pull/1297#discussion_r293239307
##
File path: be/src/olap/rowset/alpha_rowset.cpp
##
@@ -219,6 +219,20 @@ OLAPStatus Alp
yiguolei commented on a change in pull request #1297: Add copy function to
support storage migration task
URL: https://github.com/apache/incubator-doris/pull/1297#discussion_r293239820
##
File path: be/src/olap/rowset/segment_group.cpp
##
@@ -723,6 +723,39 @@ OLAPStatus Se
chaoyli commented on a change in pull request #1297: Add copy function to
support storage migration task
URL: https://github.com/apache/incubator-doris/pull/1297#discussion_r293240865
##
File path: be/src/olap/rowset/alpha_rowset.cpp
##
@@ -219,6 +219,20 @@ OLAPStatus Alph
yiguolei opened a new pull request #1298: Add migration lock when migration
URL: https://github.com/apache/incubator-doris/pull/1298
This is an automated message from the Apache Git Service.
To respond to the message, please
imay commented on a change in pull request #1297: Add copy function to support
storage migration task
URL: https://github.com/apache/incubator-doris/pull/1297#discussion_r293260962
##
File path: be/src/olap/task/engine_storage_migration_task.cpp
##
@@ -219,12 +219,16 @@ OL
chaoyli commented on a change in pull request #1297: Add copy function to
support storage migration task
URL: https://github.com/apache/incubator-doris/pull/1297#discussion_r293262297
##
File path: be/src/olap/rowset/segment_group.cpp
##
@@ -723,6 +723,39 @@ OLAPStatus Seg
chaoyli commented on a change in pull request #1297: Add copy function to
support storage migration task
URL: https://github.com/apache/incubator-doris/pull/1297#discussion_r293262506
##
File path: be/src/olap/task/engine_storage_migration_task.cpp
##
@@ -219,12 +219,16 @@
kangpinghuang commented on a change in pull request #1297: Add copy function to
support storage migration task
URL: https://github.com/apache/incubator-doris/pull/1297#discussion_r293270677
##
File path: be/src/olap/rowset/alpha_rowset.h
##
@@ -85,7 +85,9 @@ class AlphaRow
morningman merged pull request #1286: Add thirdparty lib
URL: https://github.com/apache/incubator-doris/pull/1286
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub an
morningman opened a new pull request #1299: Handle the situation when there is
no enough backends for tablet repair
URL: https://github.com/apache/incubator-doris/pull/1299
In cast there are only 3 backends and replication num is 3. If one replica
of a
tablet is bad, there is no 4th bac
chaoyli merged pull request #1297: Add copy function to support storage
migration task
URL: https://github.com/apache/incubator-doris/pull/1297
This is an automated message from the Apache Git Service.
To respond to the mess
chaoyli opened a new pull request #1300: Remove olap_table.h and olap_tablet.cpp
URL: https://github.com/apache/incubator-doris/pull/1300
This is an automated message from the Apache Git Service.
To respond to the message, pl
chaoyli merged pull request #1300: Remove olap_table.h and olap_tablet.cpp
URL: https://github.com/apache/incubator-doris/pull/1300
This is an automated message from the Apache Git Service.
To respond to the message, please l
chaoyli merged pull request #1298: Add migration lock when migration
URL: https://github.com/apache/incubator-doris/pull/1298
This is an automated message from the Apache Git Service.
To respond to the message, please log on
yiguolei opened a new pull request #1301: Remove data files using olap_header
URL: https://github.com/apache/incubator-doris/pull/1301
This is an automated message from the Apache Git Service.
To respond to the message, pleas
chaoyli merged pull request #1301: Remove data files using olap_header
URL: https://github.com/apache/incubator-doris/pull/1301
This is an automated message from the Apache Git Service.
To respond to the message, please log o
chaoyli opened a new pull request #1302: Place _init_seek_columns() in right
place
URL: https://github.com/apache/incubator-doris/pull/1302
This is an automated message from the Apache Git Service.
To respond to the message,
imay merged pull request #1302: Place _init_seek_columns() in right place
URL: https://github.com/apache/incubator-doris/pull/1302
This is an automated message from the Apache Git Service.
To respond to the message, please lo
EmmyMiao87 opened a new pull request #1303: Fix the error of duplicated label
URL: https://github.com/apache/incubator-doris/pull/1303
This is an automated message from the Apache Git Service.
To respond to the message, pleas
morningman closed pull request #1299: Handle the situation when there is no
enough backends for tablet repair
URL: https://github.com/apache/incubator-doris/pull/1299
This is an automated message from the Apache Git Service.
morningman opened a new pull request #1299: Handle the situation when there is
no enough backends for tablet repair
URL: https://github.com/apache/incubator-doris/pull/1299
In cast there are only 3 backends and replication num is 3. If one replica
of a
tablet is bad, there is no 4th bac
kangpinghuang opened a new pull request #1304: Add bitshuffle page
URL: https://github.com/apache/incubator-doris/pull/1304
1. bitshuffle page
2. add CMakeLists.txt for segment_v2
3. unit tests
This is an automated messa
kangkaisen commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293649761
##
File path: fe/src/main/java/org/apache/doris/catalog/ColocateGroupSchema.java
##
@@ -0,0 +1,144 @@
+//
kangkaisen commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293651660
##
File path: fe/src/main/java/org/apache/doris/catalog/ColocateTableIndex.java
##
@@ -33,35 +42,89 @@
i
kangpinghuang opened a new issue #1305: Add new file format for storage segment
URL: https://github.com/apache/incubator-doris/issues/1305
**Is your feature request related to a problem? Please describe.**
Now the segment format in BE storage is orc-like format. There are some
problems:
kangkaisen commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293652937
##
File path: fe/src/main/java/org/apache/doris/http/meta/ColocateMetaService.java
##
@@ -54,8 +58,11 @@
kangkaisen commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293653425
##
File path: fe/src/main/java/org/apache/doris/persist/TablePropertyInfo.java
##
@@ -33,45 +37,45 @@
kangpinghuang opened a new issue #1306: Add new file format design
URL: https://github.com/apache/incubator-doris/issues/1306
To solve the problem of ISSUE #1305 , I propose a design of new file format.
Please refer to PR #1267
---
kangpinghuang closed issue #1306: Add new file format design
URL: https://github.com/apache/incubator-doris/issues/1306
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Git
kangpinghuang opened a new issue #1307: Add new file format meta design
URL: https://github.com/apache/incubator-doris/issues/1307
Parent Issue: #1305
I propose a new file meta design in protobuf, pls refer to #1268
T
kangpinghuang closed issue #1307: Add new file format meta design
URL: https://github.com/apache/incubator-doris/issues/1307
This is an automated message from the Apache Git Service.
To respond to the message, please log on t
kangpinghuang opened a new issue #1308: Add some common and options for new
file format segment
URL: https://github.com/apache/incubator-doris/issues/1308
Parent Issue #1305
pls refer to PR #1269
This is an automated
kangkaisen commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293654151
##
File path: fe/src/test/java/org/apache/doris/catalog/ColocateTableTest.java
##
@@ -477,62 +377,4 @@ pu
kangpinghuang closed issue #1308: Add some common and options for new file
format segment
URL: https://github.com/apache/incubator-doris/issues/1308
This is an automated message from the Apache Git Service.
To respond to the
kangpinghuang closed issue #1309: Add page api for new file format segment
URL: https://github.com/apache/incubator-doris/issues/1309
This is an automated message from the Apache Git Service.
To respond to the message, please
kangpinghuang opened a new issue #1309: Add page api for new file format segment
URL: https://github.com/apache/incubator-doris/issues/1309
Parent Issue #1305
include:
1. page builder api
2. page decoder api
pls refer to PR #1270
---
kangpinghuang opened a new issue #1310: Add some utils for new file format
URL: https://github.com/apache/incubator-doris/issues/1310
parent Issue #1305
Add some utils for new file format, including:
1. faststring
2. cpu
pls refer to PR #1281
---
kangpinghuang closed issue #1310: Add some utils for new file format
URL: https://github.com/apache/incubator-doris/issues/1310
This is an automated message from the Apache Git Service.
To respond to the message, please log o
kangkaisen commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293655591
##
File path: fe/src/main/java/org/apache/doris/catalog/Catalog.java
##
@@ -4109,6 +4093,13 @@ private vo
kangpinghuang opened a new issue #1311: Add some thirdparty libs for new
encoding method
URL: https://github.com/apache/incubator-doris/issues/1311
Parent Issue #1305
We want to support bitshuffle encoding and bitmap index. So we need to add
some libs:
1. add bitshuffle lib
2. ad
kangpinghuang commented on issue #1311: Add some thirdparty libs for new
encoding method
URL:
https://github.com/apache/incubator-doris/issues/1311#issuecomment-501963412
pls refer to PR #1286
This is an automated message fr
kangpinghuang closed issue #1311: Add some thirdparty libs for new encoding
method
URL: https://github.com/apache/incubator-doris/issues/1311
This is an automated message from the Apache Git Service.
To respond to the messag
morningman opened a new pull request #1312: Fix bug that FE web frontend can
not get static resource files
URL: https://github.com/apache/incubator-doris/pull/1312
This is an automated message from the Apache Git Service.
To
morningman commented on a change in pull request #1292: Support Grouping Sets,
Rollup and Cube to extend group by statement
URL: https://github.com/apache/incubator-doris/pull/1292#discussion_r292808242
##
File path: be/src/exec/repeat_node.cpp
##
@@ -0,0 +1,214 @@
+// Lic
imay closed pull request #1303: Fix the error of duplicated label
URL: https://github.com/apache/incubator-doris/pull/1303
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
EmmyMiao87 opened a new pull request #1303: Fix the error of duplicated label
URL: https://github.com/apache/incubator-doris/pull/1303
This is an automated message from the Apache Git Service.
To respond to the message, pleas
yiguolei opened a new pull request #1313: Use remove_all_dir to remote
non-empty dir
URL: https://github.com/apache/incubator-doris/pull/1313
1. Use remove_all_dir to remote non-empty dir
2. Gc should not hold write lock too much time
3. skip tablet dir if dir already exists when crea
morningman closed pull request #1299: Handle the situation when there is no
enough backends for tablet repair
URL: https://github.com/apache/incubator-doris/pull/1299
This is an automated message from the Apache Git Service.
imay merged pull request #1303: Fix the error of duplicated label
URL: https://github.com/apache/incubator-doris/pull/1303
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
morningman opened a new pull request #1299: Handle the situation when there is
no enough backends for tablet repair
URL: https://github.com/apache/incubator-doris/pull/1299
In cast there are only 3 backends and replication num is 3. If one replica
of a
tablet is bad, there is no 4th bac
chaoyli merged pull request #1313: Use remove_all_dir to remote non-empty dir
URL: https://github.com/apache/incubator-doris/pull/1313
This is an automated message from the Apache Git Service.
To respond to the message, pleas
morningman commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293686286
##
File path: fe/src/main/java/org/apache/doris/catalog/ColocateGroupSchema.java
##
@@ -0,0 +1,144 @@
+//
imay opened a new issue #1314: uniform our status in backend
URL: https://github.com/apache/incubator-doris/issues/1314
Currently, we have three Status implementation in our backends.
1. common/status.*
2. olap/new_status.*
3. olap/olap_define.h OLAPStatus
I want to unif
morningman commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293698050
##
File path: fe/src/main/java/org/apache/doris/catalog/ColocateTableIndex.java
##
@@ -33,35 +42,89 @@
i
morningman commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293699731
##
File path: fe/src/main/java/org/apache/doris/persist/TablePropertyInfo.java
##
@@ -33,45 +37,45 @@
morningman commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293699858
##
File path: fe/src/main/java/org/apache/doris/http/meta/ColocateMetaService.java
##
@@ -54,8 +58,11 @@
morningman commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293700600
##
File path: fe/src/test/java/org/apache/doris/catalog/ColocateTableTest.java
##
@@ -477,62 +377,4 @@ pu
morningman commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293700600
##
File path: fe/src/test/java/org/apache/doris/catalog/ColocateTableTest.java
##
@@ -477,62 +377,4 @@ pu
kangpinghuang opened a new issue #1315: Add bit-shuffle encoding page
URL: https://github.com/apache/incubator-doris/issues/1315
Parent Issue #1305
Bitshuffle is efficient encoding method for highly correlated data. It has
relatively high compression ratio and high throughput.
I
kangpinghuang commented on issue #1315: Add bit-shuffle encoding page
URL:
https://github.com/apache/incubator-doris/issues/1315#issuecomment-502022655
pls refer to this PR #1304
This is an automated message from the Apache
kangpinghuang opened a new issue #1316: Add rle encoding page
URL: https://github.com/apache/incubator-doris/issues/1316
Parent Issue #1305
Add run length encoding page for int type and bool type.
This is an automated mess
morningman commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293723218
##
File path: fe/src/main/java/org/apache/doris/catalog/CatalogRecycleBin.java
##
@@ -277,6 +284,12 @@ pu
morningman commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293724094
##
File path: fe/src/main/java/org/apache/doris/catalog/Catalog.java
##
@@ -4109,6 +4093,13 @@ private vo
morningman closed pull request #1312: Fix bug that FE web frontend can not get
static resource files
URL: https://github.com/apache/incubator-doris/pull/1312
This is an automated message from the Apache Git Service.
To respo
morningman opened a new pull request #1312: Fix bug that FE web frontend can
not get static resource files
URL: https://github.com/apache/incubator-doris/pull/1312
This is an automated message from the Apache Git Service.
To
kangkaisen commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293761431
##
File path: fe/src/test/java/org/apache/doris/catalog/ColocateTableTest.java
##
@@ -477,62 +377,4 @@ pu
kangkaisen commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293761473
##
File path: fe/src/main/java/org/apache/doris/catalog/Catalog.java
##
@@ -4109,6 +4093,13 @@ private vo
imay commented on a change in pull request #1289: Modify colocation creation
logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r293771381
##
File path: fe/src/main/java/org/apache/doris/http/meta/ColocateMetaService.java
##
@@ -54,8 +58,11 @@
imay merged pull request #1312: Fix bug that FE web frontend can not get static
resource files
URL: https://github.com/apache/incubator-doris/pull/1312
This is an automated message from the Apache Git Service.
To respond to
imay merged pull request #1299: Handle the situation when there is no enough
backends for tablet repair
URL: https://github.com/apache/incubator-doris/pull/1299
This is an automated message from the Apache Git Service.
To re
imay opened a new pull request #1317: Uniform Status
URL: https://github.com/apache/incubator-doris/pull/1317
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and us
chaoyli merged pull request #1317: Uniform Status
URL: https://github.com/apache/incubator-doris/pull/1317
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use t
imay commented on a change in pull request #1304: Add bitshuffle page
URL: https://github.com/apache/incubator-doris/pull/1304#discussion_r294029047
##
File path: be/src/olap/rowset/segment_v2/CMakeLists.txt
##
@@ -0,0 +1,29 @@
+# Licensed to the Apache Software Foundation
imay commented on a change in pull request #1304: Add bitshuffle page
URL: https://github.com/apache/incubator-doris/pull/1304#discussion_r294029078
##
File path: be/src/olap/rowset/segment_v2/bitshuffle_page.cpp
##
@@ -0,0 +1,84 @@
+// Licensed to the Apache Software Found
imay commented on a change in pull request #1304: Add bitshuffle page
URL: https://github.com/apache/incubator-doris/pull/1304#discussion_r294029801
##
File path: be/src/olap/rowset/segment_v2/bitshuffle_page.h
##
@@ -0,0 +1,343 @@
+// Licensed to the Apache Software Founda
imay commented on a change in pull request #1304: Add bitshuffle page
URL: https://github.com/apache/incubator-doris/pull/1304#discussion_r294029632
##
File path: be/src/olap/rowset/segment_v2/bitshuffle_page.h
##
@@ -0,0 +1,343 @@
+// Licensed to the Apache Software Founda
imay commented on a change in pull request #1292: Support Grouping Sets, Rollup
and Cube to extend group by statement
URL: https://github.com/apache/incubator-doris/pull/1292#discussion_r294033115
##
File path: gensrc/thrift/PlanNodes.thrift
##
@@ -354,6 +355,12 @@ struct
imay commented on a change in pull request #1292: Support Grouping Sets, Rollup
and Cube to extend group by statement
URL: https://github.com/apache/incubator-doris/pull/1292#discussion_r294033138
##
File path: fe/src/main/java/org/apache/doris/planner/RepeatNode.java
##
@
imay commented on a change in pull request #1292: Support Grouping Sets, Rollup
and Cube to extend group by statement
URL: https://github.com/apache/incubator-doris/pull/1292#discussion_r294033250
##
File path: be/src/exec/repeat_node.cpp
##
@@ -0,0 +1,214 @@
+// Licensed
imay commented on a change in pull request #1292: Support Grouping Sets, Rollup
and Cube to extend group by statement
URL: https://github.com/apache/incubator-doris/pull/1292#discussion_r294033200
##
File path: be/src/exec/repeat_node.cpp
##
@@ -0,0 +1,214 @@
+// Licensed
imay commented on a change in pull request #1292: Support Grouping Sets, Rollup
and Cube to extend group by statement
URL: https://github.com/apache/incubator-doris/pull/1292#discussion_r294033106
##
File path: gensrc/script/doris_builtins_functions.py
##
@@ -640,7 +640,12
imay commented on a change in pull request #1292: Support Grouping Sets, Rollup
and Cube to extend group by statement
URL: https://github.com/apache/incubator-doris/pull/1292#discussion_r294033821
##
File path: fe/src/main/java/org/apache/doris/planner/SingleNodePlanner.java
##
imay opened a new issue #1318: BE crash when Loading data to unpartitioned
table with specified partition
URL: https://github.com/apache/incubator-doris/issues/1318
**Describe the bug**
when loading data to a unpartitioned table with a specified partition, BE
would crash.
Bec
imay opened a new pull request #1319: Deny specify partition for unpartitioned
table
URL: https://github.com/apache/incubator-doris/pull/1319
#1318
This is an automated message from the Apache Git Service.
To respond to the
imay closed pull request #1107: change Dockfile for apache/arrow
URL: https://github.com/apache/incubator-doris/pull/1107
This is an automated message from the Apache Git Service.
To respond to the message, please log on to G
imay commented on a change in pull request #1173: load data from Parquet file
(Issues #911)
URL: https://github.com/apache/incubator-doris/pull/1173#discussion_r294040625
##
File path: be/src/exec/base_scanner.cpp
##
@@ -0,0 +1,163 @@
+// Licensed to the Apache Software Fo
imay commented on a change in pull request #1173: load data from Parquet file
(Issues #911)
URL: https://github.com/apache/incubator-doris/pull/1173#discussion_r294040567
##
File path: be/src/exec/base_scanner.cpp
##
@@ -0,0 +1,163 @@
+// Licensed to the Apache Software Fo
morningman merged pull request #1319: Deny specify partition for unpartitioned
table
URL: https://github.com/apache/incubator-doris/pull/1319
This is an automated message from the Apache Git Service.
To respond to the messag
imay opened a new pull request #1320: Remove unused code
URL: https://github.com/apache/incubator-doris/pull/1320
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub an
morningman merged pull request #1320: Remove unused code
URL: https://github.com/apache/incubator-doris/pull/1320
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub an
imay opened a new pull request #1321: Add Env for file operation
URL: https://github.com/apache/incubator-doris/pull/1321
This is an automated message from the Apache Git Service.
To respond to the message, please log on to G
morningman commented on a change in pull request #1289: Modify colocation
creation logic
URL: https://github.com/apache/incubator-doris/pull/1289#discussion_r294110088
##
File path: fe/src/main/java/org/apache/doris/http/meta/ColocateMetaService.java
##
@@ -54,8 +58,11 @@
kangpinghuang commented on a change in pull request #1304: Add bitshuffle page
URL: https://github.com/apache/incubator-doris/pull/1304#discussion_r294113359
##
File path: be/src/olap/rowset/segment_v2/bitshuffle_page.cpp
##
@@ -0,0 +1,84 @@
+// Licensed to the Apache Softw
kangpinghuang commented on a change in pull request #1304: Add bitshuffle page
URL: https://github.com/apache/incubator-doris/pull/1304#discussion_r294113403
##
File path: be/src/olap/rowset/segment_v2/bitshuffle_page.h
##
@@ -0,0 +1,343 @@
+// Licensed to the Apache Softwa
kangpinghuang commented on a change in pull request #1304: Add bitshuffle page
URL: https://github.com/apache/incubator-doris/pull/1304#discussion_r294113396
##
File path: be/src/olap/rowset/segment_v2/bitshuffle_page.h
##
@@ -0,0 +1,343 @@
+// Licensed to the Apache Softwa
kangpinghuang commented on a change in pull request #1304: Add bitshuffle page
URL: https://github.com/apache/incubator-doris/pull/1304#discussion_r294113348
##
File path: be/src/olap/rowset/segment_v2/CMakeLists.txt
##
@@ -0,0 +1,29 @@
+# Licensed to the Apache Software Fo
kangpinghuang commented on a change in pull request #1321: Add Env for file
operation
URL: https://github.com/apache/incubator-doris/pull/1321#discussion_r294114687
##
File path: be/CMakeLists.txt
##
@@ -555,23 +556,24 @@ if (${MAKE_TEST} STREQUAL "ON")
add_definition
701 - 800 of 7706 matches
Mail list logo
