TsukiokaKogane commented on code in PR #63850:
URL: https://github.com/apache/doris/pull/63850#discussion_r3380597836
##########
fe/fe-core/src/main/java/org/apache/doris/catalog/stream/OlapTableStreamWrapper.java:
##########
@@ -163,4 +173,32 @@ public List<Long>
selectNonEmptyPartitionIds(Collection<Long> partitionIds) {
}
return nonEmptyIds;
}
+
+ public List<Column> getRowBinlogSchema() {
+ return baseTable.getRowBinlogMeta().getSchema();
+ }
+
+ public List<Long> filterHistoryPartitionIds(List<Long> partitionIds) {
+ return partitionIds.stream()
+ .filter(partitionId -> stream.hasHistoricalData(partitionId))
+ .collect(Collectors.toList());
+ }
+
+ public List<Long> filterIncrementalPartitionIds(List<Long> partitionIds) {
+ return partitionIds.stream()
+ .filter(partitionId -> !stream.hasHistoricalData(partitionId)
+ && stream.hasData(getPartition(partitionId)))
+ .collect(Collectors.toList());
+ }
+
+ public OlapTable getBaseTable() {
+ return baseTable;
+ }
+
+ public BaseTableStream.StreamScanType getStreamScanType() {
+ if (keysType == KeysType.DUP_KEYS) {
+ return BaseTableStream.StreamScanType.APPEND_ONLY;
+ }
+ return stream.getStreamScanType();
Review Comment:
因为stream 本质的key是跟着原表的 DUP_KEYS min delta 等价 append only 但是runtime 用append
only 跑性能更好
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
