This is an automated email from the ASF dual-hosted git repository. lihaopeng pushed a change to branch vectorized in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
from 164b274 [revert] "[improvement](bdbje) clean too many bdbje log (#7273)" (#7312) add 8660bf6 [fix](select join) Make selected slotRef nullable when slotRef is from nullable tuple in outer join sql block (#7290) add 62d1206 [feature](udf) make orthogonal bitmap udaf as build in functions (#7211) add 03ad8c1 [fix](load) Fix bug that show load may be blocked (#7254) add 5e32ae3 [improvement](cache) Optimize sql cache (#7231) add 3b10002 [community][typo](github) modify PR template (#7310) add 868281f [docs] update data-model-rollup.md (#7321) add 2ae9c41 [fix](lateral view)(subquery) Fix column materialization error (#7330) add 10ccada [fix](forward) Avoid endless forward execution (#7335) add 6f91741 [Bug]Fix BE coredump when manual compaction task is triggered (#7260) add be0cf51 [docs] add java formatter in doc (#7306) add b080e79 [community](github) add more content of gitignore file (#7307) add dc281eb [fix](routine load) fix bug that can not read image when using keyword STREAM (#7323) add db57c42 [improvement](compaction)(tablet repair) Add missing rowsets in compaction status url and support force dropping redundant replica (#7283) add ac739fe [refactor] modify the control flow code to improve code readability (#7302) add 80c11da [refactor] modify the implements of Tuple & RowBatch (#7319) add 568f661 [deps](log4j) upgrade log4j (#7364) add 5745adb [improvement](reader) optimize for single rowset reading (#7351) add e0889ae [typo](load) correct the error of ‘EtlJobMgr::get_job_status’ function (#7353) add ef2ea18 [docs] Improve the chapter on debugging FE in doc. (#7309) add 414c5a8 [fix] LRUCache::prune_if may not remove all the entries matching the predicate (#7383) add a6a584a [doc] update the compilation.md (#7350) add 4e02109 [refactor][fix](constants-fold) Refactor the code of fold constant mgr and fix some undefined behavior and mem leak (#7373) add d9c927f [improvement](log)(schema change) Add a clear memory description in the log (#7378) add e64da03 [deps](log4j) Upgrade log4j 2 to 2.16.0 (#7394) add 926540c [feature] Support return bitmp/hll data in select statement (#7276) add 382351b [fix](ut) Fix run fe ut failed, be ut memory leak and build thirdparty failed (#7377) add c8bc0cf [chore][community](github) Remove travis and add github action (#7380) add 549e849 [improvement](flink-connector) DataSourceFunction read doris supports parallel (#7232) add 8552194 [refactor](olap-scan-node) Refactor olap scannode (#7131) add 4afdcdb [performance](reader) Opt the unique reader to reduce unnecessary compare and function call (#7348) add 6ede693 [fix](insert) modify code logic of InsertStmt (#7360) add 2e334d0 [docs](sql-block-rule) modify document of sql block rule (#7370) add 2b90967 [fix][refactor](broker load) refactor the scheduling logic of broker load (#7371) add 6dd312b [docs](website) develop the caseList component (#7402) add 5fed8a9 [docs](flink-connector) Add instructions for flink doris connector (#7384) add 0499b22 [feat](lateral-view) Support execution of lateral view stmt (#7255) add c873c8c [fix](lateral view)(subquery) Forbidden directly AGG/SORT on lateral view (#7337) add 7d4da7a [fix](rpc) fix BE crash in SendRpcResponse when high concurrency (#7413) add 06c38ce [enhancement] Make concurrent_number for routine load task can be larger than be num (#7386) add e9536a8 [deps](cyrus_sasl) Add -fPIC for cyrus_sasl (#7408) add f6e598d Revert "[improvement](reader) optimize for single rowset reading (#7351)" (#7427) add e74e55d [docs] Fix typos (#7404) add 6c320df [community](github) Add .asf.yaml (#7431) add 7a1bb5b log4j upgrade to 2.17.0 (#7440) add 2d72c03 [deps](openssl) upgrade openssl to 1.1.1m (#7446) add 30db2cd [fix](cache) Some view stmt cannot be obtained when view in the subquery and add cache key UT (#7375) add 998489a [fix](sql-block-rule) move sql block rule check from ConnectProcessor to StmtExecutor (#7407) add 560c8b8 [enhancement] Remove the two lines of duplicate import. (#7331) (#7332) add 695eca8 [docs] add bloomfilter index doc (#7318) add e904960 [fix](flink-connector) Connector should visit the surviving BE nodes (#7435) add 97749ed [community][chore] Modify .asf.yaml and fix BE build warning (#7439) add 2ab3a66 [docs][community] Remove articles (#7449) add 20ef8a6 [feature-wip](remote storage)(step1) use a struct instead of string for parameter path, add basic remote method (#7098) add a8c444d [fix](sql-rewrite) Rewrite Bigint SlotRef to compare DecimalLiteral in Binary predicate (#7265) add 889e33d [docs](seatunnel) Seatunnel Supports Doris connector (#7453) add 3128c7c [fix](ut) fix testPartitionRebalancer ut (#7468) add ff5a0e9 [improvement](planner) make BinaryPredicate do not cast date to datetime/varchar (#7045) add 3ba6dcf [fix](function) fix round function for inaccuracy (#7421) add 6d1cf59 [fix] DCHECK fail at BitmapValue getSizeInBytes (#7430) add bfa6bc3 [fix](function) fix aggregate function min() at type varchar (#7437) add c596b03 [docs](docker) Add document of docker dev (#7447) add b4ce189 [improvement](flink-connector) flush data without multi httpclients (#7329) (#7450) add a8a5c0a [improvement](load) memory usage optimization for load job (#7454) add 43ed54f [docs] The name of hidden column is incorrect in batch-delete-manual.md(#7465) (#7466) add 91332fa [fix](reader) fix logic error for Tablet::capture_rs_readers (#7469) add 2347f12 [fix](fe-ut) Fix NPE when start FE in unit test. (#7471) add f33d1f7 [fix](ut) Fix FE ut SelectStmtTest.testDeduplicateOrs (#7481) add 4ed1846 [fix](ut) Fix BE broker scanner unit test bug (#7486) add fe1d0c1 [fix](materialized-view)(planner) fix mv rewrite bug (#7362) add 0c15473 [feature](function) support bitmap_union/intersect have more columns parameters (#7379) add 98551f8 [fix](grouping-set) Grouping set clause act wrong for function expr in view (#7410) (#7411) add ca97535 [docs](executor) correct some be error code (#7460) add 43e9318 [chore](docker) Add clang11 in docker dev image (#7470) add ab60c5e [fix](spark-load) fix Roaring64Map big-endian read/write in de/serialization (#7480) add 755e069 [feature](broker) support ks3 for kmr in ksyun (#7484) add 80587e7 [improvement](spark-connector)(flink-connector) Modify the max num of batch written by Spark/Flink connector each time. (#7485) add 6e052f4 [Doc][Website] blogs are sorted by date (#7491) add 07e2acb [feature] Suport national secret (national commercial password) algorithm SM3/SM4 (#7464) add 3454735 [fix](balance) fix partition rebalance bug (#7213) add 9fb8900 [revert] part of "[improvement](planner) make BinaryPredicate do not cast date to datetime/varchar (#7045)" (#7501) add a2d6e6e [improvement](config) Modify default value of some brpc config (#7493) add 3a5de97 [Feature](Partition pruning) Implement V2 version of partition prune. (#7434) add e933607 Revert "[improvement](planner) make BinaryPredicate do not cast date to datetime/varchar (#7045)" (#7517) add 2872dbf [refactor] Standardize the writing of pom files, prepare for deployment to maven (#7477) add bc4ceec [improvement] optimize java cmd find (#7428) add 85c30fc [deps] Upgrade Log4j to 2.7.1 to solve the CVE-2021-44832 security vulnerability (#7536) add 0894848 fix having clause constant folding (#7507) add dc9cd34 [docs] Add user manual for hdfs load and transaction. (#7497) add 4d01219 [fix](lower_case_table_names) Fix the bug of case-sensitive aliases in the query when lower_case_table_names=1 is set (#7495) add 7357089 [fix] change percentile_approx return from nan to null (#7512) add d88711a [fix] fix TableRef.java checkstyle failed (#7538) add 8da2e8b [fix](cache) Int overflow causes the wrong latest table to be obtained (#7533) add 723ee84 [feature] (planner) InferPredicate (#7096) add 7903e64 [Bug](partition pruning v2) Fix NPE when calling `Analyzer.getContext()` in partition pruning related logic. (#7542) new e0cadc4 [Vectorized Exec Engine] Support Vectorized Exec Engine In Doris The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .asf.yaml | 38 + .github/PULL_REQUEST_TEMPLATE.md | 4 +- .github/workflows/build-extension.yml | 74 + .github/workflows/clang-format.yml | 6 +- .gitignore | 20 +- .travis.yml | 56 - be/CMakeLists.txt | 16 + be/src/agent/task_worker_pool.cpp | 6 +- be/src/common/config.h | 14 +- be/src/common/daemon.cpp | 2 + be/src/common/utils.h | 10 + be/src/env/CMakeLists.txt | 2 + be/src/env/env.cpp | 50 + be/src/env/env.h | 121 +- be/src/env/env_posix.cpp | 462 +++--- be/src/env/env_posix.h | 101 ++ be/src/env/env_remote.cpp | 357 +++++ be/src/env/env_remote.h | 107 ++ be/src/exec/CMakeLists.txt | 1 + be/src/exec/base_scanner.h | 2 +- be/src/exec/blocking_join_node.cpp | 3 +- be/src/exec/broker_scan_node.cpp | 12 +- be/src/exec/broker_scanner.cpp | 7 +- be/src/exec/broker_scanner.h | 2 +- be/src/exec/data_sink.cpp | 15 +- be/src/exec/data_sink.h | 11 +- be/src/exec/es/es_scroll_parser.cpp | 381 ++++- be/src/exec/es/es_scroll_parser.h | 8 + be/src/exec/es_http_scan_node.cpp | 15 +- be/src/exec/es_http_scan_node.h | 45 +- be/src/exec/es_http_scanner.h | 2 +- be/src/exec/exec_node.cpp | 161 +- be/src/exec/exec_node.h | 21 +- be/src/exec/hdfs_writer.cpp | 7 + be/src/exec/json_scanner.cpp | 7 +- be/src/exec/json_scanner.h | 2 +- be/src/exec/mysql_scan_node.h | 2 +- be/src/exec/odbc_scan_node.cpp | 12 +- be/src/exec/odbc_scan_node.h | 12 +- be/src/exec/olap_scan_node.cpp | 60 +- be/src/exec/olap_scan_node.h | 31 +- be/src/exec/olap_scanner.cpp | 8 +- be/src/exec/olap_scanner.h | 2 - be/src/exec/orc_scanner.cpp | 9 +- be/src/exec/orc_scanner.h | 2 +- be/src/exec/parquet_scanner.cpp | 7 +- be/src/exec/parquet_scanner.h | 2 +- be/src/exec/parquet_writer.cpp | 38 +- be/src/exec/parquet_writer.h | 4 +- be/src/exec/partitioned_aggregation_node.cc | 2 +- be/src/exec/scan_node.h | 7 +- be/src/exec/schema_scan_node.h | 2 +- be/src/exec/table_function_node.cpp | 340 ++++ be/src/exec/table_function_node.h | 77 + be/src/exec/tablet_info.cpp | 224 +++ be/src/exec/tablet_info.h | 100 ++ be/src/exec/tablet_sink.cpp | 72 +- be/src/exec/tablet_sink.h | 6 +- be/src/exec/text_converter.cpp | 22 + be/src/exec/text_converter.h | 7 +- be/src/exec/text_converter.hpp | 133 +- be/src/exprs/CMakeLists.txt | 8 +- be/src/exprs/aggregate_functions.cpp | 26 +- be/src/exprs/bitmap_function.cpp | 364 ++++- be/src/exprs/bitmap_function.h | 42 +- be/src/exprs/encryption_functions.cpp | 179 ++- be/src/exprs/encryption_functions.h | 42 +- be/src/exprs/math_functions.cpp | 8 +- be/src/exprs/math_functions.h | 2 +- be/src/exprs/runtime_filter.cpp | 34 + be/src/exprs/runtime_filter.h | 1 + be/src/exprs/runtime_filter_slots.h | 38 +- be/src/exprs/scalar_fn_call.cpp | 53 +- be/src/exprs/scalar_fn_call.h | 5 + be/src/exprs/slot_ref.cpp | 5 +- .../exprs/table_function/dummy_table_functions.cpp | 49 + .../exprs/table_function/dummy_table_functions.h | 47 + be/src/exprs/table_function/explode_bitmap.cpp | 124 ++ be/src/exprs/table_function/explode_bitmap.h | 56 + be/src/exprs/table_function/explode_json_array.cpp | 202 +++ be/src/exprs/table_function/explode_json_array.h | 130 ++ be/src/exprs/table_function/explode_split.cpp | 115 ++ be/src/exprs/table_function/explode_split.h | 56 + be/src/exprs/table_function/table_function.h | 65 + .../table_function/table_function_factory.cpp | 48 + .../exprs/table_function/table_function_factory.h | 36 + be/src/exprs/v_string_functions.h | 219 +++ be/src/http/CMakeLists.txt | 4 +- be/src/http/action/compaction_action.cpp | 23 + be/src/http/action/compaction_action.h | 2 + be/src/olap/aggregate_func.h | 1 + be/src/olap/base_tablet.cpp | 14 +- be/src/olap/base_tablet.h | 8 +- be/src/olap/block_column_predicate.cpp | 114 ++ be/src/olap/block_column_predicate.h | 26 + be/src/olap/collect_iterator.cpp | 30 +- be/src/olap/collect_iterator.h | 17 +- be/src/olap/column_predicate.h | 13 + be/src/olap/compaction.cpp | 2 +- be/src/olap/comparison_predicate.cpp | 163 ++ be/src/olap/comparison_predicate.h | 4 + be/src/olap/data_dir.cpp | 331 ++-- be/src/olap/data_dir.h | 25 +- be/src/olap/delta_writer.cpp | 2 +- be/src/olap/fs/CMakeLists.txt | 1 + be/src/olap/fs/block_manager.h | 17 +- be/src/olap/fs/file_block_manager.cpp | 87 +- be/src/olap/fs/file_block_manager.h | 17 +- be/src/olap/fs/fs_util.cpp | 30 +- be/src/olap/fs/fs_util.h | 6 +- be/src/olap/fs/remote_block_manager.cpp | 339 ++++ be/src/olap/fs/remote_block_manager.h | 70 + be/src/olap/generic_iterators.cpp | 62 +- be/src/olap/generic_iterators.h | 4 +- be/src/olap/iterators.h | 6 +- be/src/olap/lru_cache.cpp | 46 +- be/src/olap/lru_cache.h | 10 +- be/src/olap/null_predicate.cpp | 43 + be/src/olap/null_predicate.h | 8 + be/src/olap/olap_common.h | 3 +- be/src/olap/olap_define.h | 1 + be/src/olap/olap_server.cpp | 10 +- be/src/olap/options.h | 1 + be/src/olap/push_handler.cpp | 12 +- be/src/olap/push_handler.h | 4 +- be/src/olap/reader.cpp | 17 +- be/src/olap/reader.h | 24 +- be/src/olap/row_block2.cpp | 208 +++ be/src/olap/row_block2.h | 5 + be/src/olap/rowset/alpha_rowset.cpp | 12 +- be/src/olap/rowset/alpha_rowset.h | 4 +- be/src/olap/rowset/alpha_rowset_reader.h | 4 + be/src/olap/rowset/alpha_rowset_writer.cpp | 10 +- be/src/olap/rowset/beta_rowset.cpp | 106 +- be/src/olap/rowset/beta_rowset.h | 8 +- be/src/olap/rowset/beta_rowset_reader.cpp | 42 +- be/src/olap/rowset/beta_rowset_reader.h | 1 + be/src/olap/rowset/beta_rowset_writer.cpp | 21 +- be/src/olap/rowset/rowset.cpp | 4 +- be/src/olap/rowset/rowset.h | 11 +- be/src/olap/rowset/rowset_converter.cpp | 14 +- be/src/olap/rowset/rowset_converter.h | 8 +- be/src/olap/rowset/rowset_factory.cpp | 6 +- be/src/olap/rowset/rowset_factory.h | 2 +- be/src/olap/rowset/rowset_reader.h | 8 + be/src/olap/rowset/rowset_writer_context.h | 3 +- be/src/olap/rowset/segment_group.cpp | 4 +- be/src/olap/rowset/segment_v2/binary_dict_page.cpp | 52 +- be/src/olap/rowset/segment_v2/binary_dict_page.h | 9 + be/src/olap/rowset/segment_v2/binary_plain_page.h | 31 + be/src/olap/rowset/segment_v2/binary_prefix_page.h | 4 + .../olap/rowset/segment_v2/bitmap_index_reader.cpp | 4 +- .../olap/rowset/segment_v2/bitmap_index_reader.h | 6 +- be/src/olap/rowset/segment_v2/bitshuffle_page.h | 48 + .../segment_v2/bloom_filter_index_reader.cpp | 2 +- .../rowset/segment_v2/bloom_filter_index_reader.h | 6 +- be/src/olap/rowset/segment_v2/column_reader.cpp | 131 +- be/src/olap/rowset/segment_v2/column_reader.h | 26 +- .../rowset/segment_v2/empty_segment_iterator.cpp | 6 +- .../rowset/segment_v2/empty_segment_iterator.h | 3 +- .../rowset/segment_v2/frame_of_reference_page.h | 4 + .../rowset/segment_v2/indexed_column_reader.cpp | 4 +- .../olap/rowset/segment_v2/indexed_column_reader.h | 13 +- .../olap/rowset/segment_v2/ordinal_page_index.cpp | 6 +- be/src/olap/rowset/segment_v2/ordinal_page_index.h | 7 +- be/src/olap/rowset/segment_v2/page_decoder.h | 5 + be/src/olap/rowset/segment_v2/page_io.cpp | 2 +- be/src/olap/rowset/segment_v2/plain_page.h | 4 + be/src/olap/rowset/segment_v2/rle_page.h | 23 + be/src/olap/rowset/segment_v2/segment.cpp | 38 +- be/src/olap/rowset/segment_v2/segment.h | 9 +- be/src/olap/rowset/segment_v2/segment_iterator.cpp | 9 +- be/src/olap/rowset/segment_v2/segment_iterator.h | 3 + be/src/olap/rowset/segment_v2/zone_map_index.cpp | 2 +- be/src/olap/rowset/segment_v2/zone_map_index.h | 7 +- be/src/olap/schema.cpp | 44 + be/src/olap/schema.h | 4 + be/src/olap/schema_change.cpp | 11 +- be/src/olap/segment_loader.cpp | 30 +- be/src/olap/snapshot_manager.cpp | 70 +- be/src/olap/snapshot_manager.h | 12 +- be/src/olap/storage_engine.cpp | 13 +- be/src/olap/storage_engine.h | 6 +- be/src/olap/tablet.cpp | 23 +- be/src/olap/tablet.h | 12 + be/src/olap/tablet_manager.cpp | 37 +- be/src/olap/tablet_meta.cpp | 7 +- be/src/olap/tablet_meta.h | 2 +- be/src/olap/tablet_schema.cpp | 13 + be/src/olap/tablet_schema.h | 4 + be/src/olap/task/engine_clone_task.cpp | 6 +- be/src/olap/task/engine_storage_migration_task.cpp | 9 +- be/src/olap/tuple_reader.cpp | 20 +- be/src/olap/utils.cpp | 116 -- be/src/olap/utils.h | 4 - be/src/olap/version_graph.cpp | 4 +- be/src/runtime/CMakeLists.txt | 2 +- be/src/runtime/datetime_value.cpp | 2 + be/src/runtime/datetime_value.h | 6 +- be/src/runtime/descriptors.cpp | 21 +- be/src/runtime/descriptors.h | 6 +- be/src/runtime/etl_job_mgr.cpp | 2 +- be/src/runtime/exec_env.h | 7 +- be/src/runtime/exec_env_init.cpp | 6 +- be/src/runtime/export_sink.cpp | 10 + be/src/runtime/file_result_writer.cpp | 30 +- be/src/runtime/file_result_writer.h | 9 +- be/src/runtime/fold_constant_executor.cpp | 267 ++++ be/src/runtime/fold_constant_executor.h | 61 + be/src/runtime/fold_constant_mgr.cpp | 203 --- be/src/runtime/fold_constant_mgr.h | 57 - be/src/runtime/fragment_mgr.cpp | 3 - be/src/runtime/mysql_result_writer.cpp | 25 +- be/src/runtime/mysql_result_writer.h | 8 +- be/src/runtime/plan_fragment_executor.cpp | 95 +- be/src/runtime/plan_fragment_executor.h | 7 +- be/src/runtime/primitive_type.h | 77 +- be/src/runtime/raw_value.h | 56 + be/src/runtime/result_file_sink.cpp | 4 +- be/src/runtime/result_sink.cpp | 9 +- be/src/runtime/result_writer.h | 8 +- be/src/runtime/row_batch.cpp | 300 ++-- be/src/runtime/row_batch.h | 25 +- be/src/runtime/runtime_state.cpp | 2 + be/src/runtime/runtime_state.h | 8 +- be/src/runtime/snapshot_loader.cpp | 8 +- be/src/runtime/string_value.hpp | 25 +- be/src/runtime/tuple.cpp | 64 +- be/src/runtime/types.h | 58 + be/src/service/backend_service.cpp | 6 +- be/src/service/doris_main.cpp | 6 + be/src/service/internal_service.cpp | 18 +- be/src/tools/meta_tool.cpp | 8 +- be/src/udf/udf.cpp | 5 + be/src/udf/udf.h | 12 +- be/src/udf/udf_internal.h | 5 + be/src/udf/udf_ir.cpp | 14 + be/src/util/CMakeLists.txt | 3 +- be/src/util/aes_util.cpp | 177 --- be/src/util/aes_util.h | 37 - be/src/util/binary_cast.hpp | 17 +- be/src/util/bitmap_value.h | 137 +- be/src/util/broker_storage_backend.cpp | 28 +- be/src/util/broker_storage_backend.h | 9 +- be/src/util/brpc_stub_cache.h | 2 +- be/src/util/coding.cpp | 1 - be/src/util/coding.h | 1 - be/src/util/encryption_util.cpp | 249 +++ be/src/util/encryption_util.h | 69 + be/src/util/file_utils.cpp | 106 +- be/src/util/file_utils.h | 9 +- be/src/util/path_util.cpp | 7 + be/src/util/path_util.h | 4 + be/src/util/proto_util.h | 12 +- be/src/util/runtime_profile.h | 5 +- be/src/util/s3_storage_backend.cpp | 112 +- be/src/util/s3_storage_backend.h | 9 +- be/src/util/s3_util.cpp | 25 +- be/src/util/s3_util.h | 10 + be/src/util/sm3.cpp | 51 + be/src/util/sm3.h | 44 + be/src/util/static_asserts.cpp | 3 +- be/src/util/storage_backend.h | 9 +- be/src/util/tuple_row_zorder_compare.cpp | 7 +- be/src/util/url_coding.cpp | 4 + be/src/vec/CMakeLists.txt | 153 ++ .../vec/aggregate_functions/aggregate_function.h | 237 +++ .../aggregate_functions/aggregate_function_avg.cpp | 68 + .../aggregate_functions/aggregate_function_avg.h | 128 ++ .../aggregate_function_bitmap.cpp | 87 ++ .../aggregate_function_bitmap.h | 175 +++ .../aggregate_function_combinator.h | 81 + .../aggregate_function_count.cpp | 52 + .../aggregate_functions/aggregate_function_count.h | 122 ++ .../aggregate_function_distinct.cpp | 96 ++ .../aggregate_function_distinct.h | 224 +++ .../aggregate_function_hll_union_agg.cpp | 51 + .../aggregate_function_hll_union_agg.h | 133 ++ .../aggregate_function_min_max.cpp | 85 + .../aggregate_function_min_max.h | 535 +++++++ .../aggregate_function_nothing.h | 71 + .../aggregate_function_null.cpp | 92 ++ .../aggregate_functions/aggregate_function_null.h | 291 ++++ .../aggregate_function_reader.cpp | 50 + .../aggregate_function_reader.h | 35 + .../aggregate_function_simple_factory.cpp | 62 + .../aggregate_function_simple_factory.h | 104 ++ .../aggregate_functions/aggregate_function_sum.cpp | 88 ++ .../aggregate_functions/aggregate_function_sum.h | 118 ++ .../aggregate_function_uniq.cpp | 69 + .../aggregate_functions/aggregate_function_uniq.h | 131 ++ .../aggregate_function_window.cpp | 176 +++ .../aggregate_function_window.h | 434 ++++++ be/src/vec/aggregate_functions/factory_helpers.h | 59 + be/src/vec/aggregate_functions/helpers.h | 225 +++ .../vec/aggregate_functions/key_holder_helpers.h | 48 + be/src/vec/columns/collator.cpp | 97 ++ be/src/vec/columns/collator.h | 43 + be/src/vec/columns/column.cpp | 57 + be/src/vec/columns/column.h | 483 ++++++ be/src/vec/columns/column_complex.h | 287 ++++ be/src/vec/columns/column_const.cpp | 107 ++ be/src/vec/columns/column_const.h | 174 +++ be/src/vec/columns/column_decimal.cpp | 224 +++ be/src/vec/columns/column_decimal.h | 210 +++ be/src/vec/columns/column_dummy.h | 141 ++ be/src/vec/columns/column_impl.h | 62 + be/src/vec/columns/column_nothing.h | 46 + be/src/vec/columns/column_nullable.cpp | 438 ++++++ be/src/vec/columns/column_nullable.h | 238 +++ be/src/vec/columns/column_set.h | 52 + be/src/vec/columns/column_string.cpp | 375 +++++ be/src/vec/columns/column_string.h | 286 ++++ be/src/vec/columns/column_vector.cpp | 379 +++++ be/src/vec/columns/column_vector.h | 268 ++++ be/src/vec/columns/column_vector_helper.h | 59 + be/src/vec/columns/columns_common.cpp | 273 ++++ be/src/vec/columns/columns_common.h | 91 ++ be/src/vec/columns/columns_number.h | 45 + be/src/vec/columns/predicate_column.h | 418 +++++ be/src/vec/common/aggregation_common.h | 269 ++++ be/src/vec/common/allocator.h | 312 ++++ be/src/vec/common/allocator_fwd.h | 30 + be/src/vec/common/arena.h | 285 ++++ be/src/vec/common/arithmetic_overflow.h | 112 ++ be/src/vec/common/assert_cast.h | 56 + be/src/vec/common/bit_cast.h | 47 + be/src/vec/common/bit_helpers.h | 92 ++ be/src/vec/common/columns_hashing.h | 242 +++ be/src/vec/common/columns_hashing_impl.h | 324 ++++ be/src/vec/common/cow.h | 323 ++++ be/src/vec/common/demangle.cpp | 61 + be/src/vec/common/demangle.h | 34 + be/src/vec/common/exception.cpp | 202 +++ be/src/vec/common/exception.h | 287 ++++ be/src/vec/common/field_visitors.h | 554 +++++++ be/src/vec/common/hash_table/fixed_hash_map.h | 194 +++ be/src/vec/common/hash_table/fixed_hash_table.h | 383 +++++ be/src/vec/common/hash_table/hash.h | 191 +++ be/src/vec/common/hash_table/hash_map.h | 240 +++ be/src/vec/common/hash_table/hash_set.h | 105 ++ be/src/vec/common/hash_table/hash_table.h | 914 +++++++++++ .../vec/common/hash_table/hash_table_allocator.h | 33 + .../vec/common/hash_table/hash_table_key_holder.h | 139 ++ be/src/vec/common/int_exp.h | 135 ++ be/src/vec/common/memcmp_small.h | 228 +++ be/src/vec/common/memcpy_small.h | 83 + be/src/vec/common/mremap.h | 77 + be/src/vec/common/nan_utils.h | 69 + be/src/vec/common/pod_array.cpp | 27 + be/src/vec/common/pod_array.h | 591 +++++++ be/src/vec/common/pod_array_fwd.h | 53 + be/src/vec/common/radix_sort.h | 389 +++++ be/src/vec/common/sip_hash.h | 231 +++ be/src/vec/common/string_buffer.hpp | 93 ++ be/src/vec/common/string_ref.h | 327 ++++ be/src/vec/common/string_utils/string_utils.cpp | 34 + be/src/vec/common/string_utils/string_utils.h | 155 ++ be/src/vec/common/strong_typedef.h | 84 + be/src/vec/common/typeid_cast.h | 62 + be/src/vec/common/uint128.h | 237 +++ be/src/vec/common/unaligned.h | 42 + be/src/vec/core/accurate_comparison.h | 567 +++++++ be/src/vec/core/block.cpp | 910 +++++++++++ be/src/vec/core/block.h | 349 +++++ be/src/vec/core/block_info.cpp | 42 + be/src/vec/core/block_info.h | 76 + be/src/vec/core/call_on_type_index.h | 260 ++++ be/src/vec/core/column_numbers.h | 30 + be/src/vec/core/column_with_type_and_name.cpp | 72 + be/src/vec/core/column_with_type_and_name.h | 56 + be/src/vec/core/columns_with_type_and_name.h | 31 + be/src/vec/core/decimal_comparison.h | 303 ++++ be/src/vec/core/field.cpp | 193 +++ be/src/vec/core/field.h | 909 +++++++++++ be/src/vec/core/materialize_block.cpp | 43 + be/src/vec/core/materialize_block.h | 39 + be/src/vec/core/names.h | 40 + be/src/vec/core/sort_block.cpp | 202 +++ be/src/vec/core/sort_block.h | 55 + be/src/vec/core/sort_cursor.h | 228 +++ be/src/vec/core/sort_description.h | 80 + be/src/vec/core/types.h | 438 ++++++ be/src/vec/data_types/data_type.cpp | 217 +++ be/src/vec/data_types/data_type.h | 402 +++++ be/src/vec/data_types/data_type_bitmap.cpp | 93 ++ be/src/vec/data_types/data_type_bitmap.h | 86 ++ be/src/vec/data_types/data_type_date.cpp | 66 + be/src/vec/data_types/data_type_date.h | 42 + be/src/vec/data_types/data_type_date_time.cpp | 95 ++ be/src/vec/data_types/data_type_date_time.h | 83 + be/src/vec/data_types/data_type_decimal.cpp | 146 ++ be/src/vec/data_types/data_type_decimal.h | 351 +++++ be/src/vec/data_types/data_type_factory.hpp | 87 ++ be/src/vec/data_types/data_type_nothing.cpp | 42 + be/src/vec/data_types/data_type_nothing.h | 65 + be/src/vec/data_types/data_type_nullable.cpp | 113 ++ be/src/vec/data_types/data_type_nullable.h | 90 ++ be/src/vec/data_types/data_type_number.h | 87 ++ be/src/vec/data_types/data_type_number_base.cpp | 123 ++ be/src/vec/data_types/data_type_number_base.h | 66 + be/src/vec/data_types/data_type_string.cpp | 115 ++ be/src/vec/data_types/data_type_string.h | 57 + be/src/vec/data_types/get_least_supertype.cpp | 322 ++++ be/src/vec/data_types/get_least_supertype.h | 35 + be/src/vec/data_types/nested_utils.cpp | 73 + be/src/vec/data_types/nested_utils.h | 43 + be/src/vec/data_types/number_traits.h | 275 ++++ be/src/vec/exec/join/join_op.h | 143 ++ be/src/vec/exec/join/vacquire_list.hpp | 54 + be/src/vec/exec/join/vhash_join_node.cpp | 1063 +++++++++++++ be/src/vec/exec/join/vhash_join_node.h | 225 +++ be/src/vec/exec/vaggregation_node.cpp | 1102 +++++++++++++ be/src/vec/exec/vaggregation_node.h | 483 ++++++ be/src/vec/exec/vanalytic_eval_node.cpp | 658 ++++++++ be/src/vec/exec/vanalytic_eval_node.h | 146 ++ be/src/vec/exec/vassert_num_rows_node.cpp | 99 ++ be/src/vec/exec/vassert_num_rows_node.h | 42 + be/src/vec/exec/vblocking_join_node.cpp | 140 ++ be/src/vec/exec/vblocking_join_node.h | 132 ++ be/src/vec/exec/vcross_join_node.cpp | 185 +++ be/src/vec/exec/vcross_join_node.h | 85 + be/src/vec/exec/vempty_set_node.cpp | 30 + be/src/vec/exec/vempty_set_node.h | 35 + be/src/vec/exec/ves_http_scan_node.cpp | 176 +++ be/src/vec/exec/ves_http_scan_node.h | 49 + be/src/vec/exec/ves_http_scanner.cpp | 56 + be/src/vec/exec/ves_http_scanner.h | 43 + be/src/vec/exec/vexcept_node.cpp | 112 ++ be/src/vec/exec/vexcept_node.h | 39 + be/src/vec/exec/vexchange_node.cpp | 104 ++ be/src/vec/exec/vexchange_node.h | 58 + be/src/vec/exec/vintersect_node.cpp | 111 ++ be/src/vec/exec/vintersect_node.h | 49 + be/src/vec/exec/vmysql_scan_node.cpp | 124 ++ be/src/vec/exec/vmysql_scan_node.h | 49 + be/src/vec/exec/vodbc_scan_node.cpp | 130 ++ be/src/vec/exec/vodbc_scan_node.h | 33 + be/src/vec/exec/volap_scan_node.cpp | 557 +++++++ be/src/vec/exec/volap_scan_node.h | 69 + be/src/vec/exec/volap_scanner.cpp | 205 +++ be/src/vec/exec/volap_scanner.h | 51 + be/src/vec/exec/vschema_scan_node.cpp | 263 ++++ be/src/vec/exec/vschema_scan_node.h | 50 + be/src/vec/exec/vselect_node.cpp | 72 + be/src/vec/exec/vselect_node.h | 39 + be/src/vec/exec/vset_operation_node.cpp | 379 +++++ be/src/vec/exec/vset_operation_node.h | 245 +++ be/src/vec/exec/vsort_exec_exprs.cpp | 79 + be/src/vec/exec/vsort_exec_exprs.h | 98 ++ be/src/vec/exec/vsort_node.cpp | 255 +++ be/src/vec/exec/vsort_node.h | 92 ++ be/src/vec/exec/vunion_node.cpp | 268 ++++ be/src/vec/exec/vunion_node.h | 109 ++ be/src/vec/exprs/vcase_expr.cpp | 114 ++ be/src/vec/exprs/vcase_expr.h | 49 + be/src/vec/exprs/vcast_expr.cpp | 97 ++ be/src/vec/exprs/vcast_expr.h | 53 + be/src/vec/exprs/vcompound_pred.h | 42 + be/src/vec/exprs/vectorized_agg_fn.cpp | 175 +++ be/src/vec/exprs/vectorized_agg_fn.h | 106 ++ be/src/vec/exprs/vectorized_fn_call.cpp | 120 ++ be/src/vec/exprs/vectorized_fn_call.h | 46 + be/src/vec/exprs/vexpr.cpp | 343 +++++ be/src/vec/exprs/vexpr.h | 168 ++ be/src/vec/exprs/vexpr_context.cpp | 137 ++ be/src/vec/exprs/vexpr_context.h | 91 ++ be/src/vec/exprs/vin_predicate.cpp | 109 ++ be/src/vec/exprs/vin_predicate.h | 52 + be/src/vec/exprs/vinfo_func.cpp | 59 + be/src/vec/exprs/vinfo_func.h | 47 + be/src/vec/exprs/vliteral.cpp | 138 ++ be/src/vec/exprs/vliteral.h | 45 + be/src/vec/exprs/vslot_ref.cpp | 75 + be/src/vec/exprs/vslot_ref.h | 50 + be/src/vec/functions/cast_type_to_either.h | 35 + be/src/vec/functions/comparison.cpp | 33 + be/src/vec/functions/comparison_equal_for_null.cpp | 125 ++ be/src/vec/functions/comparison_equals.cpp | 29 + be/src/vec/functions/comparison_greater.cpp | 29 + be/src/vec/functions/comparison_less.cpp | 29 + be/src/vec/functions/date_time_transforms.h | 259 ++++ be/src/vec/functions/divide.cpp | 48 + be/src/vec/functions/function.cpp | 330 ++++ be/src/vec/functions/function.h | 591 +++++++ .../vec/functions/function_always_not_nullable.h | 85 + be/src/vec/functions/function_binary_arithmetic.h | 719 +++++++++ .../function_binary_arithmetic_to_null_type.h | 247 +++ be/src/vec/functions/function_bit.cpp | 92 ++ be/src/vec/functions/function_bitmap.cpp | 471 ++++++ be/src/vec/functions/function_case.cpp | 29 + be/src/vec/functions/function_case.h | 371 +++++ be/src/vec/functions/function_cast.cpp | 27 + be/src/vec/functions/function_cast.h | 1307 ++++++++++++++++ be/src/vec/functions/function_const.h | 101 ++ .../function_date_or_datetime_computation.cpp | 140 ++ .../function_date_or_datetime_computation.h | 488 ++++++ .../function_date_or_datetime_to_something.h | 93 ++ .../function_date_or_datetime_to_string.cpp | 35 + .../function_date_or_datetime_to_string.h | 66 + .../function_datetime_string_to_string.cpp | 32 + .../functions/function_datetime_string_to_string.h | 99 ++ be/src/vec/functions/function_hash.cpp | 254 +++ be/src/vec/functions/function_hash.h | 40 + be/src/vec/functions/function_helpers.cpp | 99 ++ be/src/vec/functions/function_helpers.h | 104 ++ be/src/vec/functions/function_ifnull.cpp | 27 + be/src/vec/functions/function_ifnull.h | 98 ++ be/src/vec/functions/function_json.cpp | 369 +++++ .../vec/functions/function_math_binary_float64.h | 248 +++ be/src/vec/functions/function_math_unary.h | 167 ++ be/src/vec/functions/function_string.cpp | 802 ++++++++++ be/src/vec/functions/function_string.h | 986 ++++++++++++ be/src/vec/functions/function_string_to_string.h | 78 + be/src/vec/functions/function_timestamp.cpp | 330 ++++ be/src/vec/functions/function_totype.h | 428 ++++++ be/src/vec/functions/function_unary_arithmetic.h | 157 ++ be/src/vec/functions/function_variadic_arguments.h | 79 + be/src/vec/functions/functions_comparison.h | 475 ++++++ be/src/vec/functions/functions_logical.cpp | 531 +++++++ be/src/vec/functions/functions_logical.h | 167 ++ be/src/vec/functions/hll_cardinality.cpp | 71 + be/src/vec/functions/hll_empty.cpp | 41 + be/src/vec/functions/hll_hash.cpp | 100 ++ be/src/vec/functions/if.cpp | 480 ++++++ be/src/vec/functions/in.cpp | 182 +++ be/src/vec/functions/int_div.cpp | 153 ++ be/src/vec/functions/int_div.h | 56 + be/src/vec/functions/is_not_null.cpp | 76 + be/src/vec/functions/is_null.cpp | 77 + be/src/vec/functions/like.cpp | 321 ++++ be/src/vec/functions/like.h | 155 ++ be/src/vec/functions/math.cpp | 481 ++++++ be/src/vec/functions/minus.cpp | 56 + be/src/vec/functions/modulo.cpp | 159 ++ be/src/vec/functions/multiply.cpp | 56 + be/src/vec/functions/nullif.cpp | 155 ++ be/src/vec/functions/plus.cpp | 57 + be/src/vec/functions/random.cpp | 109 ++ be/src/vec/functions/simple_function_factory.h | 175 +++ be/src/vec/functions/time_of_function.cpp | 37 + be/src/vec/functions/to_time_function.cpp | 54 + be/src/vec/io/io_helper.h | 405 +++++ be/src/vec/io/reader_buffer.h | 46 + be/src/vec/io/var_int.h | 176 +++ be/src/vec/olap/block_reader.cpp | 362 +++++ be/src/vec/olap/block_reader.h | 120 ++ be/src/vec/olap/vcollect_iterator.cpp | 380 +++++ be/src/vec/olap/vcollect_iterator.h | 193 +++ be/src/vec/olap/vgeneric_iterators.cpp | 443 ++++++ be/src/vec/olap/vgeneric_iterators.h | 47 + be/src/vec/runtime/vdata_stream_mgr.cpp | 194 +++ be/src/vec/runtime/vdata_stream_mgr.h | 91 ++ be/src/vec/runtime/vdata_stream_recvr.cpp | 364 +++++ be/src/vec/runtime/vdata_stream_recvr.h | 188 +++ be/src/vec/runtime/vdatetime_value.cpp | 1626 ++++++++++++++++++++ be/src/vec/runtime/vdatetime_value.h | 664 ++++++++ be/src/vec/runtime/vpartition_info.cpp | 56 + be/src/vec/runtime/vpartition_info.h | 59 + be/src/vec/runtime/vsorted_run_merger.cpp | 156 ++ be/src/vec/runtime/vsorted_run_merger.h | 91 ++ be/src/vec/sink/mysql_result_writer.cpp | 349 +++++ be/src/vec/sink/mysql_result_writer.h | 70 + be/src/vec/sink/result_sink.cpp | 137 ++ be/src/vec/sink/result_sink.h | 79 + be/src/vec/sink/result_writer.h | 29 + be/src/vec/sink/vdata_stream_sender.cpp | 517 +++++++ be/src/vec/sink/vdata_stream_sender.h | 265 ++++ be/src/vec/sink/vtabet_sink.cpp | 275 ++++ be/src/vec/sink/vtablet_sink.h | 65 + be/src/vec/utils/util.hpp | 79 + be/test/env/env_posix_test.cpp | 19 +- be/test/exec/broker_scanner_test.cpp | 78 +- be/test/exec/orc_scanner_test.cpp | 15 +- be/test/exprs/bitmap_function_test.cpp | 270 ++++ be/test/exprs/encryption_functions_test.cpp | 179 ++- be/test/exprs/math_functions_test.cpp | 31 +- be/test/exprs/string_functions_test.cpp | 44 +- be/test/olap/column_reader_test.cpp | 108 ++ be/test/olap/cumulative_compaction_policy_test.cpp | 4 +- be/test/olap/delete_handler_test.cpp | 12 +- be/test/olap/file_utils_test.cpp | 8 +- be/test/olap/fs/file_block_manager_test.cpp | 6 +- be/test/olap/generic_iterators_test.cpp | 6 +- be/test/olap/lru_cache_test.cpp | 19 +- be/test/olap/memory/mem_tablet_test.cpp | 3 +- be/test/olap/olap_snapshot_converter_test.cpp | 2 +- be/test/olap/rowset/alpha_rowset_test.cpp | 2 +- be/test/olap/rowset/beta_rowset_test.cpp | 2 +- be/test/olap/rowset/rowset_converter_test.cpp | 10 +- .../rowset/segment_v2/binary_dict_page_test.cpp | 2 + .../olap/rowset/segment_v2/bitmap_index_test.cpp | 4 +- .../bloom_filter_index_reader_writer_test.cpp | 4 +- .../segment_v2/column_reader_writer_test.cpp | 146 +- .../rowset/segment_v2/ordinal_page_index_test.cpp | 10 +- be/test/olap/rowset/segment_v2/segment_test.cpp | 20 +- .../olap/rowset/segment_v2/zone_map_index_test.cpp | 10 +- be/test/olap/tablet_meta_test.cpp | 2 +- be/test/olap/tablet_mgr_test.cpp | 8 +- be/test/olap/tablet_test.cpp | 2 +- be/test/olap/txn_manager_test.cpp | 10 +- be/test/plugin/plugin_zip_test.cpp | 4 +- be/test/tools/benchmark_tool.cpp | 4 +- be/test/util/CMakeLists.txt | 3 +- be/test/util/aes_util_test.cpp | 93 -- be/test/util/bitmap_value_test.cpp | 37 + be/test/util/broker_storage_backend_test.cpp | 2 +- be/test/util/counts_test.cpp | 2 +- be/test/util/encryption_util_test.cpp | 145 ++ be/test/util/s3_storage_backend_test.cpp | 4 +- be/test/util/sm3_test.cpp | 68 + be/test/util/tuple_row_zorder_compare_test.cpp | 266 ++-- be/test/util/zip_util_test.cpp | 4 +- be/test/vec/aggregate_functions/CMakeLists.txt | 23 + be/test/vec/aggregate_functions/agg_test.cpp | 61 + be/test/vec/core/CMakeLists.txt | 23 + be/test/vec/core/block_test.cpp | 309 ++++ be/test/vec/core/column_complex_test.cpp | 52 + be/test/vec/exec/CMakeLists.txt | 21 + be/test/vec/exec/vgeneric_iterators_test.cpp | 207 +++ be/test/vec/exprs/CMakeLists.txt | 22 + be/test/vec/exprs/vexpr_test.cpp | 357 +++++ be/test/vec/function/CMakeLists.txt | 31 + be/test/vec/function/function_abs_test.cpp | 92 ++ be/test/vec/function/function_arithmetic_test.cpp | 142 ++ be/test/vec/function/function_bitmap_test.cpp | 120 ++ be/test/vec/function/function_comparison_test.cpp | 150 ++ be/test/vec/function/function_hash_test.cpp | 103 ++ be/test/vec/function/function_ifnull_test.cpp | 85 + be/test/vec/function/function_like_test.cpp | 125 ++ be/test/vec/function/function_math_test.cpp | 425 +++++ be/test/vec/function/function_nullif_test.cpp | 75 + be/test/vec/function/function_string_test.cpp | 690 +++++++++ be/test/vec/function/function_test_util.h | 291 ++++ be/test/vec/function/function_time_test.cpp | 582 +++++++ be/test/vec/runtime/CMakeLists.txt | 22 + be/test/vec/runtime/vdata_stream_test.cpp | 178 +++ bin/start_be.sh | 50 +- bin/start_fe.sh | 120 +- build.sh | 8 +- contrib/udf/CMakeLists.txt | 8 +- .../udf/src/udaf_orthogonal_bitmap/CMakeLists.txt | 92 -- .../udf/src/udaf_orthogonal_bitmap/bitmap_value.h | 1327 ---------------- .../orthogonal_bitmap_function.cpp | 492 ------ .../orthogonal_bitmap_function.h | 62 - .../udf/src/udaf_orthogonal_bitmap/string_value.h | 148 -- docker/Dockerfile | 20 +- docker/README.md | 4 + docs/.vuepress/components/CaseList.vue | 102 ++ docs/.vuepress/public/images/Bloom_filter.svg.png | Bin 0 -> 51109 bytes .../images/binlog/image-20211110145044815.png | Bin 146900 -> 0 bytes .../images/binlog/image-20211110160106602.png | Bin 52259 -> 0 bytes .../images/binlog/image-20211110160331479.png | Bin 67624 -> 0 bytes .../images/binlog/image-20211110160710709.png | Bin 56885 -> 0 bytes .../public/images/cdc/image-20211025162831632.png | Bin 143949 -> 0 bytes .../public/images/cdc/image-20211025165547903.png | Bin 39487 -> 0 bytes .../public/images/cdc/image-20211025170642628.png | Bin 49165 -> 0 bytes .../public/images/cdc/image-20211025182341086.png | Bin 21677 -> 0 bytes .../public/images/cdc/image-20211025182435827.png | Bin 48534 -> 0 bytes .../public/images/cdc/image-20211026095513892.png | Bin 92955 -> 0 bytes .../public/images/cdc/image-20211026100505972.png | Bin 33173 -> 0 bytes .../public/images/cdc/image-20211026100804091.png | Bin 10829 -> 0 bytes .../public/images/cdc/image-20211026100943474.png | Bin 284282 -> 0 bytes .../public/images/cdc/image-20211026101004547.png | Bin 21854 -> 0 bytes .../public/images/cdc/image-20211026101203629.png | Bin 43195 -> 0 bytes .../public/images/image-20210903132250723.png | Bin 250503 -> 0 bytes .../public/images/image-20210903132539511.png | Bin 54482 -> 0 bytes .../public/images/image-20210903134043421.png | Bin 333578 -> 0 bytes docs/.vuepress/sidebar/en.js | 52 +- docs/.vuepress/sidebar/zh-CN.js | 50 +- docs/.vuepress/theme/components/Home.vue | 4 +- docs/.vuepress/theme/layouts/ArticleList.vue | 3 +- .../en/administrator-guide/block-rule/sql-block.md | 27 +- docs/en/administrator-guide/bloomfilter.md | 133 ++ docs/en/administrator-guide/config/fe_config.md | 11 + .../http-actions/compaction-action.md | 2 + .../load-data/batch-delete-manual.md | 8 +- .../load-data/broker-load-manual.md | 14 + .../load-data/routine-load-manual.md | 4 +- .../operation/be-olap-error-code.md | 6 +- .../orthogonal-bitmap-manual.md | 159 ++ docs/en/administrator-guide/outfile.md | 161 +- docs/en/administrator-guide/variables.md | 48 +- docs/en/article/articles/datax-doris-writer.md | 257 ---- docs/en/article/articles/doris-binlog-load.md | 418 ----- docs/en/article/articles/fe-load-balance.md | 476 ------ docs/en/article/articles/flink-cdc-to-doris.md | 374 ----- docs/en/case-user/case-user.md | 25 + docs/en/community/commit-format-specification.md | 162 ++ docs/en/developer-guide/How-to-Share-blogs.md | 77 +- docs/en/developer-guide/bitmap-hll-file-format.md | 64 + .../developer-guide/commit-format-specification.md | 160 -- docs/en/developer-guide/docker-dev.md | 161 ++ docs/en/developer-guide/fe-idea-dev.md | 85 +- docs/en/developer-guide/java-format-code.md | 12 + docs/en/extending-doris/flink-doris-connector.md | 84 +- docs/en/extending-doris/seatunnel.md | 116 ++ docs/en/extending-doris/spark-doris-connector.md | 4 +- .../udf/contrib/udaf-orthogonal-bitmap-manual.md | 249 --- docs/en/faq/faq.md | 50 +- docs/en/getting-started/data-model-rollup.md | 10 +- docs/en/installing/compilation.md | 24 +- .../sql-functions/bitmap-functions/bitmap_and.md | 32 +- .../bitmap-functions/bitmap_and_count.md | 25 +- .../sql-functions/bitmap-functions/bitmap_or.md | 32 +- .../bitmap-functions/bitmap_or_count.md | 16 +- .../sql-functions/bitmap-functions/bitmap_xor.md | 25 +- .../bitmap-functions/bitmap_xor_count.md | 25 +- .../orthogonal_bitmap_intersect.md | 47 + .../orthogonal_bitmap_intersect_count.md | 46 + .../orthogonal_bitmap_union_count.md | 46 + .../sql-functions/encrypt-digest-functions/aes.md | 88 ++ .../sql-functions/encrypt-digest-functions/md5.md | 47 + .../encrypt-digest-functions/md5sum.md | 56 + .../sql-functions/encrypt-digest-functions/sm3.md | 47 + .../encrypt-digest-functions/sm3sum.md | 56 + .../sql-functions/encrypt-digest-functions/sm4.md | 93 ++ .../table-functions/explode-bitmap.md | 157 ++ .../table-functions/explode-json-array.md | 286 ++++ .../sql-functions/table-functions/explode-split.md | 112 ++ .../Data Manipulation/BROKER LOAD.md | 8 +- .../sql-statements/Data Manipulation/EXPORT.md | 12 + .../sql-statements/Data Manipulation/OUTFILE.md | 207 +++ .../Data Manipulation/lateral-view.md | 94 ++ .../administrator-guide/block-rule/sql-block.md | 27 +- docs/zh-CN/administrator-guide/bloomfilter.md | 133 ++ docs/zh-CN/administrator-guide/config/be_config.md | 1 - docs/zh-CN/administrator-guide/config/fe_config.md | 11 + .../http-actions/compaction-action.md | 2 + .../load-data/batch-delete-manual.md | 10 +- .../load-data/broker-load-manual.md | 12 + .../load-data/routine-load-manual.md | 4 +- .../operation/be-olap-error-code.md | 6 +- .../orthogonal-bitmap-manual.md | 161 ++ docs/zh-CN/administrator-guide/outfile.md | 161 +- docs/zh-CN/administrator-guide/variables.md | 44 +- docs/zh-CN/article/articles/datax-doris-writer.md | 261 ---- docs/zh-CN/article/articles/doris-binlog-load.md | 421 ----- docs/zh-CN/article/articles/fe-load-balance.md | 475 ------ docs/zh-CN/article/articles/flink-cdc-to-doris.md | 372 ----- docs/zh-CN/case-user/case-user.md | 25 + .../zh-CN/community/commit-format-specification.md | 160 ++ docs/zh-CN/developer-guide/How-to-Share-blogs.md | 75 +- .../developer-guide/bitmap-hll-file-format.md | 64 + .../developer-guide/commit-format-specification.md | 158 -- docs/zh-CN/developer-guide/docker-dev.md | 162 ++ docs/zh-CN/developer-guide/fe-idea-dev.md | 27 +- docs/zh-CN/developer-guide/java-format-code.md | 11 + docs/zh-CN/downloads/downloads.md | 1 - .../zh-CN/extending-doris/flink-doris-connector.md | 103 +- docs/zh-CN/extending-doris/seatunnel.md | 117 ++ .../zh-CN/extending-doris/spark-doris-connector.md | 4 +- .../udf/contrib/udaf-orthogonal-bitmap-manual.md | 238 --- docs/zh-CN/faq/faq.md | 54 +- docs/zh-CN/getting-started/data-model-rollup.md | 12 +- docs/zh-CN/installing/compilation.md | 24 +- .../sql-functions/bitmap-functions/bitmap_and.md | 30 +- .../bitmap-functions/bitmap_and_count.md | 25 +- .../sql-functions/bitmap-functions/bitmap_or.md | 32 +- .../bitmap-functions/bitmap_or_count.md | 18 +- .../sql-functions/bitmap-functions/bitmap_xor.md | 25 +- .../bitmap-functions/bitmap_xor_count.md | 25 +- .../orthogonal_bitmap_intersect.md | 47 + .../orthogonal_bitmap_intersect_count.md | 46 + .../orthogonal_bitmap_union_count.md | 47 + .../sql-functions/encrypt-digest-functions/aes.md | 93 ++ .../sql-functions/encrypt-digest-functions/md5.md | 47 + .../encrypt-digest-functions/md5sum.md | 56 + .../sql-functions/encrypt-digest-functions/sm3.md | 47 + .../encrypt-digest-functions/sm3sum.md | 56 + .../sql-functions/encrypt-digest-functions/sm4.md | 93 ++ .../table-functions/explode-bitmap.md | 157 ++ .../table-functions/explode-json-array.md | 286 ++++ .../sql-functions/table-functions/explode-split.md | 112 ++ .../Data Manipulation/BROKER LOAD.md | 8 +- .../sql-statements/Data Manipulation/EXPORT.md | 12 + .../sql-statements/Data Manipulation/OUTFILE.md | 209 +++ .../Data Manipulation/lateral-view.md | 94 ++ env.sh | 35 +- extension/flink-doris-connector/build.sh | 2 + extension/flink-doris-connector/pom.xml | 52 +- .../doris/flink/cfg/DorisExecutionOptions.java | 4 +- .../flink/datastream/DorisSourceFunction.java | 32 +- .../org/apache/doris/flink/rest/RestService.java | 6 +- .../flink/table/DorisDynamicOutputFormat.java | 22 +- .../doris/flink/table/DorisDynamicTableSource.java | 2 +- .../apache/doris/flink/table/DorisStreamLoad.java | 36 +- .../org/apache/doris/flink/DorisSourceExample.java | 2 +- extension/spark-doris-connector/build.sh | 3 +- extension/spark-doris-connector/pom.xml | 76 +- extension/spark-doris-connector/pom_3.0.xml | 76 +- .../doris/spark/cfg/ConfigurationOptions.java | 6 +- .../doris/spark/sql/DorisStreamLoadSink.scala | 2 +- fe/fe-common/pom.xml | 20 +- .../org/apache/doris/common/io/BitmapValue.java | 425 +++++ .../java/org/apache/doris/common/io/Codec.java | 58 + .../main/java/org/apache/doris/common/io/Hll.java | 396 +++++ .../org/apache/doris/common/io/Roaring64Map.java | 1467 ++++++++++++++++++ .../apache/doris/common/io/BitmapValueTest.java | 518 +++++++ .../java/org/apache/doris/common/io/HllTest.java | 266 ++++ fe/fe-core/pom.xml | 43 +- fe/fe-core/src/main/cup/sql_parser.cup | 2 + .../src/main/java/org/apache/doris/PaloFe.java | 82 +- .../org/apache/doris/analysis/AnalyticExpr.java | 6 +- .../java/org/apache/doris/analysis/Analyzer.java | 164 +- .../org/apache/doris/analysis/ArithmeticExpr.java | 95 +- .../org/apache/doris/analysis/BinaryPredicate.java | 4 +- .../org/apache/doris/analysis/DecimalLiteral.java | 9 + .../apache/doris/analysis/FunctionCallExpr.java | 235 ++- .../org/apache/doris/analysis/InPredicate.java | 9 +- .../org/apache/doris/analysis/InlineViewRef.java | 4 + .../java/org/apache/doris/analysis/InsertStmt.java | 6 +- .../org/apache/doris/analysis/LateralViewRef.java | 42 +- .../org/apache/doris/analysis/LikePredicate.java | 5 +- .../org/apache/doris/analysis/OutFileClause.java | 17 + .../org/apache/doris/analysis/PredicateUtils.java | 55 + .../java/org/apache/doris/analysis/QueryStmt.java | 16 + .../java/org/apache/doris/analysis/SelectStmt.java | 35 +- .../apache/doris/analysis/SetOperationStmt.java | 12 +- .../java/org/apache/doris/analysis/SetVar.java | 9 + .../java/org/apache/doris/analysis/SlotRef.java | 8 + .../java/org/apache/doris/analysis/TableRef.java | 20 +- .../java/org/apache/doris/analysis/UpdateStmt.java | 3 +- .../org/apache/doris/backup/BackupJobInfo.java | 2 +- .../apache/doris/catalog/AggregateFunction.java | 19 +- .../java/org/apache/doris/catalog/Catalog.java | 89 +- .../java/org/apache/doris/catalog/FunctionSet.java | 259 +++- .../org/apache/doris/catalog/PartitionKey.java | 12 +- .../apache/doris/catalog/TabletInvertedIndex.java | 5 +- .../main/java/org/apache/doris/catalog/Type.java | 25 + .../apache/doris/clone/ClusterLoadStatistic.java | 14 +- .../org/apache/doris/clone/TabletScheduler.java | 21 +- .../clone/TwoDimensionalGreedyRebalanceAlgo.java | 11 + .../main/java/org/apache/doris/common/Config.java | 11 + .../java/org/apache/doris/common/ErrorCode.java | 43 +- .../org/apache/doris/common/ThreadPoolManager.java | 35 +- .../doris/common/proc/FrontendsProcNode.java | 25 +- .../common/profile/MultiProfileTreeBuilder.java | 2 +- .../doris/common/profile/PlanTreeBuilder.java | 1 + .../doris/common/profile/ProfileTreeBuilder.java | 6 + .../java/org/apache/doris/httpv2/HttpServer.java | 5 +- .../main/java/org/apache/doris/load/ExportJob.java | 3 +- .../doris/load/loadv2/BrokerLoadPendingTask.java | 5 +- .../org/apache/doris/load/loadv2/BulkLoadJob.java | 57 +- .../java/org/apache/doris/load/loadv2/LoadJob.java | 18 +- .../apache/doris/load/loadv2/LoadJobScheduler.java | 51 +- .../apache/doris/load/loadv2/LoadLoadingTask.java | 1 + .../org/apache/doris/load/loadv2/LoadManager.java | 43 +- .../doris/load/loadv2/LoadTimeoutChecker.java | 49 - .../doris/load/loadv2/SparkLoadPendingTask.java | 19 +- .../load/routineload/KafkaRoutineLoadJob.java | 22 +- .../doris/load/routineload/RoutineLoadJob.java | 2 +- .../java/org/apache/doris/mysql/MysqlChannel.java | 4 +- .../mysql/privilege/CommonUserProperties.java | 3 +- .../org/apache/doris/planner/AnalyticPlanner.java | 1 + .../java/org/apache/doris/planner/ColumnBound.java | 66 + .../java/org/apache/doris/planner/ColumnRange.java | 106 ++ .../apache/doris/planner/DistributedPlanner.java | 1 + .../org/apache/doris/planner/ExchangeNode.java | 1 + .../org/apache/doris/planner/HashJoinNode.java | 47 +- .../doris/planner/ListPartitionPrunerV2.java | 195 +++ .../org/apache/doris/planner/LoadScanNode.java | 3 +- .../org/apache/doris/planner/OlapScanNode.java | 29 +- .../org/apache/doris/planner/PartitionPruner.java | 2 +- .../doris/planner/PartitionPrunerV2Base.java | 200 +++ .../org/apache/doris/planner/PlanFragment.java | 3 +- .../java/org/apache/doris/planner/PlanNode.java | 11 +- .../java/org/apache/doris/planner/Planner.java | 1 + .../doris/planner/RangePartitionPrunerV2.java | 270 ++++ .../java/org/apache/doris/planner/RepeatNode.java | 21 + .../java/org/apache/doris/planner/ScanNode.java | 198 ++- .../apache/doris/planner/SingleNodePlanner.java | 5 +- .../apache/doris/planner/TableFunctionNode.java | 15 +- .../java/org/apache/doris/qe/ConnectContext.java | 32 +- .../java/org/apache/doris/qe/ConnectProcessor.java | 47 +- .../java/org/apache/doris/qe/ConnectScheduler.java | 12 +- .../main/java/org/apache/doris/qe/Coordinator.java | 3 +- .../java/org/apache/doris/qe/SessionVariable.java | 49 +- .../java/org/apache/doris/qe/SimpleScheduler.java | 2 +- .../java/org/apache/doris/qe/StmtExecutor.java | 69 +- .../org/apache/doris/qe/cache/CacheAnalyzer.java | 29 +- .../org/apache/doris/qe/cache/PartitionCache.java | 11 +- .../java/org/apache/doris/qe/cache/SqlCache.java | 10 +- .../doris/rewrite/BetweenToCompoundRule.java | 2 +- .../doris/rewrite/CompoundPredicateWriteRule.java | 2 +- .../org/apache/doris/rewrite/ExprRewriteRule.java | 2 +- .../org/apache/doris/rewrite/ExprRewriter.java | 32 +- .../doris/rewrite/ExtractCommonFactorsRule.java | 4 +- .../java/org/apache/doris/rewrite/FEFunctions.java | 8 +- .../apache/doris/rewrite/FoldConstantsRule.java | 6 +- .../org/apache/doris/rewrite/InferFiltersRule.java | 676 ++++++++ .../rewrite/NormalizeBinaryPredicatesRule.java | 2 +- .../doris/rewrite/RewriteAliasFunctionRule.java | 2 +- .../doris/rewrite/RewriteBinaryPredicatesRule.java | 99 ++ .../doris/rewrite/RewriteEncryptKeyRule.java | 2 +- .../doris/rewrite/RewriteFromUnixTimeRule.java | 2 +- .../doris/rewrite/RewriteLikePredicateRule.java | 2 +- ...implifyInvalidDateBinaryPredicatesDateRule.java | 2 +- .../rewrite/mvrewrite/CountDistinctToBitmap.java | 3 +- .../mvrewrite/CountDistinctToBitmapOrHLLRule.java | 3 +- .../doris/rewrite/mvrewrite/CountFieldToSum.java | 3 +- .../rewrite/mvrewrite/HLLHashToSlotRefRule.java | 3 +- .../apache/doris/rewrite/mvrewrite/NDVToHll.java | 3 +- .../rewrite/mvrewrite/ToBitmapToSlotRefRule.java | 3 +- .../apache/doris/service/FrontendServiceImpl.java | 44 +- .../org/apache/doris/task/MasterTaskExecutor.java | 4 +- .../doris/transaction/DatabaseTransactionMgr.java | 29 +- .../apache/doris/transaction/TransactionState.java | 91 +- .../doris/analysis/ListPartitionPrunerTest.java | 160 +- .../doris/analysis/PartitionPruneTestBase.java | 71 + .../doris/analysis/RangePartitionPruneTest.java | 213 +++ .../org/apache/doris/analysis/SelectStmtTest.java | 22 +- .../analysis/TableNameStoredLowercaseTest.java | 10 + .../doris/blockrule/SqlBlockRuleMgrTest.java | 29 + .../java/org/apache/doris/clone/RebalanceTest.java | 4 +- .../org/apache/doris/load/loadv2/LoadJobTest.java | 14 +- .../apache/doris/load/loadv2/SparkLoadJobTest.java | 28 +- .../load/loadv2/SparkLoadPendingTaskTest.java | 11 +- .../load/routineload/KafkaRoutineLoadJobTest.java | 10 +- .../org/apache/doris/mysql/MysqlChannelTest.java | 10 +- .../planner/MaterializedViewFunctionTest.java | 37 +- .../java/org/apache/doris/planner/PlannerTest.java | 40 + .../org/apache/doris/planner/QueryPlanTest.java | 26 +- .../doris/planner/TableFunctionPlanTest.java | 124 +- .../org/apache/doris/qe/PartitionCacheTest.java | 289 +++- .../java/org/apache/doris/qe/StmtExecutorTest.java | 2 +- .../apache/doris/rewrite/InferFiltersRuleTest.java | 309 ++++ .../rewrite/mvrewrite/CountFieldToSumTest.java | 3 +- fe/pom.xml | 84 +- fe/spark-dpp/pom.xml | 22 +- .../main/java/org/apache/doris/common/Codec.java | 58 - .../apache/doris/load/loadv2/dpp/BitmapValue.java | 425 ----- .../load/loadv2/dpp/DorisKryoRegistrator.java | 3 + .../java/org/apache/doris/load/loadv2/dpp/Hll.java | 396 ----- .../apache/doris/load/loadv2/dpp/Roaring64Map.java | 1468 ------------------ .../doris/load/loadv2/dpp/SparkRDDAggregator.java | 2 + .../doris/load/loadv2/dpp/BitmapValueTest.java | 521 ------- .../org/apache/doris/load/loadv2/dpp/HllTest.java | 268 ---- fe_plugins/auditdemo/pom.xml | 10 +- fe_plugins/auditloader/pom.xml | 15 +- fe_plugins/pom.xml | 63 +- fs_brokers/apache_hdfs_broker/bin/start_broker.sh | 71 +- fs_brokers/apache_hdfs_broker/pom.xml | 58 +- .../doris/broker/hdfs/FileSystemManager.java | 70 +- gensrc/proto/data.proto | 1 - gensrc/proto/internal_service.proto | 4 + gensrc/proto/olap_file.proto | 7 + gensrc/proto/palo_internal_service.proto | 46 + gensrc/script/doris_builtins_functions.py | 318 ++-- gensrc/script/gen_build_version.sh | 59 +- gensrc/script/gen_builtins_functions.py | 5 + gensrc/thrift/DataSinks.thrift | 2 - gensrc/thrift/PaloInternalService.thrift | 5 + gensrc/thrift/PlanNodes.thrift | 5 + gensrc/thrift/Types.thrift | 1 + samples/doris-demo/flink-demo/pom.xml | 5 +- samples/doris-demo/pom.xml | 2 +- samples/doris-demo/spark-demo/pom.xml | 4 +- samples/doris-demo/spring-jdbc-demo/pom.xml | 2 +- samples/doris-demo/stream-load-demo/pom.xml | 2 +- thirdparty/CHANGELOG.md | 13 + thirdparty/build-thirdparty.sh | 15 + thirdparty/vars.sh | 15 +- 963 files changed, 86868 insertions(+), 13709 deletions(-) create mode 100644 .asf.yaml create mode 100644 .github/workflows/build-extension.yml delete mode 100644 .travis.yml create mode 100644 be/src/env/env.cpp create mode 100644 be/src/env/env_posix.h create mode 100644 be/src/env/env_remote.cpp create mode 100644 be/src/env/env_remote.h create mode 100644 be/src/exec/table_function_node.cpp create mode 100644 be/src/exec/table_function_node.h create mode 100644 be/src/exprs/table_function/dummy_table_functions.cpp create mode 100644 be/src/exprs/table_function/dummy_table_functions.h create mode 100644 be/src/exprs/table_function/explode_bitmap.cpp create mode 100644 be/src/exprs/table_function/explode_bitmap.h create mode 100644 be/src/exprs/table_function/explode_json_array.cpp create mode 100644 be/src/exprs/table_function/explode_json_array.h create mode 100644 be/src/exprs/table_function/explode_split.cpp create mode 100644 be/src/exprs/table_function/explode_split.h create mode 100644 be/src/exprs/table_function/table_function.h create mode 100644 be/src/exprs/table_function/table_function_factory.cpp create mode 100644 be/src/exprs/table_function/table_function_factory.h create mode 100644 be/src/exprs/v_string_functions.h create mode 100644 be/src/olap/fs/remote_block_manager.cpp create mode 100644 be/src/olap/fs/remote_block_manager.h create mode 100644 be/src/runtime/fold_constant_executor.cpp create mode 100644 be/src/runtime/fold_constant_executor.h delete mode 100644 be/src/runtime/fold_constant_mgr.cpp delete mode 100644 be/src/runtime/fold_constant_mgr.h delete mode 100644 be/src/util/aes_util.cpp delete mode 100644 be/src/util/aes_util.h create mode 100644 be/src/util/encryption_util.cpp create mode 100644 be/src/util/encryption_util.h create mode 100644 be/src/util/sm3.cpp create mode 100644 be/src/util/sm3.h create mode 100644 be/src/vec/CMakeLists.txt create mode 100644 be/src/vec/aggregate_functions/aggregate_function.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_avg.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_avg.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_bitmap.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_bitmap.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_combinator.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_count.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_count.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_distinct.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_distinct.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_hll_union_agg.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_hll_union_agg.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_min_max.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_min_max.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_nothing.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_null.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_null.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_reader.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_reader.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_simple_factory.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_simple_factory.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_sum.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_sum.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_uniq.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_uniq.h create mode 100644 be/src/vec/aggregate_functions/aggregate_function_window.cpp create mode 100644 be/src/vec/aggregate_functions/aggregate_function_window.h create mode 100644 be/src/vec/aggregate_functions/factory_helpers.h create mode 100644 be/src/vec/aggregate_functions/helpers.h create mode 100644 be/src/vec/aggregate_functions/key_holder_helpers.h create mode 100644 be/src/vec/columns/collator.cpp create mode 100644 be/src/vec/columns/collator.h create mode 100644 be/src/vec/columns/column.cpp create mode 100644 be/src/vec/columns/column.h create mode 100644 be/src/vec/columns/column_complex.h create mode 100644 be/src/vec/columns/column_const.cpp create mode 100644 be/src/vec/columns/column_const.h create mode 100644 be/src/vec/columns/column_decimal.cpp create mode 100644 be/src/vec/columns/column_decimal.h create mode 100644 be/src/vec/columns/column_dummy.h create mode 100644 be/src/vec/columns/column_impl.h create mode 100644 be/src/vec/columns/column_nothing.h create mode 100644 be/src/vec/columns/column_nullable.cpp create mode 100644 be/src/vec/columns/column_nullable.h create mode 100644 be/src/vec/columns/column_set.h create mode 100644 be/src/vec/columns/column_string.cpp create mode 100644 be/src/vec/columns/column_string.h create mode 100644 be/src/vec/columns/column_vector.cpp create mode 100644 be/src/vec/columns/column_vector.h create mode 100644 be/src/vec/columns/column_vector_helper.h create mode 100644 be/src/vec/columns/columns_common.cpp create mode 100644 be/src/vec/columns/columns_common.h create mode 100644 be/src/vec/columns/columns_number.h create mode 100644 be/src/vec/columns/predicate_column.h create mode 100644 be/src/vec/common/aggregation_common.h create mode 100644 be/src/vec/common/allocator.h create mode 100644 be/src/vec/common/allocator_fwd.h create mode 100644 be/src/vec/common/arena.h create mode 100644 be/src/vec/common/arithmetic_overflow.h create mode 100644 be/src/vec/common/assert_cast.h create mode 100644 be/src/vec/common/bit_cast.h create mode 100644 be/src/vec/common/bit_helpers.h create mode 100644 be/src/vec/common/columns_hashing.h create mode 100644 be/src/vec/common/columns_hashing_impl.h create mode 100644 be/src/vec/common/cow.h create mode 100644 be/src/vec/common/demangle.cpp create mode 100644 be/src/vec/common/demangle.h create mode 100644 be/src/vec/common/exception.cpp create mode 100644 be/src/vec/common/exception.h create mode 100644 be/src/vec/common/field_visitors.h create mode 100644 be/src/vec/common/hash_table/fixed_hash_map.h create mode 100644 be/src/vec/common/hash_table/fixed_hash_table.h create mode 100644 be/src/vec/common/hash_table/hash.h create mode 100644 be/src/vec/common/hash_table/hash_map.h create mode 100644 be/src/vec/common/hash_table/hash_set.h create mode 100644 be/src/vec/common/hash_table/hash_table.h create mode 100644 be/src/vec/common/hash_table/hash_table_allocator.h create mode 100644 be/src/vec/common/hash_table/hash_table_key_holder.h create mode 100644 be/src/vec/common/int_exp.h create mode 100644 be/src/vec/common/memcmp_small.h create mode 100644 be/src/vec/common/memcpy_small.h create mode 100644 be/src/vec/common/mremap.h create mode 100644 be/src/vec/common/nan_utils.h create mode 100644 be/src/vec/common/pod_array.cpp create mode 100644 be/src/vec/common/pod_array.h create mode 100644 be/src/vec/common/pod_array_fwd.h create mode 100644 be/src/vec/common/radix_sort.h create mode 100644 be/src/vec/common/sip_hash.h create mode 100644 be/src/vec/common/string_buffer.hpp create mode 100644 be/src/vec/common/string_ref.h create mode 100644 be/src/vec/common/string_utils/string_utils.cpp create mode 100644 be/src/vec/common/string_utils/string_utils.h create mode 100644 be/src/vec/common/strong_typedef.h create mode 100644 be/src/vec/common/typeid_cast.h create mode 100644 be/src/vec/common/uint128.h create mode 100644 be/src/vec/common/unaligned.h create mode 100644 be/src/vec/core/accurate_comparison.h create mode 100644 be/src/vec/core/block.cpp create mode 100644 be/src/vec/core/block.h create mode 100644 be/src/vec/core/block_info.cpp create mode 100644 be/src/vec/core/block_info.h create mode 100644 be/src/vec/core/call_on_type_index.h create mode 100644 be/src/vec/core/column_numbers.h create mode 100644 be/src/vec/core/column_with_type_and_name.cpp create mode 100644 be/src/vec/core/column_with_type_and_name.h create mode 100644 be/src/vec/core/columns_with_type_and_name.h create mode 100644 be/src/vec/core/decimal_comparison.h create mode 100644 be/src/vec/core/field.cpp create mode 100644 be/src/vec/core/field.h create mode 100644 be/src/vec/core/materialize_block.cpp create mode 100644 be/src/vec/core/materialize_block.h create mode 100644 be/src/vec/core/names.h create mode 100644 be/src/vec/core/sort_block.cpp create mode 100644 be/src/vec/core/sort_block.h create mode 100644 be/src/vec/core/sort_cursor.h create mode 100644 be/src/vec/core/sort_description.h create mode 100644 be/src/vec/core/types.h create mode 100644 be/src/vec/data_types/data_type.cpp create mode 100644 be/src/vec/data_types/data_type.h create mode 100644 be/src/vec/data_types/data_type_bitmap.cpp create mode 100644 be/src/vec/data_types/data_type_bitmap.h create mode 100644 be/src/vec/data_types/data_type_date.cpp create mode 100644 be/src/vec/data_types/data_type_date.h create mode 100644 be/src/vec/data_types/data_type_date_time.cpp create mode 100644 be/src/vec/data_types/data_type_date_time.h create mode 100644 be/src/vec/data_types/data_type_decimal.cpp create mode 100644 be/src/vec/data_types/data_type_decimal.h create mode 100644 be/src/vec/data_types/data_type_factory.hpp create mode 100644 be/src/vec/data_types/data_type_nothing.cpp create mode 100644 be/src/vec/data_types/data_type_nothing.h create mode 100644 be/src/vec/data_types/data_type_nullable.cpp create mode 100644 be/src/vec/data_types/data_type_nullable.h create mode 100644 be/src/vec/data_types/data_type_number.h create mode 100644 be/src/vec/data_types/data_type_number_base.cpp create mode 100644 be/src/vec/data_types/data_type_number_base.h create mode 100644 be/src/vec/data_types/data_type_string.cpp create mode 100644 be/src/vec/data_types/data_type_string.h create mode 100644 be/src/vec/data_types/get_least_supertype.cpp create mode 100644 be/src/vec/data_types/get_least_supertype.h create mode 100644 be/src/vec/data_types/nested_utils.cpp create mode 100644 be/src/vec/data_types/nested_utils.h create mode 100644 be/src/vec/data_types/number_traits.h create mode 100644 be/src/vec/exec/join/join_op.h create mode 100644 be/src/vec/exec/join/vacquire_list.hpp create mode 100644 be/src/vec/exec/join/vhash_join_node.cpp create mode 100644 be/src/vec/exec/join/vhash_join_node.h create mode 100644 be/src/vec/exec/vaggregation_node.cpp create mode 100644 be/src/vec/exec/vaggregation_node.h create mode 100644 be/src/vec/exec/vanalytic_eval_node.cpp create mode 100644 be/src/vec/exec/vanalytic_eval_node.h create mode 100644 be/src/vec/exec/vassert_num_rows_node.cpp create mode 100644 be/src/vec/exec/vassert_num_rows_node.h create mode 100644 be/src/vec/exec/vblocking_join_node.cpp create mode 100644 be/src/vec/exec/vblocking_join_node.h create mode 100644 be/src/vec/exec/vcross_join_node.cpp create mode 100644 be/src/vec/exec/vcross_join_node.h create mode 100644 be/src/vec/exec/vempty_set_node.cpp create mode 100644 be/src/vec/exec/vempty_set_node.h create mode 100644 be/src/vec/exec/ves_http_scan_node.cpp create mode 100644 be/src/vec/exec/ves_http_scan_node.h create mode 100644 be/src/vec/exec/ves_http_scanner.cpp create mode 100644 be/src/vec/exec/ves_http_scanner.h create mode 100644 be/src/vec/exec/vexcept_node.cpp create mode 100644 be/src/vec/exec/vexcept_node.h create mode 100644 be/src/vec/exec/vexchange_node.cpp create mode 100644 be/src/vec/exec/vexchange_node.h create mode 100644 be/src/vec/exec/vintersect_node.cpp create mode 100644 be/src/vec/exec/vintersect_node.h create mode 100644 be/src/vec/exec/vmysql_scan_node.cpp create mode 100644 be/src/vec/exec/vmysql_scan_node.h create mode 100644 be/src/vec/exec/vodbc_scan_node.cpp create mode 100644 be/src/vec/exec/vodbc_scan_node.h create mode 100644 be/src/vec/exec/volap_scan_node.cpp create mode 100644 be/src/vec/exec/volap_scan_node.h create mode 100644 be/src/vec/exec/volap_scanner.cpp create mode 100644 be/src/vec/exec/volap_scanner.h create mode 100644 be/src/vec/exec/vschema_scan_node.cpp create mode 100644 be/src/vec/exec/vschema_scan_node.h create mode 100644 be/src/vec/exec/vselect_node.cpp create mode 100644 be/src/vec/exec/vselect_node.h create mode 100644 be/src/vec/exec/vset_operation_node.cpp create mode 100644 be/src/vec/exec/vset_operation_node.h create mode 100644 be/src/vec/exec/vsort_exec_exprs.cpp create mode 100644 be/src/vec/exec/vsort_exec_exprs.h create mode 100644 be/src/vec/exec/vsort_node.cpp create mode 100644 be/src/vec/exec/vsort_node.h create mode 100644 be/src/vec/exec/vunion_node.cpp create mode 100644 be/src/vec/exec/vunion_node.h create mode 100644 be/src/vec/exprs/vcase_expr.cpp create mode 100644 be/src/vec/exprs/vcase_expr.h create mode 100644 be/src/vec/exprs/vcast_expr.cpp create mode 100644 be/src/vec/exprs/vcast_expr.h create mode 100644 be/src/vec/exprs/vcompound_pred.h create mode 100644 be/src/vec/exprs/vectorized_agg_fn.cpp create mode 100644 be/src/vec/exprs/vectorized_agg_fn.h create mode 100644 be/src/vec/exprs/vectorized_fn_call.cpp create mode 100644 be/src/vec/exprs/vectorized_fn_call.h create mode 100644 be/src/vec/exprs/vexpr.cpp create mode 100644 be/src/vec/exprs/vexpr.h create mode 100644 be/src/vec/exprs/vexpr_context.cpp create mode 100644 be/src/vec/exprs/vexpr_context.h create mode 100644 be/src/vec/exprs/vin_predicate.cpp create mode 100644 be/src/vec/exprs/vin_predicate.h create mode 100644 be/src/vec/exprs/vinfo_func.cpp create mode 100644 be/src/vec/exprs/vinfo_func.h create mode 100644 be/src/vec/exprs/vliteral.cpp create mode 100644 be/src/vec/exprs/vliteral.h create mode 100644 be/src/vec/exprs/vslot_ref.cpp create mode 100644 be/src/vec/exprs/vslot_ref.h create mode 100644 be/src/vec/functions/cast_type_to_either.h create mode 100644 be/src/vec/functions/comparison.cpp create mode 100644 be/src/vec/functions/comparison_equal_for_null.cpp create mode 100644 be/src/vec/functions/comparison_equals.cpp create mode 100644 be/src/vec/functions/comparison_greater.cpp create mode 100644 be/src/vec/functions/comparison_less.cpp create mode 100644 be/src/vec/functions/date_time_transforms.h create mode 100644 be/src/vec/functions/divide.cpp create mode 100644 be/src/vec/functions/function.cpp create mode 100644 be/src/vec/functions/function.h create mode 100644 be/src/vec/functions/function_always_not_nullable.h create mode 100644 be/src/vec/functions/function_binary_arithmetic.h create mode 100644 be/src/vec/functions/function_binary_arithmetic_to_null_type.h create mode 100644 be/src/vec/functions/function_bit.cpp create mode 100644 be/src/vec/functions/function_bitmap.cpp create mode 100644 be/src/vec/functions/function_case.cpp create mode 100644 be/src/vec/functions/function_case.h create mode 100644 be/src/vec/functions/function_cast.cpp create mode 100644 be/src/vec/functions/function_cast.h create mode 100644 be/src/vec/functions/function_const.h create mode 100644 be/src/vec/functions/function_date_or_datetime_computation.cpp create mode 100644 be/src/vec/functions/function_date_or_datetime_computation.h create mode 100644 be/src/vec/functions/function_date_or_datetime_to_something.h create mode 100644 be/src/vec/functions/function_date_or_datetime_to_string.cpp create mode 100644 be/src/vec/functions/function_date_or_datetime_to_string.h create mode 100644 be/src/vec/functions/function_datetime_string_to_string.cpp create mode 100644 be/src/vec/functions/function_datetime_string_to_string.h create mode 100644 be/src/vec/functions/function_hash.cpp create mode 100644 be/src/vec/functions/function_hash.h create mode 100644 be/src/vec/functions/function_helpers.cpp create mode 100644 be/src/vec/functions/function_helpers.h create mode 100644 be/src/vec/functions/function_ifnull.cpp create mode 100644 be/src/vec/functions/function_ifnull.h create mode 100644 be/src/vec/functions/function_json.cpp create mode 100644 be/src/vec/functions/function_math_binary_float64.h create mode 100644 be/src/vec/functions/function_math_unary.h create mode 100644 be/src/vec/functions/function_string.cpp create mode 100644 be/src/vec/functions/function_string.h create mode 100644 be/src/vec/functions/function_string_to_string.h create mode 100644 be/src/vec/functions/function_timestamp.cpp create mode 100644 be/src/vec/functions/function_totype.h create mode 100644 be/src/vec/functions/function_unary_arithmetic.h create mode 100644 be/src/vec/functions/function_variadic_arguments.h create mode 100644 be/src/vec/functions/functions_comparison.h create mode 100644 be/src/vec/functions/functions_logical.cpp create mode 100644 be/src/vec/functions/functions_logical.h create mode 100644 be/src/vec/functions/hll_cardinality.cpp create mode 100644 be/src/vec/functions/hll_empty.cpp create mode 100644 be/src/vec/functions/hll_hash.cpp create mode 100644 be/src/vec/functions/if.cpp create mode 100644 be/src/vec/functions/in.cpp create mode 100644 be/src/vec/functions/int_div.cpp create mode 100644 be/src/vec/functions/int_div.h create mode 100644 be/src/vec/functions/is_not_null.cpp create mode 100644 be/src/vec/functions/is_null.cpp create mode 100644 be/src/vec/functions/like.cpp create mode 100644 be/src/vec/functions/like.h create mode 100644 be/src/vec/functions/math.cpp create mode 100644 be/src/vec/functions/minus.cpp create mode 100644 be/src/vec/functions/modulo.cpp create mode 100644 be/src/vec/functions/multiply.cpp create mode 100644 be/src/vec/functions/nullif.cpp create mode 100644 be/src/vec/functions/plus.cpp create mode 100644 be/src/vec/functions/random.cpp create mode 100644 be/src/vec/functions/simple_function_factory.h create mode 100644 be/src/vec/functions/time_of_function.cpp create mode 100644 be/src/vec/functions/to_time_function.cpp create mode 100644 be/src/vec/io/io_helper.h create mode 100644 be/src/vec/io/reader_buffer.h create mode 100644 be/src/vec/io/var_int.h create mode 100644 be/src/vec/olap/block_reader.cpp create mode 100644 be/src/vec/olap/block_reader.h create mode 100644 be/src/vec/olap/vcollect_iterator.cpp create mode 100644 be/src/vec/olap/vcollect_iterator.h create mode 100644 be/src/vec/olap/vgeneric_iterators.cpp create mode 100644 be/src/vec/olap/vgeneric_iterators.h create mode 100644 be/src/vec/runtime/vdata_stream_mgr.cpp create mode 100644 be/src/vec/runtime/vdata_stream_mgr.h create mode 100644 be/src/vec/runtime/vdata_stream_recvr.cpp create mode 100644 be/src/vec/runtime/vdata_stream_recvr.h create mode 100644 be/src/vec/runtime/vdatetime_value.cpp create mode 100644 be/src/vec/runtime/vdatetime_value.h create mode 100644 be/src/vec/runtime/vpartition_info.cpp create mode 100644 be/src/vec/runtime/vpartition_info.h create mode 100644 be/src/vec/runtime/vsorted_run_merger.cpp create mode 100644 be/src/vec/runtime/vsorted_run_merger.h create mode 100644 be/src/vec/sink/mysql_result_writer.cpp create mode 100644 be/src/vec/sink/mysql_result_writer.h create mode 100644 be/src/vec/sink/result_sink.cpp create mode 100644 be/src/vec/sink/result_sink.h create mode 100644 be/src/vec/sink/result_writer.h create mode 100644 be/src/vec/sink/vdata_stream_sender.cpp create mode 100644 be/src/vec/sink/vdata_stream_sender.h create mode 100644 be/src/vec/sink/vtabet_sink.cpp create mode 100644 be/src/vec/sink/vtablet_sink.h create mode 100644 be/src/vec/utils/util.hpp delete mode 100644 be/test/util/aes_util_test.cpp create mode 100644 be/test/util/encryption_util_test.cpp create mode 100644 be/test/util/sm3_test.cpp create mode 100644 be/test/vec/aggregate_functions/CMakeLists.txt create mode 100644 be/test/vec/aggregate_functions/agg_test.cpp create mode 100644 be/test/vec/core/CMakeLists.txt create mode 100644 be/test/vec/core/block_test.cpp create mode 100644 be/test/vec/core/column_complex_test.cpp create mode 100644 be/test/vec/exec/CMakeLists.txt create mode 100644 be/test/vec/exec/vgeneric_iterators_test.cpp create mode 100644 be/test/vec/exprs/CMakeLists.txt create mode 100644 be/test/vec/exprs/vexpr_test.cpp create mode 100644 be/test/vec/function/CMakeLists.txt create mode 100644 be/test/vec/function/function_abs_test.cpp create mode 100644 be/test/vec/function/function_arithmetic_test.cpp create mode 100644 be/test/vec/function/function_bitmap_test.cpp create mode 100644 be/test/vec/function/function_comparison_test.cpp create mode 100644 be/test/vec/function/function_hash_test.cpp create mode 100644 be/test/vec/function/function_ifnull_test.cpp create mode 100644 be/test/vec/function/function_like_test.cpp create mode 100644 be/test/vec/function/function_math_test.cpp create mode 100644 be/test/vec/function/function_nullif_test.cpp create mode 100644 be/test/vec/function/function_string_test.cpp create mode 100644 be/test/vec/function/function_test_util.h create mode 100644 be/test/vec/function/function_time_test.cpp create mode 100644 be/test/vec/runtime/CMakeLists.txt create mode 100644 be/test/vec/runtime/vdata_stream_test.cpp delete mode 100644 contrib/udf/src/udaf_orthogonal_bitmap/CMakeLists.txt delete mode 100644 contrib/udf/src/udaf_orthogonal_bitmap/bitmap_value.h delete mode 100644 contrib/udf/src/udaf_orthogonal_bitmap/orthogonal_bitmap_function.cpp delete mode 100644 contrib/udf/src/udaf_orthogonal_bitmap/orthogonal_bitmap_function.h delete mode 100644 contrib/udf/src/udaf_orthogonal_bitmap/string_value.h create mode 100644 docs/.vuepress/components/CaseList.vue create mode 100644 docs/.vuepress/public/images/Bloom_filter.svg.png delete mode 100644 docs/.vuepress/public/images/binlog/image-20211110145044815.png delete mode 100644 docs/.vuepress/public/images/binlog/image-20211110160106602.png delete mode 100644 docs/.vuepress/public/images/binlog/image-20211110160331479.png delete mode 100644 docs/.vuepress/public/images/binlog/image-20211110160710709.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211025162831632.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211025165547903.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211025170642628.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211025182341086.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211025182435827.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211026095513892.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211026100505972.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211026100804091.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211026100943474.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211026101004547.png delete mode 100644 docs/.vuepress/public/images/cdc/image-20211026101203629.png delete mode 100644 docs/.vuepress/public/images/image-20210903132250723.png delete mode 100644 docs/.vuepress/public/images/image-20210903132539511.png delete mode 100644 docs/.vuepress/public/images/image-20210903134043421.png create mode 100644 docs/en/administrator-guide/bloomfilter.md create mode 100644 docs/en/administrator-guide/orthogonal-bitmap-manual.md delete mode 100644 docs/en/article/articles/datax-doris-writer.md delete mode 100644 docs/en/article/articles/doris-binlog-load.md delete mode 100644 docs/en/article/articles/fe-load-balance.md delete mode 100644 docs/en/article/articles/flink-cdc-to-doris.md create mode 100644 docs/en/case-user/case-user.md create mode 100644 docs/en/community/commit-format-specification.md create mode 100644 docs/en/developer-guide/bitmap-hll-file-format.md delete mode 100644 docs/en/developer-guide/commit-format-specification.md create mode 100644 docs/en/developer-guide/docker-dev.md create mode 100644 docs/en/extending-doris/seatunnel.md delete mode 100644 docs/en/extending-doris/udf/contrib/udaf-orthogonal-bitmap-manual.md create mode 100644 docs/en/sql-reference/sql-functions/bitmap-functions/orthogonal_bitmap_intersect.md create mode 100644 docs/en/sql-reference/sql-functions/bitmap-functions/orthogonal_bitmap_intersect_count.md create mode 100644 docs/en/sql-reference/sql-functions/bitmap-functions/orthogonal_bitmap_union_count.md create mode 100644 docs/en/sql-reference/sql-functions/encrypt-digest-functions/aes.md create mode 100644 docs/en/sql-reference/sql-functions/encrypt-digest-functions/md5.md create mode 100644 docs/en/sql-reference/sql-functions/encrypt-digest-functions/md5sum.md create mode 100644 docs/en/sql-reference/sql-functions/encrypt-digest-functions/sm3.md create mode 100644 docs/en/sql-reference/sql-functions/encrypt-digest-functions/sm3sum.md create mode 100644 docs/en/sql-reference/sql-functions/encrypt-digest-functions/sm4.md create mode 100644 docs/en/sql-reference/sql-functions/table-functions/explode-bitmap.md create mode 100644 docs/en/sql-reference/sql-functions/table-functions/explode-json-array.md create mode 100644 docs/en/sql-reference/sql-functions/table-functions/explode-split.md create mode 100644 docs/en/sql-reference/sql-statements/Data Manipulation/OUTFILE.md create mode 100644 docs/en/sql-reference/sql-statements/Data Manipulation/lateral-view.md create mode 100644 docs/zh-CN/administrator-guide/bloomfilter.md create mode 100644 docs/zh-CN/administrator-guide/orthogonal-bitmap-manual.md delete mode 100644 docs/zh-CN/article/articles/datax-doris-writer.md delete mode 100644 docs/zh-CN/article/articles/doris-binlog-load.md delete mode 100644 docs/zh-CN/article/articles/fe-load-balance.md delete mode 100644 docs/zh-CN/article/articles/flink-cdc-to-doris.md create mode 100644 docs/zh-CN/case-user/case-user.md create mode 100644 docs/zh-CN/community/commit-format-specification.md create mode 100644 docs/zh-CN/developer-guide/bitmap-hll-file-format.md delete mode 100644 docs/zh-CN/developer-guide/commit-format-specification.md create mode 100644 docs/zh-CN/developer-guide/docker-dev.md create mode 100644 docs/zh-CN/extending-doris/seatunnel.md delete mode 100644 docs/zh-CN/extending-doris/udf/contrib/udaf-orthogonal-bitmap-manual.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/bitmap-functions/orthogonal_bitmap_intersect.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/bitmap-functions/orthogonal_bitmap_intersect_count.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/bitmap-functions/orthogonal_bitmap_union_count.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/encrypt-digest-functions/aes.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/encrypt-digest-functions/md5.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/encrypt-digest-functions/md5sum.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/encrypt-digest-functions/sm3.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/encrypt-digest-functions/sm3sum.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/encrypt-digest-functions/sm4.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/table-functions/explode-bitmap.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/table-functions/explode-json-array.md create mode 100644 docs/zh-CN/sql-reference/sql-functions/table-functions/explode-split.md create mode 100644 docs/zh-CN/sql-reference/sql-statements/Data Manipulation/OUTFILE.md create mode 100644 docs/zh-CN/sql-reference/sql-statements/Data Manipulation/lateral-view.md create mode 100644 fe/fe-common/src/main/java/org/apache/doris/common/io/BitmapValue.java create mode 100644 fe/fe-common/src/main/java/org/apache/doris/common/io/Codec.java create mode 100644 fe/fe-common/src/main/java/org/apache/doris/common/io/Hll.java create mode 100644 fe/fe-common/src/main/java/org/apache/doris/common/io/Roaring64Map.java create mode 100644 fe/fe-common/src/test/java/org/apache/doris/common/io/BitmapValueTest.java create mode 100644 fe/fe-common/src/test/java/org/apache/doris/common/io/HllTest.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/analysis/PredicateUtils.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/load/loadv2/LoadTimeoutChecker.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/planner/ColumnBound.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/planner/ColumnRange.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/planner/ListPartitionPrunerV2.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/planner/PartitionPrunerV2Base.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/planner/RangePartitionPrunerV2.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/rewrite/InferFiltersRule.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/rewrite/RewriteBinaryPredicatesRule.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/analysis/PartitionPruneTestBase.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/analysis/RangePartitionPruneTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/rewrite/InferFiltersRuleTest.java delete mode 100644 fe/spark-dpp/src/main/java/org/apache/doris/common/Codec.java delete mode 100644 fe/spark-dpp/src/main/java/org/apache/doris/load/loadv2/dpp/BitmapValue.java delete mode 100644 fe/spark-dpp/src/main/java/org/apache/doris/load/loadv2/dpp/Hll.java delete mode 100644 fe/spark-dpp/src/main/java/org/apache/doris/load/loadv2/dpp/Roaring64Map.java delete mode 100644 fe/spark-dpp/src/test/java/org/apache/doris/load/loadv2/dpp/BitmapValueTest.java delete mode 100644 fe/spark-dpp/src/test/java/org/apache/doris/load/loadv2/dpp/HllTest.java create mode 100644 gensrc/proto/palo_internal_service.proto --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org