Re: How to insert hll_hash with flink?

2022-07-10 Thread song wang
yes,I'm worried that writing Doris directly will increase the load of Doris, so I want hll_hash(fieldName) outside doris by flink,can it work?

Re: Re: How to insert hll_hash with flink?

2022-07-10 Thread song wang
thanks 聪辉, If I insert into doris by enlarge the batch size, can it reduce the load of Doris?just like do pre aggregation hll outside doris?

Re:Re: How to insert hll_hash with flink?

2022-07-10 Thread 蔡聪辉
hi, song wang. now. flink-conncetor cannot do pre aggregation such as hll and bitmap outside doris. maybe you should enlarge the batch size and cocurrent num to achive your consume rate goal 100w/s 在 2022-07-11 12:43:04,"song wang" 写道: >Hi wudi, >Thank you for your reply, The introduction i

Re: How to insert hll_hash with flink?

2022-07-10 Thread wudi
hi, song wang What does flink's preprocessing mean? Does it mean the data of HLL generated by flink? I understand that flink does not need to care about the HLL type. The HLL data is generated by HLL_HASH(column) when it is imported. So you only need to import the existing data in flink into dor

Re: How to insert hll_hash with flink?

2022-07-10 Thread song wang
Hi wudi, Thank you for your reply, The introduction in the link is very simple, I didn't find the pre-processing related to Flink, Could you explain it in more detail? wudi <676366...@qq.com.invalid> 于2022年7月11日周一 11:38写道: > Hello, you can import using streamload and process hll in the heade

Re:Re: [Discuss] Apache Doris Bi-Weekly Community Sync

2022-07-10 Thread Mingyu Chen
Yes, Like I said in the proposal: > the host of the next meeting shall be confirmed on a voluntary basis Everyone can be the host, and the host needs to ensure that the preparation and finishing work before and after the meeting can be completed. -- 此致!Best Regards 陈明雨 Mingyu Chen Email

Re: [VOTE] Release Apache Doris 1.1.0-rc05

2022-07-10 Thread 张家峰
+1 this is a great version I have verified all versions, it is OK 1. [x] Whether the download link is legitimate. 2. [x] Whether the checksum and PGP signature are legitimate. 3. 3. [x] Whether the DISCLAIMER or DISCLAIMER-WIP is included. 4. [x] Whether the code matche

Re: How to insert hll_hash with flink?

2022-07-10 Thread wudi
Hello, you can import using streamload and process hll in the header. You can refer to https://doris.apache.org/docs/advanced/using-hll.html > 2022年7月11日 上午11:22,song wang 写道: > > Hi All > > I am trying flink 2 doris, the doris field type is HLL, I have a large > amount of data(100w/s). I want

Re:Re: [VOTE] Release Apache Doris 1.1.0-rc05

2022-07-10 Thread Mingyu Chen
Yes, I will add it later. -- 此致!Best Regards 陈明雨 Mingyu Chen Email: morning...@apache.org 在 2022-07-11 11:10:47,"ling miao" 写道: >Does the change of outer join from fallback logic to vectorized logic need >to be declared in the change log? > >Mingyu Chen 于2022年7月11日周一 09:10写道: > >> Hi a

How to insert hll_hash with flink?

2022-07-10 Thread song wang
Hi All I am trying flink 2 doris, the doris field type is HLL, I have a large amount of data(100w/s). I want to aggregate it first and then write it to doris,But I don't know how to generate this HLL type? Any idea? Thanks!

Re: [Discuss] Apache Doris Bi-Weekly Community Sync

2022-07-10 Thread ling miao
+1 Just a small comment, the first meeting could be chaired by the PMC Chair. Whether subsequent meetings can take turns for each PMC to be the meeting host. Ling Miao LinZhong,Chen <490103...@qq.com.invalid> 于2022年7月11日周一 09:10写道: > +1,good idea > > > > ---Original--- > From: "Mingyu Chen" Date

Re: [VOTE] Release Apache Doris 1.1.0-rc05

2022-07-10 Thread ling miao
Does the change of outer join from fallback logic to vectorized logic need to be declared in the change log? Mingyu Chen 于2022年7月11日周一 09:10写道: > Hi all, > > > > > Please review and vote on Apache Doris 1.1.0 release. > > The release candidate has been tagged in GitHub as 1.1.0-rc05, available >

[RESULT] [VOTE] Release Apache Doris Flink Connector 1.1.0

2022-07-10 Thread 41108453
Hi All, The vote has passed and closed now for releasing Flink Connectors v1.1.0 for Apache Doris. The results are as follows: 3 (bindings): Mingyu Chen Zuo Wei jiafeng Zhang 1 (non binding) wudi No 0 or -1 votes。 Vote thread: https://lists.apache.org/thread/8ncyc7pzz88

[RESULT] [VOTE] Release Apache Doris Spark Connector 1.1.0

2022-07-10 Thread 41108453
Hi All, The vote has passed and closed now for releasing Spark Connectors v1.1.0 for Apache Doris. The results are as follows: 3 (bindings): Mingyu Chen Zuo Wei jiafeng Zhang 1 (non binding) wudi No 0 or -1 votes。 Vote thread: https://lists.apache.org/thread/6q2sjjcs2sgrry

[CANNEL][RESULT][VOTE] Release Apache Doris Spark Connector 1.1.0

2022-07-10 Thread 41108453
Sorry for my omission, I will post the results later zhangfen_41108453 zhangfen_41108...@qq.com

[RESULT][VOTE] Release Apache Doris Spark Connector 1.1.0

2022-07-10 Thread 41108453
Hi All, The vote has passed and closed now for releasing Spark Connectors v1.1.0 for Apache Doris. The results are as follows: 2 +1 (bindings): Mingyu Chen Zuo Wei 1 +1 (non binding) wudi No 0 or -1 votes。 Vote thread: https://lists.apache.org/thread/6q2sjjcs2sgrry4855513t2r1

[VOTE] Release Apache Doris 1.1.0-rc05

2022-07-10 Thread Mingyu Chen
Hi all, Please review and vote on Apache Doris 1.1.0 release. The release candidate has been tagged in GitHub as 1.1.0-rc05, available here: https://github.com/apache/doris/tree/1.1.0-rc05 Compare to rc03, we have fixed some bugs about vec execution engine[1]. Release Notes are here: h

Re: [Discuss] Apache Doris Bi-Weekly Community Sync

2022-07-10 Thread LinZhong,Chen
+1,good idea ---Original--- From: "Mingyu Chen"

Re: Re:[Discuss] Apache Doris Bi-Weekly Community Sync

2022-07-10 Thread 张家峰
+1 Great, this is more conducive to everyone's assistance Brs Jiafeng.Zhang / 张家锋 Willem Jiang 于2022年7月11日周一 08:23写道: > +1, the developer meeting should be transparent and inclusive. > Uploading the meeting record and meeting minutes is the first step of > the process. > > I think we still ne

Re: Re:[Discuss] Apache Doris Bi-Weekly Community Sync

2022-07-10 Thread Willem Jiang
+1, the developer meeting should be transparent and inclusive. Uploading the meeting record and meeting minutes is the first step of the process. I think we still need to leverage the mailing list for the inclusive discussion. It could be much better if we have a mail thread for the feature analys

Re: Re:[Discuss] Apache Doris Bi-Weekly Community Sync

2022-07-10 Thread luzhijing
+1, I would like to record the meeing and post on social media sites. iPhone -- Original -- From: Mingyu Chen https://docs.google.com/document/d/1JR-cSic9M5Hf6ehiB4ZwMjgaQoClSWS7y6dt62fNYCo/edit -- ??Best Regards ?? Mingyu Chen Email: mornin

Re: Re:[Discuss] Apache Doris Bi-Weekly Community Sync

2022-07-10 Thread 王博
+1 I'm very glad to hear this news and looking forward to participate it. ---Original--- From: "Mingyu Chen"https://docs.google.com/document/d/1JR-cSic9M5Hf6ehiB4ZwMjgaQoClSWS7y6dt62fNYCo/edit -- 此致!Best Regards 陈明雨 Mingyu Chen Email: morning...@apache.org At 2022-07-10 23:18:16, "Ming

Re:[Discuss] Apache Doris Bi-Weekly Community Sync

2022-07-10 Thread Mingyu Chen
And I would like to host the first meeting at 2022-07-13(Next Wednesday). The Call-For-Topics can be found here[1] and everyone is free to edit it. [1] https://docs.google.com/document/d/1JR-cSic9M5Hf6ehiB4ZwMjgaQoClSWS7y6dt62fNYCo/edit -- 此致!Best Regards 陈明雨 Mingyu Chen Email: morning...@a

[Discuss] Apache Doris Bi-Weekly Community Sync

2022-07-10 Thread Mingyu Chen
Hi all, I'm going to launch a Bi-Weekly Sync Meeting for the Doris community. Motivation: 1. Provide a platform for Doris developers to communicate. 2. Align community development progress to facilitate developers to know community development trends. At the same time, ensure feature scheduling