Re: [D] Support Parallel Processing of Window Functions. [cloudberry]

GitHub user avamingli added a comment to the discussion: Support Parallel Processing of Window Functions. @leborchuk Thank you so much for sharing your insightful observations and experiences. I will make the necessary adjustments to ensure our tests are robust. A preliminary test indicates

Re: [D] Support Parallel Processing of Window Functions. [cloudberry]

GitHub user leborchuk added a comment to the discussion: Support Parallel Processing of Window Functions. > During develop, I found that the result of Window Agg without Order By clause > is unstable. > > Referring to the SQL 2011 standard, it states that if ORDER BY is omitted, > the order

Re: [D] Support Parallel Processing of Window Functions. [cloudberry]

GitHub user jianlirong added a comment to the discussion: Support Parallel Processing of Window Functions. In my personal opinion, we should modify the corresponding SQL statement and add ORDER BY. Although we're discussing window functions here, the issue reflected in this example is essenti

Re: [D] Support Parallel Processing of Window Functions. [cloudberry]

GitHub user avamingli added a comment to the discussion: Support Parallel Processing of Window Functions. > To pass parallel test cases, we need to modify the SQL in that case. Postgres discussion: https://www.postgresql.org/message-id/flat/fbb5c0d7-4a96-4dd1-9a26-5dfccfac667a%40Spark AFAK,

Re: [D] Support Parallel Processing of Window Functions. [cloudberry]

GitHub user avamingli added a comment to the discussion: Support Parallel Processing of Window Functions. During develop, I found that the result of Window Agg without Order By clause is unstable. Referring to the SQL 2011 standard, it states that if ORDER BY is omitted, the order of rows in

Re: [D] Support Parallel Processing of Window Functions. [cloudberry]

GitHub user avamingli added a comment to the discussion: Support Parallel Processing of Window Functions. Yes, and the focus is more on optimizer changes, specifically leveraging Motion to redistribute data based on the Partition By clauses of window functions. Once the plan is established, e

Re: [D] Support Parallel Processing of Window Functions. [cloudberry]

GitHub user my-ship-it added a comment to the discussion: Support Parallel Processing of Window Functions. Leverage parallel approach of MPP to implent executor parallelism seems to be a viable path. In fact, because Cloudberry data has distribution information, we can implement executor par

Re: [D] Support Parallel Processing of Window Functions. [cloudberry]

GitHub user cnliuchong added a comment to the discussion: Support Parallel Processing of Window Functions. When large amounts of data, the window function is performance low. If parallel execution is possible, the performance will be greatly improved. GitHub link: https://github.com/apache/c