Cheolsoo Park created PIG-3799:
----------------------------------
Summary: TestCustomPartitioner is broken in tez branch
Key: PIG-3799
URL: https://issues.apache.org/jira/browse/PIG-3799
Project: Pig
Issue Type: Sub-task
Components: tez
Affects Versions: tez-branch
Reporter: Cheolsoo Park
Assignee: Cheolsoo Park
Fix For: tez-branch
This is a regression of PIG-3795. In TezCompiler, visitDistinct() doesn't set
the requested parallelism of TezOperator, resulting that only one reducer runs
for the following query-
{code}
A = LOAD 'table_testCustomPartitionerDistinct' as (a0:int, a1:int);
B = distinct A PARTITION BY org.apache.pig.test.utils.SimpleCustomPartitioner3
parallel 2;
{code}
The test fails because it sees a single output file while it expects two.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
