Rohini Palaniswamy created PIG-3658:
---------------------------------------
Summary: Use Tez ObjectRegistry to cache FRJoin map and
WeightedRangePartitioner map
Key: PIG-3658
URL: https://issues.apache.org/jira/browse/PIG-3658
Project: Pig
Issue Type: Sub-task
Reporter: Rohini Palaniswamy
Assignee: Rohini Palaniswamy
Fix For: tez-branch
Tez provides way to cache objects with Vertex scope. We can use it to
1) caching the replication join map constructed instead of reading from
multiple broadcast inputs from one or more vertex and reconstructing it
2) Cache the map in WeightedRangePartitioner. Thought the quantilefile is
only one brodcast input from one vertex still it would be faster to use the
local cache.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
