[
https://issues.apache.org/jira/browse/HADOOP-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14734965#comment-14734965
]
Ming Ma commented on HADOOP-10598:
----------------------------------
Thanks, [~zhangyongxyz]. You are welcome to take it over. Couple notes:
* As you can tell from the main task HADOOP-9640, the majority of RPC fair
callqueue functionality have been completed and running in large production
clusters. This specific jira is to make the fair share configurable.
* In addition to user based fair share, it might be useful to evaluate NN
method based fair share, e.g., getContentSummary has lower share than addBLock.
* Implementation wise, you might want to investigate how to leverage the RPC
scheduler abstraction.
* I did some prototype a while back. The effectiveness of configurable fair
share depends on the work load. It is useful if you have extremely high write
volume. It will be good you can do additional benchmarking.
> Support configurable RPC fair share
> -----------------------------------
>
> Key: HADOOP-10598
> URL: https://issues.apache.org/jira/browse/HADOOP-10598
> Project: Hadoop Common
> Issue Type: Sub-task
> Reporter: Ming Ma
>
> It will be useful if we can support RPC min fair share on a per user or group
> basis. That will be useful for SLA jobs in a shared cluster. It will be
> complementary to the history-based soft policy defined in fair queue's
> history RPC server.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
