[
https://issues.apache.org/jira/browse/HADOOP-13845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16109776#comment-16109776
]
Steve Loughran commented on HADOOP-13845:
-----------------------------------------
Like your thoughts about live viewing.
something like this, though of course it'll make the code even more complex.
If you are looking at improving metrics in S3A, how about taking a look at
what's mentioned in HADOOP-13551: working out how to fetch the SDK internal
metrics and pump them out. The SDK team have done stuff internally, and it
seems good to get at all this stuff before we move to instrumenting our own
code more. They're working at a lower level than we can instrument, so could do
things we can't (and vice-versa).
> s3a to instrument duration of HTTP calls
> ----------------------------------------
>
> Key: HADOOP-13845
> URL: https://issues.apache.org/jira/browse/HADOOP-13845
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 2.9.0
> Reporter: Steve Loughran
> Priority: Minor
>
> HADOOP-13844 proposes pulling out the swift duration classes for reuse; this
> patch proposes instrumenting s3a with it.
> One interesting question: what to do with the values. For now, they could
> just be printed, but it might be interesting to include in FS stats collected
> at the end of a run. However, those are all assumed to be simple counters
> where merging is a matter of addition. These are more metrics
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
