[
https://issues.apache.org/jira/browse/HADOOP-18180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571589#comment-17571589
]
Steve Loughran commented on HADOOP-18180:
-----------------------------------------
should be using the executor stuff in hadoop common, possibly through TaskPool
API. these can collect stats on time waiting for an executor and propagate
audit and IOStatisticsContext (not an issue here as the audit span is handled
in the callbacks to s3a fs, and IOStatisticsContext.aggregator() cached in
constructor when implemented
> Remove use of scala jar twitter util-core with java futures in S3A
> prefetching stream
> -------------------------------------------------------------------------------------
>
> Key: HADOOP-18180
> URL: https://issues.apache.org/jira/browse/HADOOP-18180
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: PJ Fanning
> Assignee: PJ Fanning
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
> Time Spent: 9h
> Remaining Estimate: 0h
>
> This jar will cause trouble for scala projects like spark that use different
> scala versions from the scala 2.11 used in the twitter util-core
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
