[
https://issues.apache.org/jira/browse/HADOOP-18186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17601517#comment-17601517
]
ASF GitHub Bot commented on HADOOP-18186:
-----------------------------------------
virajjasani commented on code in PR #4796:
URL: https://github.com/apache/hadoop/pull/4796#discussion_r965331518
##########
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3APrefetchingInputStream.java:
##########
@@ -130,6 +131,7 @@ public void testReadLargeFileFully() throws Throwable {
}
// Verify that once stream is closed, all memory is freed
verifyStatisticGaugeValue(ioStats,
StreamStatisticNames.STREAM_READ_ACTIVE_MEMORY_IN_USE, 0);
+ assertDurationRange(ioStats, StoreStatisticNames.ACTION_EXECUTOR_ACQUIRED,
0, 10);
Review Comment:
Done
> s3a prefetching to use SemaphoredDelegatingExecutor for submitting work
> -----------------------------------------------------------------------
>
> Key: HADOOP-18186
> URL: https://issues.apache.org/jira/browse/HADOOP-18186
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Steve Loughran
> Assignee: Viraj Jasani
> Priority: Major
> Labels: pull-request-available
>
> Use SemaphoredDelegatingExecutor for each to stream to submit work, if
> possible, for better fairness in processes with many streams.
> this also takes a DurationTrackerFactory to count how long was spent in the
> queue, something we would want to know
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
