[
https://issues.apache.org/jira/browse/HADOOP-19743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18039110#comment-18039110
]
ASF GitHub Bot commented on HADOOP-19743:
-----------------------------------------
steveloughran commented on PR #8087:
URL: https://github.com/apache/hadoop/pull/8087#issuecomment-3546811429
jenkins couldn't update the PR; here's the results from the console.
Failures are from the new spotbugs complaints. which need a review then turning
off
```
21:32:02
============================================================================
21:32:02
============================================================================
21:32:02 Adding comment to Github
21:32:02
============================================================================
21:32:02
============================================================================
21:32:02
21:32:02
21:32:07 ERROR: Failed to write github status. Token expired or missing
repo:status write?
21:32:08
21:32:08
21:32:08
============================================================================
21:32:08
============================================================================
21:32:08 Writing HTML to
21:32:08
============================================================================
21:32:08
============================================================================
21:32:08
21:32:08
21:32:11
21:32:11
21:32:11 -1 overall
21:32:11
21:32:11 | Vote | Subsystem | Runtime | Comment
21:32:11
============================================================================
21:32:11 | 0 | reexec | 21m 41s | Docker mode activated.
21:32:11
+---------------------------------------------------------------------------
21:32:11 | | | | Prechecks
21:32:11
+---------------------------------------------------------------------------
21:32:11 | +1 | dupname | 0m 0s | No case conflicting files
found.
21:32:11 | 0 | codespell | 0m 0s | codespell was not
available.
21:32:11 | 0 | detsecrets | 0m 0s | detect-secrets was not
available.
21:32:11 | +1 | @author | 0m 0s | The patch does not
contain any @author
21:32:11 | | | | tags.
21:32:11 | +1 | test4tests | 0m 0s | The patch appears to
include 1 new or
21:32:11 | | | | modified test files.
21:32:11
+---------------------------------------------------------------------------
21:32:11 | | | | trunk Compile Tests
21:32:11
+---------------------------------------------------------------------------
21:32:11 | +1 | mvninstall | 42m 49s | trunk passed
21:32:11 | +1 | compile | 0m 46s | trunk passed with JDK
21:32:11 | | | |
Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
21:32:11 | +1 | compile | 0m 45s | trunk passed with JDK
21:32:11 | | | |
Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
21:32:11 | +1 | checkstyle | 0m 34s | trunk passed
21:32:11 | +1 | mvnsite | 0m 53s | trunk passed
21:32:11 | +1 | javadoc | 0m 41s | trunk passed with JDK
21:32:11 | | | |
Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
21:32:11 | +1 | javadoc | 0m 37s | trunk passed with JDK
21:32:11 | | | |
Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
21:32:11 | -1 | spotbugs | 1m 31s | hadoop-tools/hadoop-aws
in trunk has
21:32:11 | | | | 188 extant spotbugs
warnings.
21:32:11 | +1 | shadedclient | 31m 22s | branch has no errors when
building and
21:32:11 | | | | testing our client
artifacts.
21:32:11
+---------------------------------------------------------------------------
21:32:11 | | | | Patch Compile Tests
21:32:11
+---------------------------------------------------------------------------
21:32:11 | +1 | mvninstall | 0m 41s | the patch passed
21:32:11 | +1 | compile | 0m 39s | the patch passed with JDK
21:32:11 | | | |
Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
21:32:11 | +1 | javac | 0m 39s | the patch passed
21:32:11 | +1 | compile | 0m 37s | the patch passed with JDK
21:32:11 | | | |
Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
21:32:11 | +1 | javac | 0m 37s | the patch passed
21:32:11 | +1 | blanks | 0m 0s | The patch has no blanks
issues.
21:32:11 | +1 | checkstyle | 0m 22s | the patch passed
21:32:11 | +1 | mvnsite | 0m 45s | the patch passed
21:32:11 | +1 | javadoc | 0m 30s | the patch passed with JDK
21:32:11 | | | |
Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
21:32:11 | +1 | javadoc | 0m 29s | the patch passed with JDK
21:32:11 | | | |
Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
21:32:11 | +1 | spotbugs | 1m 31s | the patch passed
21:32:11 | +1 | shadedclient | 32m 1s | patch has no errors when
building and
21:32:11 | | | | testing our client
artifacts.
21:32:11
+---------------------------------------------------------------------------
21:32:11 | | | | Other Tests
21:32:11
+---------------------------------------------------------------------------
21:32:11 | +1 | unit | 3m 31s | hadoop-aws in the patch
passed.
21:32:11 | +1 | asflicense | 0m 37s | The patch does not
generate ASF
21:32:11 | | | | License warnings.
21:32:11 | | | 144m 24s |
21:32:11
```
> S3A: ITestS3ACommitterMRJob MR process OOM on java17
> ----------------------------------------------------
>
> Key: HADOOP-19743
> URL: https://issues.apache.org/jira/browse/HADOOP-19743
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
> Affects Versions: 3.5.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Labels: pull-request-available
>
> MR AppMaster launched by S3ACommitterMRJob can OOM on java17 while launching
> because the heap size is set for all forked processes to 128M.
> {code}
> ava.lang.OutOfMemoryError: Java heap space
> at
> java.base/java.io.BufferedOutputStream.<init>(BufferedOutputStream.java:75)
> at
> org.apache.hadoop.fs.statistics.BufferedIOStatisticsOutputStream.<init>(BufferedIOStatisticsOutputStream.java:78)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:629)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:660)
> {code}
> Fix: double it. Why not larger? increases memory footprint and in parallel
> test runs with many junit threads running there's a lot of load on memory
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
