[
https://issues.apache.org/jira/browse/HADOOP-17224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226561#comment-17226561
]
Ahmed Hussein commented on HADOOP-17224:
----------------------------------------
{quote}Ahmed Hussein If the cause is in the tests, we should fix them or make
them skipped if it takes time. If the cause is ISA-L feature itself, we should
disable it first then fix or drop it.
I'm going to look into relevant OPEN issues under HDFS-15646.{quote}
Thanks [~iwasakims]. I certainly agree with you that the tests need to be fixed.
This change adds native libraries and it looks plausible that those JUnits in
question are affected by loading the native library.
[~ayushtkn] and [~aajisaka] were able to narrow the reason of the failure (see
[comment|https://issues.apache.org/jira/browse/HDFS-15643?focusedCommentId=17223204&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17223204]).
While this was a bug in the implementation, it is still does not seem right
that those debugging are done after merging HADOOP-17224 .
If [~ayushtkn] and [~aajisaka] were not aware of that change, I would not
figure out the problem.
The closed jiras HDFS-15654, HDFS-15461 need to be re-investigated after the
fix done in HDFS-15643.
Also, Yetus fails when the JVM fails to allocate memory to create new threads.
It is unclear so far when that error was introduced in Hadoop. Yet, I can
imagine that calling a new native library could lead to different memory
behavior.
For Example, there could be a bug in the native code that leads to a memory
leak, or the library reserves buffer that are not released back.
If you think HADOOP-17224 is unlikely to trigger the failures of Junits, then
do you have suggestions what could be the code commit that change the behavior
of those units and trigger OOM on Yetus?
> Install Intel ISA-L library in Dockerfile
> -----------------------------------------
>
> Key: HADOOP-17224
> URL: https://issues.apache.org/jira/browse/HADOOP-17224
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Takanobu Asanuma
> Assignee: Takanobu Asanuma
> Priority: Blocker
> Fix For: 3.4.0
>
>
> Currently, there is not isa-l library in the docker container, and jenkins
> skips the natvie tests, TestNativeRSRawCoder and TestNativeXORRawCoder.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
