Hi Kevin,
Did you try setting the "docker.allowed.rw-mounts"
with "/opt/hadoop-3.2.0/logs/userlogs"?

BR,
Zhankun

On Mon, 10 Jun 2019 at 05:50, kevin su <[email protected]> wrote:

> Hi all,
>
> I follow
> https://hadoop.apache.org/docs/r3.2.0/hadoop-yarn/hadoop-yarn-site/DockerContainers.html#Cluster_Configuration
>
> ,and try to launch applications using docker container, but I got this
> error
>
> I use * hadoop-3.2.0* with *library/openjdk:8* docker image
>
> Exception message: Launch container failed
> Shell error output: Configuration does not allow docker mount 
> '/opt/hadoop-3.2.0/logs/userlogs/application_1560115840519_0003/container_1560115840519_0003_01_000002:/opt/hadoop-3.2.0/logs/userlogs/application_1560115840519_0003/container_1560115840519_0003_01_000002:rw',
>  
> realpath=/opt/hadoop-3.2.0/logs/userlogs/application_1560115840519_0003/container_1560115840519_0003_01_000002
> Error constructing docker command, docker error code=14, error 
> message='Invalid docker read-write mount'
>
> Shell output: main : command provided 4main : run as user is kevinmain : 
> requested yarn user is kevin
> Creating script paths...
> Creating local dirs...
>
> [2019-06-10 05:32:42.367]Container exited with a non-zero exit code 29. 
> [2019-06-10 05:32:42.367]Container exited with a non-zero exit code 29.
>
>
> my container-executor.cfg
>
> 1 yarn.nodemanager.linux-container-executor.group=kevin                       
>       2 banned.users=*#*4 allowed.system.users=#5 feature.tc.enabled=false6 7 
> 8 [docker]9   module.enabled=true10   
> docker.privileged-containers.enabled=false
> 11   
> docker.allowed.capabilities=SYS_CHROOT,MKNOD,SETFCAP,SETPCAP,FSETID,CHOWN,AUDIT_W
>     RITE,SETGID,NET_RAW,FOWNER,SETUID,DAC_OVERRIDE,KILL,NET_BIND_SERVICE12   
> docker.allowed.networks=bridge,host,none13   
> docker.trusted.registries=library,openjdk14   
> docker.allow.ro-mounts=/usr/local/hadoop,/etc/passwd,/etc/group15   
> docker.allow.rw-mounts=/opt/hadoop-3.2.0/logs
>
>
> what error in my config
>
> Thanks in advanced
>
>
> Kevin,
>
> Best Regards
>
>

Reply via email to