[ 
https://issues.apache.org/jira/browse/HADOOP-17835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18015202#comment-18015202
 ] 

Michael Smith commented on HADOOP-17835:
----------------------------------------

We seem to be running into some compatibility issues with this upgrading to 
Hadoop 3.4. We're running into
{code}
   [junit4]   2> 7508 ERROR (Curator-SafeNotifyService-0) [     ] 
o.a.c.f.l.MappingListenerManager Listener 
(org.apache.curator.framework.recipes.cache.CuratorCacheListenerBuilderImpl$2@12e1ab13)
 threw an exception
   [junit4]   2>           => java.io.UncheckedIOException: 
java.io.IOException: Unknown version of delegation token 49
   [junit4]   2>        at 
org.apache.hadoop.security.token.delegation.ZKDelegationTokenSecretManager.lambda$startThreads$2(ZKDelegationTokenSecretManager.java:326)
   [junit4]   2> java.io.UncheckedIOException: java.io.IOException: Unknown 
version of delegation token 49
   [junit4]   2>        at 
org.apache.hadoop.security.token.delegation.ZKDelegationTokenSecretManager.lambda$startThreads$2(ZKDelegationTokenSecretManager.java:326)
 ~[hadoop-common-3.4.1.7.3.2.0-445.jar:?]
   [junit4]   2>        at 
org.apache.curator.framework.recipes.cache.CuratorCacheListenerBuilderImpl.lambda$forCreatesAndChanges$2(CuratorCacheListenerBuilderImpl.java:69)
 ~[curator-recipes-5.4.0.7.3.2.0-445.jar:5.4.0.7.3.2.0-445]
   [junit4]   2>        at 
org.apache.curator.framework.recipes.cache.CuratorCacheListenerBuilderImpl$2.lambda$event$0(CuratorCacheListenerBuilderImpl.java:149)
 ~[curator-recipes-5.4.0.7.3.2.0-445.jar:5.4.0.7.3.2.0-445]
   [junit4]   2>        at java.util.ArrayList.forEach(ArrayList.java:1511) 
~[?:?]
   [junit4]   2>        at 
org.apache.curator.framework.recipes.cache.CuratorCacheListenerBuilderImpl$2.event(CuratorCacheListenerBuilderImpl.java:149)
 ~[curator-recipes-5.4.0.7.3.2.0-445.jar:5.4.0.7.3.2.0-445]
   [junit4]   2>        at 
org.apache.curator.framework.recipes.cache.CuratorCacheImpl.lambda$putStorage$6(CuratorCacheImpl.java:287)
 ~[curator-recipes-5.4.0.7.3.2.0-445.jar:5.4.0.7.3.2.0-445]
   [junit4]   2>        at 
org.apache.curator.framework.listen.MappingListenerManager.lambda$forEach$0(MappingListenerManager.java:92)
 ~[curator-framework-5.4.0.7.3.2.0-445.jar:5.4.0.7.3.2.0-445]
   [junit4]   2>        at 
org.apache.curator.framework.listen.MappingListenerManager.forEach(MappingListenerManager.java:89)
 ~[curator-framework-5.4.0.7.3.2.0-445.jar:5.4.0.7.3.2.0-445]
   [junit4]   2>        at 
org.apache.curator.framework.listen.StandardListenerManager.forEach(StandardListenerManager.java:89)
 ~[curator-framework-5.4.0.7.3.2.0-445.jar:5.4.0.7.3.2.0-445]
   [junit4]   2>        at 
org.apache.curator.framework.recipes.cache.CuratorCacheImpl.lambda$callListeners$9(CuratorCacheImpl.java:301)
 ~[curator-recipes-5.4.0.7.3.2.0-445.jar:5.4.0.7.3.2.0-445]
   [junit4]   2>        at 
java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
 ~[?:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 
~[?:?]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 
~[?:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:840) ~[?:?]
   [junit4]   2> Caused by: java.io.IOException: Unknown version of delegation 
token 49
   [junit4]   2>        at 
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenIdentifier.readFields(AbstractDelegationTokenIdentifier.java:193)
 ~[hadoop-common-3.4.1.7.3.2.0-445.jar:?]
   [junit4]   2>        at 
org.apache.hadoop.security.token.delegation.ZKDelegationTokenSecretManager.processTokenAddOrUpdate(ZKDelegationTokenSecretManager.java:415)
 ~[hadoop-common-3.4.1.7.3.2.0-445.jar:?]
   [junit4]   2>        at 
org.apache.hadoop.security.token.delegation.ZKDelegationTokenSecretManager.lambda$startThreads$2(ZKDelegationTokenSecretManager.java:322)
 ~[hadoop-common-3.4.1.7.3.2.0-445.jar:?]
{code}

> Use CuratorCache implementation instead of PathChildrenCache / TreeCache
> ------------------------------------------------------------------------
>
>                 Key: HADOOP-17835
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17835
>             Project: Hadoop Common
>          Issue Type: Task
>          Components: common
>    Affects Versions: 3.4.0
>            Reporter: Viraj Jasani
>            Assignee: Viraj Jasani
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.4.0
>
>          Time Spent: 3h 20m
>  Remaining Estimate: 0h
>
> As we have moved to Curator 5.2.0 for Hadoop 3.4.0, we should start using new 
> CuratorCache service implementation in place of deprecated PathChildrenCache 
> and TreeCache usecases.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to