[
https://issues.apache.org/jira/browse/HADOOP-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18020924#comment-18020924
]
Steve Loughran commented on HADOOP-19697:
-----------------------------------------
Trying to list local root
If there are dependencies needed in the HADOOP-19696 let's make sure they get
into common/lib, but this registration process mustn't fail this way, so let's
just have a fs.gs.impl declararation in core-default.xml
{code}
bin/hadoop fs -ls file:///
2025-09-17 15:03:47,688 [main] WARN fs.FileSystem
(FileSystem.java:loadFileSystems(3539)) - Cannot load filesystem
java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem:
org.apache.hadoop.fs.gs.GoogleHadoopFileSystem Unable to get public no-arg
constructor
at java.base/java.util.ServiceLoader.fail(ServiceLoader.java:586)
at
java.base/java.util.ServiceLoader.getConstructor(ServiceLoader.java:679)
at
java.base/java.util.ServiceLoader$LazyClassPathLookupIterator.hasNextService(ServiceLoader.java:1240)
at
java.base/java.util.ServiceLoader$LazyClassPathLookupIterator.hasNext(ServiceLoader.java:1273)
at java.base/java.util.ServiceLoader$2.hasNext(ServiceLoader.java:1309)
at java.base/java.util.ServiceLoader$3.hasNext(ServiceLoader.java:1393)
at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:3522)
at
org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3562)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3612)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3716)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3667)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:557)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:373)
at org.apache.hadoop.fs.shell.PathData.expandAsGlob(PathData.java:347)
at org.apache.hadoop.fs.shell.Command.expandArgument(Command.java:265)
at org.apache.hadoop.fs.shell.Command.expandArguments(Command.java:248)
at
org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:105)
at org.apache.hadoop.fs.shell.Command.run(Command.java:192)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:327)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:97)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:390)
Caused by: java.lang.NoClassDefFoundError: com/google/auth/Credentials
at java.base/java.lang.Class.getDeclaredConstructors0(Native Method)
at
java.base/java.lang.Class.privateGetDeclaredConstructors(Class.java:3373)
at java.base/java.lang.Class.getConstructor0(Class.java:3578)
at java.base/java.lang.Class.getConstructor(Class.java:2271)
at java.base/java.util.ServiceLoader$1.run(ServiceLoader.java:666)
at java.base/java.util.ServiceLoader$1.run(ServiceLoader.java:663)
at
java.base/java.security.AccessController.doPrivileged(AccessController.java:569)
at
java.base/java.util.ServiceLoader.getConstructor(ServiceLoader.java:674)
... 20 more
Caused by: java.lang.ClassNotFoundException: com.google.auth.Credentials
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
... 28 more
Found 20 items
---------- 1 root admin 0 2025-08-16 19:44 file:///.file
...
{code}
> google gs connector registration failing
> ----------------------------------------
>
> Key: HADOOP-19697
> URL: https://issues.apache.org/jira/browse/HADOOP-19697
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/gcs
> Affects Versions: 3.5.0
> Reporter: Steve Loughran
> Priority: Blocker
>
> Surfaced during HADOOP-19696 and work with all the cloud connectors on the
> classpath.
> There's a missing dependency causing the gcs connector to fail to register
> *when the first filesystem is instantiated*, because the service registration
> process loads the gcs connector class, instantiates one and asks for its
> schema.
> As well as a sign of a problem, it's better to just add an entry in
> core-default.xml as this saves all classloading overhead. It's what the other
> asf bundled ones do.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
