singhpk234 commented on code in PR #9884:
URL: https://github.com/apache/iceberg/pull/9884#discussion_r1516865683
##########
core/src/main/java/org/apache/iceberg/io/ResolvingFileIO.java:
##########
@@ -53,20 +53,22 @@ public class ResolvingFileIO implements HadoopConfigurable,
DelegateFileIO {
private static final String S3_FILE_IO_IMPL =
"org.apache.iceberg.aws.s3.S3FileIO";
private static final String GCS_FILE_IO_IMPL =
"org.apache.iceberg.gcp.gcs.GCSFileIO";
private static final String ADLS_FILE_IO_IMPL =
"org.apache.iceberg.azure.adlsv2.ADLSFileIO";
- private static final Map<String, String> SCHEME_TO_FILE_IO =
+ private static final Map<String, String> DEFAULT_SCHEME_TO_FILE_IO =
ImmutableMap.of(
"s3", S3_FILE_IO_IMPL,
"s3a", S3_FILE_IO_IMPL,
"s3n", S3_FILE_IO_IMPL,
"gs", GCS_FILE_IO_IMPL,
"abfs", ADLS_FILE_IO_IMPL,
"abfss", ADLS_FILE_IO_IMPL);
+ private static final String SCHEME_PROPERTY_PREFIX = "resolving-io.schemes.";
private final Map<String, DelegateFileIO> ioInstances =
Maps.newConcurrentMap();
private final AtomicBoolean isClosed = new AtomicBoolean(false);
private final transient StackTraceElement[] createStack;
private SerializableMap<String, String> properties;
private SerializableSupplier<Configuration> hadoopConf;
+ private final Map<String, String> schemeToFileIo = Maps.newConcurrentMap();
Review Comment:
yup, i think it makes sense for `ioInstances` considering it's being invoked
from `io()` but not sure if we require it here unless we call initialize in a
multi-threaded fashion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
