911432 commented on issue #10326: URL: https://github.com/apache/iceberg/issues/10326#issuecomment-2107631861
I would like to store the query engine as a container image and the iceberg table and iceberg catalog as a file system. Let's take this [spark page](https://iceberg.apache.org/docs/nightly/spark-configuration/#catalogs) as an example. The code below is always valid. ``` spark.sql.catalog.hadoop_prod = org.apache.iceberg.spark.SparkCatalog spark.sql.catalog.hadoop_prod.type = hadoop spark.sql.catalog.hadoop_prod.warehouse = hdfs://nn:8020/warehouse/path ``` I wish I could do the code below as well. ``` spark.sql.catalog.s3 = org.apache.iceberg.spark.SparkCatalog spark.sql.catalog.s3.type = s3 spark.sql.catalog.s3.warehouse = s3://nn:8020/warehouse/path ``` ``` spark.sql.catalog.file = org.apache.iceberg.spark.SparkCatalog spark.sql.catalog.file.type = file spark.sql.catalog.file.warehouse = file://warehouse/path ``` I think it will make the [spark-quickstart page](https://iceberg.apache.org/spark-quickstart/) easier. And I think I can distinguish between computing and storage more clearly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
