Re: [I] Support relative paths in Table Metadata [iceberg]

2024-09-26 Thread via GitHub
devinrsmith commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-2377813382 I'm primarily interested this as a means to enable unit testing; pyicberg seems to be able to read and write relative paths of the form: * `my-warehouse/...` * `file:my-

Re: [I] Support relative paths in Table Metadata [iceberg]

2024-09-08 Thread via GitHub
lightmelodies commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-2337073064 For anyone who is interested: https://github.com/lightmelodies/iceberg-relative-io -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [I] Support relative paths in Table Metadata [iceberg]

2024-08-16 Thread via GitHub
akizminet commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-2294629384 We also face the same issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] Support relative paths in Table Metadata [iceberg]

2024-07-30 Thread via GitHub
flyrain commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-2258846471 > I also tried downloading the files from S3 locally and query them in DuckDB and Clickhouse and they both try to pull the data from S3 while the copies exist locally. That's

Re: [I] Support relative paths in Table Metadata [iceberg]

2024-07-30 Thread via GitHub
buremba commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-2257949158 I'm trying to use Cloudflare R2 Sippy in front of S3, and I also run into this issue. Snowflake uses a full absolute path to S3 when generating manifest and when I try querying the I

Re: [I] Support relative paths in Table Metadata [iceberg]

2024-04-03 Thread via GitHub
ksmatharoo commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-2036181086 @jotarada We encountered a similar issue when we switched S3 vendors, necessitating the copying of all data to another bucket, resulting in unreadable iceberg tables. Currently, w

Re: [I] Support relative paths in Table Metadata [iceberg]

2024-02-06 Thread via GitHub
anuragmantri commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-1930514916 Hi @jotarada, unfortunately, I had to move on to other priorities and could not continue working on this issue. If you are interested, feel free to contribute, I will be happy t

Re: [I] Support relative paths in Table Metadata [iceberg]

2024-02-06 Thread via GitHub
jotarada commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-1930467433 Any updates on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [I] Support relative paths in Table Metadata [iceberg]

2023-11-17 Thread via GitHub
jotarada commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-1816946130 @abmo-x Can i do that on trino as well? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] Support relative paths in Table Metadata [iceberg]

2023-11-16 Thread via GitHub
abmo-x commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-1815701202 @jotarada yes, relative path should help with this use case However, you don't really need relative paths if you use the same paths in alluxio. you can just configure the s3 end

Re: [I] Support relative paths in Table Metadata [iceberg]

2023-10-03 Thread via GitHub
jotarada commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-1745283095 Hey any news related to this subject? This is relevant for us and would guess for other users when trying to introduce alluxio FS. We would like to have a load process that