Re: [I] `catalog.load_table` raises Invalid JSON error [iceberg-python]

2024-12-05 Thread via GitHub
kevinjqliu commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2521085687 > Output: b'' that would explain the validation error. Its weird to me that s3 returns 0 bytes instead of an error. Couple of things you can try. 1. S

Re: [I] `catalog.load_table` raises Invalid JSON error [iceberg-python]

2024-12-05 Thread via GitHub
sandcobainer commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2520829390 so i ran boto3 vs pyiceberg's `load_file_io` with the same credentials ``` catalog = HiveCatalog( "bucket", **{ "uri":"hive2://localhost:908

Re: [I] `catalog.load_table` raises Invalid JSON error [iceberg-python]

2024-12-04 Thread via GitHub
kevinjqliu commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2518327326 > does this mean it's an s3 access issue? likely, to debug you can try reading the file directly ``` print(input_file.open().read()) ``` this should m

Re: [I] `catalog.load_table` raises Invalid JSON error [iceberg-python]

2024-12-02 Thread via GitHub
sandcobainer commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2512626122 @kevinjqliu tried this snippet by pointing the metadata location directly to the s3 uri, and the error is the same. does this mean it's an s3 access issue? ```File

Re: [I] `catalog.load_table` raises Invalid JSON error [iceberg-python]

2024-11-22 Thread via GitHub
kevinjqliu commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2494993070 if it's empty on read, it's most likely related to a permission issue. Here's something you can run to debug. ``` metadata_location = "s3://" io = cat

Re: [I] `catalog.load_table` raises Invalid JSON error [iceberg-python]

2024-11-22 Thread via GitHub
sandcobainer commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2494328682 @Fokko I've tried to see if my s3 credentials are the issue, but that doesn't seem to be the issue. Here's the metadata file that i downloaded directly from the S3 bucke

Re: [I] `catalog.load_table` raises Invalid JSON error [iceberg-python]

2024-11-20 Thread via GitHub
Fokko commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2489389534 @sandcobainer Thanks for raising this, any chance that you could share the table metadata JSON? -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] `catalog.load_table` raises Invalid JSON error [iceberg-python]

2024-11-19 Thread via GitHub
kevinjqliu commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2487486564 The issue is most likely from reading the table metadata file https://github.com/apache/iceberg-python/blob/93ebd39e3c457dcb86cd053c60d2d13f0713a637/pyiceberg/catalo

Re: [I] `catalog.load_table` raises Invalid JSON error [iceberg-python]

2024-11-19 Thread via GitHub
kevinjqliu commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2487485560 > Invalid JSON: EOF while parsing a value at line 1 column 0 [type=json_invalid, input_value='', input_type=str]" I think this usually means the table metadata from