Re: [I] (AWS Lake Formation shared resources) Iceberg tables in AWS Glue catalog has a different root namespace than the original [iceberg-python]

[via GitHub]

doctormohamed commented on issue #845:
URL: https://github.com/apache/iceberg-python/issues/845#issuecomment-2189659111

   @kevinjqliu 
   
   To clarify, the example above does not work unless the table.identifier 
override is applied, right? --> Correct
   What Im overriding here is the database name.
   
   See this:
   
   ``
   import pandas as pd
   import pyarrow as pa
   
   database = 'dev_demo_fs'
   table_name = 'demo_table_20240620_pyiceberg1'
   
   df = pd.DataFrame({'col_1': [1, 2], 'col_2': ['a', 'b']})
   df = pa.Table.from_pandas(df)
   
   table = catalog.create_table(
       identifier=f'{database}.{table_name}',
       schema=df.schema
   )
   print(table.identifier)
   ``
   
   Result:
   ``
   ('AwsGlueCatalog', 'gov-demo_fs', 'demo_table_20240620_pyiceberg1')
   ``
   
   As you notice, the new database name has changed, due to AWS Lakeformation 
resource link activated, adding a prefix  "gov-" to the database in Glue (as it 
is the 'real' Database I think...)
   
   Here is a snapshot to the error:
   
![image](https://github.com/apache/iceberg-python/assets/60315717/f9866c3c-ae85-4b19-a559-55780c79098a)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org