belldoor commented on issue #8916:
URL: https://github.com/apache/iceberg/issues/8916#issuecomment-2475626871
Same here,
No errors are displayed at all, only the table is created and data is not
written.
You can easily reproduce from this code.
```py
from pyflink.datastream import StreamExecutionEnvironment
from pyflink.table import EnvironmentSettings
from pyflink.table.table_environment import StreamTableEnvironment
if __name__ == '__main__':
env = StreamExecutionEnvironment.get_execution_environment()
settings = EnvironmentSettings.in_streaming_mode()
table_env = StreamTableEnvironment.create(env,
environment_settings=settings)
table_env.execute_sql("""
CREATE CATALOG glue_catalog WITH (
'type'='iceberg',
'warehouse'='s3://temp/iceberg-sink/',
'catalog-impl'='org.apache.iceberg.aws.glue.GlueCatalog',
'io-impl'='org.apache.iceberg.aws.s3.S3FileIO'
)
""")
table_env.execute_sql("""
CREATE TABLE Users (
`id` STRING,
`name` STRING
) WITH (
'connector' = 'datagen'
)
""")
# For print stream from datagen
table_env.execute_sql("""
CREATE TABLE print_users_sink (
`id` STRING,
`name` STRING
) WITH (
'connector' = 'print'
)
""")
# For iceberg sink
table_env.execute_sql("""
CREATE TABLE IF NOT EXISTS glue_catalog.test_db.test_users_sink (
`id` STRING,
`name` STRING
) WITH (
'format-version' = '2'
)
""")
# This insert statement works
table_env.execute_sql("""
INSERT INTO print_users_sink
SELECT * FROM Users
""")
# Only this insert statement works
table_env.execute_sql("""
INSERT INTO glue_catalog.test_db.test_users_sink VALUES ('1', 'John
Doe')
""")
# This insert statement fails without any errors
table_env.execute_sql("""
INSERT INTO glue_catalog.test_db.test_users_sink
SELECT * FROM Users
""").wait()
```
And `print_users_sink` from print connector result log shown below
```
11>
+I[50739f4947396dc5bc5c08dabdbe8d3a855bd09a25f8e7f9a5642e475fa77778f31328c4c18a9a63093e62cb77cc89ba0ccd,
f4050f4d08f1377155813b2ada4a800249e874888bbd4f54f62163d16fd578d0af2c6cc7f717c8d8f792b206268c449e2356]
9>
+I[268145198d877014c0a30a20cfbe48aebdf84d95065f806efd148ecd94dc2fde873e294331ddbb532e30d1ec1b272b6abdf5,
4851bac2b5acc5d23c90612a56060b0f319d65d78601ca4711c1ee8b25a8ffb81026b01907274458d8df201e61ceba316fe3]
7>
+I[fb3a202c417293d671394408a807c8e7bc049d287c23fedb21b65a12b2ec3576fd68f065fe33e69bc7b8bbef2dc4120a9641,
dbb9f22de3c00901ef6b7657547dc9898ec96bfcf63d833e4baa22c3668ccf3ab7a952926e53c034f4329f37fae70693bf74]
10>
+I[d5aa27bbc8a77a0263da5ed1142dbd11584fc283f07faf577beb797e343a0238791b1666f7de7573760bef0c59afdfa7519a,
4c5efc02cdc7819dacd3ea49c365f2d155ae9784e9a59a4b8a801ccd540d05ee996e948d1975ec2f7248a7b94ee2f300d1db]
12>
+I[9ded56844e9d6f409e0982a584dae7c0b97ca33beca9b6211bbbc9d05b4060b90782f1a9ba2cbf3688368190585382d8433a,
5d23d501c3c45741ae04498f6c1afb9da6b12ce1ced235445732b4068cb8c61ed417cb87b1f0aea8b30ef16f3676c52626fc]
....
```
You can only find one row from directly use `insert into ~ values` statement
at `test_users_sink` table.
```json
{"id":"1","name":"John Doe"}
```
I'm using iceberg version `1.6.1` and pyflink `1.19.0`.
Perhaps, given that no one has replied, is there an issue with the method
I’m using?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
