Re: [I] Concurrent writes failures [iceberg-python]

2024-10-19 Thread via GitHub
reinthal commented on issue #1084: URL: https://github.com/apache/iceberg-python/issues/1084#issuecomment-2423927862 Here's some code that worked for me for me ```python def append_to_table_with_retry(pa_df: pa.Table, table_name: str, catalog: Catalog) -> None: """Appends

Re: [I] Concurrent writes failures [iceberg-python]

2024-09-02 Thread via GitHub
bikeshedder commented on issue #1084: URL: https://github.com/apache/iceberg-python/issues/1084#issuecomment-2325085387 > FYI, according to the docs, "SQLite is not built for concurrency, you should use this catalog for exploratory or development purposes." https://py.iceberg.apache.org/co

Re: [I] Concurrent writes failures [iceberg-python]

2024-08-31 Thread via GitHub
kevinjqliu commented on issue #1084: URL: https://github.com/apache/iceberg-python/issues/1084#issuecomment-2322896488 > currently using sqlite + local fs FYI, according to the docs, "SQLite is not built for concurrency, you should use this catalog for exploratory or development purp

Re: [I] Concurrent writes failures [iceberg-python]

2024-08-23 Thread via GitHub
TiansuYu commented on issue #1084: URL: https://github.com/apache/iceberg-python/issues/1084#issuecomment-2306516939 ^ Second link should be this one https://github.com/apache/iceberg-python/issues/819 -- This is an automated message from the Apache Git Service. To respond to the message

Re: [I] Concurrent writes failures [iceberg-python]

2024-08-21 Thread via GitHub
bikeshedder commented on issue #1084: URL: https://github.com/apache/iceberg-python/issues/1084#issuecomment-2302420037 As pointed out in the Slack channel by @sungwy this is caused by the following two issues: - https://github.com/apache/iceberg-python/issues/269 - https://github.com

[I] Concurrent writes failures [iceberg-python]

2024-08-21 Thread via GitHub
bikeshedder opened a new issue, #1084: URL: https://github.com/apache/iceberg-python/issues/1084 ### Apache Iceberg version None ### Please describe the bug 🐞 ## Summary I'm currently trying to migrate a couple of dataframes with a custom hive-like storage scheme