Re: [I] Merge into / Upsert [iceberg-python]

2025-02-27 Thread via GitHub
kevinjqliu commented on issue #402: URL: https://github.com/apache/iceberg-python/issues/402#issuecomment-2688531149 yes we have plans to improve upsert functionalities. The current implementation was a first pass to support the minimal functionalities of upsert :) I can open a new

Re: [I] Merge into / Upsert [iceberg-python]

2024-09-24 Thread via GitHub
sungwy commented on issue #402: URL: https://github.com/apache/iceberg-python/issues/402#issuecomment-2371902578 Hi @Minfante377 sorry for the delayed response, and thank you for the interest! Unfortunately, this is still an open issue on PyIceberg with no assignee. MERGE INTO with t

Re: [I] Merge into / Upsert [iceberg-python]

2024-08-31 Thread via GitHub
Minfante377 commented on issue #402: URL: https://github.com/apache/iceberg-python/issues/402#issuecomment-2322949632 Any updates on this one? I'm good with overwrite + overwrite filters for now but for tables where columns are populated by different sources it would be awesome to have full

Re: [I] Merge into / Upsert [iceberg-python]

2024-08-06 Thread via GitHub
sungwy commented on issue #402: URL: https://github.com/apache/iceberg-python/issues/402#issuecomment-2271531980 @ev2900 agreed :) I've added that Issue above (#1008) to address that -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [I] Merge into / Upsert [iceberg-python]

2024-08-06 Thread via GitHub
sungwy commented on issue #402: URL: https://github.com/apache/iceberg-python/issues/402#issuecomment-2271507538 Hi @ev2900 - would using the `overwrite` feature by specifying the boolean expression on which to upsert work for your use case? https://github.com/apache/iceberg-python/b

Re: [I] Merge into / Upsert [iceberg-python]

2024-08-01 Thread via GitHub
Milias commented on issue #402: URL: https://github.com/apache/iceberg-python/issues/402#issuecomment-2264079323 That PR looks exactly like what I am asking for, yes! Thank you very much for pointing it out. I will keep an eye on it. -- This is an automated message from the Apache Git Ser

Re: [I] Merge into / Upsert [iceberg-python]

2024-08-01 Thread via GitHub
sungwy commented on issue #402: URL: https://github.com/apache/iceberg-python/issues/402#issuecomment-2262744645 I think you must be referring to dynamic overwrite / replace partition API that detects the partitions of the given input and replaces it. This feature is actually still in progr

Re: [I] Merge into / Upsert [iceberg-python]

2024-06-12 Thread via GitHub
syun64 commented on issue #402: URL: https://github.com/apache/iceberg-python/issues/402#issuecomment-2164079178 Hi @corleyma - I opened up this PR to address your comment here by [introducing a scan API that will return a RecordBatchReader](https://github.com/apache/iceberg-python/pull/786

Re: [I] Merge into / Upsert [iceberg-python]

2024-03-15 Thread via GitHub
corleyma commented on issue #402: URL: https://github.com/apache/iceberg-python/issues/402#issuecomment-2000597425 Note from Slack: to work in the larger-file usecases where folks are using PySpark/Spark, I think this would need to play well with pyarrow streaming read/write functionality,