Re: [I] Failure to delete with merge-on-read in branch and main branch [iceberg]

2024-02-06 Thread via GitHub
edgarRd commented on issue #7635: URL: https://github.com/apache/iceberg/issues/7635#issuecomment-1930771143 Thanks for fixing this issue, @amogh-jahagirdar! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] Failure to delete with merge-on-read in branch and main branch [iceberg]

2023-11-19 Thread via GitHub
rdblue closed issue #7635: Failure to delete with merge-on-read in branch and main branch URL: https://github.com/apache/iceberg/issues/7635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] Failure to delete with merge-on-read in branch and main branch [iceberg]

2023-11-17 Thread via GitHub
rdblue commented on issue #7635: URL: https://github.com/apache/iceberg/issues/7635#issuecomment-1817116426 @amogh-jahagirdar, that looks right to me. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] Failure to delete with merge-on-read in branch and main branch [iceberg]

2023-11-17 Thread via GitHub
amogh-jahagirdar commented on issue #7635: URL: https://github.com/apache/iceberg/issues/7635#issuecomment-1816926262 Ok I think got the root cause, the problem is in `canDeleteUsingMetadata` https://github.com/apache/iceberg/blob/main/spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/

Re: [I] Failure to delete with merge-on-read in branch and main branch [iceberg]

2023-11-16 Thread via GitHub
amogh-jahagirdar commented on issue #7635: URL: https://github.com/apache/iceberg/issues/7635#issuecomment-1815363187 OK after some debugging and writing some local tests, what I'm seeing is the following: 1.) In certain cases, when there's branches the DELETE in Spark gets executed

Re: [I] Failure to delete with merge-on-read in branch and main branch [iceberg]

2023-11-15 Thread via GitHub
amogh-jahagirdar commented on issue #7635: URL: https://github.com/apache/iceberg/issues/7635#issuecomment-1813498341 Also, I should note that I can repro this only when there's the `COALESCE` query hint and it gets applied. When there's no `COALESCE` and there's separate files the delete w

Re: [I] Failure to delete with merge-on-read in branch and main branch [iceberg]

2023-11-15 Thread via GitHub
amogh-jahagirdar commented on issue #7635: URL: https://github.com/apache/iceberg/issues/7635#issuecomment-1813387970 Sorry for the delay on this issue. I'm looking at it right now. Thanks for the clear reproduction steps, I can repro this and I also see this same failure happens for copy o

Re: [I] Failure to delete with merge-on-read in branch and main branch [iceberg]

2023-10-18 Thread via GitHub
edgarRd commented on issue #7635: URL: https://github.com/apache/iceberg/issues/7635#issuecomment-1769711711 Ping @amogh-jahagirdar - Is there any progress on this? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u