VenuReddy2103 opened a new pull request, #6399: URL: https://github.com/apache/hive/pull/6399
### What changes were proposed in this pull request? When a table is soft deleted, `soft_delete` flag is recorded in COMPACTION_QUEUE table properties. This flag is used in `MarkCleanedFunction` ### Why are the changes needed? When the configuration property hive.acid.createtable.softdelete is set to true, deletion of ACID table data is performed asynchronously by a background cleaner thread. As part of this process, the cleaner thread removes entry corresponding to the acid table from the COMPACTION_QUEUE and records a completion entry in the COMPLETED_COMPACTIONS table using `org.apache.hadoop.hive.metastore.txn.TxnStore#markCleaned()`. However, by the time this operation is executed, the associated ACID table has already been deleted (soft-deleted) in HMS. As a result, a COMPLETED_COMPACTIONS entry is created for a table that no longer exists. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Tested manually -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
