amogh-jahagirdar commented on code in PR #10755:
URL: https://github.com/apache/iceberg/pull/10755#discussion_r1697706041


##########
api/src/main/java/org/apache/iceberg/RemoveUnusedSpecs.java:
##########
@@ -0,0 +1,29 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.iceberg;
+
+import java.util.List;
+
+/**
+ * API for removing partition specs from the metadata which are not the 
default spec and no longer
+ * refer to any datafiles in the table.
+ *
+ * <p>{@link #apply()} returns the specs that will remain if committed on the 
current metadata
+ */
+public interface RemoveUnusedSpecs extends PendingUpdate<List<PartitionSpec>> 
{}

Review Comment:
   @advancedxy I think a decent example to look at would be the 
`ManageSnapshots` API which handles cherry picking/rollback and 
branching/tagging operations. That is the public interface (analagous to 
"maintenance" in this case), but the implementation the individual operation 
implementations are still in separate classes which are package-private and 
focused on a single operation, as well as to enable different configuration 
options as you mentioned.
   
   The `ManageSnapshots` implementation is tracking all of these operations as 
part of a transaction (which for the combined schema + partition spec pruning 
operation case sounds reasonable to me).
   
    I think the pending question is should this be done as part of 
`ExpireSnapshots` or should we have a separate operation. If i think about when 
it makes sense for this cleanup to happen `ExpireSnapshots` does make sense 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to