amogh-jahagirdar commented on code in PR #13555:
URL: https://github.com/apache/iceberg/pull/13555#discussion_r2220365365
##########
spark/v4.0/spark-extensions/src/test/java/org/apache/iceberg/spark/extensions/TestRewriteDataFilesProcedure.java:
##########
@@ -976,10 +978,50 @@ public void testRewriteDataFilesSummary() {
EnvironmentContext.ENGINE_VERSION, v ->
assertThat(v).startsWith("4.0"));
}
+ @TestTemplate
+ public void testRewriteDataFilesPreservesLineage() throws
NoSuchTableException {
+ createTable(ImmutableMap.of(TableProperties.FORMAT_VERSION, "3"));
+ List<ThreeColumnRecord> records = Lists.newArrayList();
+ for (int i = 0; i < 10; i++) {
+ records.add(new ThreeColumnRecord(i, null, null));
+ }
+
+ spark
+ .createDataFrame(records, ThreeColumnRecord.class)
+ .repartition(10)
+ .writeTo(tableName)
+ .append();
+ List<Object[]> expectedRowsWithLineage =
Review Comment:
Will update (note the action tests assert the row id and seq numbers, and
the procedure is just calling the action)., but no harm in asserting in these
tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
