aokolnychyi commented on PR #15281:
URL: https://github.com/apache/iceberg/pull/15281#issuecomment-3878284441
@pan3793, if I recall correctly, `Scan$description` is only used in scan
exec nodes. This PR removes the projection schema per Javadoc instructions in
Spark and adds the scan class to the name (I am planning to add even more scan
types later so it is helpful to see with which scan we are dealing with). I
debated whether I should preserve the runtime filters field but decided to keep
it as is for now, even though it somewhat duplicates what Spark includes.
```
== Physical Plan ==
*(1) ColumnarToRow
+- BatchScan testhive.default.table[id#39, dep#40]
IcebergScan(table=testhive.default.table, branch=null, filters=,
runtimeFilters=, groupedBy=) RuntimeFilters: []
```
```
== Physical Plan ==
ReplaceData IcebergWrite(table=testhive.default.table, format=ORC)
+- AdaptiveSparkPlan isFinalPlan=false
+- MergeRowsExec[__row_operation#55, id#56, dep#57, _file#58]
+- SortMergeJoin [id#39], [id#33], FullOuter
:- Sort [id#39 ASC NULLS FIRST], false, 0
: +- Exchange hashpartitioning(id#39, 4), ENSURE_REQUIREMENTS,
[plan_id=91]
: +- Project [id#39, dep#40, _file#48, true AS
__row_from_target#51, monotonically_increasing_id() AS __row_id#52L]
: +- BatchScan testhive.default.table[id#39, dep#40,
_file#48] IcebergCopyOnWriteScan(table=testhive.default.table, filters=true,
groupedBy=) RuntimeFilters: []
+- Sort [id#33 ASC NULLS FIRST], false, 0
+- Exchange hashpartitioning(id#33, 4), ENSURE_REQUIREMENTS,
[plan_id=92]
+- Project [id#33, dep#34, true AS __row_from_source#53]
+- Scan ExistingRDD[id#33,dep#34]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
