This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4adc282 [SPARK-33035][SQL] Updates the obsoleted entries of attribute
mapping in QueryPlan#transformUpWithNewOutput
add 2793347 [SPARK-32511][SQL] Add dropFields method to Column class
No new revisions were added by this update.
Summary of changes:
.../catalyst/expressions/complexTypeCreator.scala | 127 ++-
.../sql/catalyst/optimizer/ComplexTypes.scala | 20 +-
.../spark/sql/catalyst/optimizer/Optimizer.scala | 6 +-
.../{WithFields.scala => UpdateFields.scala} | 16 +-
...sSuite.scala => CombineUpdateFieldsSuite.scala} | 41 +-
.../sql/catalyst/optimizer/complexTypesSuite.scala | 345 ++++++--
.../benchmarks/UpdateFieldsBenchmark-results.txt | 26 +
.../main/scala/org/apache/spark/sql/Column.scala | 119 ++-
.../apache/spark/sql/ColumnExpressionSuite.scala | 881 +++++++++++++++++++--
.../apache/spark/sql/UpdateFieldsBenchmark.scala | 224 ++++++
10 files changed, 1607 insertions(+), 198 deletions(-)
rename
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/{WithFields.scala
=> UpdateFields.scala} (68%)
rename
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/{CombineWithFieldsSuite.scala
=> CombineUpdateFieldsSuite.scala} (65%)
create mode 100644 sql/core/benchmarks/UpdateFieldsBenchmark-results.txt
create mode 100644
sql/core/src/test/scala/org/apache/spark/sql/UpdateFieldsBenchmark.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]