[
https://issues.apache.org/jira/browse/SPARK-56250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh resolved SPARK-56250.
---------------------------------
Fix Version/s: 4.2.0
4.1.2
Resolution: Fixed
Issue resolved by pull request 55048
[https://github.com/apache/spark/pull/55048]
> Remove confusing defensive code in SortExec.rowSorter and add warning comment
> -----------------------------------------------------------------------------
>
> Key: SPARK-56250
> URL: https://issues.apache.org/jira/browse/SPARK-56250
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 4.2.0, 4.1.1
> Reporter: L. C. Hsieh
> Assignee: L. C. Hsieh
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.2.0, 4.1.2
>
>
> SPARK-52609 added some defensive code to SortExec. The defensive has some
> issues and was fixed by SPARK-56203.
> But actually the defensive code is not for Spark itself but to guard
> multithreading access to SortExec. The defensive code could easily confuse
> others. After rethinking about it, it might be better to revert it and add
> some warning comment.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
