This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.1 by this push:
new f8e390b8e7fa [SPARK-7008][SDP][ML] Make
`org.apache.spark.sql.pipelines` internal package and make `EstimatorUtils`
private
f8e390b8e7fa is described below
commit f8e390b8e7faf5d6f253012250e5fa8b402c1720
Author: Ruifeng Zheng <[email protected]>
AuthorDate: Mon Dec 15 10:51:55 2025 +0800
[SPARK-7008][SDP][ML] Make `org.apache.spark.sql.pipelines` internal
package and make `EstimatorUtils` private
### What changes were proposed in this pull request?
Make org.apache.spark.sql.pipelines internal package and make
EstimatorUtils private
### Why are the changes needed?
they should not be exposed to end users
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
ci
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #53444 from zhengruifeng/mk_EstimatorUtils_private.
Authored-by: Ruifeng Zheng <[email protected]>
Signed-off-by: Wenchen Fan <[email protected]>
(cherry picked from commit 348164964c1d070d257c717aac914c460630c58a)
Signed-off-by: Wenchen Fan <[email protected]>
---
mllib/src/main/scala/org/apache/spark/ml/Estimator.scala | 2 +-
project/SparkBuild.scala | 2 ++
2 files changed, 3 insertions(+), 1 deletion(-)
diff --git a/mllib/src/main/scala/org/apache/spark/ml/Estimator.scala
b/mllib/src/main/scala/org/apache/spark/ml/Estimator.scala
index 0e1f64cc7b63..84ced2441437 100644
--- a/mllib/src/main/scala/org/apache/spark/ml/Estimator.scala
+++ b/mllib/src/main/scala/org/apache/spark/ml/Estimator.scala
@@ -106,7 +106,7 @@ abstract class Estimator[M <: Model[M]] extends
PipelineStage {
}
-object EstimatorUtils {
+private[spark] object EstimatorUtils {
// This warningMessagesBuffer is for collecting warning messages during
`estimator.fit`
// execution in Spark Connect server.
private[spark] val warningMessagesBuffer = new
java.lang.ThreadLocal[ArrayBuffer[String]]() {
diff --git a/project/SparkBuild.scala b/project/SparkBuild.scala
index 7a4c3f0828d0..fec6a3346f7d 100644
--- a/project/SparkBuild.scala
+++ b/project/SparkBuild.scala
@@ -366,6 +366,7 @@ object SparkBuild extends PomBuild {
"org.apache.spark.kafka010",
"org.apache.spark.network",
"org.apache.spark.sql.avro",
+ "org.apache.spark.sql.pipelines",
"org.apache.spark.sql.scripting",
"org.apache.spark.types.variant",
"org.apache.spark.ui.flamegraph",
@@ -1530,6 +1531,7 @@ object Unidoc {
.map(_.filterNot(_.getCanonicalPath.contains("org/apache/spark/sql/classic/")))
.map(_.filterNot(_.getCanonicalPath.contains("org/apache/spark/sql/execution")))
.map(_.filterNot(_.getCanonicalPath.contains("org/apache/spark/sql/internal")))
+
.map(_.filterNot(_.getCanonicalPath.contains("org/apache/spark/sql/pipelines")))
.map(_.filterNot(_.getCanonicalPath.contains("org/apache/spark/sql/scripting")))
.map(_.filterNot(_.getCanonicalPath.contains("org/apache/spark/sql/ml")))
.map(_.filterNot(_.getCanonicalPath.contains("org/apache/spark/sql/hive")))
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
