This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 011b2b8b2eda [SPARK-53833][PYTHON] Update `dev/requirements.txt` to
skip `torch/torchvision` in Python 3.14
011b2b8b2eda is described below
commit 011b2b8b2eda5a999dc4b131499715fa2bd41413
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Wed Oct 8 00:40:05 2025 -0700
[SPARK-53833][PYTHON] Update `dev/requirements.txt` to skip
`torch/torchvision` in Python 3.14
### What changes were proposed in this pull request?
This PR aims to update `dev/requirements.txt` to skip `torch` and
`torchvision` packages in Python 3.14.
### Why are the changes needed?
Although `Python 3.14` is released, both `torch` and `torchvision` do not
support `Python 3.14` yet. We had better disable it for `Python 3.14` until
they become ready.
- https://pypi.org/project/torch/
- https://pypi.org/project/torchvision/
```
$ python3 --version
Python 3.14.0
$ pip3 install torch
ERROR: Could not find a version that satisfies the requirement torch (from
versions: none)
ERROR: No matching distribution found for torch
$ pip3 install torchvision
ERROR: Ignored the following yanked versions: 0.1.6, 0.1.7, 0.1.8, 0.1.9,
0.2.0, 0.2.1, 0.2.2, 0.2.2.post2, 0.2.2.post3
ERROR: Could not find a version that satisfies the requirement torchvision
(from versions: none)
ERROR: No matching distribution found for torchvision
```
### Does this PR introduce _any_ user-facing change?
No behavior change.
### How was this patch tested?
Manual review.
```
$ python3 --version
Python 3.14.0
$ pip3 install -r dev/requirements.txt # Success
```
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #52543 from dongjoon-hyun/SPARK-53833.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
dev/requirements.txt | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/dev/requirements.txt b/dev/requirements.txt
index 76652df74481..40e7fa46cf14 100644
--- a/dev/requirements.txt
+++ b/dev/requirements.txt
@@ -76,8 +76,8 @@ graphviz==0.20.3
flameprof==0.4
# TorchDistributor dependencies
-torch
-torchvision
+torch; python_version < '3.14'
+torchvision; python_version < '3.14'
torcheval
# DeepspeedTorchDistributor dependencies
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
