This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new ff084ed8ff2 Add sql extras to pandas in the providers where sqlalchemy
is needed (#53535)
ff084ed8ff2 is described below
commit ff084ed8ff27827e6496fbae520953836051fd29
Author: Jarek Potiuk <[email protected]>
AuthorDate: Sat Jul 19 16:50:40 2025 +0200
Add sql extras to pandas in the providers where sqlalchemy is needed
(#53535)
Without those extras pandas does not impose limitations on sqlalchemy
version used - but it is really an implicit dependency of pandas,
when it is used for sqlalchemy interactions.
This will drop constraint version of pandas for Airflow 3 to 2.1 and
it is really a conflicting dependency for Python 3.13 where only pandas
2.2.3 can be used but it requires sqlalchemy 2. This extra should
be added while migrating to sqlalchemy 2 is complete.
---
providers/common/sql/pyproject.toml | 4 +++-
providers/presto/pyproject.toml | 2 +-
2 files changed, 4 insertions(+), 2 deletions(-)
diff --git a/providers/common/sql/pyproject.toml
b/providers/common/sql/pyproject.toml
index d55b6c47282..b3b95697344 100644
--- a/providers/common/sql/pyproject.toml
+++ b/providers/common/sql/pyproject.toml
@@ -69,7 +69,9 @@ dependencies = [
# Any change in the dependencies is preserved when the file is regenerated
[project.optional-dependencies]
"pandas" = [
- 'pandas>=2.1.2; python_version <"3.13"',
+ 'pandas[sql-other]>=2.1.2; python_version <"3.13"',
+ # Technically - we should add "sql-other" here as well, but this will only
be possible when we move
+ # to sqlalchemy 2+ TODO(potiuk): do so.
'pandas>=2.2.3; python_version >="3.13"',
]
"openlineage" = [
diff --git a/providers/presto/pyproject.toml b/providers/presto/pyproject.toml
index 3abdbf82047..269c57b127c 100644
--- a/providers/presto/pyproject.toml
+++ b/providers/presto/pyproject.toml
@@ -60,7 +60,7 @@ dependencies = [
"apache-airflow>=2.10.0",
"apache-airflow-providers-common-sql>=1.26.0",
"presto-python-client>=0.8.4",
- 'pandas>=2.1.2; python_version <"3.13"',
+ 'pandas[postgres]>=2.1.2; python_version <"3.13"',
'pandas>=2.2.3; python_version >="3.13"',
]
