This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/github_actions/github-actions-updates-5d993b9bb5
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 0b829098af0 Bump aws-actions/configure-aws-credentials
add e55d90f0692 fix(glue): Fix GlueJobOperator verbose logs not showing in
deferrable mode (#64342)
add 6cbf4c8bc41 Add workers.celery.extraVolumes &
workers.kubernetes.extraVolumes (#64746)
add 17c4db97c4e Bump axios in
/providers/edge3/src/airflow/providers/edge3/plugins/www (#65004)
add 34497e5f3c6 fix the bulk (#65015)
add 74283fb2a86 Add FAQ entry for API server memory growth with gunicorn
worker recycling (#65036)
add 3ce9681214d Add v3-2-stable branch protection for Airflow 3.2.0
release (#65038)
add 2c9f34cf778 Fix HITL review plugin crash on Airflow < 3.1 due to
unconditional im… (#64981)
add d5cbfe52e78 Add workers.celery.tolerations &
workers.kubernetes.tolerations (#64976)
add d212f624cf4 Sync default image Python version references (#64994)
add 99e5127f6d5 add ttlSecondsAfterFinished to databaseCleanup job (#64164)
add 7d3364b22f3 Validate operator arg types at decoration time in @task
decorator (#65041)
add 511af0a7dd5 Add workers.celery.topologySpreadConstraints &
workers.kubernetes.topologySpreadConstraints (#64980)
add 3564d44ee3d Add workers.celery.annotations field (#64982)
add cbcd5636f07 Fixed incorrect image path for helm/core issues in breeze
docs (#65060)
add 6d02bae165d fix: update dependencies to fix dependabot alarms in
registry (#65051)
add 4ecbd59c0be Fix missing dag_id in get_task_instance (#64957) (#64968)
add 8a02c43dcb7 Add workers.celery.podAnnotations &
workers.kubernetes.podAnnotations (#65027)
add 7c633b6f8f6 Fix RESOURCE_ASSET compatibility with Airflow 2.x in
common-compat (#64933)
add 9e92ac9e46f Fix stale system test documentation links (#65071)
add 8ff744f7e4a Fix opensearch provider to use SDK imports for Airflow
3.2+ (#65076)
add 88eccf4e939 Add workers.celery.extraVolumeMounts &
workers.kubernetes.extraVolumeMounts (#65059)
add 3a458dea5e9 [Helm]Support tpl rendering in ServiceAccount annotations,
metadataConnection, and config ConfigMap names (#64763)
add 9f8678a3efc Fix CLI error handling and exit codes for failed commands
(#65052)
add 556380f86e4 Add workers.celery.logGroomerSidecar section (#65033)
add 30c170e6748 add yaml-based help texts for auto-generated airflowctl
commands (#65073)
add 6ef5165a2b6 fix(cli): change is_alive default to None in jobs list
(#65065)
add f13b71371da Trigger unit tests when only shared/*.py files change
(#64999)
add eae5f754463 Prevent path traversal via AIRFLOW_CLI_ENVIRONMENT in
airflowctl (#64618)
add 6a63b1e1c6b Fix publishing failure when new providers are added to
main (#65093)
add 2ebfc0ed762 Update providers metadata 2026-04-12 (#65102)
add 977c119a050 Add workers.celery.labels & workers.kubernetes.labels
(#65030)
add 4c0535857bc Generate JWT Secret of recommended length (#65082)
add b24538b0bc3 Added breeze generate issue content for airflow-ctl
(#65042)
add 0ecfcee859b Add workers.celery.env & workers.kubernetes.env (#65056)
add 0c023531d0c Prepare providers release 2026-04-12 (#65106)
add c90e756f84f Bump aws-actions/configure-aws-credentials
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (0b829098af0)
\
N -- N -- N
refs/heads/dependabot/github_actions/github-actions-updates-5d993b9bb5
(c90e756f84f)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 5 +
Dockerfile | 2 +-
Dockerfile.ci | 2 +-
airflow-core/docs/faq.rst | 37 +
airflow-core/src/airflow/models/taskinstance.py | 1 +
airflow-core/tests/system/example_empty.py | 2 +-
.../tests/unit/models/test_taskinstance.py | 75 ++
airflow-ctl/.pre-commit-config.yaml | 9 +
airflow-ctl/docs/images/command_hashes.txt | 22 +-
airflow-ctl/docs/images/output_assets.svg | 186 ++---
airflow-ctl/docs/images/output_backfill.svg | 122 +--
airflow-ctl/docs/images/output_config.svg | 98 +--
airflow-ctl/docs/images/output_connections.svg | 88 +--
airflow-ctl/docs/images/output_dagrun.svg | 86 +--
airflow-ctl/docs/images/output_dags.svg | 170 ++--
airflow-ctl/docs/images/output_jobs.svg | 80 +-
airflow-ctl/docs/images/output_plugins.svg | 64 +-
airflow-ctl/docs/images/output_pools.svg | 116 +--
airflow-ctl/docs/images/output_providers.svg | 80 +-
airflow-ctl/docs/images/output_variables.svg | 76 +-
airflow-ctl/src/airflowctl/api/client.py | 36 +-
airflow-ctl/src/airflowctl/api/operations.py | 14 +-
airflow-ctl/src/airflowctl/ctl/cli_config.py | 27 +-
airflow-ctl/src/airflowctl/ctl/help_texts.yaml | 102 +++
airflow-ctl/tests/airflow_ctl/api/test_client.py | 19 +
.../tests/airflow_ctl/api/test_operations.py | 31 +
.../tests/airflow_ctl/ctl/test_cli_config.py | 115 +++
chart/docs/customizing-labels.rst | 7 +-
chart/docs/production-guide.rst | 11 +
chart/docs/setting-resources-for-containers.rst | 2 +-
chart/files/pod-template-file.kubernetes-helm-yaml | 28 +-
chart/newsfragments/64746.significant.rst | 1 +
chart/newsfragments/64976.significant.rst | 1 +
chart/newsfragments/64980.significant.rst | 1 +
chart/newsfragments/64982.significant.rst | 1 +
chart/newsfragments/65027.significant.rst | 1 +
chart/newsfragments/65030.significant.rst | 1 +
chart/newsfragments/65033.significant.rst | 1 +
chart/newsfragments/65056.significant.rst | 1 +
chart/newsfragments/65059.significant.rst | 1 +
chart/templates/NOTES.txt | 160 ++++
chart/templates/_helpers.yaml | 30 +-
.../api-server/api-server-serviceaccount.yaml | 3 +-
.../dag-processor-serviceaccount.yaml | 3 +-
.../database-cleanup/database-cleanup-cronjob.yaml | 3 +
.../pgbouncer/pgbouncer-serviceaccount.yaml | 3 +-
.../scheduler/scheduler-serviceaccount.yaml | 4 +-
chart/templates/secrets/jwt-secret.yaml | 2 +-
.../secrets/metadata-connection-secret.yaml | 9 +-
.../triggerer/triggerer-serviceaccount.yaml | 3 +-
.../webserver/webserver-serviceaccount.yaml | 3 +-
.../workers/worker-kubernetes-serviceaccount.yaml | 4 +-
chart/templates/workers/worker-serviceaccount.yaml | 3 +-
chart/values.schema.json | 562 +++++++++++++-
chart/values.yaml | 170 +++-
contributing-docs/12_provider_distributions.rst | 2 +-
contributing-docs/testing/system_tests.rst | 6 +-
dev/breeze/doc/09_release_management_tasks.rst | 14 +-
.../doc/images/output_release-management.svg | 42 +-
.../doc/images/output_release-management.txt | 2 +-
...nagement_generate-issue-content-airflow-ctl.svg | 134 ++++
...nagement_generate-issue-content-airflow-ctl.txt | 1 +
.../output_setup_check-all-params-in-groups.svg | 4 +-
.../output_setup_check-all-params-in-groups.txt | 2 +-
.../output_setup_regenerate-command-images.svg | 72 +-
.../output_setup_regenerate-command-images.txt | 2 +-
.../commands/release_management_commands.py | 67 +-
.../commands/release_management_commands_config.py | 16 +-
.../src/airflow_breeze/utils/docs_publisher.py | 4 +
.../src/airflow_breeze/utils/selective_checks.py | 1 +
dev/breeze/tests/test_selective_checks.py | 10 +
docker-stack-docs/build-arg-ref.rst | 2 +-
.../customizing/add-build-essential-custom.sh | 2 +-
.../docker-examples/customizing/custom-sources.sh | 2 +-
.../customizing/pypi-dev-runtime-deps.sh | 2 +-
.../customizing/pypi-extras-and-deps.sh | 2 +-
.../customizing/pypi-selected-version.sh | 2 +-
.../restricted/restricted_environments.sh | 2 +-
generated/provider_metadata.json | 612 +++++++++++----
helm-tests/tests/chart_utils/log_groomer.py | 145 ++--
.../helm_tests/airflow_aux/test_annotations.py | 285 +++++--
.../airflow_aux/test_basic_helm_chart.py | 7 +
.../airflow_aux/test_container_lifecycle.py | 71 +-
.../airflow_aux/test_database_cleanup.py | 26 +
.../airflow_aux/test_pod_template_file.py | 275 +++++--
.../helm_tests/airflow_core/test_pdb_worker.py | 31 +-
.../tests/helm_tests/airflow_core/test_worker.py | 554 ++++++++++---
.../helm_tests/airflow_core/test_worker_sets.py | 109 ++-
.../security/test_metadata_connection_secret.py | 40 +
.../helm_tests/security/test_security_context.py | 25 +-
providers/.last_release_date.txt | 2 +-
.../system/airbyte/example_airbyte_trigger_job.py | 2 +-
.../system/alibaba/example_adb_spark_batch.py | 2 +-
.../tests/system/alibaba/example_adb_spark_sql.py | 2 +-
.../tests/system/alibaba/example_maxcompute_sql.py | 2 +-
.../tests/system/alibaba/example_oss_bucket.py | 2 +-
.../tests/system/alibaba/example_oss_object.py | 2 +-
providers/amazon/docs/changelog.rst | 6 +-
.../src/airflow/providers/amazon/aws/hooks/glue.py | 36 +-
.../airflow/providers/amazon/aws/triggers/glue.py | 135 +++-
.../amazon/tests/system/amazon/CONTRIBUTING.md | 2 +-
.../tests/system/amazon/aws/example_appflow.py | 2 +-
.../tests/system/amazon/aws/example_appflow_run.py | 2 +-
.../tests/system/amazon/aws/example_athena.py | 2 +-
.../system/amazon/aws/example_azure_blob_to_s3.py | 2 +-
.../tests/system/amazon/aws/example_batch.py | 2 +-
.../tests/system/amazon/aws/example_bedrock.py | 2 +-
.../amazon/aws/example_bedrock_batch_inference.py | 2 +-
.../aws/example_bedrock_retrieve_and_generate.py | 2 +-
.../system/amazon/aws/example_cloudformation.py | 2 +-
.../tests/system/amazon/aws/example_comprehend.py | 2 +-
.../aws/example_comprehend_document_classifier.py | 2 +-
.../tests/system/amazon/aws/example_datasync.py | 2 +-
.../amazon/tests/system/amazon/aws/example_dms.py | 2 +-
.../system/amazon/aws/example_dms_serverless.py | 2 +-
.../tests/system/amazon/aws/example_dynamodb.py | 2 +-
.../system/amazon/aws/example_dynamodb_to_s3.py | 2 +-
.../amazon/tests/system/amazon/aws/example_ec2.py | 2 +-
.../amazon/tests/system/amazon/aws/example_ecs.py | 2 +-
.../tests/system/amazon/aws/example_ecs_fargate.py | 2 +-
.../system/amazon/aws/example_eks_templated.py | 2 +-
.../aws/example_eks_with_fargate_in_one_step.py | 2 +-
.../amazon/aws/example_eks_with_fargate_profile.py | 2 +-
.../aws/example_eks_with_nodegroup_in_one_step.py | 2 +-
.../amazon/aws/example_eks_with_nodegroups.py | 2 +-
.../amazon/tests/system/amazon/aws/example_emr.py | 2 +-
.../tests/system/amazon/aws/example_emr_eks.py | 2 +-
.../amazon/aws/example_emr_notebook_execution.py | 2 +-
.../system/amazon/aws/example_emr_serverless.py | 2 +-
.../tests/system/amazon/aws/example_eventbridge.py | 2 +-
.../tests/system/amazon/aws/example_ftp_to_s3.py | 2 +-
.../tests/system/amazon/aws/example_gcs_to_s3.py | 2 +-
.../system/amazon/aws/example_glacier_to_gcs.py | 2 +-
.../amazon/tests/system/amazon/aws/example_glue.py | 2 +-
.../system/amazon/aws/example_glue_data_quality.py | 2 +-
...xample_glue_data_quality_with_recommendation.py | 2 +-
.../system/amazon/aws/example_glue_databrew.py | 2 +-
.../amazon/aws/example_google_api_sheets_to_s3.py | 2 +-
.../amazon/aws/example_google_api_youtube_to_s3.py | 2 +-
.../system/amazon/aws/example_hive_to_dynamodb.py | 2 +-
.../tests/system/amazon/aws/example_http_to_s3.py | 2 +-
.../amazon/aws/example_imap_attachment_to_s3.py | 2 +-
.../system/amazon/aws/example_kinesis_analytics.py | 2 +-
.../tests/system/amazon/aws/example_lambda.py | 2 +-
.../tests/system/amazon/aws/example_local_to_s3.py | 2 +-
.../tests/system/amazon/aws/example_mongo_to_s3.py | 2 +-
.../amazon/tests/system/amazon/aws/example_mwaa.py | 2 +-
.../system/amazon/aws/example_mwaa_airflow2.py | 2 +-
.../tests/system/amazon/aws/example_neptune.py | 2 +-
.../tests/system/amazon/aws/example_quicksight.py | 2 +-
.../tests/system/amazon/aws/example_rds_event.py | 2 +-
.../tests/system/amazon/aws/example_rds_export.py | 2 +-
.../system/amazon/aws/example_rds_instance.py | 2 +-
.../system/amazon/aws/example_rds_snapshot.py | 2 +-
.../tests/system/amazon/aws/example_redshift.py | 2 +-
.../amazon/aws/example_redshift_s3_transfers.py | 2 +-
.../amazon/tests/system/amazon/aws/example_s3.py | 2 +-
.../system/amazon/aws/example_s3_to_dynamodb.py | 2 +-
.../tests/system/amazon/aws/example_s3_to_ftp.py | 2 +-
.../tests/system/amazon/aws/example_s3_to_sftp.py | 2 +-
.../tests/system/amazon/aws/example_s3_to_sql.py | 2 +-
.../tests/system/amazon/aws/example_sagemaker.py | 2 +-
.../amazon/aws/example_sagemaker_condition.py | 2 +-
.../amazon/aws/example_sagemaker_endpoint.py | 2 +-
.../amazon/aws/example_sagemaker_notebook.py | 2 +-
.../amazon/aws/example_sagemaker_pipeline.py | 2 +-
.../amazon/aws/example_sagemaker_unified_studio.py | 2 +-
.../system/amazon/aws/example_salesforce_to_s3.py | 2 +-
.../amazon/tests/system/amazon/aws/example_ses.py | 2 +-
.../tests/system/amazon/aws/example_sftp_to_s3.py | 2 +-
.../amazon/tests/system/amazon/aws/example_sns.py | 2 +-
.../tests/system/amazon/aws/example_sql_to_s3.py | 2 +-
.../amazon/tests/system/amazon/aws/example_sqs.py | 2 +-
.../amazon/tests/system/amazon/aws/example_ssm.py | 2 +-
.../system/amazon/aws/example_step_functions.py | 2 +-
.../tests/unit/amazon/aws/triggers/test_glue.py | 245 ++++++
.../beam/tests/system/apache/beam/example_beam.py | 2 +-
.../system/apache/beam/example_beam_java_flink.py | 2 +-
.../system/apache/beam/example_beam_java_spark.py | 2 +-
.../beam/tests/system/apache/beam/example_go.py | 2 +-
.../system/apache/beam/example_go_dataflow.py | 2 +-
.../system/apache/beam/example_java_dataflow.py | 2 +-
.../tests/system/apache/beam/example_python.py | 2 +-
.../system/apache/beam/example_python_async.py | 2 +-
.../system/apache/beam/example_python_dataflow.py | 2 +-
.../apache/cassandra/example_cassandra_dag.py | 2 +-
.../tests/system/apache/drill/example_drill_dag.py | 2 +-
.../tests/system/apache/druid/example_druid_dag.py | 2 +-
.../hive/tests/system/apache/hive/example_hive.py | 2 +-
.../system/apache/hive/example_twitter_dag.py | 2 +-
.../tests/system/apache/iceberg/example_iceberg.py | 2 +-
.../tests/system/apache/impala/example_impala.py | 2 +-
.../apache/kafka/example_dag_event_listener.py | 2 +-
.../system/apache/kafka/example_dag_hello_kafka.py | 2 +-
.../example_dag_kafka_message_queue_trigger.py | 2 +-
.../kafka/example_dag_message_queue_trigger.py | 2 +-
.../tests/system/apache/kylin/example_kylin_dag.py | 2 +-
.../livy/tests/system/apache/livy/example_livy.py | 2 +-
.../pig/tests/system/apache/pig/example_pig.py | 2 +-
.../tests/system/apache/pinot/example_pinot_dag.py | 2 +-
.../tests/system/apache/spark/example_pyspark.py | 2 +-
.../tests/system/apache/spark/example_spark_dag.py | 2 +-
.../system/apache/tinkerpop/example_gremlin_dag.py | 2 +-
.../asana/tests/system/asana/example_asana.py | 2 +-
.../system/cncf/kubernetes/example_kubernetes.py | 2 +-
.../cncf/kubernetes/example_kubernetes_async.py | 2 +-
.../kubernetes/example_kubernetes_cmd_decorator.py | 2 +-
.../kubernetes/example_kubernetes_decorator.py | 2 +-
.../cncf/kubernetes/example_kubernetes_job.py | 2 +-
.../cncf/kubernetes/example_kubernetes_kueue.py | 2 +-
.../cncf/kubernetes/example_kubernetes_resource.py | 2 +-
.../cncf/kubernetes/example_spark_kubernetes.py | 2 +-
.../cohere/example_cohere_embedding_operator.py | 2 +-
.../providers/common/ai/plugins/hitl_review.py | 858 ++++++++++-----------
.../common/ai/plugins/test_hitl_review_compat.py} | 24 +-
providers/common/compat/docs/changelog.rst | 2 +
.../common/compat/security/permissions.py | 9 +-
.../common/io/example_file_transfer_local_to_s3.py | 2 +-
.../messaging/example_message_queue_trigger.py | 2 +-
.../system/common/sql/example_generic_transfer.py | 2 +-
.../common/sql/example_sql_column_table_check.py | 2 +-
.../system/common/sql/example_sql_execute_query.py | 2 +-
.../system/common/sql/example_sql_insert_rows.py | 2 +-
.../common/sql/example_sql_threshold_check.py | 2 +-
.../system/common/sql/example_sql_value_check.py | 2 +-
.../tests/system/databricks/example_databricks.py | 2 +-
.../system/databricks/example_databricks_repos.py | 2 +-
.../databricks/example_databricks_sensors.py | 2 +-
.../system/databricks/example_databricks_sql.py | 2 +-
.../databricks/example_databricks_workflow.py | 2 +-
.../tests/system/dbt/cloud/example_dbt_cloud.py | 2 +-
.../tests/system/dingding/example_dingding.py | 2 +-
.../docker/tests/system/docker/example_docker.py | 2 +-
.../system/docker/example_docker_copy_data.py | 2 +-
.../tests/system/docker/example_docker_swarm.py | 2 +-
.../example_taskflow_api_docker_virtualenv.py | 4 +-
.../providers/edge3/plugins/www/package.json | 2 +-
.../providers/edge3/plugins/www/pnpm-lock.yaml | 36 +-
.../www/src/components/BulkWorkerOperations.tsx | 159 +++-
.../providers/edge3/plugins/www/src/constants.ts | 12 +
.../plugins/www/src/hooks/useBulkWorkerActions.ts | 73 +-
.../elasticsearch/example_elasticsearch_query.py | 2 +-
.../exasol/tests/system/exasol/example_exasol.py | 2 +-
providers/ftp/tests/system/ftp/example_ftp.py | 2 +-
.../github/tests/system/github/example_github.py | 2 +-
.../google/tests/system/google/ads/example_ads.py | 2 +-
.../google/cloud/alloy_db/example_alloy_db.py | 2 +-
.../cloud/azure/example_azure_blob_to_gcs.py | 2 +-
.../cloud/azure/example_azure_fileshare_to_gcs.py | 2 +-
.../cloud/bigquery/example_bigquery_dataset.py | 2 +-
.../google/cloud/bigquery/example_bigquery_dts.py | 2 +-
.../google/cloud/bigquery/example_bigquery_jobs.py | 2 +-
.../cloud/bigquery/example_bigquery_operations.py | 2 +-
.../cloud/bigquery/example_bigquery_queries.py | 2 +-
.../bigquery/example_bigquery_queries_async.py | 2 +-
.../cloud/bigquery/example_bigquery_sensors.py | 2 +-
.../cloud/bigquery/example_bigquery_tables.py | 2 +-
.../cloud/bigquery/example_bigquery_to_bigquery.py | 2 +-
.../cloud/bigquery/example_bigquery_to_gcs.py | 2 +-
.../cloud/bigquery/example_bigquery_to_mssql.py | 2 +-
.../cloud/bigquery/example_bigquery_to_mysql.py | 2 +-
.../cloud/bigquery/example_bigquery_to_postgres.py | 2 +-
.../cloud/bigquery/example_bigquery_transfer.py | 2 +-
.../cloud/bigquery/example_bigquery_value_check.py | 4 +-
.../google/cloud/bigtable/example_bigtable.py | 2 +-
.../cloud/cloud_batch/example_cloud_batch.py | 2 +-
.../cloud/cloud_build/example_cloud_build.py | 2 +-
.../cloud_build/example_cloud_build_trigger.py | 2 +-
.../cloud/cloud_functions/example_functions.py | 2 +-
.../example_cloud_memorystore_memcached.py | 2 +-
.../example_cloud_memorystore_redis.py | 2 +-
.../google/cloud/cloud_run/example_cloud_run.py | 2 +-
.../cloud/cloud_run/example_cloud_run_service.py | 2 +-
.../google/cloud/cloud_sql/example_cloud_sql.py | 2 +-
.../cloud/cloud_sql/example_cloud_sql_query.py | 2 +-
.../cloud/cloud_sql/example_cloud_sql_query_iam.py | 2 +-
.../cloud/cloud_sql/example_cloud_sql_query_ssl.py | 2 +-
.../cloud/composer/example_cloud_composer.py | 2 +-
.../system/google/cloud/compute/example_compute.py | 2 +-
.../google/cloud/compute/example_compute_igm.py | 2 +-
.../google/cloud/compute/example_compute_ssh.py | 2 +-
.../cloud/compute/example_compute_ssh_os_login.py | 2 +-
.../cloud/compute/example_compute_ssh_parallel.py | 2 +-
.../example_dlp_deidentify_content.py | 2 +-
.../data_loss_prevention/example_dlp_info_types.py | 2 +-
.../example_dlp_inspect_template.py | 2 +-
.../cloud/data_loss_prevention/example_dlp_job.py | 2 +-
.../example_dlp_job_trigger.py | 2 +-
.../google/cloud/dataflow/example_dataflow_go.py | 2 +-
.../dataflow/example_dataflow_java_streaming.py | 2 +-
.../cloud/dataflow/example_dataflow_native_java.py | 2 +-
.../dataflow/example_dataflow_native_python.py | 2 +-
.../example_dataflow_native_python_async.py | 2 +-
.../cloud/dataflow/example_dataflow_pipeline.py | 2 +-
.../example_dataflow_pipeline_streaming.py | 2 +-
.../example_dataflow_sensors_deferrable.py | 2 +-
.../dataflow/example_dataflow_streaming_python.py | 2 +-
.../cloud/dataflow/example_dataflow_template.py | 2 +-
.../google/cloud/dataflow/example_dataflow_yaml.py | 2 +-
.../google/cloud/dataform/example_dataform.py | 2 +-
.../google/cloud/datafusion/example_datafusion.py | 2 +-
.../google/cloud/dataplex/example_dataplex.py | 2 +-
.../cloud/dataplex/example_dataplex_catalog.py | 2 +-
.../google/cloud/dataplex/example_dataplex_dp.py | 2 +-
.../google/cloud/dataplex/example_dataplex_dq.py | 2 +-
.../google/cloud/dataprep/example_dataprep.py | 2 +-
.../cloud/dataproc/example_dataproc_batch.py | 2 +-
.../dataproc/example_dataproc_batch_deferrable.py | 2 +-
.../dataproc/example_dataproc_batch_persistent.py | 2 +-
...proc_cluster_create_existing_stopped_cluster.py | 2 +-
.../example_dataproc_cluster_deferrable.py | 2 +-
.../dataproc/example_dataproc_cluster_diagnose.py | 2 +-
.../dataproc/example_dataproc_cluster_generator.py | 2 +-
.../example_dataproc_cluster_start_stop.py | 2 +-
.../dataproc/example_dataproc_cluster_update.py | 2 +-
.../cloud/dataproc/example_dataproc_flink.py | 2 +-
.../google/cloud/dataproc/example_dataproc_gke.py | 2 +-
.../cloud/dataproc/example_dataproc_hadoop.py | 2 +-
.../google/cloud/dataproc/example_dataproc_hive.py | 2 +-
.../google/cloud/dataproc/example_dataproc_pig.py | 2 +-
.../cloud/dataproc/example_dataproc_presto.py | 2 +-
.../cloud/dataproc/example_dataproc_pyspark.py | 2 +-
.../cloud/dataproc/example_dataproc_spark.py | 2 +-
.../cloud/dataproc/example_dataproc_spark_async.py | 2 +-
.../dataproc/example_dataproc_spark_deferrable.py | 2 +-
.../cloud/dataproc/example_dataproc_spark_sql.py | 2 +-
.../cloud/dataproc/example_dataproc_sparkr.py | 2 +-
.../cloud/dataproc/example_dataproc_trino.py | 2 +-
.../cloud/dataproc/example_dataproc_workflow.py | 2 +-
.../example_dataproc_workflow_deferrable.py | 2 +-
.../example_dataproc_metastore.py | 2 +-
.../example_dataproc_metastore_backup.py | 2 +-
...ple_dataproc_metastore_hive_partition_sensor.py | 2 +-
.../cloud/datastore/example_datastore_commit.py | 2 +-
.../cloud/datastore/example_datastore_query.py | 2 +-
.../cloud/datastore/example_datastore_rollback.py | 2 +-
.../google/cloud/gcs/example_calendar_to_gcs.py | 2 +-
.../system/google/cloud/gcs/example_firestore.py | 2 +-
.../system/google/cloud/gcs/example_gcs_acl.py | 2 +-
.../google/cloud/gcs/example_gcs_copy_delete.py | 2 +-
.../system/google/cloud/gcs/example_gcs_sensor.py | 2 +-
.../google/cloud/gcs/example_gcs_to_bigquery.py | 2 +-
.../cloud/gcs/example_gcs_to_bigquery_async.py | 2 +-
.../system/google/cloud/gcs/example_gcs_to_gcs.py | 2 +-
.../google/cloud/gcs/example_gcs_to_gdrive.py | 2 +-
.../system/google/cloud/gcs/example_gcs_to_sftp.py | 2 +-
.../google/cloud/gcs/example_gcs_to_sheets.py | 2 +-
.../google/cloud/gcs/example_gcs_transform.py | 2 +-
.../cloud/gcs/example_gcs_transform_timespan.py | 2 +-
.../cloud/gcs/example_gcs_upload_download.py | 2 +-
.../google/cloud/gcs/example_gdrive_to_gcs.py | 2 +-
.../system/google/cloud/gcs/example_http_to_gcs.py | 2 +-
.../google/cloud/gcs/example_mssql_to_gcs.py | 2 +-
.../google/cloud/gcs/example_mysql_to_gcs.py | 2 +-
.../google/cloud/gcs/example_oracle_to_gcs.py | 2 +-
.../google/cloud/gcs/example_presto_to_gcs.py | 2 +-
.../system/google/cloud/gcs/example_s3_to_gcs.py | 2 +-
.../google/cloud/gcs/example_salesforce_to_gcs.py | 2 +-
.../system/google/cloud/gcs/example_sftp_to_gcs.py | 2 +-
.../system/google/cloud/gcs/example_sheets.py | 2 +-
.../google/cloud/gcs/example_sheets_to_gcs.py | 2 +-
.../google/cloud/gcs/example_trino_to_gcs.py | 2 +-
.../gen_ai/example_gen_ai_gemini_batch_api.py | 2 +-
.../gen_ai/example_gen_ai_generative_model.py | 2 +-
.../example_gen_ai_generative_model_tuning.py | 2 +-
.../kubernetes_engine/example_kubernetes_engine.py | 2 +-
.../example_kubernetes_engine_async.py | 2 +-
.../example_kubernetes_engine_job.py | 2 +-
.../example_kubernetes_engine_kueue.py | 2 +-
.../example_kubernetes_engine_ray.py | 2 +-
.../example_kubernetes_engine_resource.py | 2 +-
.../system/google/cloud/looker/example_looker.py | 2 +-
.../managed_kafka/example_managed_kafka_cluster.py | 2 +-
.../example_managed_kafka_consumer_group.py | 2 +-
.../managed_kafka/example_managed_kafka_topic.py | 2 +-
.../google/cloud/ml_engine/example_mlengine.py | 2 +-
.../natural_language/example_natural_language.py | 2 +-
.../system/google/cloud/pubsub/example_pubsub.py | 2 +-
.../cloud/pubsub/example_pubsub_deferrable.py | 2 +-
.../system/google/cloud/ray/example_ray_job.py | 2 +-
.../system/google/cloud/spanner/example_spanner.py | 2 +-
.../cloud/speech_to_text/example_speech_to_text.py | 2 +-
.../cloud/sql_to_sheets/example_sql_to_sheets.py | 2 +-
.../cloud/stackdriver/example_stackdriver.py | 2 +-
.../example_cloud_storage_transfer_service_aws.py | 2 +-
.../example_cloud_storage_transfer_service_gcp.py | 2 +-
...le_cloud_storage_transfer_service_gcs_to_gcs.py | 2 +-
.../system/google/cloud/tasks/example_queue.py | 2 +-
.../system/google/cloud/tasks/example_tasks.py | 2 +-
.../cloud/text_to_speech/example_text_to_speech.py | 2 +-
.../cloud/transfers/example_facebook_ads_to_gcs.py | 2 +-
.../google/cloud/transfers/example_gcs_to_sftp.py | 2 +-
.../cloud/transfers/example_gdrive_to_local.py | 2 +-
.../cloud/transfers/example_postgres_to_gcs.py | 2 +-
.../google/cloud/translate/example_translate.py | 2 +-
.../cloud/translate/example_translate_dataset.py | 2 +-
.../cloud/translate/example_translate_document.py | 2 +-
.../cloud/translate/example_translate_glossary.py | 2 +-
.../cloud/translate/example_translate_model.py | 2 +-
.../cloud/translate/example_translate_text.py | 2 +-
.../translate_speech/example_translate_speech.py | 2 +-
...ample_vertex_ai_auto_ml_forecasting_training.py | 2 +-
...ple_vertex_ai_auto_ml_image_object_detection.py | 2 +-
.../example_vertex_ai_auto_ml_list_training.py | 2 +-
.../example_vertex_ai_auto_ml_tabular_training.py | 2 +-
.../example_vertex_ai_batch_prediction_job.py | 2 +-
.../example_vertex_ai_custom_container.py | 2 +-
.../vertex_ai/example_vertex_ai_custom_job.py | 2 +-
.../example_vertex_ai_custom_job_python_package.py | 2 +-
.../cloud/vertex_ai/example_vertex_ai_dataset.py | 2 +-
.../cloud/vertex_ai/example_vertex_ai_endpoint.py | 2 +-
.../example_vertex_ai_experiment_service.py | 2 +-
.../vertex_ai/example_vertex_ai_feature_store.py | 2 +-
.../example_vertex_ai_hyperparameter_tuning_job.py | 2 +-
.../example_vertex_ai_list_custom_jobs.py | 2 +-
.../vertex_ai/example_vertex_ai_model_service.py | 2 +-
.../vertex_ai/example_vertex_ai_pipeline_job.py | 2 +-
.../cloud/vertex_ai/example_vertex_ai_ray.py | 2 +-
.../example_video_intelligence.py | 2 +-
.../cloud/vision/example_vision_annotate_image.py | 2 +-
.../cloud/vision/example_vision_autogenerated.py | 2 +-
.../google/cloud/vision/example_vision_explicit.py | 2 +-
.../google/cloud/workflows/example_workflows.py | 2 +-
.../example_event_schedule_pubsub.py | 2 +-
.../tests/system/google/leveldb/example_leveldb.py | 2 +-
.../marketing_platform/example_analytics_admin.py | 2 +-
.../marketing_platform/example_bid_manager.py | 2 +-
.../marketing_platform/example_campaign_manager.py | 2 +-
.../marketing_platform/example_display_video.py | 2 +-
.../marketing_platform/example_search_ads.py | 2 +-
.../system/google/suite/example_local_to_drive.py | 2 +-
providers/http/tests/system/http/example_http.py | 2 +-
.../tests/system/influxdb/example_influxdb.py | 2 +-
.../system/influxdb/example_influxdb_query.py | 2 +-
.../jdbc/tests/system/jdbc/example_jdbc_queries.py | 2 +-
.../system/jenkins/example_jenkins_job_trigger.py | 2 +-
.../microsoft/azure/example_adf_run_pipeline.py | 2 +-
.../system/microsoft/azure/example_adls_create.py | 2 +-
.../system/microsoft/azure/example_adls_delete.py | 2 +-
.../system/microsoft/azure/example_adls_list.py | 2 +-
.../azure/example_azure_batch_operator.py | 2 +-
.../azure/example_azure_container_instances.py | 2 +-
.../microsoft/azure/example_azure_cosmosdb.py | 2 +-
.../microsoft/azure/example_azure_service_bus.py | 2 +-
.../microsoft/azure/example_azure_synapse.py | 2 +-
.../microsoft/azure/example_event_schedule_asb.py | 2 +-
.../system/microsoft/azure/example_fileshare.py | 2 +-
.../microsoft/azure/example_local_to_adls.py | 2 +-
.../microsoft/azure/example_local_to_wasb.py | 2 +-
.../system/microsoft/azure/example_msfabric.py | 2 +-
.../system/microsoft/azure/example_msgraph.py | 2 +-
.../system/microsoft/azure/example_powerbi.py | 2 +-
.../azure/example_powerbi_dataset_list.py | 2 +-
.../azure/example_powerbi_dataset_refresh.py | 2 +-
.../azure/example_powerbi_workspace_list.py | 2 +-
.../system/microsoft/azure/example_s3_to_wasb.py | 2 +-
.../system/microsoft/azure/example_sftp_to_wasb.py | 2 +-
.../azure/example_synapse_run_pipeline.py | 2 +-
.../system/microsoft/azure/example_wasb_sensors.py | 2 +-
.../tests/system/microsoft/mssql/example_mssql.py | 2 +-
.../tests/system/microsoft/winrm/example_winrm.py | 2 +-
.../mysql/tests/system/mysql/example_mysql.py | 2 +-
.../neo4j/tests/system/neo4j/example_neo4j.py | 2 +-
.../tests/system/neo4j/example_neo4j_query.py | 2 +-
.../tests/system/neo4j/example_neo4j_sensor.py | 2 +-
.../openai/tests/system/openai/example_openai.py | 2 +-
.../openai/example_trigger_batch_operator.py | 2 +-
providers/openlineage/docs/changelog.rst | 9 +
.../example_openlineage_base_complex_dag.py | 2 +-
.../example_openlineage_base_simple_dag.py | 2 +-
.../example_openlineage_defer_simple_dag.py | 2 +-
.../example_openlineage_docs_file_dag.py | 2 +-
.../example_openlineage_mapped_simple_dag.py | 2 +-
...ample_openlineage_schedule_asset_or_time_dag.py | 2 +-
.../example_openlineage_schedule_cron_dag.py | 2 +-
...openlineage_schedule_list_complex_assets_dag.py | 2 +-
...penlineage_schedule_list_multiple_assets_dag.py | 2 +-
...e_openlineage_schedule_list_single_asset_dag.py | 2 +-
...ple_openlineage_schedule_multiple_assets_dag.py | 2 +-
...xample_openlineage_schedule_single_asset_dag.py | 2 +-
.../example_openlineage_schedule_timetable_dag.py | 2 +-
.../example_openlineage_setup_teardown_dag.py | 2 +-
.../example_openlineage_short_circuit_dag.py | 2 +-
.../example_openlineage_task_groups_dag.py | 2 +-
.../example_openlineage_taskflow_simple_dag.py | 2 +-
.../openlineage/example_openlineage_trigger_dag.py | 2 +-
.../example_openlineage_trigger_dag_deferrable.py | 2 +-
.../example_openlineage_versioned_dag.py | 2 +-
.../providers/opensearch/log/os_task_handler.py | 5 +-
.../tests/system/opensearch/example_opensearch.py | 2 +-
.../system/opsgenie/example_opsgenie_alert.py | 2 +-
.../system/opsgenie/example_opsgenie_notifier.py | 2 +-
.../oracle/tests/system/oracle/example_oracle.py | 2 +-
.../tests/system/papermill/example_papermill.py | 2 +-
.../papermill/example_papermill_remote_verify.py | 2 +-
.../system/papermill/example_papermill_verify.py | 2 +-
.../tests/system/pgvector/example_pgvector.py | 2 +-
.../system/pgvector/example_pgvector_openai.py | 2 +-
.../system/pinecone/example_create_pod_index.py | 2 +-
.../pinecone/example_create_serverless_index.py | 2 +-
.../tests/system/pinecone/example_dag_pinecone.py | 2 +-
.../system/pinecone/example_pinecone_cohere.py | 2 +-
.../system/pinecone/example_pinecone_openai.py | 2 +-
.../tests/system/postgres/example_postgres.py | 2 +-
.../tests/system/presto/example_gcs_to_presto.py | 2 +-
.../presto/tests/system/presto/example_presto.py | 2 +-
.../tests/system/qdrant/example_dag_qdrant.py | 2 +-
.../redis/example_dag_message_queue_trigger.py | 2 +-
.../tests/system/redis/example_redis_publish.py | 2 +-
.../tests/system/salesforce/example_bulk.py | 2 +-
.../salesforce/example_salesforce_apex_rest.py | 2 +-
.../tests/system/samba/example_gcs_to_samba.py | 2 +-
.../sftp/tests/system/sftp/example_sftp_sensor.py | 2 +-
.../system/singularity/example_singularity.py | 2 +-
.../slack/tests/system/slack/example_slack.py | 2 +-
.../tests/system/slack/example_slack_webhook.py | 2 +-
.../tests/system/slack/example_sql_to_slack.py | 2 +-
.../system/slack/example_sql_to_slack_webhook.py | 2 +-
.../snowflake/example_copy_into_snowflake.py | 2 +-
.../tests/system/snowflake/example_snowflake.py | 2 +-
.../system/snowflake/example_snowpark_decorator.py | 2 +-
.../system/snowflake/example_snowpark_operator.py | 2 +-
.../sqlite/tests/system/sqlite/example_sqlite.py | 2 +-
.../tests/system/tableau/example_tableau.py | 2 +-
.../tests/system/telegram/example_telegram.py | 2 +-
.../example_azure_blob_to_teradata_transfer.py | 2 +-
.../teradata/tests/system/teradata/example_bteq.py | 2 +-
.../tests/system/teradata/example_remote_bteq.py | 2 +-
.../tests/system/teradata/example_remote_tpt.py | 2 +-
.../teradata/example_s3_to_teradata_transfer.py | 2 +-
.../tests/system/teradata/example_ssl_teradata.py | 2 +-
.../tests/system/teradata/example_teradata.py | 2 +-
.../system/teradata/example_teradata_call_sp.py | 2 +-
.../teradata/example_teradata_compute_cluster.py | 2 +-
.../example_teradata_to_teradata_transfer.py | 2 +-
.../teradata/tests/system/teradata/example_tpt.py | 2 +-
.../tests/system/trino/example_gcs_to_trino.py | 2 +-
.../trino/tests/system/trino/example_trino.py | 2 +-
providers/vespa/README.rst | 2 +-
providers/vespa/docs/commits.rst | 1 +
.../system/weaviate/example_weaviate_cohere.py | 2 +-
.../example_weaviate_dynamic_mapping_dag.py | 2 +-
.../system/weaviate/example_weaviate_openai.py | 2 +-
.../system/weaviate/example_weaviate_operator.py | 2 +-
.../system/weaviate/example_weaviate_using_hook.py | 2 +-
.../weaviate/example_weaviate_vectorizer_dag.py | 2 +-
.../example_weaviate_without_vectorizer_dag.py | 2 +-
.../tests/system/yandex/example_yandexcloud.py | 2 +-
.../system/yandex/example_yandexcloud_dataproc.py | 2 +-
.../example_yandexcloud_dataproc_lightweight.py | 2 +-
.../tests/system/yandex/example_yandexcloud_yq.py | 2 +-
providers/ydb/tests/system/ydb/example_ydb.py | 2 +-
.../system/zendesk/example_zendesk_custom_get.py | 2 +-
registry/pnpm-lock.yaml | 11 +-
registry/pnpm-workspace.yaml | 3 +
.../ci/prek/check_airflowctl_command_coverage.py | 34 +-
scripts/ci/prek/check_airflowctl_help_texts.py | 87 +++
scripts/ci/prek/common_prek_utils.py | 61 +-
scripts/ci/prek/upgrade_important_versions.py | 10 +-
scripts/tests/ci/prek/test_common_prek_utils.py | 14 +
task-sdk/src/airflow/sdk/bases/decorator.py | 8 +
task-sdk/tests/task_sdk/bases/test_decorator.py | 33 +
562 files changed, 5834 insertions(+), 2194 deletions(-)
create mode 100644 airflow-ctl/src/airflowctl/ctl/help_texts.yaml
create mode 100644 chart/newsfragments/64746.significant.rst
create mode 100644 chart/newsfragments/64976.significant.rst
create mode 100644 chart/newsfragments/64980.significant.rst
create mode 100644 chart/newsfragments/64982.significant.rst
create mode 100644 chart/newsfragments/65027.significant.rst
create mode 100644 chart/newsfragments/65030.significant.rst
create mode 100644 chart/newsfragments/65033.significant.rst
create mode 100644 chart/newsfragments/65056.significant.rst
create mode 100644 chart/newsfragments/65059.significant.rst
create mode 100644
dev/breeze/doc/images/output_release-management_generate-issue-content-airflow-ctl.svg
create mode 100644
dev/breeze/doc/images/output_release-management_generate-issue-content-airflow-ctl.txt
copy providers/{fab/src/airflow/providers/fab/www/airflow_flask_app.py =>
common/ai/tests/unit/common/ai/plugins/test_hitl_review_compat.py} (54%)
create mode 100755 scripts/ci/prek/check_airflowctl_help_texts.py
