mirror of
https://github.com/apache/airflow.git
synced 2026-11-04 07:12:48 +00:00
github-actions[bot]andJarek Potiuk
cfbd70b66d
* [main] CI: Upgrade important CI environment * Ignore pydantic-ai's generic OpenAI-compatible provider in vendor drift checks pydantic-ai-slim 2.63.0 adds a provider for any OpenAI-compatible endpoint. It needs a service name at construction and infer_model has no prefix for it, so a common.ai connection can never reach it and it is not a vendor the services page should list. Generated-by: Claude Opus 5 --------- Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
140 lines
8.4 KiB
ReStructuredText
140 lines
8.4 KiB
ReStructuredText
|
|
.. Licensed to the Apache Software Foundation (ASF) under one
|
|
or more contributor license agreements. See the NOTICE file
|
|
distributed with this work for additional information
|
|
regarding copyright ownership. The ASF licenses this file
|
|
to you under the Apache License, Version 2.0 (the
|
|
"License"); you may not use this file except in compliance
|
|
with the License. You may obtain a copy of the License at
|
|
|
|
.. http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
.. Unless required by applicable law or agreed to in writing,
|
|
software distributed under the License is distributed on an
|
|
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
|
KIND, either express or implied. See the License for the
|
|
specific language governing permissions and limitations
|
|
under the License.
|
|
|
|
.. NOTE! THIS FILE IS AUTOMATICALLY GENERATED AND WILL BE OVERWRITTEN!
|
|
|
|
.. IF YOU WANT TO MODIFY TEMPLATE FOR THIS FILE, YOU SHOULD MODIFY THE TEMPLATE
|
|
``PROVIDER_README_TEMPLATE.rst.jinja2`` IN the ``dev/breeze/src/airflow_breeze/templates`` DIRECTORY
|
|
|
|
Package ``apache-airflow-providers-amazon``
|
|
|
|
Release: ``9.39.0``
|
|
|
|
|
|
Amazon integration (including `Amazon Web Services (AWS) <https://aws.amazon.com/>`__).
|
|
|
|
|
|
Provider package
|
|
----------------
|
|
|
|
This is a provider package for ``amazon`` provider. All classes for this provider package
|
|
are in ``airflow.providers.amazon`` python package.
|
|
|
|
You can find package information and changelog for the provider
|
|
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.39.0/>`_.
|
|
|
|
Installation
|
|
------------
|
|
|
|
You can install this package on top of an existing Airflow installation (see ``Requirements`` below
|
|
for the minimum Airflow version supported) via
|
|
``pip install apache-airflow-providers-amazon``
|
|
|
|
The package supports the following python versions: 3.11,3.12,3.13,3.14
|
|
|
|
Requirements
|
|
------------
|
|
|
|
========================================== ======================================
|
|
PIP package Version required
|
|
========================================== ======================================
|
|
``apache-airflow`` ``>=2.11.0``
|
|
``apache-airflow-providers-common-compat`` ``>=1.23.0``
|
|
``apache-airflow-providers-common-sql`` ``>=1.32.0``
|
|
``apache-airflow-providers-http``
|
|
``boto3`` ``>=1.43.4``
|
|
``botocore`` ``>=1.43.4``
|
|
``inflection`` ``>=0.5.1``
|
|
``watchtower`` ``>=3.3.1,<4``
|
|
``jsonpath_ng`` ``>=1.5.3``
|
|
``redshift_connector`` ``>=2.1.3``
|
|
``redshift_connector`` ``>=2.1.13; python_version >= "3.14"``
|
|
``asgiref`` ``>=2.3.0; python_version < "3.14"``
|
|
``asgiref`` ``>=3.11.1; python_version >= "3.14"``
|
|
``PyAthena`` ``>=3.10.0``
|
|
``jmespath`` ``>=0.7.0``
|
|
``sagemaker-studio`` ``>=1.0.25,<1.1.0``
|
|
``marshmallow`` ``>=3``
|
|
========================================== ======================================
|
|
|
|
Optional cross provider package dependencies
|
|
--------------------------------------------
|
|
|
|
Those are dependencies that might be needed in order to use all the features of the package.
|
|
You need to install the specified providers in order to use them.
|
|
|
|
You can install such cross-provider dependencies when installing from PyPI. For example:
|
|
|
|
.. code-block:: bash
|
|
|
|
pip install apache-airflow-providers-amazon[apache.hive]
|
|
|
|
|
|
======================================================================================================================== ====================
|
|
Dependent package Extra
|
|
======================================================================================================================== ====================
|
|
`apache-airflow-providers-apache-hive <https://airflow.apache.org/docs/apache-airflow-providers-apache-hive>`_ ``apache.hive``
|
|
`apache-airflow-providers-cncf-kubernetes <https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes>`_ ``cncf.kubernetes``
|
|
`apache-airflow-providers-common-ai <https://airflow.apache.org/docs/apache-airflow-providers-common-ai>`_ ``common.ai``
|
|
`apache-airflow-providers-common-messaging <https://airflow.apache.org/docs/apache-airflow-providers-common-messaging>`_ ``common.messaging``
|
|
`apache-airflow-providers-duckdb <https://airflow.apache.org/docs/apache-airflow-providers-duckdb>`_ ``duckdb``
|
|
`apache-airflow-providers-exasol <https://airflow.apache.org/docs/apache-airflow-providers-exasol>`_ ``exasol``
|
|
`apache-airflow-providers-ftp <https://airflow.apache.org/docs/apache-airflow-providers-ftp>`_ ``ftp``
|
|
`apache-airflow-providers-google <https://airflow.apache.org/docs/apache-airflow-providers-google>`_ ``google``
|
|
`apache-airflow-providers-imap <https://airflow.apache.org/docs/apache-airflow-providers-imap>`_ ``imap``
|
|
`apache-airflow-providers-microsoft-azure <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure>`_ ``microsoft.azure``
|
|
`apache-airflow-providers-mongo <https://airflow.apache.org/docs/apache-airflow-providers-mongo>`_ ``mongo``
|
|
`apache-airflow-providers-openlineage <https://airflow.apache.org/docs/apache-airflow-providers-openlineage>`_ ``openlineage``
|
|
`apache-airflow-providers-salesforce <https://airflow.apache.org/docs/apache-airflow-providers-salesforce>`_ ``salesforce``
|
|
`apache-airflow-providers-ssh <https://airflow.apache.org/docs/apache-airflow-providers-ssh>`_ ``ssh``
|
|
======================================================================================================================== ====================
|
|
|
|
Optional dependencies
|
|
----------------------
|
|
|
|
==================== ======================================================================================================================================================================
|
|
Extra Dependencies
|
|
==================== ======================================================================================================================================================================
|
|
``aiobotocore`` ``aiobotocore>=3.0.0``
|
|
``cncf.kubernetes`` ``apache-airflow-providers-cncf-kubernetes>=7.2.0``
|
|
``s3fs`` ``s3fs>=2023.10.0``
|
|
``msk`` ``aws-msk-iam-sasl-signer-python>=1.0.1``
|
|
``python3-saml`` ``python3-saml>=1.16.0; python_version < '3.13'``, ``xmlsec>=1.3.14; python_version < '3.13'``, ``lxml>=6.0.0; python_version < '3.13'``
|
|
``apache.hive`` ``apache-airflow-providers-apache-hive``
|
|
``exasol`` ``apache-airflow-providers-exasol``
|
|
``fab`` ``apache-airflow-providers-fab>=2.2.0``
|
|
``ftp`` ``apache-airflow-providers-ftp``
|
|
``google`` ``apache-airflow-providers-google``
|
|
``imap`` ``apache-airflow-providers-imap``
|
|
``microsoft.azure`` ``apache-airflow-providers-microsoft-azure``
|
|
``mongo`` ``apache-airflow-providers-mongo``
|
|
``pandas`` ``pandas>=2.1.2; python_version <"3.13"``, ``pandas>=2.2.3; python_version >="3.13" and python_version <"3.14"``, ``pandas>=2.3.3; python_version >="3.14"``
|
|
``parquet`` ``pyarrow>=16.1.0; python_version < '3.13'``, ``pyarrow>=18.0.0; python_version >= '3.13' and python_version < '3.14'``, ``pyarrow>=22.0.0; python_version >= '3.14'``
|
|
``openlineage`` ``apache-airflow-providers-openlineage>=2.3.0``
|
|
``salesforce`` ``apache-airflow-providers-salesforce``
|
|
``ssh`` ``apache-airflow-providers-ssh``
|
|
``standard`` ``apache-airflow-providers-standard``
|
|
``common.ai`` ``apache-airflow-providers-common-ai>=0.11.0``
|
|
``common.messaging`` ``apache-airflow-providers-common-messaging>=2.0.0``
|
|
``duckdb`` ``apache-airflow-providers-duckdb>=0.1.0``
|
|
``sqlalchemy`` ``sqlalchemy>=1.4.54,!=2.1.0``
|
|
==================== ======================================================================================================================================================================
|
|
|
|
The changelog for the provider package can be found in the
|
|
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.39.0/changelog.html>`_.
|