mirror of
https://github.com/apache/airflow.git
synced 2026-11-04 07:12:48 +00:00
Upgrade the Airflow version to 3.4.0 and Task SDK version to 1.4.0 (#69085)
This commit is contained in:
1 parent
e1c6feb72c
commit
5aa3ff7d17
18 files changed
+31
-31
No files matched your search
@@ -31,12 +31,12 @@ Every time a new version of Airflow is released, the images are prepared in the
|
||||
[apache/airflow DockerHub](https://hub.docker.com/r/apache/airflow)
|
||||
for all the supported Python versions.
|
||||
|
||||
You can find the following images there (Assuming Airflow version `3.3.0`):
|
||||
You can find the following images there (Assuming Airflow version `3.4.0`):
|
||||
|
||||
* `apache/airflow:latest` - the latest released Airflow image with default Python version (3.12 currently)
|
||||
* `apache/airflow:latest-pythonX.Y` - the latest released Airflow image with specific Python version
|
||||
* `apache/airflow:3.3.0` - the versioned Airflow image with default Python version (3.12 currently)
|
||||
* `apache/airflow:3.3.0-pythonX.Y` - the versioned Airflow image with specific Python version
|
||||
* `apache/airflow:3.4.0` - the versioned Airflow image with default Python version (3.12 currently)
|
||||
* `apache/airflow:3.4.0-pythonX.Y` - the versioned Airflow image with specific Python version
|
||||
|
||||
Those are "reference" regular images. They contain the most common set of extras, dependencies and providers that are
|
||||
often used by the users and they are good to "try-things-out" when you want to just take Airflow for a spin,
|
||||
@@ -47,8 +47,8 @@ via [Building the image](https://airflow.apache.org/docs/docker-stack/build.html
|
||||
|
||||
* `apache/airflow:slim-latest` - the latest released Airflow image with default Python version (3.12 currently)
|
||||
* `apache/airflow:slim-latest-pythonX.Y` - the latest released Airflow image with specific Python version
|
||||
* `apache/airflow:slim-3.3.0` - the versioned Airflow image with default Python version (3.12 currently)
|
||||
* `apache/airflow:slim-3.3.0-pythonX.Y` - the versioned Airflow image with specific Python version
|
||||
* `apache/airflow:slim-3.4.0` - the versioned Airflow image with default Python version (3.12 currently)
|
||||
* `apache/airflow:slim-3.4.0-pythonX.Y` - the versioned Airflow image with specific Python version
|
||||
|
||||
The Apache Airflow image provided as convenience package is optimized for size, and
|
||||
it provides just a bare minimal set of the extras and dependencies installed and in most cases
|
||||
|
||||
@@ -17,7 +17,7 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
ENV AIRFLOW__CORE__LOAD_EXAMPLES=True
|
||||
ENV AIRFLOW__DATABASE__SQL_ALCHEMY_CONN=my_conn_string
|
||||
# [END Dockerfile]
|
||||
@@ -17,7 +17,7 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
USER root
|
||||
RUN apt-get update \
|
||||
&& apt-get install -y --no-install-recommends \
|
||||
|
||||
@@ -17,7 +17,7 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
USER root
|
||||
RUN apt-get update \
|
||||
&& apt-get install -y --no-install-recommends \
|
||||
|
||||
@@ -17,7 +17,7 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
USER root
|
||||
RUN apt-get update \
|
||||
&& apt-get install -y --no-install-recommends \
|
||||
|
||||
+1
-1
@@ -17,6 +17,6 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
RUN pip install --no-cache-dir "apache-airflow==${AIRFLOW_VERSION}" lxml --constraint "${HOME}/constraints.txt"
|
||||
# [END Dockerfile]
|
||||
@@ -17,7 +17,7 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
|
||||
# The `uv` tools is Rust packaging tool that is much faster than `pip` and other installers
|
||||
# Support for uv as installation tool is experimental
|
||||
|
||||
@@ -17,6 +17,6 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
RUN pip install --no-cache-dir "apache-airflow==${AIRFLOW_VERSION}" lxml
|
||||
# [END Dockerfile]
|
||||
@@ -17,7 +17,7 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
COPY requirements.txt /
|
||||
RUN pip install --no-cache-dir "apache-airflow==${AIRFLOW_VERSION}" -r /requirements.txt
|
||||
# [END Dockerfile]
|
||||
@@ -17,6 +17,6 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
RUN pip install "apache-airflow==${AIRFLOW_VERSION}" --no-cache-dir apache-airflow-providers-docker==2.5.1
|
||||
# [END Dockerfile]
|
||||
@@ -17,7 +17,7 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
|
||||
COPY --chown=airflow:root test_dag.py /opt/airflow/dags
|
||||
|
||||
|
||||
@@ -17,7 +17,7 @@
|
||||
|
||||
# This is an example Dockerfile. It is not intended for PRODUCTION use
|
||||
# [START Dockerfile]
|
||||
FROM apache/airflow:3.3.0
|
||||
FROM apache/airflow:3.4.0
|
||||
RUN umask 0002; \
|
||||
mkdir -p ~/writeable-directory
|
||||
# [END Dockerfile]
|
||||
@@ -132,7 +132,7 @@ if you specify extra arguments. For example:
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
docker run -it apache/airflow:3.3.0-python3.10 bash -c "ls -la"
|
||||
docker run -it apache/airflow:3.4.0-python3.10 bash -c "ls -la"
|
||||
total 16
|
||||
drwxr-xr-x 4 airflow root 4096 Jun 5 18:12 .
|
||||
drwxr-xr-x 1 root root 4096 Jun 5 18:12 ..
|
||||
@@ -144,7 +144,7 @@ you pass extra parameters. For example:
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
> docker run -it apache/airflow:3.3.0-python3.10 python -c "print('test')"
|
||||
> docker run -it apache/airflow:3.4.0-python3.10 python -c "print('test')"
|
||||
test
|
||||
|
||||
If first argument equals to ``airflow`` - the rest of the arguments is treated as an Airflow command
|
||||
@@ -152,13 +152,13 @@ to execute. Example:
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
docker run -it apache/airflow:3.3.0-python3.10 airflow webserver
|
||||
docker run -it apache/airflow:3.4.0-python3.10 airflow webserver
|
||||
|
||||
If there are any other arguments - they are simply passed to the "airflow" command
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
> docker run -it apache/airflow:3.3.0-python3.10 help
|
||||
> docker run -it apache/airflow:3.4.0-python3.10 help
|
||||
usage: airflow [-h] GROUP_OR_COMMAND ...
|
||||
|
||||
Positional Arguments:
|
||||
@@ -366,7 +366,7 @@ database and creating an ``admin/admin`` Admin user with the following command:
|
||||
--env "_AIRFLOW_DB_MIGRATE=true" \
|
||||
--env "_AIRFLOW_WWW_USER_CREATE=true" \
|
||||
--env "_AIRFLOW_WWW_USER_PASSWORD=admin" \
|
||||
apache/airflow:3.3.0-python3.10 webserver
|
||||
apache/airflow:3.4.0-python3.10 webserver
|
||||
|
||||
|
||||
.. code-block:: bash
|
||||
@@ -375,7 +375,7 @@ database and creating an ``admin/admin`` Admin user with the following command:
|
||||
--env "_AIRFLOW_DB_MIGRATE=true" \
|
||||
--env "_AIRFLOW_WWW_USER_CREATE=true" \
|
||||
--env "_AIRFLOW_WWW_USER_PASSWORD_CMD=echo admin" \
|
||||
apache/airflow:3.3.0-python3.10 webserver
|
||||
apache/airflow:3.4.0-python3.10 webserver
|
||||
|
||||
The commands above perform initialization of the SQLite database, create admin user with admin password
|
||||
and Admin role. They also forward local port ``8080`` to the webserver port and finally start the webserver.
|
||||
@@ -415,6 +415,6 @@ Example:
|
||||
--env "_AIRFLOW_DB_MIGRATE=true" \
|
||||
--env "_AIRFLOW_WWW_USER_CREATE=true" \
|
||||
--env "_AIRFLOW_WWW_USER_PASSWORD_CMD=echo admin" \
|
||||
apache/airflow:3.3.0-python3.10 webserver
|
||||
apache/airflow:3.4.0-python3.10 webserver
|
||||
|
||||
This method is only available starting from Docker image of Airflow 2.1.1 and above.
|
||||
Reference in new issue
Block a user