mirror of
https://github.com/apache/airflow.git
synced 2026-11-04 07:12:48 +00:00
* [main] CI: Upgrade important CI environment * Ignore pydantic-ai's generic OpenAI-compatible provider in vendor drift checks pydantic-ai-slim 2.63.0 adds a provider for any OpenAI-compatible endpoint. It needs a service name at construction and infer_model has no prefix for it, so a common.ai connection can never reach it and it is not a vendor the services page should list. Generated-by: Claude Opus 5 --------- Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
Helm Chart for Apache Airflow
Apache Airflow is a platform to programmatically author, schedule and monitor workflows.
Introduction
This chart will bootstrap an Airflow deployment on a Kubernetes cluster using the Helm package manager.
Requirements
- Kubernetes 1.31+ cluster
- Helm 3.0+
- PV provisioner support in the underlying infrastructure (optionally)
Features
- Supported executors (all Airflow versions):
LocalExecutor,CeleryExecutor,KubernetesExecutor - Supported multiple Executors
- Supported AWS executors with AWS provider version
8.21.0+:airflow.providers.amazon.aws.executors.batch.AwsBatchExecutorairflow.providers.amazon.aws.executors.ecs.AwsEcsExecutor
- Supported Edge executor with edge3 provider version
1.0.0+:airflow.providers.edge3.executors.EdgeExecutor
- Supported Airflow version:
3.1+ - Supported database backend:
PostgreSQL,MySQL - Autoscaling for
CeleryExecutorprovided by KEDA PostgreSQLandPgBouncerwith a battle-tested configuration- Security enhancements:
- Container-specific Service Account Token Volume configuration implementing Principle of Least Privilege
- Only scheduler containers receive API access; init and sidecar containers operate without tokens
- Defense-in-depth security with both ServiceAccount and Pod-level controls
- Compatibility with security policies like Kyverno and compliance frameworks
- Monitoring:
- StatsD/Prometheus metrics for Airflow
- Prometheus metrics for PgBouncer
- Flower
- Automatic database migration after a new deployment
- Administrator account creation during deployment
- Kerberos secure configuration
- One-command deployment for any type of executor. You don't need to provide other services e.g. Redis/Database to test the Airflow.
Documentation
Full documentation for Helm Chart (latest stable release) lives on the website.
Note: If you're looking for documentation for main branch (latest development branch): you can find it on s.apache.org/airflow-docs/. Source code for documentation is in
chart/docs
Contributing
Want to help build Apache Airflow? Check out our contributing documentation.