Airflow
Running Airflow on GKE
→ 日本語版を読むRequirements
- Run Airflow on GKE and access the Airflow UI from an external network.
- Encrypt communication with HTTPS.
Architecture
- Use External HTTP(S) Load Balancing. This handles HTTPS termination.
- From a GKE perspective, this means using Ingress and Service (NodePort).
Another option considered was using External TCP/UDP Network Load Balancing (by specifying LoadBalancer for a K8s Service), but this was rejected because it cannot handle HTTPS termination.
References
Freely Control Traffic Coming into GKE | 10th Google Cloud INSIDE Games & Apps Online from Google Cloud Platform - Japan