Use Persistent Volume Claims (PVCs) if you are running Airflow on Kubernetes and need to keep images locally accessible to multiple tasks. Best Practices for Image Workflows Use Retries for Network Flakiness
Use the SFTPHook for secure file transfers from legacy servers. Implementing a Web Image Download airflow image download
Always log the source URL and the destination path. If an Airflow image download fails, your logs should tell you if it was a 404 (missing file), a 403 (permissions issue), or a 500 (server error). Use Persistent Volume Claims (PVCs) if you are