亚马逊MWAA本地跑步者：在docker-compose-local.yml中添加气流变量和连接的位置

Question

我正在使用Amazon MWAA本地跑步库来开发和测试我在本地的DAG，然后再向Main/Dev分支提交PR。 我已经从在这里 启动容器后，我想立即导出气流变量和气流连接： ./ mwaa-local-env start 气流变量：key = depoly_environment and value = qa 气流连接：conn id = slack_conn; conn type = http; passwass = *****

像这样的东西

我只能更改 docker/docker-compose-local.yml 以在文件中包括气流变量。

version: '3.7'
services:
    postgres:
        image: postgres:10-alpine
        environment:
            - POSTGRES_USER=airflow
            - POSTGRES_PASSWORD=airflow
            - POSTGRES_DB=airflow
        logging:
            options:
                max-size: 10m
                max-file: "3"
        volumes:
            - "${PWD}/db-data:/var/lib/postgresql/data"

    local-runner:
        image: amazon/mwaa-local:2.0.2
        restart: always
        depends_on:
            - postgres
        environment:
            - LOAD_EX=n
            - EXECUTOR=Local
            - AIRFLOW__CORE__SQL_ALCHEMY_CONN=postgresql+psycopg2://airflow:airflow@postgres:5432/airflow
            - AIRFLOW_VAR_DEPLOY_ENVIRONMENT=qa
        logging:
            options:
                max-size: 10m
                max-file: "3"
        volumes:
            - ${PWD}/dags:/usr/local/airflow/dags
            - ${PWD}/plugins:/usr/local/airflow/plugins
            - $HOME/.aws/credentials:/usr/local/airflow/.aws/credentials:ro
        ports:
            - "8080:8080"
        command: local-runner
        healthcheck:
            test: ["CMD-SHELL", "[ -f /usr/local/airflow/airflow-webserver.pid ]"]
            interval: 30s
            timeout: 30s
            retries: 3

我以为 airflow_var_deploy_environment = qa 可以完成工作。但是，这就是我启动气流环境后得到的。

为了添加气流连接，我无法弄清楚如何在 docker-compose-local.yml 中导出该

连接赞赏！

Answer 1

连接信息可以在环境变量中存储为JSON字符串。并非所有键都需要。仅提供Slack提供商模块所需的内容。

export AIRFLOW_CONN_SLACK_CONN='{
    "conn_type": "my-conn-type",
    "login": "my-login",
    "password": "my-password",
    "host": "my-host",
    "port": 1234,
    "schema": "my-schema",
    "extra": {
        "param1": "val1",
        "param2": "val2"
    }
}'

您还可以在环境变量中以URI格式存储连接信息。

export AIRFLOW_CONN_SLACK_CONN='my-conn-type://login:password@host:port/schema?param1=val1¶m2=val2'

环境变量名称必须在 airflow_conn _ 之前前缀。

参考：