Airflow run dag with config about kedro-airflow-k8s

[daBlesr]

Actually, after more investigation, I was able to do this by adding an entry params in the list on macro params specification.

[szczeles]

Take a look here: https://github.com/getindata/kedro-airflow-k8s/blob/0.8.0/kedro_airflow_k8s/config.py#L93 - this parameter allows you to specify list of airflow variables that are pushed as Kedro parameters

[daBlesr]

That works indeed for fixed variables in Airflow. In this case, I'd like to run a DAG with specific variables only for that single DAG run. That is a different thing and is not picked up.

[szczeles]

That's right, the config provided during "trigger dag" operation is not used. If you have free time, feel free to create a PR. I'd plug here: https://github.com/getindata/kedro-airflow-k8s/blob/0.8.0/kedro_airflow_k8s/airflow_dag_template.j2#L303 with:

• static list of possible configs provided in the config file
• for loop in the template, using dag_run.conf to get the values

It's not the best way, as the user can't explicitly override any parameter without the static list of possible lookups. Maybe during implementation you will find a better solution!