#Apache airflow documentation code#

Defaults to true to preserve prior functionality, but should be set to false for new instances. Query result will be converted to the format specified by a Record Writer.

A dedicated index is recommended, for example: nifi.

Example schemas/mappings for data sources (Elasticsearch mapping, Solr schema, JSON schema). The allowed ciphers, might be ‘fast’, ‘normal’ or list ciphers separated with ‘:’.Ĭommand to use for PgBouncer (templated).Nifi tasks time example.

The name of the file to load user names and passwords from Specify scheduling constraints for PgBouncer pods.Īnnotations to add to the PgBouncer deployment Otherwise, remote access will be blocked for this user

#Apache airflow documentation code#

To avoid images with user code for running and waiting for DB migrations set this to true.Īssign a password to the ‘postgres’ admin user. If _container_tag is set, k8s executor will use config value instead. If _container_repository is set, k8s executor will use config value instead. The PgBouncer exporter image pull policy.Īirflow-pgbouncer-exporter-2023.02.21-0.14.0 The time (in seconds) to wait for the DB migrations to complete. workers.resources), so you normally won’t need to override this directly. The default (see files/pod-template-file.kubernetes-helm-yaml) already takes into account normal workers configuration parameters (e.g. The contents of pod_template_file.yaml used for KubernetesExecutor workers (templated). If true, it creates ClusterRole/ ClusterRolebinding (with access to entire cluster) Whether Airflow can launch workers and/or pods in multiple namespaces. Subpath within the PVC where dags are located.Ĭonnection : host : '.' pass : '.' port : '.' scheme : https user : '.'Ī secret containing the connection string.ĮnableBuiltInSecretEnvVars.AIRFLOW_CONN_AIRFLOW_DBĮnable AIRFLOW_CONN_AIRFLOW_DB variable to be read from the Metadata SecretĮnableBuiltInSecretEnvVars.AIRFLOW_CELERY_BROKER_URLĮnable AIRFLOW_CELERY_BROKER_URL variable to be read from the Celery Broker URL SecretĮnableBuiltInSecretEnvVars.AIRFLOW_CELERY_CELERY_RESULT_BACKENDĮnable AIRFLOW_CELERY_CELERY_RESULT_BACKEND variable to be read from the Celery Result Backend Secret - Airflow 1.10.* variantĮnableBuiltInSecretEnvVars.AIRFLOW_CELERY_RESULT_BACKENDĮnable AIRFLOW_CELERY_RESULT_BACKEND variable to be read from the Celery Result Backend SecretĮnableBuiltInSecretEnvVars.AIRFLOW_CORE_FERNET_KEYĮnable AIRFLOW_CORE_FERNET_KEY variable to be read from the Fernet key SecretĮnableBuiltInSecretEnvVars.AIRFLOW_CORE_SQL_ALCHEMY_CONNĮnable AIRFLOW_CORE_SQL_ALCHEMY_CONN variable to be read from the Metadata SecretĮnableBuiltInSecretEnvVars.AIRFLOW_DATABASE_SQL_ALCHEMY_CONNĮnable AIRFLOW_DATABASE_SQL_ALCHEMY_CONN variable to be read from the Metadata SecretĮnableBuiltInSecretEnvVars.AIRFLOW_ELASTICSEARCH_ELASTICSEARCH_HOSTĮnable AIRFLOW_ELASTICSEARCH_ELASTICSEARCH_HOST variable to be read from the Elasticsearch Host Secret - Airflow <1.10.4 variantĮnableBuiltInSecretEnvVars.AIRFLOW_ELASTICSEARCH_HOSTĮnable AIRFLOW_ELASTICSEARCH_HOST variable to be read from the Elasticsearch Host SecretĮnableBuiltInSecretEnvVars.AIRFLOW_WEBSERVER_SECRET_KEYĮnable AIRFLOW_WEBSERVER_SECRET_KEY variable to be read from the Webserver Secret Key SecretĮnvironment variables for all Airflow containers.ĮxtraEnvFrom : |- secretRef: name: '-airflow-variables'Įnable persistent volume for storing logs. If using a custom StorageClass, pass name here. Low values cause more traffic to the remote git repository.Įnable persistent volume for storing dags. High values are more likely to cause DAGs to become out of sync between different components. Interval between git sync attempts in seconds. Git sync container run as user parameter. Subpath within the repo where dags are located. Name of a Secret containing the repo sshKeySecret. Securit圜ontext : runAsGroup : 0 runAsUser : 50000 You can bake a webserver_config.py in to your image instead or specify a configmap containing the webserver_config.py. This string (can be templated) will be mounted into the Airflow webserver as a custom webserver_config.py. The Fernet key used to encrypt passwords (can only be set during install, not upgrade). Overrides tag.ĭefault airflow repository. Settings to go into the mounted airflow.cfgĭefault airflow digest to deploy. Airflow_local_settings file as a string (can be templated).Īirflow version (Used to make some decisions based on Airflow Version being deployed).