2.0.1 cannot write log to GCS bucket

[klinux]

I've configured airflow to use remote log on GCS bucket:

export AIRFLOW__LOGGING__REMOTE_LOGGING=True
export AIRFLOW__LOGGING__REMOTE_BASE_LOG_FOLDER=gs://airflow-????????/airflow/logs
export AIRFLOW__LOGGING__GOOGLE_KEY_PATH=/opt/airflow/gcs.json

But airflow do not log anything in the bucket, there no log to help me, can someone help me?

Pods are success created, and success runing dags. But no logs in the bucket.

Airflow: 2.0.1
Executor: KubernetesExecutor

[turbaszek]

Have you installed apache-airflow-google-provider?

[klinux]

Yes, was installed, but no success to save on GCS, it looks like airflow ignore AIRFLOW__LOGGING__REMOTE_LOGGING.

airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-automl<2.0.0,>=0.4.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.0.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-auth<2.0.0,>=1.0.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.26.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-bigquery-datatransfer<2.0.0,>=0.4.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.1.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-secret-manager<2.0.0,>=0.2.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.0.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-memcache>=0.2.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (0.3.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: PyOpenSSL in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (19.1.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: grpcio-gcp>=0.2.2 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (0.2.2)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-auth-httplib2>=0.0.1 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (0.0.4)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-storage<2.0.0,>=1.16 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.36.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-videointelligence<2.0.0,>=1.7.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.16.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-os-login<2.0.0,>=1.0.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.0.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-logging<2.0.0,>=1.14.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.15.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-dlp<2.0.0,>=0.11.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.0.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: apache-airflow>=2.0.0a0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (2.0.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: pandas-gbq in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (0.14.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-pubsub<2.0.0,>=1.0.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.7.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-bigtable<2.0.0,>=1.0.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.7.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-translate<2.0.0,>=1.5.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.7.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-container<2.0.0,>=0.1.1 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.0.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-ads<8.0.0,>=4.0.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (4.0.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-language<2.0.0,>=1.1.1 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.3.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-monitoring<2.0.0,>=0.34.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.1.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-dataproc<2.0.0,>=1.0.1 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.1.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-api-python-client<2.0.0,>=1.6.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.12.8)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-redis<2.0.0,>=0.3.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.0.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-tasks<2.0.0,>=1.2.1 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.5.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-vision<2.0.0,>=0.35.2 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.0.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-spanner<2.0.0,>=1.10.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.19.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-texttospeech<2.0.0,>=0.4.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.0.1)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-datacatalog<0.8,>=0.5.0 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (0.7.0)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-speech<2.0.0,>=0.36.3 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.3.2)
airflow-scheduler-85c7894dcc-wp9l7 airflow-scheduler Requirement already satisfied: google-cloud-kms<2.0.0,>=1.2.1 in /home/airflow/.local/lib/python3.6/site-packages (from apache-airflow-providers-google) (1.4.0)

[turbaszek]

Have you configured this?

airflow/airflow/config_templates/default_airflow.cfg

Lines 247 to 249 in 5539069

	# Users must supply an Airflow connection id that provides access to the storage
	# location.
	remote_log_conn_id =

I think if the logging does not work you should be able to see this in task logs (which afaik are stored also locally).

[klinux]

Yes, it is configured too:

export AIRFLOW__LOGGING__REMOTE_LOG_CONN_ID=google_cloud_default

[klinux]

I find out the problem, my json file was corrupted, sorry about this thread.