scheduler-log

[2023-05-11T19:05:01.895+0000] {executor_loader.py:114} INFO - Loaded executor: KubernetesExecutor
/home/airflow/.local/lib/python3.8/site-packages/airflow/kubernetes/kube_config.py:37 DeprecationWarning: The pod_template_file option in [kubernetes] has been moved to the pod_template_file option in [kubernetes_executor] - the old setting has been used, but please update your config.
/home/airflow/.local/lib/python3.8/site-packages/airflow/kubernetes/kube_config.py:39 DeprecationWarning: The delete_worker_pods option in [kubernetes] has been moved to the delete_worker_pods option in [kubernetes_executor] - the old setting has been used, but please update your config.
/home/airflow/.local/lib/python3.8/site-packages/airflow/kubernetes/kube_config.py:43 DeprecationWarning: The worker_pods_creation_batch_size option in [kubernetes] has been moved to the worker_pods_creation_batch_size option in [kubernetes_executor] - the old setting has been used, but please update your config.
/home/airflow/.local/lib/python3.8/site-packages/airflow/kubernetes/kube_config.py:47 DeprecationWarning: The worker_container_repository option in [kubernetes] has been moved to the worker_container_repository option in [kubernetes_executor] - the old setting has been used, but please update your config.
/home/airflow/.local/lib/python3.8/site-packages/airflow/kubernetes/kube_config.py:48 DeprecationWarning: The worker_container_tag option in [kubernetes] has been moved to the worker_container_tag option in [kubernetes_executor] - the old setting has been used, but please update your config.
/home/airflow/.local/lib/python3.8/site-packages/airflow/kubernetes/kube_config.py:58 DeprecationWarning: The namespace option in [kubernetes] has been moved to the namespace option in [kubernetes_executor] - the old setting has been used, but please update your config.
/home/airflow/.local/lib/python3.8/site-packages/airflow/kubernetes/kube_config.py:72 DeprecationWarning: The namespace option in [kubernetes] has been moved to the namespace option in [kubernetes_executor] - the old setting has been used, but please update your config.
[2023-05-11T19:05:02.019+0000] {scheduler_job_runner.py:823} INFO - Starting the scheduler
[2023-05-11T19:05:02.021+0000] {scheduler_job_runner.py:830} INFO - Processing each file at most -1 times
[2023-05-11T19:05:02.023+0000] {kubernetes_executor.py:604} INFO - Start Kubernetes executor
/home/airflow/.local/lib/python3.8/site-packages/airflow/kubernetes/kube_client.py:113 FutureWarning: The config section [kubernetes] has been renamed to [kubernetes_executor]. Please update your `conf.get*` call to use the new name
[2023-05-11T19:05:02.070+0000] {kubernetes_executor.py:155} INFO - Event: and now my watch begins starting at resource_version: 0
[2023-05-11T19:05:02.089+0000] {kubernetes_executor.py:553} INFO - Found 0 queued task instances
[2023-05-11T19:05:02.101+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 577
[2023-05-11T19:05:02.104+0000] {scheduler_job_runner.py:1576} INFO - Resetting orphaned tasks for active dag runs
[2023-05-11T19:05:02.116+0000] {settings.py:60} INFO - Configured default timezone Timezone('UTC')
/home/airflow/.local/lib/python3.8/site-packages/airflow/dag_processing/manager.py:439 DeprecationWarning: The deactivate_stale_dags_interval option in [scheduler] has been renamed to parsing_cleanup_interval - the old setting has been used, but please update your config.
/home/airflow/.local/lib/python3.8/site-packages/airflow/jobs/scheduler_job_runner.py:984 DeprecationWarning: The deactivate_stale_dags_interval option in [scheduler] has been renamed to parsing_cleanup_interval - the old setting has been used, but please update your config.
/home/airflow/.local/lib/python3.8/site-packages/airflow/dag_processing/processor.py:198 DeprecationWarning: This module is deprecated. Please use `airflow.providers.cncf.kubernetes.operators.pod` instead.
[2023-05-11T19:06:02.225+0000] {kubernetes_executor.py:553} INFO - Found 0 queued task instances
[2023-05-11T19:07:02.301+0000] {kubernetes_executor.py:553} INFO - Found 0 queued task instances
[2023-05-11T19:07:12.360+0000] {scheduler_job_runner.py:254} INFO - Exiting gracefully upon receiving signal 15
[2023-05-11T19:07:13.364+0000] {process_utils.py:131} INFO - Sending Signals.SIGTERM to group 577. PIDs of all processes in the group: [7682, 577]
[2023-05-11T19:07:13.364+0000] {process_utils.py:86} INFO - Sending the signal Signals.SIGTERM to group 577
[2023-05-11T19:07:14.110+0000] {process_utils.py:258} INFO - Waiting up to 5 seconds for processes to exit...
[2023-05-11T19:07:14.112+0000] {process_utils.py:79} INFO - Process psutil.Process(pid=7682, status='terminated', started='19:07:12') (7682) terminated with exit code None
[2023-05-11T19:07:14.166+0000] {process_utils.py:79} INFO - Process psutil.Process(pid=577, status='terminated', exitcode=0, started='19:05:01') (577) terminated with exit code 0
[2023-05-11T19:07:14.166+0000] {kubernetes_executor.py:1011} INFO - Shutting down Kubernetes executor
[2023-05-11T19:07:14.167+0000] {scheduler_job_runner.py:893} ERROR - Exception when executing Executor.end
Traceback (most recent call last):
  File "/home/airflow/.local/lib/python3.8/site-packages/airflow/jobs/scheduler_job_runner.py", line 870, in _execute
    self._run_scheduler_loop()
  File "/home/airflow/.local/lib/python3.8/site-packages/airflow/jobs/scheduler_job_runner.py", line 1027, in _run_scheduler_loop
    time.sleep(min(self._scheduler_idle_sleep_time, next_event if next_event else 0))
  File "/home/airflow/.local/lib/python3.8/site-packages/airflow/jobs/scheduler_job_runner.py", line 257, in _exit_gracefully
    sys.exit(os.EX_OK)
SystemExit: 0

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/airflow/.local/lib/python3.8/site-packages/airflow/jobs/scheduler_job_runner.py", line 891, in _execute
    self.job.executor.end()
  File "/home/airflow/.local/lib/python3.8/site-packages/airflow/executors/kubernetes_executor.py", line 1014, in end
    self._flush_task_queue()
  File "/home/airflow/.local/lib/python3.8/site-packages/airflow/executors/kubernetes_executor.py", line 966, in _flush_task_queue
    self.log.debug("Executor shutting down, task_queue approximate size=%d", self.task_queue.qsize())
  File "<string>", line 2, in qsize
  File "/usr/local/lib/python3.8/multiprocessing/managers.py", line 834, in _callmethod
    conn.send((self._id, methodname, args, kwds))
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 206, in send
    self._send_bytes(_ForkingPickler.dumps(obj))
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 411, in _send_bytes
    self._send(header + buf)
  File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 368, in _send
    n = write(self._handle, buf)
BrokenPipeError: [Errno 32] Broken pipe