/dvc-exp-worker-1.out Secret
Last active
July 11, 2022 18:02
-
-
Save dacbd/be7648bc29f9c019410032365302e872 to your computer and use it in GitHub Desktop.
Console on worker stoping
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [2022-07-11 17:40:23,171: WARNING/MainProcess] No hostname was supplied. Reverting to default 'localhost' | |
| -------------- dvc-exp-ef64fc-1@localhost v5.3.0a1 (dawn-chorus) | |
| --- ***** ----- | |
| -- ******* ---- Linux-5.10.0-15-cloud-amd64-x86_64-with-glibc2.31 2022-07-11 17:40:23 | |
| - *** --- * --- | |
| - ** ---------- [config] | |
| - ** ---------- .> app: dvc-exp-local:0x7fc772ef4b50 | |
| - ** ---------- .> transport: filesystem://localhost// | |
| - ** ---------- .> results: file:///home/Todd.Jordan/pfc-irm/ml/.dvc/tmp/exps/celery/result | |
| - *** --- * --- .> concurrency: 1 (thread) | |
| -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) | |
| --- ***** ----- | |
| -------------- [queues] | |
| .> celery exchange=celery(direct) key=celery | |
| [tasks] | |
| . dvc.repo.experiments.queue.tasks.cleanup_exp | |
| . dvc.repo.experiments.queue.tasks.collect_exp | |
| . dvc.repo.experiments.queue.tasks.run_exp | |
| . dvc.repo.experiments.queue.tasks.setup_exp | |
| . dvc_task.proc.tasks.run | |
| [2022-07-11 17:40:23,206: WARNING/MainProcess] /home/Todd.Jordan/pfc-irm/ml/.venv/lib/python3.9/site-packages/celery/worker/consumer/consumer.py:491: CPendingDeprecationWarning: The broker_connection_retry configuration setting will no longer determine | |
| whether broker connection retries are made during startup in Celery 6.0 and above. | |
| If you wish to retain the existing behavior for retrying connections on startup, | |
| you should set broker_connection_retry_on_startup to True. | |
| warnings.warn( | |
| [2022-07-11 17:40:23,207: WARNING/MainProcess] No hostname was supplied. Reverting to default 'localhost' | |
| [2022-07-11 17:40:23,207: INFO/MainProcess] Connected to filesystem://localhost// | |
| [2022-07-11 17:40:23,211: INFO/MainProcess] dvc-exp-ef64fc-1@localhost ready. | |
| [2022-07-11 17:40:23,212: INFO/MainProcess] Task dvc.repo.experiments.queue.tasks.run_exp[92bb3f0d-a1f8-4289-bdbd-99f265cd825e] received | |
| [2022-07-11 17:40:26,004: INFO/MainProcess] monitor: watching celery worker 'dvc-exp-ef64fc-1@localhost' | |
| [2022-07-11 17:41:00,745: INFO/MainProcess] Task dvc.repo.experiments.queue.tasks.run_exp[92bb3f0d-a1f8-4289-bdbd-99f265cd825e] succeeded in 37.53234221300045s: None | |
| [2022-07-11 17:41:02,291: INFO/MainProcess] Task dvc.repo.experiments.queue.tasks.run_exp[8c75e68d-86c6-4bef-9fd1-42e2ffccd706] received | |
| [2022-07-11 17:41:18,688: INFO/MainProcess] Task dvc.repo.experiments.queue.tasks.run_exp[8c75e68d-86c6-4bef-9fd1-42e2ffccd706] succeeded in 16.396160084999792s: None | |
| [2022-07-11 17:41:19,325: INFO/MainProcess] Task dvc.repo.experiments.queue.tasks.run_exp[f8c0da77-456c-47a8-8089-4fe3fe76e42c] received | |
| [2022-07-11 17:41:22,103: INFO/MainProcess] monitor: shutting down due to empty queue. | |
| [2022-07-11 17:41:22,104: INFO/MainProcess] monitor: done | |
| [2022-07-11 17:41:22,333: WARNING/MainProcess] Got shutdown from remote | |
| [2022-07-11 17:41:33,332: INFO/MainProcess] Task dvc.repo.experiments.queue.tasks.run_exp[f8c0da77-456c-47a8-8089-4fe3fe76e42c] succeeded in 14.006777598999179s: None |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (.venv) Todd.Jordan@pfc-irm-dev:~/pfc-irm/ml$ dvc queue start | |
| Start 1 new worker to process the queue. | |
| (.venv) Todd.Jordan@pfc-irm-dev:~/pfc-irm/ml$ echo $(date +%x_%r); echo "Running"; dvc queue status | grep -o -i Running | wc -l; echo "Success"; dvc queue status | grep -o -i Success | wc -l ; echo "Queued"; dvc queue status | grep -o -i Queued | wc -l | |
| 07/11/22_05:40:41 PM | |
| Running | |
| 1 | |
| Success | |
| 0 | |
| Queued | |
| 99 | |
| (.venv) Todd.Jordan@pfc-irm-dev:~/pfc-irm/ml$ echo $(date +%x_%r); echo "Running"; dvc queue status | grep -o -i Running | wc -l; echo "Success"; dvc queue status | grep -o -i Success | wc -l ; echo "Queued"; dvc queue status | grep -o -i Queued | wc -l | |
| 07/11/22_05:43:10 PM | |
| Running | |
| 0 | |
| Success | |
| 3 | |
| Queued | |
| 97 | |
| (.venv) Todd.Jordan@pfc-irm-dev:~/pfc-irm/ml$ dvc status | |
| process_data: | |
| changed deps: | |
| params.yaml: | |
| modified: S_prep.keep_columns | |
| modified: M_prep.keep_columns | |
| modified: L_prep.keep_columns | |
| (.venv) Todd.Jordan@pfc-irm-dev:~/pfc-irm/ml$ dvc queue status | |
| Task Name Created Status | |
| 2ebb104 05:37 PM Queued | |
| 116b131 05:37 PM Queued | |
| a5471c9 05:37 PM Queued | |
| a62ac32 05:37 PM Queued | |
| 0cc02a9 05:37 PM Queued | |
| 7973db2 05:37 PM Queued | |
| 03ef606 05:37 PM Queued | |
| 5bb3f96 05:37 PM Queued | |
| b53abb5 05:37 PM Queued | |
| 85bfab8 05:38 PM Queued | |
| 7304a4d 05:38 PM Queued | |
| d4f94cd 05:38 PM Queued | |
| a62bad4 05:38 PM Queued | |
| 297e0be 05:38 PM Queued | |
| 9e8c731 05:38 PM Queued | |
| 372b767 05:38 PM Queued | |
| b1d1876 05:38 PM Queued | |
| a7311fe 05:38 PM Queued | |
| 0220b3f 05:38 PM Queued | |
| 2567d51 05:38 PM Queued | |
| c483a05 05:38 PM Queued | |
| de3160a 05:38 PM Queued | |
| 3c7de2a 05:38 PM Queued | |
| 0c3b617 05:38 PM Queued | |
| 009b22e 05:38 PM Queued | |
| c48c28e 05:38 PM Queued | |
| 20dbe4e 05:38 PM Queued | |
| edd6432 05:38 PM Queued | |
| e52c184 05:38 PM Queued | |
| e4fb773 05:38 PM Queued | |
| e7efac5 05:38 PM Queued | |
| 0f05e59 05:38 PM Queued | |
| ab0da03 05:38 PM Queued | |
| 5d9aba4 05:38 PM Queued | |
| c7aa2e0 05:38 PM Queued | |
| c6f5ecf 05:38 PM Queued | |
| 2b86b5b 05:38 PM Queued | |
| 41ada93 05:38 PM Queued | |
| a63a671 05:38 PM Queued | |
| 1083e03 05:38 PM Queued | |
| 369d1a6 05:38 PM Queued | |
| b7b2081 05:38 PM Queued | |
| a600afa 05:38 PM Queued | |
| f435cf8 05:38 PM Queued | |
| 17b5c86 05:38 PM Queued | |
| 56e6e8a 05:38 PM Queued | |
| bf1ed23 05:38 PM Queued | |
| d3a8da2 05:38 PM Queued | |
| 02ac1cd 05:38 PM Queued | |
| 9dfd424 05:38 PM Queued | |
| 2f1a101 05:38 PM Queued | |
| 61bbf77 05:38 PM Queued | |
| 87dde1a 05:38 PM Queued | |
| 489a572 05:38 PM Queued | |
| 2778d97 05:38 PM Queued | |
| 7aab409 05:39 PM Queued | |
| a255ea5 05:39 PM Queued | |
| 0fe232f 05:39 PM Queued | |
| 7c4b24e 05:39 PM Queued | |
| 98aeacf 05:39 PM Queued | |
| 6c794f8 05:39 PM Queued | |
| 350c01b 05:39 PM Queued | |
| 9295202 05:39 PM Queued | |
| 1ceecfb 05:39 PM Queued | |
| 35dc871 05:39 PM Queued | |
| 975fe93 05:39 PM Queued | |
| de7b9e7 05:39 PM Queued | |
| 45e7ee8 05:39 PM Queued | |
| ee0df42 05:39 PM Queued | |
| 13b8382 05:39 PM Queued | |
| f0f37c5 05:39 PM Queued | |
| 9fcf98d 05:39 PM Queued | |
| 445f2ac 05:39 PM Queued | |
| b9cf181 05:39 PM Queued | |
| 8eac64f 05:39 PM Queued | |
| afdda99 05:39 PM Queued | |
| e221cfc 05:39 PM Queued | |
| d5e1a96 05:39 PM Queued | |
| cbf51de 05:39 PM Queued | |
| 8af9ee9 05:39 PM Queued | |
| 2f7be62 05:39 PM Queued | |
| ed8d853 05:39 PM Queued | |
| 7b292ca 05:39 PM Queued | |
| fb61d81 05:39 PM Queued | |
| d7e22d7 05:39 PM Queued | |
| 8b564fb 05:39 PM Queued | |
| 607ded4 05:39 PM Queued | |
| b918eaf 05:39 PM Queued | |
| 9745013 05:39 PM Queued | |
| 10e99ac 05:39 PM Queued | |
| 2a62a73 05:39 PM Queued | |
| 09f2f37 05:39 PM Queued | |
| 8c553f5 05:39 PM Queued | |
| 90e5e60 05:39 PM Queued | |
| f0b7f74 05:39 PM Queued | |
| 503e786 05:39 PM Queued | |
| 449e366 05:39 PM Queued | |
| d1113ba exp-8f185 05:37 PM Success | |
| 3ae63cc exp-1251c 05:37 PM Success | |
| 15afc40 exp-68e05 05:37 PM Success | |
| No worker active, no worker idle at present. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment