Skip to content

Instantly share code, notes, and snippets.

@jiayuan-hu-dd

jiayuan-hu-dd/gist:697b7da18401930b80e7c887c1ffc32d

Last active June 25, 2025 00:02
Show Gist options
  • Save jiayuan-hu-dd/697b7da18401930b80e7c887c1ffc32d to your computer and use it in GitHub Desktop.
Save jiayuan-hu-dd/697b7da18401930b80e7c887c1ffc32d to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
INFO 2025-06-17 16:55:46.682 credentials.py:1147] Found credentials in environment variables.
INFO 2025-06-17 16:55:46.856 credentials.py:1147] Found credentials in environment variables.
INFO 2025-06-17 16:55:47.023 credentials.py:1147] Found credentials in environment variables.
INFO 2025-06-17 16:55:47.187 credentials.py:1147] Found credentials in environment variables.
INFO 2025-06-17 16:55:47.202 jenkins.py:95] Job not started yet, waiting...
WARNING 2025-06-17 16:55:47.487 api.py:250] Node group None has no memory specified. Defaulting to 14.4G
WARNING 2025-06-17 16:55:47.487 api.py:250] Node group cpu_nodes has no memory specified. Defaulting to 14.4G
INFO 2025-06-17 16:55:47.202 jenkins.py:95] Job not started yet, waiting...
WARNING 2025-06-17 16:55:47.487 api.py:250] Node group None has no memory specified. Defaulting to 14.4G
WARNING 2025-06-17 16:55:47.487 api.py:250] Node group cpu_nodes has no memory specified. Defaulting to 14.4G
INFO 2025-06-17 16:55:47.665 jenkins.py:95] Job not started yet, waiting...
INFO 2025-06-17 16:55:52.296 jenkins.py:95] Job not started yet, waiting...
INFO 2025-06-17 16:55:52.761 jenkins.py:95] Job not started yet, waiting...
INFO 2025-06-17 16:55:57.393 jenkins.py:92] Job started: https://jenkins-controller-2.doordashlabs.net/job/analyzer-jobs/job/event_capture_extractor/16994/
INFO 2025-06-17 16:55:57.857 jenkins.py:92] Job started: https://jenkins-controller-2.doordashlabs.net/job/push_image_to_ecr/14896/
INFO 2025-06-17 17:02:58.974 credentials.py:1147] Found credentials in environment variables.
INFO 2025-06-17 17:03:00.598 kuberay_job.py:674] Wrote cluster config to /root/.cache/ray_clusters/kuberay-cluster-u5olso0e
INFO 2025-06-17 17:03:00.598 job_runner.py:195] Starting job with timeout 4:00:00
INFO 2025-06-17 17:03:00.599 job_runner.py:90] Submitting job to cluster
INFO 2025-06-17 17:03:01.466 kuberay_job.py:688] Created job
INFO 2025-06-17 17:03:01.467 job_runner.py:92] Waiting for job to start
INFO 2025-06-17 17:03:01.467 job_runner.py:93] Job ID: event-capture-extractor-179rjn
Submitting Ray job with command: /opt/analyzers/jobs/event_capture_extractor/event_capture_extractor_image analyzers/jobs/event_capture_extractor/event_capture_extractor_main --full_robot_s3_log_path=badger-3/test/2025-05-07_16-53-54_56806.log/ --out_dir /tmp && /opt/analyzers/jobs/event_capture_extractor/event_capture_extractor_image analyzers/data/loaders/redshift_loader --path /tmp/event_capture_index --schema public --table_name event_captures --id_col full_s3_path
2025-06-18 00:03:52,618 INFO cli.py:39 -- Job submission server address: http://capture-extractor-179rjn-raycluster-z5vl4-head-svc.ray.svc.cluster.local:8265
2025-06-18 00:03:52,674 SUCC cli.py:63 -- -----------------------------------------------------------------
2025-06-18 00:03:52,674 SUCC cli.py:64 -- Job 'event-capture-extractor-179rjn-r5c75' submitted successfully
2025-06-18 00:03:52,674 SUCC cli.py:65 -- -----------------------------------------------------------------
2025-06-18 00:03:52,674 INFO cli.py:289 -- Next steps
2025-06-18 00:03:52,674 INFO cli.py:290 -- Query the logs of the job:
2025-06-18 00:03:52,674 INFO cli.py:292 -- ray job logs event-capture-extractor-179rjn-r5c75
2025-06-18 00:03:52,674 INFO cli.py:294 -- Query the status of the job:
2025-06-18 00:03:52,674 INFO cli.py:296 -- ray job status event-capture-extractor-179rjn-r5c75
2025-06-18 00:03:52,674 INFO cli.py:298 -- Request the job to be stopped:
2025-06-18 00:03:52,674 INFO cli.py:300 -- ray job stop event-capture-extractor-179rjn-r5c75
2025-06-18 00:03:52,681 INFO cli.py:307 -- Tailing logs until the job exits (disable with --no-wait):
2025-06-18 00:03:52,647 INFO job_manager.py:530 -- Runtime env is setting up.
I20250618 00:03:54.198807 520 bag_reader.cc:295] Reading bag from CLI
I20250618 00:03:54.198916 520 bag_reader.cc:309] Loading bag from S3
Downloading: 16.95% [###### ] Remaining: 78.4 KB
Downloading: 34.36% [########### ] Remaining: 62.0 KB
Downloading: 52.37% [################ ] Remaining: 45.0 KB
Downloading: 70.38% [###################### ] Remaining: 28.0 KB
Downloading: 88.39% [########################### ] Remaining: 11.0 KB
Downloading: 100.00% [##############################] Remaining: 0 bytes
Downloading: 6.98% [### ] Remaining: 432.3 KB
Downloading: 13.11% [#### ] Remaining: 403.8 KB
Downloading: 18.24% [###### ] Remaining: 379.9 KB
Downloading: 25.42% [######## ] Remaining: 346.5 KB
Downloading: 33.10% [########## ] Remaining: 310.9 KB
Downloading: 39.24% [############ ] Remaining: 282.3 KB
Downloading: 44.58% [############## ] Remaining: 257.5 KB
Downloading: 51.89% [################ ] Remaining: 223.5 KB
Downloading: 57.82% [################## ] Remaining: 196.0 KB
Downloading: 65.13% [#################### ] Remaining: 162.0 KB
Downloading: 71.06% [###################### ] Remaining: 134.5 KB
Downloading: 78.37% [######################## ] Remaining: 100.5 KB
Downloading: 84.29% [########################## ] Remaining: 73.0 KB
Downloading: 91.27% [############################ ] Remaining: 40.6 KB
Downloading: 98.95% [##############################] Remaining: 4.9 KB
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 910:32: Message type "doordash.config.SpeedSearchCosts" has no field named "w_static_keep_clear".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 924:40: Message type "doordash.config.SpeedSearchCosts" has no field named "w_static_keep_clear_stopped".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 1058:44: Message type "doordash.config.PullOverConfig" has no field named "max_angle_to_consider_garbage_truck".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 1076:30: Message type "doordash.config.UnstructuredPlanner" has no field named "use_pcp_obstacle_grid".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 1991:32: Message type "doordash.config.SpeedSearchCosts" has no field named "w_static_keep_clear".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 2005:40: Message type "doordash.config.SpeedSearchCosts" has no field named "w_static_keep_clear_stopped".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 2139:44: Message type "doordash.config.PullOverConfig" has no field named "max_angle_to_consider_garbage_truck".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 2157:30: Message type "doordash.config.UnstructuredPlanner" has no field named "use_pcp_obstacle_grid".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 2339:20: Message type "doordash.perception.proto.TrafficSignalClassifierConfig" has no field named "sensor_id".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 910:32: Message type "doordash.config.SpeedSearchCosts" has no field named "w_static_keep_clear".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 924:40: Message type "doordash.config.SpeedSearchCosts" has no field named "w_static_keep_clear_stopped".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 1058:44: Message type "doordash.config.PullOverConfig" has no field named "max_angle_to_consider_garbage_truck".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 1076:30: Message type "doordash.config.UnstructuredPlanner" has no field named "use_pcp_obstacle_grid".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 1991:32: Message type "doordash.config.SpeedSearchCosts" has no field named "w_static_keep_clear".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 2005:40: Message type "doordash.config.SpeedSearchCosts" has no field named "w_static_keep_clear_stopped".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 2139:44: Message type "doordash.config.PullOverConfig" has no field named "max_angle_to_consider_garbage_truck".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 2157:30: Message type "doordash.config.UnstructuredPlanner" has no field named "use_pcp_obstacle_grid".
[libprotobuf WARNING external/com_google_protobuf/src/google/protobuf/text_format.cc:350] Warning parsing text-format doordash.config.ParametersProfile: 2339:20: Message type "doordash.perception.proto.TrafficSignalClassifierConfig" has no field named "sensor_id".
E20250618 00:03:54.763578 520 event_capture_extractor_main.cc:37] Failed to extract event capture: /event_capture_metadata not found in bag. Cannot generate EventCapture index.
INFO 2025-06-18 00:03:56.394 redshift_loader.py:251] Path does not exist: /tmp/event_capture_index, Nothing to load.
INFO 2025-06-17 17:03:58.309 job_runner.py:144] Job event-capture-extractor-179rjn finished with status JobStatus.SUCCEEDED
INFO 2025-06-17 17:03:58.378 job_runner.py:207] Shutting down cluster
INFO 2025-06-17 17:03:58.905 kuberay_job.py:739] Deleting job and cluster event-capture-extractor-179rjn
INFO 2025-06-17 17:03:58.998 job_runner.py:222] Cluster shut down
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment