Skip to content

Instantly share code, notes, and snippets.

@philips
Created June 25, 2024 20:27
Show Gist options
  • Save philips/c4d57b280a8e6a9fc80dd5372576120b to your computer and use it in GitHub Desktop.
Save philips/c4d57b280a8e6a9fc80dd5372576120b to your computer and use it in GitHub Desktop.
$ podman compose up
>>>> Executing external compose provider "/usr/local/bin/docker-compose". Please refer to the documentation for details. <<<<
[+] Running 18/18
✔ Network divviup-api-docker2_default Created 0.0s
✔ Container divviup-api-docker2-postgres-1 Created 0.1s
✔ Container divviup-api-docker2-janus_2_migrate-1 Created 0.0s
✔ Container divviup-api-docker2-divviup_api_migrate-1 Created 0.0s
✔ Container divviup-api-docker2-janus_1_migrate-1 Created 0.0s
✔ Container divviup-api-docker2-divviup_api-1 Created 0.0s
✔ Container divviup-api-docker2-janus_1_aggregator-1 Created 0.1s
✔ Container divviup-api-docker2-janus_2_garbage_collector-1 Created 0.2s
✔ Container divviup-api-docker2-janus_1_aggregation_job_creator-1 Created 0.2s
✔ Container divviup-api-docker2-janus_1_collection_job_driver-1 Created 0.1s
✔ Container divviup-api-docker2-janus_2_aggregation_job_driver-1 Created 0.1s
✔ Container divviup-api-docker2-janus_2_aggregator-1 Created 0.1s
✔ Container divviup-api-docker2-janus_1_garbage_collector-1 Created 0.1s
✔ Container divviup-api-docker2-janus_1_aggregation_job_driver-1 Created 0.2s
✔ Container divviup-api-docker2-janus_2_collection_job_driver-1 Created 0.2s
✔ Container divviup-api-docker2-janus_2_aggregation_job_creator-1 Created 0.1s
✔ Container divviup-api-docker2-pair_aggregator-1 Created 0.0s
✔ Container divviup-api-docker2-static_assets-1 Created 0.0s
Attaching to divviup_api-1, divviup_api_migrate-1, janus_1_aggregation_job_creator-1, janus_1_aggregation_job_driver-1, janus_1_aggregator-1, janus_1_collection_job_driver-1, janus_1_garbage_collector-1, janus_1_migrate-1, janus_2_aggregation_job_creator-1, janus_2_aggregation_job_driver-1, janus_2_aggregator-1, janus_2_collection_job_driver-1, janus_2_garbage_collector-1, janus_2_migrate-1, pair_aggregator-1, postgres-1, static_assets-1
postgres-1 | The files belonging to this database system will be owned by user "postgres".
postgres-1 | This user must also own the server process.
postgres-1 |
postgres-1 | The database cluster will be initialized with locale "en_US.utf8".
postgres-1 | The default database encoding has accordingly been set to "UTF8".
postgres-1 | The default text search configuration will be set to "english".
postgres-1 |
postgres-1 | Data page checksums are disabled.
postgres-1 |
postgres-1 | fixing permissions on existing directory /var/lib/postgresql/data ... ok
postgres-1 | creating subdirectories ... ok
postgres-1 | selecting dynamic shared memory implementation ... posix
postgres-1 | selecting default max_connections ... 100
postgres-1 | selecting default shared_buffers ... 128MB
postgres-1 | selecting default time zone ... Etc/UTC
postgres-1 | creating configuration files ... ok
postgres-1 | running bootstrap script ... ok
postgres-1 | performing post-bootstrap initialization ... ok
postgres-1 | syncing data to disk ... ok
postgres-1 |
postgres-1 |
postgres-1 | Success. You can now start the database server using:
postgres-1 |
postgres-1 | pg_ctl -D /var/lib/postgresql/data -l logfile start
postgres-1 |
postgres-1 | initdb: warning: enabling "trust" authentication for local connections
postgres-1 | initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.
postgres-1 | waiting for server to start....2024-06-25 20:25:12.812 UTC [32] LOG: starting PostgreSQL 16.3 (Debian 16.3-1.pgdg120+1) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
postgres-1 | 2024-06-25 20:25:12.812 UTC [32] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
postgres-1 | 2024-06-25 20:25:12.814 UTC [35] LOG: database system was shut down at 2024-06-25 20:25:12 UTC
postgres-1 | 2024-06-25 20:25:12.817 UTC [32] LOG: database system is ready to accept connections
postgres-1 | done
postgres-1 | server started
postgres-1 |
postgres-1 | /usr/local/bin/docker-entrypoint.sh: running /docker-entrypoint-initdb.d/postgres_init.sql
postgres-1 | CREATE DATABASE
postgres-1 | CREATE DATABASE
postgres-1 | CREATE DATABASE
postgres-1 |
postgres-1 |
postgres-1 | 2024-06-25 20:25:13.061 UTC [32] LOG: received fast shutdown request
postgres-1 | waiting for server to shut down....2024-06-25 20:25:13.062 UTC [32] LOG: aborting any active transactions
postgres-1 | 2024-06-25 20:25:13.063 UTC [32] LOG: background worker "logical replication launcher" (PID 38) exited with exit code 1
postgres-1 | 2024-06-25 20:25:13.063 UTC [33] LOG: shutting down
postgres-1 | 2024-06-25 20:25:13.064 UTC [33] LOG: checkpoint starting: shutdown immediate
postgres-1 | 2024-06-25 20:25:13.252 UTC [33] LOG: checkpoint complete: wrote 2754 buffers (16.8%); 0 WAL file(s) added, 0 removed, 1 recycled; write=0.045 s, sync=0.143 s, total=0.189 s; sync files=893, longest=0.120 s, average=0.001 s; distance=12764 kB, estimate=12764 kB; lsn=0/2161440, redo lsn=0/2161440
postgres-1 | 2024-06-25 20:25:13.256 UTC [32] LOG: database system is shut down
postgres-1 | done
postgres-1 | server stopped
postgres-1 |
postgres-1 | PostgreSQL init process complete; ready for start up.
postgres-1 |
postgres-1 | 2024-06-25 20:25:13.274 UTC [1] LOG: starting PostgreSQL 16.3 (Debian 16.3-1.pgdg120+1) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
postgres-1 | 2024-06-25 20:25:13.274 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432
postgres-1 | 2024-06-25 20:25:13.274 UTC [1] LOG: listening on IPv6 address "::", port 5432
postgres-1 | 2024-06-25 20:25:13.275 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
postgres-1 | 2024-06-25 20:25:13.278 UTC [48] LOG: database system was shut down at 2024-06-25 20:25:13 UTC
postgres-1 | 2024-06-25 20:25:13.285 UTC [1] LOG: database system is ready to accept connections
divviup_api_migrate-1 | Applying all pending migrations
divviup_api_migrate-1 | Applying migration 'm20230211_224741_create_tasks'
divviup_api_migrate-1 | Migration 'm20230211_224741_create_tasks' has been applied
divviup_api_migrate-1 | Applying migration 'm20230211_224853_create_sessions'
divviup_api_migrate-1 | Migration 'm20230211_224853_create_sessions' has been applied
divviup_api_migrate-1 | Applying migration 'm20230211_233835_create_accounts'
divviup_api_migrate-1 | Migration 'm20230211_233835_create_accounts' has been applied
divviup_api_migrate-1 | Applying migration 'm20230217_211422_create_memberships'
divviup_api_migrate-1 | Migration 'm20230217_211422_create_memberships' has been applied
divviup_api_migrate-1 | Applying migration 'm20230322_223043_add_fields_to_task'
divviup_api_migrate-1 | Migration 'm20230322_223043_add_fields_to_task' has been applied
divviup_api_migrate-1 | Applying migration 'm20230427_221953_create_queue'
divviup_api_migrate-1 | Migration 'm20230427_221953_create_queue' has been applied
divviup_api_migrate-1 | Applying migration 'm20230512_200213_make_task_max_batch_size_a_big_integer'
divviup_api_migrate-1 | Migration 'm20230512_200213_make_task_max_batch_size_a_big_integer' has been applied
divviup_api_migrate-1 | Applying migration 'm20230512_202411_add_two_urls_to_every_task'
divviup_api_migrate-1 | Migration 'm20230512_202411_add_two_urls_to_every_task' has been applied
divviup_api_migrate-1 | Applying migration 'm20230616_223923_create_aggregators'
divviup_api_migrate-1 | Migration 'm20230616_223923_create_aggregators' has been applied
divviup_api_migrate-1 | Applying migration 'm20230620_195535_add_aggregators_to_tasks'
divviup_api_migrate-1 | Migration 'm20230620_195535_add_aggregators_to_tasks' has been applied
divviup_api_migrate-1 | Applying migration 'm20230622_232534_make_aggregator_api_url_mandatory'
divviup_api_migrate-1 | Migration 'm20230622_232534_make_aggregator_api_url_mandatory' has been applied
divviup_api_migrate-1 | Applying migration 'm20230626_183248_add_is_first_party_to_aggregators'
divviup_api_migrate-1 | Migration 'm20230626_183248_add_is_first_party_to_aggregators' has been applied
divviup_api_migrate-1 | Applying migration 'm20230630_175314_create_api_tokens'
divviup_api_migrate-1 | Migration 'm20230630_175314_create_api_tokens' has been applied
divviup_api_migrate-1 | Applying migration 'm20230703_201332_add_additional_fields_to_api_tokens'
divviup_api_migrate-1 | Migration 'm20230703_201332_add_additional_fields_to_api_tokens' has been applied
divviup_api_migrate-1 | Applying migration 'm20230725_220134_add_vdafs_and_query_types_to_aggregators'
divviup_api_migrate-1 | Migration 'm20230725_220134_add_vdafs_and_query_types_to_aggregators' has been applied
divviup_api_migrate-1 | Applying migration 'm20230731_181722_rename_aggregator_bearer_token'
janus_2_migrate-1 | Applied 1/migrate initial schema (206.042239ms)
janus_2_migrate-1 | Applied 2/migrate collection job step attempts (830.796µs)
janus_2_migrate-1 | Applied 3/migrate outstanding batch state (1.980636ms)
divviup_api_migrate-1 | Migration 'm20230731_181722_rename_aggregator_bearer_token' has been applied
divviup_api_migrate-1 | Applying migration 'm20230808_204859_create_hpke_config'
divviup_api_migrate-1 | Migration 'm20230808_204859_create_hpke_config' has been applied
divviup_api_migrate-1 | Applying migration 'm20230817_192017_add_protocol_to_aggregators'
divviup_api_migrate-1 | Migration 'm20230817_192017_add_protocol_to_aggregators' has been applied
divviup_api_migrate-1 | Applying migration 'm20230907_175501_add_aggregator_onboarding_boolean_to_account'
janus_1_migrate-1 | Applied 1/migrate initial schema (176.591198ms)
divviup_api_migrate-1 | Migration 'm20230907_175501_add_aggregator_onboarding_boolean_to_account' has been applied
divviup_api_migrate-1 | Applying migration 'm20231012_205810_add_features_to_aggregators'
janus_1_migrate-1 | Applied 2/migrate collection job step attempts (1.053673ms)
divviup_api_migrate-1 | Migration 'm20231012_205810_add_features_to_aggregators' has been applied
divviup_api_migrate-1 | Applying migration 'm20231012_225001_rename_hpke_configs_to_collector_credentials'
divviup_api_migrate-1 | Migration 'm20231012_225001_rename_hpke_configs_to_collector_credentials' has been applied
divviup_api_migrate-1 | Applying migration 'm20231012_233117_add_token_hash_to_collector_credential'
divviup_api_migrate-1 | Migration 'm20231012_233117_add_token_hash_to_collector_credential' has been applied
divviup_api_migrate-1 | Applying migration 'm20240214_215101_upload_metrics'
divviup_api_migrate-1 | Migration 'm20240214_215101_upload_metrics' has been applied
divviup_api_migrate-1 | Applying migration 'm20240411_195358_time_bucketed_fixed_size'
divviup_api_migrate-1 | Migration 'm20240411_195358_time_bucketed_fixed_size' has been applied
divviup_api_migrate-1 | Applying migration 'm20240416_172920_task_deleted_at'
divviup_api_migrate-1 | Migration 'm20240416_172920_task_deleted_at' has been applied
janus_1_migrate-1 | Applied 3/migrate outstanding batch state (4.393983ms)
janus_2_migrate-1 exited with code 0
divviup_api_migrate-1 exited with code 0
janus_1_migrate-1 exited with code 0
janus_1_aggregation_job_creator-1 | {"timestamp":"2024-06-25T20:25:14.992929Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_1_aggregation_job_creator.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_1, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, batch_aggregation_shard_count: 32, tasks_update_frequency_secs: 10, aggregation_job_creation_interval_secs: 10, min_aggregation_job_size: 10, max_aggregation_job_size: 100, aggregation_job_creation_report_window: 5000 }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
janus_2_garbage_collector-1 | {"timestamp":"2024-06-25T20:25:15.148094Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_2_garbage_collector.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_2, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, garbage_collection: GarbageCollectorConfig { gc_frequency_s: 60, report_limit: 5000, aggregation_limit: 500, collection_limit: 50, tasks_per_tx: 1, concurrent_tx_limit: None } }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
janus_2_aggregator-1 | {"timestamp":"2024-06-25T20:25:15.318117Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_2_aggregator.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_2, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, taskprov_config: TaskprovConfig { enabled: false, ignore_unknown_differential_privacy_mechanism: false }, garbage_collection: None, listen_address: 0.0.0.0:8080, aggregator_api: Some(AggregatorApi { listen_address: None, path_prefix: Some(\"aggregator-api\"), public_dap_url: http://localhost:9002/ }), max_upload_batch_size: 100, max_upload_batch_write_delay_ms: 250, batch_aggregation_shard_count: 32, task_counter_shard_count: 32, global_hpke_configs_refresh_interval: None, task_cache_ttl_seconds: None, task_cache_capacity: None }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
janus_2_aggregation_job_driver-1 | {"timestamp":"2024-06-25T20:25:15.345680Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_2_aggregation_job_driver.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_2, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, job_driver_config: JobDriverConfig { job_discovery_interval_secs: 10, max_concurrent_job_workers: 10, worker_lease_duration_secs: 600, worker_lease_clock_skew_allowance_secs: 60, maximum_attempts_before_failure: 10, http_request_connection_timeout_secs: 10, http_request_timeout_secs: 30, retry_initial_interval_millis: 1000, retry_max_interval_millis: 30000, retry_max_elapsed_time_millis: 300000 }, taskprov_config: TaskprovConfig { enabled: false, ignore_unknown_differential_privacy_mechanism: false }, batch_aggregation_shard_count: 32 }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
janus_1_collection_job_driver-1 | {"timestamp":"2024-06-25T20:25:15.449960Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_1_collection_job_driver.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_1, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, job_driver_config: JobDriverConfig { job_discovery_interval_secs: 10, max_concurrent_job_workers: 10, worker_lease_duration_secs: 600, worker_lease_clock_skew_allowance_secs: 60, maximum_attempts_before_failure: 10, http_request_connection_timeout_secs: 10, http_request_timeout_secs: 30, retry_initial_interval_millis: 1000, retry_max_interval_millis: 30000, retry_max_elapsed_time_millis: 300000 }, batch_aggregation_shard_count: 32, min_collection_job_retry_delay_secs: 600, max_collection_job_retry_delay_secs: 3600, collection_job_retry_delay_exponential_factor: 1.25 }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
janus_1_garbage_collector-1 | {"timestamp":"2024-06-25T20:25:15.477638Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_1_garbage_collector.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_1, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, garbage_collection: GarbageCollectorConfig { gc_frequency_s: 60, report_limit: 5000, aggregation_limit: 500, collection_limit: 50, tasks_per_tx: 1, concurrent_tx_limit: None } }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
janus_2_collection_job_driver-1 | {"timestamp":"2024-06-25T20:25:15.483169Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_2_collection_job_driver.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_2, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, job_driver_config: JobDriverConfig { job_discovery_interval_secs: 10, max_concurrent_job_workers: 10, worker_lease_duration_secs: 600, worker_lease_clock_skew_allowance_secs: 60, maximum_attempts_before_failure: 10, http_request_connection_timeout_secs: 10, http_request_timeout_secs: 30, retry_initial_interval_millis: 1000, retry_max_interval_millis: 30000, retry_max_elapsed_time_millis: 300000 }, batch_aggregation_shard_count: 32, min_collection_job_retry_delay_secs: 600, max_collection_job_retry_delay_secs: 3600, collection_job_retry_delay_exponential_factor: 1.25 }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
janus_2_aggregator-1 | {"timestamp":"2024-06-25T20:25:15.521582Z","level":"INFO","fields":{"message":"Serving aggregator API relative to DAP API","aggregator_bound_address":"None","path_prefix":"aggregator-api"},"target":"janus_aggregator::binaries::aggregator","filename":"aggregator/src/binaries/aggregator.rs","line_number":109,"threadId":"ThreadId(1)"}
janus_2_aggregation_job_creator-1 | {"timestamp":"2024-06-25T20:25:15.506336Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_2_aggregation_job_creator.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_2, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, batch_aggregation_shard_count: 32, tasks_update_frequency_secs: 10, aggregation_job_creation_interval_secs: 10, min_aggregation_job_size: 10, max_aggregation_job_size: 100, aggregation_job_creation_report_window: 5000 }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
janus_2_aggregator-1 | {"timestamp":"2024-06-25T20:25:15.539622Z","level":"INFO","fields":{"message":"Running aggregator","aggregator_bound_address":"0.0.0.0:8080"},"target":"janus_aggregator::binaries::aggregator","filename":"aggregator/src/binaries/aggregator.rs","line_number":131,"threadId":"ThreadId(1)"}
divviup_api-1 |
divviup_api-1 | 🌱🦀🌱 divviup-api 0.3.16 started
divviup_api-1 | Listening at api url: http://localhost:8080/
divviup_api-1 | app url: http://localhost:8081/
divviup_api-1 | (bound as tcp://0.0.0.0:8080)
divviup_api-1 |
divviup_api-1 | Control-C to quit
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.671899Z","level":"INFO","fields":{"summary":"SELECT COUNT(*) AS num_items …","db.statement":"\n\nSELECT\n COUNT(*) AS num_items\nFROM\n (\n SELECT\n \"queue\".\"id\",\n \"queue\".\"created_at\",\n \"queue\".\"updated_at\",\n \"queue\".\"scheduled_at\",\n \"queue\".\"failure_count\",\n \"queue\".\"status\",\n \"queue\".\"job\",\n \"queue\".\"error_message\",\n \"queue\".\"parent_id\",\n \"queue\".\"child_id\"\n FROM\n \"queue\"\n WHERE\n (job ->> 'type' = $1)\n AND \"queue\".\"scheduled_at\" > $2\n ) AS \"sub_query\"\n","rows_affected":0,"rows_returned":1,"elapsed":"24.497596ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(2)"}
janus_1_aggregation_job_driver-1 | {"timestamp":"2024-06-25T20:25:15.665665Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_1_aggregation_job_driver.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_1, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, job_driver_config: JobDriverConfig { job_discovery_interval_secs: 10, max_concurrent_job_workers: 10, worker_lease_duration_secs: 600, worker_lease_clock_skew_allowance_secs: 60, maximum_attempts_before_failure: 10, http_request_connection_timeout_secs: 10, http_request_timeout_secs: 30, retry_initial_interval_millis: 1000, retry_max_interval_millis: 30000, retry_max_elapsed_time_millis: 300000 }, taskprov_config: TaskprovConfig { enabled: false, ignore_unknown_differential_privacy_mechanism: false }, batch_aggregation_shard_count: 32 }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.699646Z","level":"INFO","fields":{"summary":"INSERT INTO \"queue\" (\"id\", …","db.statement":"\n\nINSERT INTO\n \"queue\" (\n \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n )\nVALUES\n ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10) RETURNING \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n","rows_affected":0,"rows_returned":1,"elapsed":"7.231874ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(2)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.717502Z","level":"INFO","fields":{"summary":"COMMIT","db.statement":"","rows_affected":0,"rows_returned":0,"elapsed":"4.557859ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(2)"}
janus_1_aggregator-1 | {"timestamp":"2024-06-25T20:25:15.722409Z","level":"INFO","fields":{"message":"Starting up","common_options":"Options { config_file: \"/janus_1_aggregator.yaml\" }","config":"Config { common_config: CommonConfig { database: DbConfig { url: postgres://postgres@postgres:5432/janus_1, connection_pool_timeouts_secs: 60, connection_pool_max_size: None, check_schema_version: true, tls_trust_store_path: None }, logging_config: TraceConfiguration { use_test_writer: false, force_json_output: false, stackdriver_json_output: false, tokio_console_config: TokioConsoleConfiguration { enabled: false, listen_address: None }, open_telemetry_config: None, chrome: false }, metrics_config: MetricsConfiguration { exporter: None, tokio: None }, health_check_listen_address: 0.0.0.0:8000, max_transaction_retries: 1000 }, taskprov_config: TaskprovConfig { enabled: false, ignore_unknown_differential_privacy_mechanism: false }, garbage_collection: None, listen_address: 0.0.0.0:8080, aggregator_api: Some(AggregatorApi { listen_address: None, path_prefix: Some(\"aggregator-api\"), public_dap_url: http://localhost:9001/ }), max_upload_batch_size: 100, max_upload_batch_write_delay_ms: 250, batch_aggregation_shard_count: 32, task_counter_shard_count: 32, global_hpke_configs_refresh_interval: None, task_cache_ttl_seconds: None, task_cache_capacity: None }","version":"0.7.7","git_revision":"cd43e15","rust_version":"1.77.2"},"target":"janus_aggregator::binary_utils","filename":"aggregator/src/binary_utils.rs","line_number":306,"threadId":"ThreadId(1)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.739303Z","level":"INFO","fields":{"summary":"SELECT COUNT(*) AS num_items …","db.statement":"\n\nSELECT\n COUNT(*) AS num_items\nFROM\n (\n SELECT\n \"queue\".\"id\",\n \"queue\".\"created_at\",\n \"queue\".\"updated_at\",\n \"queue\".\"scheduled_at\",\n \"queue\".\"failure_count\",\n \"queue\".\"status\",\n \"queue\".\"job\",\n \"queue\".\"error_message\",\n \"queue\".\"parent_id\",\n \"queue\".\"child_id\"\n FROM\n \"queue\"\n WHERE\n (job ->> 'type' = $1)\n AND \"queue\".\"scheduled_at\" > $2\n ) AS \"sub_query\"\n","rows_affected":0,"rows_returned":1,"elapsed":"700.712µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.740910Z","level":"INFO","fields":{"summary":"INSERT INTO \"queue\" (\"id\", …","db.statement":"\n\nINSERT INTO\n \"queue\" (\n \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n )\nVALUES\n ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10) RETURNING \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n","rows_affected":0,"rows_returned":1,"elapsed":"282.502µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.742297Z","level":"INFO","fields":{"summary":"COMMIT","db.statement":"","rows_affected":0,"rows_returned":0,"elapsed":"953.839µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.747159Z","level":"INFO","fields":{"summary":"SELECT \"queue\".\"id\", \"queue\".\"created_at\", \"queue\".\"updated_at\", …","db.statement":"\n\nSELECT\n \"queue\".\"id\",\n \"queue\".\"created_at\",\n \"queue\".\"updated_at\",\n \"queue\".\"scheduled_at\",\n \"queue\".\"failure_count\",\n \"queue\".\"status\",\n \"queue\".\"job\",\n \"queue\".\"error_message\",\n \"queue\".\"parent_id\",\n \"queue\".\"child_id\"\nFROM\n \"queue\"\nWHERE\n \"queue\".\"status\" = $1\n AND (\n \"queue\".\"scheduled_at\" IS NULL\n OR \"queue\".\"scheduled_at\" < $2\n )\nORDER BY\n \"queue\".\"created_at\" ASC\nLIMIT\n $3 FOR\nUPDATE\n SKIP LOCKED\n","rows_affected":0,"rows_returned":1,"elapsed":"896.297µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.760621Z","level":"INFO","fields":{"summary":"DELETE FROM \"queue\" WHERE …","db.statement":"\n\nDELETE FROM\n \"queue\"\nWHERE\n (job ->> 'type' = $1)\n AND \"queue\".\"scheduled_at\" > $2\n","rows_affected":0,"rows_returned":0,"elapsed":"11.459356ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.764051Z","level":"INFO","fields":{"summary":"DELETE FROM \"session\" WHERE …","db.statement":"\n\nDELETE FROM\n \"session\"\nWHERE\n \"session\".\"expiry\" < $1\n","rows_affected":0,"rows_returned":0,"elapsed":"407.627µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.765858Z","level":"INFO","fields":{"summary":"INSERT INTO \"queue\" (\"id\", …","db.statement":"\n\nINSERT INTO\n \"queue\" (\n \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n )\nVALUES\n ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10) RETURNING \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n","rows_affected":0,"rows_returned":1,"elapsed":"320.877µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.770818Z","level":"INFO","fields":{"summary":"SELECT \"queue\".\"id\", \"queue\".\"created_at\", \"queue\".\"updated_at\", …","db.statement":"\n\nSELECT\n \"queue\".\"id\",\n \"queue\".\"created_at\",\n \"queue\".\"updated_at\",\n \"queue\".\"scheduled_at\",\n \"queue\".\"failure_count\",\n \"queue\".\"status\",\n \"queue\".\"job\",\n \"queue\".\"error_message\",\n \"queue\".\"parent_id\",\n \"queue\".\"child_id\"\nFROM\n \"queue\"\nWHERE\n \"queue\".\"status\" = $1\n AND (\n \"queue\".\"scheduled_at\" IS NULL\n OR \"queue\".\"scheduled_at\" < $2\n )\nORDER BY\n \"queue\".\"created_at\" ASC\nLIMIT\n $3 FOR\nUPDATE\n SKIP LOCKED\n","rows_affected":0,"rows_returned":1,"elapsed":"6.285577ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.772029Z","level":"INFO","fields":{"summary":"UPDATE \"queue\" SET \"updated_at\" …","db.statement":"\n\nUPDATE\n \"queue\"\nSET\n \"updated_at\" = $1,\n \"scheduled_at\" = $2,\n \"status\" = $3,\n \"job\" = $4,\n \"child_id\" = $5\nWHERE\n \"queue\".\"id\" = $6 RETURNING \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n","rows_affected":0,"rows_returned":1,"elapsed":"1.362883ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(2)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.772336Z","level":"INFO","fields":{"summary":"DELETE FROM \"queue\" WHERE …","db.statement":"\n\nDELETE FROM\n \"queue\"\nWHERE\n (job ->> 'type' = $1)\n AND \"queue\".\"scheduled_at\" > $2\n","rows_affected":0,"rows_returned":0,"elapsed":"317.043µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.773886Z","level":"INFO","fields":{"summary":"DELETE FROM \"queue\" WHERE …","db.statement":"\n\nDELETE FROM\n \"queue\"\nWHERE\n \"queue\".\"status\" = $1\n AND \"queue\".\"updated_at\" < $2\n","rows_affected":0,"rows_returned":0,"elapsed":"827.797µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.774551Z","level":"INFO","fields":{"summary":"COMMIT","db.statement":"","rows_affected":0,"rows_returned":0,"elapsed":"1.185381ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.776017Z","level":"INFO","fields":{"summary":"INSERT INTO \"queue\" (\"id\", …","db.statement":"\n\nINSERT INTO\n \"queue\" (\n \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n )\nVALUES\n ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10) RETURNING \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n","rows_affected":0,"rows_returned":1,"elapsed":"862.088µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(2)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.779113Z","level":"INFO","fields":{"summary":"SELECT \"queue\".\"id\", \"queue\".\"created_at\", \"queue\".\"updated_at\", …","db.statement":"\n\nSELECT\n \"queue\".\"id\",\n \"queue\".\"created_at\",\n \"queue\".\"updated_at\",\n \"queue\".\"scheduled_at\",\n \"queue\".\"failure_count\",\n \"queue\".\"status\",\n \"queue\".\"job\",\n \"queue\".\"error_message\",\n \"queue\".\"parent_id\",\n \"queue\".\"child_id\"\nFROM\n \"queue\"\nWHERE\n \"queue\".\"status\" = $1\n AND (\n \"queue\".\"scheduled_at\" IS NULL\n OR \"queue\".\"scheduled_at\" < $2\n )\nORDER BY\n \"queue\".\"created_at\" ASC\nLIMIT\n $3 FOR\nUPDATE\n SKIP LOCKED\n","rows_affected":0,"rows_returned":0,"elapsed":"296.293µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.779503Z","level":"INFO","fields":{"summary":"COMMIT","db.statement":"","rows_affected":0,"rows_returned":0,"elapsed":"111.334µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.780629Z","level":"INFO","fields":{"summary":"UPDATE \"queue\" SET \"updated_at\" …","db.statement":"\n\nUPDATE\n \"queue\"\nSET\n \"updated_at\" = $1,\n \"scheduled_at\" = $2,\n \"status\" = $3,\n \"job\" = $4,\n \"child_id\" = $5\nWHERE\n \"queue\".\"id\" = $6 RETURNING \"id\",\n \"created_at\",\n \"updated_at\",\n \"scheduled_at\",\n \"failure_count\",\n \"status\",\n \"job\",\n \"error_message\",\n \"parent_id\",\n \"child_id\"\n","rows_affected":0,"rows_returned":1,"elapsed":"2.175137ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.781107Z","level":"INFO","fields":{"summary":"COMMIT","db.statement":"","rows_affected":0,"rows_returned":0,"elapsed":"249.252µs"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.784352Z","level":"INFO","fields":{"summary":"SELECT \"queue\".\"id\", \"queue\".\"created_at\", \"queue\".\"updated_at\", …","db.statement":"\n\nSELECT\n \"queue\".\"id\",\n \"queue\".\"created_at\",\n \"queue\".\"updated_at\",\n \"queue\".\"scheduled_at\",\n \"queue\".\"failure_count\",\n \"queue\".\"status\",\n \"queue\".\"job\",\n \"queue\".\"error_message\",\n \"queue\".\"parent_id\",\n \"queue\".\"child_id\"\nFROM\n \"queue\"\nWHERE\n \"queue\".\"status\" = $1\n AND (\n \"queue\".\"scheduled_at\" IS NULL\n OR \"queue\".\"scheduled_at\" < $2\n )\nORDER BY\n \"queue\".\"created_at\" ASC\nLIMIT\n $3 FOR\nUPDATE\n SKIP LOCKED\n","rows_affected":0,"rows_returned":0,"elapsed":"2.247429ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
divviup_api-1 | {"timestamp":"2024-06-25T20:25:15.785767Z","level":"INFO","fields":{"summary":"COMMIT","db.statement":"","rows_affected":0,"rows_returned":0,"elapsed":"1.345257ms"},"target":"sqlx::query","filename":"/usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/sqlx-core-0.7.3/src/logger.rs","line_number":135,"threadId":"ThreadId(3)"}
janus_1_aggregator-1 | {"timestamp":"2024-06-25T20:25:15.826359Z","level":"INFO","fields":{"message":"Serving aggregator API relative to DAP API","aggregator_bound_address":"None","path_prefix":"aggregator-api"},"target":"janus_aggregator::binaries::aggregator","filename":"aggregator/src/binaries/aggregator.rs","line_number":109,"threadId":"ThreadId(1)"}
janus_1_aggregator-1 | {"timestamp":"2024-06-25T20:25:15.829008Z","level":"INFO","fields":{"message":"Running aggregator","aggregator_bound_address":"0.0.0.0:8080"},"target":"janus_aggregator::binaries::aggregator","filename":"aggregator/src/binaries/aggregator.rs","line_number":131,"threadId":"ThreadId(1)"}
dependency failed to start: container divviup-api-docker2-divviup_api-1 is unhealthy
Error: executing /usr/local/bin/docker-compose up: exit status 1
$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment