Skip to content

Instantly share code, notes, and snippets.

@starofsky

starofsky/Sentry 23.4.log

Created March 17, 2021 05:46
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save starofsky/90468293807adc0c64cad62197768899 to your computer and use it in GitHub Desktop.
Save starofsky/90468293807adc0c64cad62197768899 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Sentry 23.4.log
Starting sentry_onpremise_zookeeper_1 ... done
Starting sentry_onpremise_postgres_1 ... done
Starting sentry_onpremise_smtp_1 ... done
Starting sentry_onpremise_redis_1 ... done
Creating sentry_onpremise_geoipupdate_1 ... done
Starting sentry_onpremise_clickhouse_1 ... done
Creating sentry_onpremise_symbolicator-cleanup_1 ... done
Starting sentry_onpremise_symbolicator_1 ... done
Starting sentry_onpremise_memcached_1 ... done
Starting sentry_onpremise_kafka_1 ... done
Starting sentry_onpremise_snuba-subscription-consumer-events_1 ... done
Starting sentry_onpremise_snuba-api_1 ... done
Starting sentry_onpremise_snuba-transactions-consumer_1 ... done
Starting sentry_onpremise_snuba-consumer_1 ... done
Starting sentry_onpremise_snuba-replacer_1 ... done
Starting sentry_onpremise_snuba-outcomes-consumer_1 ... done
Creating sentry_onpremise_relay_1 ... done
Starting sentry_onpremise_snuba-sessions-consumer_1 ... done
Starting sentry_onpremise_snuba-subscription-consumer-transactions_1 ... done
Creating sentry_onpremise_snuba-cleanup_1 ... done
Creating sentry_onpremise_worker_1 ... done
Creating sentry_onpremise_subscription-consumer-events_1 ... done
Creating sentry_onpremise_sentry-cleanup_1 ... done
Creating sentry_onpremise_web_1 ... done
Creating sentry_onpremise_ingest-consumer_1 ... done
Creating sentry_onpremise_subscription-consumer-transactions_1 ... done
Creating sentry_onpremise_cron_1 ... done
Creating sentry_onpremise_post-process-forwarder_1 ... done
Creating sentry_onpremise_nginx_1 ... done
Attaching to sentry_onpremise_zookeeper_1, sentry_onpremise_postgres_1, sentry_onpremise_clickhouse_1, sentry_onpremise_geoipupdate_1, sentry_onpremise_memcached_1, sentry_onpremise_kafka_1, sentry_onpremise_smtp_1, sentry_onpremise_redis_1, sentry_onpremise_symbolicator-cleanup_1, sentry_onpremise_symbolicator_1, sentry_onpremise_snuba-transactions-consumer_1, sentry_onpremise_snuba-api_1, sentry_onpremise_relay_1, sentry_onpremise_snuba-consumer_1, sentry_onpremise_snuba-subscription-consumer-events_1, sentry_onpremise_snuba-sessions-consumer_1, sentry_onpremise_snuba-replacer_1, sentry_onpremise_snuba-subscription-consumer-transactions_1, sentry_onpremise_snuba-outcomes-consumer_1, sentry_onpremise_snuba-cleanup_1, sentry_onpremise_worker_1, sentry_onpremise_ingest-consumer_1, sentry_onpremise_subscription-consumer-events_1, sentry_onpremise_subscription-consumer-transactions_1, sentry_onpremise_cron_1, sentry_onpremise_web_1, sentry_onpremise_sentry-cleanup_1, sentry_onpremise_post-process-forwarder_1, sentry_onpremise_nginx_1
clickhouse_1 | Processing configuration file '/etc/clickhouse-server/config.xml'.
clickhouse_1 | Merging configuration file '/etc/clickhouse-server/config.d/docker_related_config.xml'.
clickhouse_1 | Merging configuration file '/etc/clickhouse-server/config.d/sentry.xml'.
clickhouse_1 | Include not found: clickhouse_remote_servers
clickhouse_1 | Include not found: clickhouse_compression
clickhouse_1 | Logging information to /var/log/clickhouse-server/clickhouse-server.log
clickhouse_1 | Logging errors to /var/log/clickhouse-server/clickhouse-server.err.log
clickhouse_1 | Logging information to console
clickhouse_1 | 2021.03.17 04:22:39.591706 [ 1 ] {} <Information> : Starting ClickHouse 20.3.9.70 with revision 54433
clickhouse_1 | 2021.03.17 04:22:39.599332 [ 1 ] {} <Information> Application: starting up
clickhouse_1 | Include not found: networks
clickhouse_1 | 2021.03.17 04:22:39.624985 [ 1 ] {} <Information> Application: Loading metadata from /var/lib/clickhouse/
clickhouse_1 | 2021.03.17 04:22:39.627078 [ 1 ] {} <Information> DatabaseOrdinary (system): Total 2 tables and 0 dictionaries.
clickhouse_1 | 2021.03.17 04:22:39.631904 [ 46 ] {} <Information> BackgroundProcessingPool: Create BackgroundProcessingPool with 16 threads
clickhouse_1 | 2021.03.17 04:22:39.715271 [ 1 ] {} <Information> DatabaseOrdinary (system): Starting up tables.
clickhouse_1 | 2021.03.17 04:22:39.857723 [ 1 ] {} <Information> DatabaseOrdinary (default): Total 13 tables and 0 dictionaries.
clickhouse_1 | 2021.03.17 04:22:39.919284 [ 1 ] {} <Information> DatabaseOrdinary (default): Starting up tables.
clickhouse_1 | 2021.03.17 04:22:39.921908 [ 1 ] {} <Information> BackgroundSchedulePool: Create BackgroundSchedulePool with 16 threads
clickhouse_1 | 2021.03.17 04:22:39.922381 [ 1 ] {} <Information> Application: It looks like the process has no CAP_NET_ADMIN capability, 'taskstats' performance statistics will be disabled. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_net_admin=+ep /usr/bin/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems. It also doesn't work if you run clickhouse-server inside network namespace as it happens in some containers.
clickhouse_1 | 2021.03.17 04:22:39.922418 [ 1 ] {} <Information> Application: It looks like the process has no CAP_SYS_NICE capability, the setting 'os_thread_nice' will have no effect. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_sys_nice=+ep /usr/bin/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems.
clickhouse_1 | 2021.03.17 04:22:40.027287 [ 1 ] {} <Error> Application: Listen [::]:8123 failed: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = DNS error: EAI: -9 (version 20.3.9.70 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0</listen_host> . Example for disabled IPv4: <listen_host>::</listen_host>
clickhouse_1 | 2021.03.17 04:22:40.077936 [ 1 ] {} <Error> Application: Listen [::]:9000 failed: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = DNS error: EAI: -9 (version 20.3.9.70 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0</listen_host> . Example for disabled IPv4: <listen_host>::</listen_host>
clickhouse_1 | 2021.03.17 04:22:40.078548 [ 1 ] {} <Error> Application: Listen [::]:9009 failed: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = DNS error: EAI: -9 (version 20.3.9.70 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0</listen_host> . Example for disabled IPv4: <listen_host>::</listen_host>
clickhouse_1 | 2021.03.17 04:22:40.078795 [ 1 ] {} <Error> Application: Listen [::]:9004 failed: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = DNS error: EAI: -9 (version 20.3.9.70 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0</listen_host> . Example for disabled IPv4: <listen_host>::</listen_host>
clickhouse_1 | 2021.03.17 04:22:40.079950 [ 1 ] {} <Information> Application: Listening for http://0.0.0.0:8123
clickhouse_1 | 2021.03.17 04:22:40.080041 [ 1 ] {} <Information> Application: Listening for connections with native protocol (tcp): 0.0.0.0:9000
clickhouse_1 | 2021.03.17 04:22:40.080098 [ 1 ] {} <Information> Application: Listening for replica communication (interserver): http://0.0.0.0:9009
clickhouse_1 | 2021.03.17 04:22:40.468037 [ 1 ] {} <Information> Application: Listening for MySQL compatibility protocol: 0.0.0.0:9004
clickhouse_1 | 2021.03.17 04:22:40.468688 [ 1 ] {} <Information> Application: Available RAM: 31.41 GiB; physical cores: 3; logical cores: 6.
clickhouse_1 | 2021.03.17 04:22:40.468714 [ 1 ] {} <Information> Application: Ready for connections.
clickhouse_1 | Include not found: clickhouse_remote_servers
clickhouse_1 | Include not found: clickhouse_compression
geoipupdate_1 | error loading configuration file /sentry/GeoIP.conf: error opening file: open /sentry/GeoIP.conf: no such file or directory
kafka_1 | ===> ENV Variables ...
kafka_1 | ALLOW_UNSIGNED=false
kafka_1 | COMPONENT=kafka
kafka_1 | CONFLUENT_DEB_VERSION=1
kafka_1 | CONFLUENT_PLATFORM_LABEL=
kafka_1 | CONFLUENT_SUPPORT_METRICS_ENABLE=false
kafka_1 | CONFLUENT_VERSION=5.5.0
kafka_1 | CUB_CLASSPATH=/etc/confluent/docker/docker-utils.jar
kafka_1 | HOME=/root
kafka_1 | HOSTNAME=153981ae9a31
kafka_1 | KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://kafka:9092
kafka_1 | KAFKA_LOG4J_LOGGERS=kafka.cluster=WARN,kafka.controller=WARN,kafka.coordinator=WARN,kafka.log=WARN,kafka.server=WARN,kafka.zookeeper=WARN,state.change.logger=WARN
kafka_1 | KAFKA_LOG4J_ROOT_LOGLEVEL=WARN
kafka_1 | KAFKA_LOG_RETENTION_HOURS=24
kafka_1 | KAFKA_MAX_REQUEST_SIZE=50000000
kafka_1 | KAFKA_MESSAGE_MAX_BYTES=50000000
kafka_1 | KAFKA_OFFSETS_TOPIC_NUM_PARTITIONS=1
kafka_1 | KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR=1
kafka_1 | KAFKA_TOOLS_LOG4J_LOGLEVEL=WARN
kafka_1 | KAFKA_VERSION=
kafka_1 | KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181
kafka_1 | LANG=C.UTF-8
kafka_1 | PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
kafka_1 | PWD=/
kafka_1 | PYTHON_PIP_VERSION=8.1.2
kafka_1 | PYTHON_VERSION=2.7.9-1
kafka_1 | SCALA_VERSION=2.12
kafka_1 | SHLVL=1
kafka_1 | ZULU_OPENJDK_VERSION=8=8.38.0.13
kafka_1 | _=/usr/bin/env
kafka_1 | ===> User
kafka_1 | uid=0(root) gid=0(root) groups=0(root)
sentry_onpremise_geoipupdate_1 exited with code 1
kafka_1 | ===> Configuring ...
kafka_1 | ===> Running preflight checks ...
kafka_1 | ===> Check if /var/lib/kafka/data is writable ...
postgres_1 |
postgres_1 | PostgreSQL Database directory appears to contain a database; Skipping initialization
postgres_1 |
postgres_1 | LOG: database system was shut down at 2021-03-17 04:22:19 UTC
postgres_1 | LOG: MultiXact member wraparound protections are now enabled
postgres_1 | LOG: database system is ready to accept connections
postgres_1 | LOG: autovacuum launcher started
redis_1 | 1:C 17 Mar 2021 04:22:40.383 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
redis_1 | 1:C 17 Mar 2021 04:22:40.383 # Redis version=5.0.12, bits=64, commit=00000000, modified=0, pid=1, just started
redis_1 | 1:C 17 Mar 2021 04:22:40.383 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
redis_1 | 1:M 17 Mar 2021 04:22:40.385 * Running mode=standalone, port=6379.
redis_1 | 1:M 17 Mar 2021 04:22:40.385 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
redis_1 | 1:M 17 Mar 2021 04:22:40.385 # Server initialized
redis_1 | 1:M 17 Mar 2021 04:22:40.385 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
redis_1 | 1:M 17 Mar 2021 04:22:40.386 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
redis_1 | 1:M 17 Mar 2021 04:22:40.405 * DB loaded from disk: 0.019 seconds
redis_1 | 1:M 17 Mar 2021 04:22:40.405 * Ready to accept connections
relay_1 | 2021-03-17T04:22:43Z [rdkafka::client] ERROR: librdkafka: FAIL [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 15ms in state CONNECT)
relay_1 | 2021-03-17T04:22:43Z [rdkafka::client] ERROR: librdkafka: Global error: BrokerTransportFailure (Local: Broker transport failure): kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 15ms in state CONNECT)
relay_1 | 2021-03-17T04:22:43Z [rdkafka::client] ERROR: librdkafka: Global error: AllBrokersDown (Local: All broker connections are down): 1/1 brokers are down
relay_1 | 2021-03-17T04:22:43Z [rdkafka::client] ERROR: librdkafka: FAIL [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 1ms in state CONNECT)
relay_1 | 2021-03-17T04:22:43Z [rdkafka::client] ERROR: librdkafka: Global error: BrokerTransportFailure (Local: Broker transport failure): kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 1ms in state CONNECT)
relay_1 | 2021-03-17T04:22:43Z [rdkafka::client] ERROR: librdkafka: Global error: AllBrokersDown (Local: All broker connections are down): 1/1 brokers are down
relay_1 | 2021-03-17T04:22:43Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-17T04:22:43Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-17T04:22:44Z [rdkafka::client] ERROR: librdkafka: FAIL [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
relay_1 | 2021-03-17T04:22:44Z [rdkafka::client] ERROR: librdkafka: Global error: BrokerTransportFailure (Local: Broker transport failure): kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
relay_1 | 2021-03-17T04:22:44Z [rdkafka::client] ERROR: librdkafka: FAIL [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
relay_1 | 2021-03-17T04:22:44Z [rdkafka::client] ERROR: librdkafka: Global error: BrokerTransportFailure (Local: Broker transport failure): kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
relay_1 | 2021-03-17T04:22:44Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-17T04:22:46Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-17T04:22:48Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-17T04:22:51Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
sentry-cleanup_1 | SHELL=/bin/bash
sentry-cleanup_1 | BASH_ENV=/container.env
sentry-cleanup_1 | 0 0 * * * gosu sentry sentry cleanup --days 90 > /proc/1/fd/1 2>/proc/1/fd/2
smtp_1 | + sed -ri '
smtp_1 | s/^#?(dc_local_interfaces)=.*/\1='\''0.0.0.0 ; ::0'\''/;
smtp_1 | s/^#?(dc_other_hostnames)=.*/\1='\'''\''/;
smtp_1 | s/^#?(dc_relay_nets)=.*/\1='\''0.0.0.0\/0'\''/;
smtp_1 | s/^#?(dc_eximconfig_configtype)=.*/\1='\''internet'\''/;
smtp_1 | ' /etc/exim4/update-exim4.conf.conf
smtp_1 | + update-exim4.conf -v
smtp_1 | using non-split configuration scheme from /etc/exim4/exim4.conf.template
smtp_1 | 269 LOG: MAIN
smtp_1 | 269 exim 4.92 daemon started: pid=269, no queue runs, listening for SMTP on port 25 (IPv6 and IPv4)
snuba-api_1 | + '[' a = - ']'
snuba-api_1 | + snuba api --help
snuba-api_1 | + set -- snuba api
snuba-api_1 | + set gosu snuba snuba api
snuba-api_1 | + exec gosu snuba snuba api
snuba-cleanup_1 | SHELL=/bin/bash
snuba-cleanup_1 | BASH_ENV=/container.env
snuba-cleanup_1 | */5 * * * * gosu snuba snuba cleanup --dry-run False > /proc/1/fd/1 2>/proc/1/fd/2
snuba-consumer_1 | + '[' c = - ']'
snuba-consumer_1 | + snuba consumer --help
snuba-consumer_1 | + set -- snuba consumer --storage events --auto-offset-reset=latest --max-batch-time-ms 750
snuba-consumer_1 | + set gosu snuba snuba consumer --storage events --auto-offset-reset=latest --max-batch-time-ms 750
snuba-consumer_1 | + exec gosu snuba snuba consumer --storage events --auto-offset-reset=latest --max-batch-time-ms 750
snuba-replacer_1 | + '[' r = - ']'
snuba-replacer_1 | + snuba replacer --help
snuba-replacer_1 | + set -- snuba replacer --storage events --auto-offset-reset=latest --max-batch-size 3
snuba-replacer_1 | + set gosu snuba snuba replacer --storage events --auto-offset-reset=latest --max-batch-size 3
snuba-replacer_1 | + exec gosu snuba snuba replacer --storage events --auto-offset-reset=latest --max-batch-size 3
snuba-sessions-consumer_1 | + '[' c = - ']'
snuba-sessions-consumer_1 | + snuba consumer --help
snuba-sessions-consumer_1 | + set -- snuba consumer --storage sessions_raw --auto-offset-reset=latest --max-batch-time-ms 750
snuba-sessions-consumer_1 | + set gosu snuba snuba consumer --storage sessions_raw --auto-offset-reset=latest --max-batch-time-ms 750
snuba-sessions-consumer_1 | + exec gosu snuba snuba consumer --storage sessions_raw --auto-offset-reset=latest --max-batch-time-ms 750
snuba-subscription-consumer-events_1 | + '[' s = - ']'
snuba-subscription-consumer-events_1 | + snuba subscriptions --help
snuba-subscription-consumer-events_1 | + set -- snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-events-subscriptions-consumers --topic=events --result-topic=events-subscription-results --dataset=events --commit-log-topic=snuba-commit-log --commit-log-group=snuba-consumers --delay-seconds=60 --schedule-ttl=60
snuba-subscription-consumer-events_1 | + set gosu snuba snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-events-subscriptions-consumers --topic=events --result-topic=events-subscription-results --dataset=events --commit-log-topic=snuba-commit-log --commit-log-group=snuba-consumers --delay-seconds=60 --schedule-ttl=60
snuba-subscription-consumer-events_1 | + exec gosu snuba snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-events-subscriptions-consumers --topic=events --result-topic=events-subscription-results --dataset=events --commit-log-topic=snuba-commit-log --commit-log-group=snuba-consumers --delay-seconds=60 --schedule-ttl=60
snuba-subscription-consumer-transactions_1 | + '[' s = - ']'
snuba-subscription-consumer-transactions_1 | + snuba subscriptions --help
snuba-subscription-consumer-transactions_1 | + set -- snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-transactions-subscriptions-consumers --topic=events --result-topic=transactions-subscription-results --dataset=transactions --commit-log-topic=snuba-commit-log --commit-log-group=transactions_group --delay-seconds=60 --schedule-ttl=60
snuba-subscription-consumer-transactions_1 | + set gosu snuba snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-transactions-subscriptions-consumers --topic=events --result-topic=transactions-subscription-results --dataset=transactions --commit-log-topic=snuba-commit-log --commit-log-group=transactions_group --delay-seconds=60 --schedule-ttl=60
snuba-subscription-consumer-transactions_1 | + exec gosu snuba snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-transactions-subscriptions-consumers --topic=events --result-topic=transactions-subscription-results --dataset=transactions --commit-log-topic=snuba-commit-log --commit-log-group=transactions_group --delay-seconds=60 --schedule-ttl=60
snuba-outcomes-consumer_1 | + '[' c = - ']'
snuba-outcomes-consumer_1 | + snuba consumer --help
snuba-transactions-consumer_1 | + '[' c = - ']'
snuba-transactions-consumer_1 | + snuba consumer --help
snuba-transactions-consumer_1 | + set -- snuba consumer --storage transactions --consumer-group transactions_group --auto-offset-reset=latest --max-batch-time-ms 750 --commit-log-topic=snuba-commit-log
snuba-transactions-consumer_1 | + set gosu snuba snuba consumer --storage transactions --consumer-group transactions_group --auto-offset-reset=latest --max-batch-time-ms 750 --commit-log-topic=snuba-commit-log
snuba-transactions-consumer_1 | + exec gosu snuba snuba consumer --storage transactions --consumer-group transactions_group --auto-offset-reset=latest --max-batch-time-ms 750 --commit-log-topic=snuba-commit-log
symbolicator-cleanup_1 | SHELL=/bin/bash
symbolicator-cleanup_1 | BASH_ENV=/container.env
symbolicator-cleanup_1 | 55 23 * * * gosu symbolicator symbolicator cleanup > /proc/1/fd/1 2>/proc/1/fd/2
zookeeper_1 | ===> ENV Variables ...
zookeeper_1 | ALLOW_UNSIGNED=false
zookeeper_1 | COMPONENT=zookeeper
zookeeper_1 | CONFLUENT_DEB_VERSION=1
zookeeper_1 | CONFLUENT_PLATFORM_LABEL=
zookeeper_1 | CONFLUENT_SUPPORT_METRICS_ENABLE=false
zookeeper_1 | CONFLUENT_VERSION=5.5.0
zookeeper_1 | CUB_CLASSPATH=/etc/confluent/docker/docker-utils.jar
zookeeper_1 | HOME=/root
zookeeper_1 | HOSTNAME=0fa561f7a2ad
zookeeper_1 | KAFKA_VERSION=
zookeeper_1 | LANG=C.UTF-8
zookeeper_1 | PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
zookeeper_1 | PWD=/
zookeeper_1 | PYTHON_PIP_VERSION=8.1.2
zookeeper_1 | PYTHON_VERSION=2.7.9-1
zookeeper_1 | SCALA_VERSION=2.12
zookeeper_1 | SHLVL=1
zookeeper_1 | ZOOKEEPER_CLIENT_PORT=2181
zookeeper_1 | ZOOKEEPER_LOG4J_ROOT_LOGLEVEL=WARN
zookeeper_1 | ZOOKEEPER_TOOLS_LOG4J_LOGLEVEL=WARN
zookeeper_1 | ZULU_OPENJDK_VERSION=8=8.38.0.13
zookeeper_1 | _=/usr/bin/env
zookeeper_1 | ===> User
zookeeper_1 | uid=0(root) gid=0(root) groups=0(root)
zookeeper_1 | ===> Configuring ...
zookeeper_1 | ===> Running preflight checks ...
zookeeper_1 | ===> Check if /var/lib/zookeeper/data is writable ...
zookeeper_1 | ===> Check if /var/lib/zookeeper/log is writable ...
zookeeper_1 | ===> Launching ...
zookeeper_1 | ===> Launching zookeeper ...
zookeeper_1 | [2021-03-17 04:22:51,524] WARN Either no config or no quorum defined in config, running in standalone mode (org.apache.zookeeper.server.quorum.QuorumPeerMain)
zookeeper_1 | [2021-03-17 04:22:54,473] WARN o.e.j.s.ServletContextHandler@4d95d2a2{/,null,UNAVAILABLE} contextPath ends with /* (org.eclipse.jetty.server.handler.ContextHandler)
zookeeper_1 | [2021-03-17 04:22:54,473] WARN Empty contextPath (org.eclipse.jetty.server.handler.ContextHandler)
snuba-outcomes-consumer_1 | + set -- snuba consumer --storage outcomes_raw --auto-offset-reset=earliest --max-batch-time-ms 750
snuba-outcomes-consumer_1 | + set gosu snuba snuba consumer --storage outcomes_raw --auto-offset-reset=earliest --max-batch-time-ms 750
snuba-outcomes-consumer_1 | + exec gosu snuba snuba consumer --storage outcomes_raw --auto-offset-reset=earliest --max-batch-time-ms 750
kafka_1 | ===> Check if Zookeeper is healthy ...
snuba-transactions-consumer_1 | %3|1615954976.956|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 3ms in state CONNECT)
snuba-transactions-consumer_1 | %3|1615954976.971|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 3ms in state CONNECT)
relay_1 | 2021-03-17T04:22:57Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 0ns
relay_1 | 2021-03-17T04:22:57Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-17T04:22:57Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 1s
snuba-transactions-consumer_1 | %3|1615954977.952|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
snuba-transactions-consumer_1 | %3|1615954977.959|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
relay_1 | 2021-03-17T04:22:58Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 1.5s
snuba-api_1 | *** Starting uWSGI 2.0.18 (64bit) on [Wed Mar 17 04:22:58 2021] ***
snuba-api_1 | compiled with version: 8.3.0 on 15 March 2021 15:25:59
snuba-api_1 | os: Linux-4.18.0-1015-gcp #16-Ubuntu SMP Tue Jun 25 15:10:06 UTC 2019
snuba-api_1 | nodename: 52d3c0509986
snuba-api_1 | machine: x86_64
snuba-api_1 | clock source: unix
snuba-api_1 | pcre jit disabled
snuba-api_1 | detected number of CPU cores: 6
snuba-api_1 | current working directory: /usr/src/snuba
snuba-api_1 | detected binary path: /usr/local/bin/uwsgi
snuba-api_1 | your memory page size is 4096 bytes
snuba-api_1 | detected max file descriptor number: 1048576
snuba-api_1 | lock engine: pthread robust mutexes
snuba-api_1 | thunder lock: enabled
snuba-api_1 | uwsgi socket 0 bound to TCP address 0.0.0.0:1218 fd 3
snuba-api_1 | Python version: 3.8.8 (default, Mar 12 2021, 19:44:18) [GCC 8.3.0]
snuba-api_1 | Set PythonHome to /usr/local
snuba-api_1 | Python main interpreter initialized at 0x56023ddc7bd0
snuba-api_1 | python threads support enabled
snuba-api_1 | your server socket listen backlog is limited to 100 connections
snuba-api_1 | your mercy for graceful operations on workers is 60 seconds
snuba-api_1 | mapped 145808 bytes (142 KB) for 1 cores
snuba-api_1 | *** Operational MODE: single process ***
snuba-api_1 | initialized 38 metrics
snuba-api_1 | spawned uWSGI master process (pid: 1)
snuba-api_1 | spawned uWSGI worker 1 (pid: 14, cores: 1)
snuba-api_1 | metrics collector thread started
relay_1 | 2021-03-17T04:22:59Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 2.25s
snuba-sessions-consumer_1 | %3|1615954979.891|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 7ms in state CONNECT)
snuba-sessions-consumer_1 | %3|1615954979.891|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 5ms in state CONNECT)
snuba-consumer_1 | %3|1615954979.976|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 1ms in state CONNECT)
snuba-consumer_1 | %3|1615954979.977|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 1ms in state CONNECT)
nginx_1 | 2021/03/17 04:23:00 [error] 6#6: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 192.168.64.1, server: , request: "POST /api/0/relays/register/challenge/ HTTP/1.1", upstream: "http://192.168.64.25:9000/api/0/relays/register/challenge/", host: "127.0.0.1"
nginx_1 | 192.168.64.1 - - [17/Mar/2021:04:23:00 +0000] "POST /api/0/relays/register/challenge/ HTTP/1.1" 502 150 "-" "-" "-"
snuba-replacer_1 | %3|1615954980.761|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 9ms in state CONNECT)
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/10/2020 11:30 GMT
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=153981ae9a31
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_212
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Azul Systems, Inc.
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/zulu-8-amd64/jre
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/etc/confluent/docker/docker-utils.jar
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=4.18.0-1015-gcp
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.free=477MB
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.max=7148MB
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.total=483MB
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=zookeeper:2181 sessionTimeout=40000 watcher=io.confluent.admin.utils.ZookeeperConnectionWatcher@cc34f4d
kafka_1 | [main] INFO org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
snuba-sessions-consumer_1 | %3|1615954980.876|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
snuba-sessions-consumer_1 | %3|1615954980.885|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
kafka_1 | [main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 4194304 Bytes
snuba-consumer_1 | %3|1615954980.934|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
kafka_1 | [main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=
snuba-consumer_1 | %3|1615954980.976|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
kafka_1 | [main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server zookeeper/192.168.64.2:2181. Will not attempt to authenticate using SASL (unknown error)
snuba-subscription-consumer-events_1 | %3|1615954981.115|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 3ms in state CONNECT)
kafka_1 | [main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /192.168.64.11:33398, server: zookeeper/192.168.64.2:2181
kafka_1 | [main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server zookeeper/192.168.64.2:2181, sessionid = 0x100406b06040000, negotiated timeout = 40000
snuba-replacer_1 | %3|1615954981.755|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
relay_1 | 2021-03-17T04:23:01Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 3.375s
kafka_1 | [main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x100406b06040000 closed
kafka_1 | ===> Launching ...
kafka_1 | ===> Launching kafka ...
snuba-subscription-consumer-events_1 | %3|1615954982.103|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 8ms in state CONNECT)
snuba-subscription-consumer-events_1 | %3|1615954982.103|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
snuba-subscription-consumer-transactions_1 | %3|1615954982.631|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 12ms in state CONNECT)
snuba-outcomes-consumer_1 | %3|1615954982.771|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 5ms in state CONNECT)
snuba-outcomes-consumer_1 | %3|1615954982.773|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT)
snuba-subscription-consumer-events_1 | %3|1615954983.095|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
snuba-subscription-consumer-transactions_1 | %3|1615954983.619|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 24ms in state CONNECT)
snuba-subscription-consumer-transactions_1 | %3|1615954983.631|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
snuba-outcomes-consumer_1 | %3|1615954983.772|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
snuba-outcomes-consumer_1 | %3|1615954983.788|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 10ms in state CONNECT, 1 identical error(s) suppressed)
snuba-api_1 | WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56023ddc7bd0 pid: 14 (default app)
snuba-subscription-consumer-transactions_1 | %3|1615954984.599|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
relay_1 | 2021-03-17T04:23:04Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-17T04:23:05Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 5.0625s
kafka_1 | [2021-03-17 04:23:05,349] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$)
kafka_1 | [2021-03-17 04:23:08,295] WARN The package io.confluent.support.metrics.collectors.FullCollector for collecting the full set of support metrics could not be loaded, so we are reverting to anonymous, basic metric collection. If you are a Confluent customer, please refer to the Confluent Platform documentation, section Proactive Support, on how to activate full metrics collection. (io.confluent.support.metrics.KafkaSupportConfig)
kafka_1 | [2021-03-17 04:23:08,296] WARN The support metrics collection feature ("Metrics") of Proactive Support is disabled. (io.confluent.support.metrics.SupportedServerStartable)
subscription-consumer-events_1 | 04:23:09 [INFO] sentry.plugins.github: apps-not-configured
ingest-consumer_1 | 04:23:09 [INFO] sentry.plugins.github: apps-not-configured
worker_1 | 04:23:09 [INFO] sentry.plugins.github: apps-not-configured
subscription-consumer-transactions_1 | 04:23:09 [INFO] sentry.plugins.github: apps-not-configured
subscription-consumer-events_1 | %3|1615954990.035|FAIL|rdkafka#producer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT)
relay_1 | 2021-03-17T04:23:10Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 7.59375s
ingest-consumer_1 | %3|1615954990.552|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT)
post-process-forwarder_1 | 04:23:10 [INFO] sentry.plugins.github: apps-not-configured
cron_1 | 04:23:10 [INFO] sentry.plugins.github: apps-not-configured
worker_1 | 04:23:10 [INFO] sentry.bgtasks: bgtask.spawn (task_name='sentry.bgtasks.clean_dsymcache:clean_dsymcache')
worker_1 | 04:23:10 [INFO] sentry.bgtasks: bgtask.spawn (task_name='sentry.bgtasks.clean_releasefilecache:clean_releasefilecache')
subscription-consumer-transactions_1 | %3|1615954990.783|FAIL|rdkafka#producer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 6ms in state CONNECT)
subscription-consumer-events_1 | %3|1615954991.011|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 1ms in state CONNECT)
subscription-consumer-events_1 | %3|1615954991.039|FAIL|rdkafka#producer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
web_1 | 04:23:11 [INFO] sentry.plugins.github: apps-not-configured
post-process-forwarder_1 | %3|1615954991.199|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 4ms in state CONNECT)
post-process-forwarder_1 | %3|1615954991.227|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 3ms in state CONNECT)
web_1 | *** Starting uWSGI 2.0.19.1 (64bit) on [Wed Mar 17 04:23:11 2021] ***
web_1 | compiled with version: 8.3.0 on 16 March 2021 19:59:25
web_1 | os: Linux-4.18.0-1015-gcp #16-Ubuntu SMP Tue Jun 25 15:10:06 UTC 2019
web_1 | nodename: b953a41553dd
web_1 | machine: x86_64
web_1 | clock source: unix
web_1 | detected number of CPU cores: 6
web_1 | current working directory: /
web_1 | detected binary path: /usr/local/bin/uwsgi
web_1 | !!! no internal routing support, rebuild with pcre support !!!
web_1 | your memory page size is 4096 bytes
web_1 | detected max file descriptor number: 1048576
web_1 | lock engine: pthread robust mutexes
web_1 | thunder lock: enabled
web_1 | uWSGI http bound on 0.0.0.0:9000 fd 4
web_1 | uwsgi socket 0 bound to TCP address 127.0.0.1:46713 (port auto-assigned) fd 3
web_1 | Python version: 3.6.13 (default, Mar 12 2021, 21:13:53) [GCC 8.3.0]
web_1 | Set PythonHome to /usr/local
ingest-consumer_1 | %3|1615954991.555|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
web_1 | Python main interpreter initialized at 0x55c65a1a4ec0
web_1 | python threads support enabled
web_1 | your server socket listen backlog is limited to 100 connections
web_1 | your mercy for graceful operations on workers is 60 seconds
web_1 | setting request body buffering size to 65536 bytes
web_1 | mapped 1924224 bytes (1879 KB) for 12 cores
web_1 | *** Operational MODE: preforking+threaded ***
web_1 | spawned uWSGI master process (pid: 20)
web_1 | spawned uWSGI worker 1 (pid: 24, cores: 4)
web_1 | spawned uWSGI worker 2 (pid: 25, cores: 4)
web_1 | spawned uWSGI worker 3 (pid: 26, cores: 4)
web_1 | spawned uWSGI http 1 (pid: 27)
subscription-consumer-transactions_1 | %3|1615954991.779|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT)
subscription-consumer-transactions_1 | %3|1615954991.797|FAIL|rdkafka#producer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 4ms in state CONNECT, 1 identical error(s) suppressed)
subscription-consumer-events_1 | %3|1615954992.018|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
post-process-forwarder_1 | %3|1615954992.195|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
post-process-forwarder_1 | %3|1615954992.215|FAIL|rdkafka#consumer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
kafka_1 | [2021-03-17 04:23:12,304] INFO Starting the log cleaner (kafka.log.LogCleaner)
kafka_1 | [2021-03-17 04:23:12,482] INFO [kafka-log-cleaner-thread-0]: Starting (kafka.log.LogCleaner)
worker_1 |
worker_1 | -------------- celery@96d30acc7cf4 v4.4.7 (cliffs)
worker_1 | --- ***** -----
worker_1 | -- ******* ---- Linux-4.18.0-1015-gcp-x86_64-with-debian-10.8 2021-03-17 04:23:12
worker_1 | - *** --- * ---
worker_1 | - ** ---------- [config]
worker_1 | - ** ---------- .> app: sentry:0x7f86ea5dc780
worker_1 | - ** ---------- .> transport: redis://redis:6379/0
worker_1 | - ** ---------- .> results: disabled://
worker_1 | - *** --- * --- .> concurrency: 6 (prefork)
worker_1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker_1 | --- ***** -----
worker_1 | -------------- [queues]
worker_1 | .> activity.notify exchange=default(direct) key=activity.notify
worker_1 | .> alerts exchange=default(direct) key=alerts
worker_1 | .> app_platform exchange=default(direct) key=app_platform
worker_1 | .> assemble exchange=default(direct) key=assemble
worker_1 | .> auth exchange=default(direct) key=auth
worker_1 | .> buffers.process_pending exchange=default(direct) key=buffers.process_pending
worker_1 | .> cleanup exchange=default(direct) key=cleanup
worker_1 | .> commits exchange=default(direct) key=commits
worker_1 | .> counters-0 exchange=counters(direct) key=default
worker_1 | .> data_export exchange=default(direct) key=data_export
worker_1 | .> default exchange=default(direct) key=default
worker_1 | .> digests.delivery exchange=default(direct) key=digests.delivery
worker_1 | .> digests.scheduling exchange=default(direct) key=digests.scheduling
worker_1 | .> email exchange=default(direct) key=email
worker_1 | .> events.preprocess_event exchange=default(direct) key=events.preprocess_event
worker_1 | .> events.process_event exchange=default(direct) key=events.process_event
worker_1 | .> events.reprocess_events exchange=default(direct) key=events.reprocess_events
worker_1 | .> events.reprocessing.preprocess_event exchange=default(direct) key=events.reprocessing.preprocess_event
worker_1 | .> events.reprocessing.process_event exchange=default(direct) key=events.reprocessing.process_event
worker_1 | .> events.reprocessing.symbolicate_event exchange=default(direct) key=events.reprocessing.symbolicate_event
worker_1 | .> events.save_event exchange=default(direct) key=events.save_event
worker_1 | .> events.symbolicate_event exchange=default(direct) key=events.symbolicate_event
worker_1 | .> files.delete exchange=default(direct) key=files.delete
worker_1 | .> group_owners.process_suspect_commits exchange=default(direct) key=group_owners.process_suspect_commits
worker_1 | .> incident_snapshots exchange=default(direct) key=incident_snapshots
worker_1 | .> incidents exchange=default(direct) key=incidents
worker_1 | .> integrations exchange=default(direct) key=integrations
worker_1 | .> merge exchange=default(direct) key=merge
worker_1 | .> options exchange=default(direct) key=options
worker_1 | .> relay_config exchange=default(direct) key=relay_config
worker_1 | .> reports.deliver exchange=default(direct) key=reports.deliver
worker_1 | .> reports.prepare exchange=default(direct) key=reports.prepare
worker_1 | .> search exchange=default(direct) key=search
worker_1 | .> sleep exchange=default(direct) key=sleep
worker_1 | .> stats exchange=default(direct) key=stats
worker_1 | .> subscriptions exchange=default(direct) key=subscriptions
worker_1 | .> triggers-0 exchange=triggers(direct) key=default
worker_1 | .> unmerge exchange=default(direct) key=unmerge
worker_1 | .> update exchange=default(direct) key=update
worker_1 |
subscription-consumer-transactions_1 | %3|1615954992.774|FAIL|rdkafka#consumer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.64.11:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
kafka_1 | [2021-03-17 04:23:13,323] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor)
kafka_1 | [2021-03-17 04:23:13,429] INFO [SocketServer brokerId=1001] Created data-plane acceptor and processors for endpoint : EndPoint(0.0.0.0,9092,ListenerName(PLAINTEXT),PLAINTEXT) (kafka.network.SocketServer)
kafka_1 | [2021-03-17 04:23:13,433] INFO [SocketServer brokerId=1001] Started 1 acceptor threads for data-plane (kafka.network.SocketServer)
kafka_1 | [2021-03-17 04:23:13,893] INFO Creating /brokers/ids/1001 (is it secure? false) (kafka.zk.KafkaZkClient)
kafka_1 | [2021-03-17 04:23:13,953] INFO Stat of the created znode at /brokers/ids/1001 is: 247,247,1615954993920,1615954993920,1,0,0,72128422444531713,180,0,247
kafka_1 | (kafka.zk.KafkaZkClient)
kafka_1 | [2021-03-17 04:23:13,954] INFO Registered broker 1001 at path /brokers/ids/1001 with addresses: ArrayBuffer(EndPoint(kafka,9092,ListenerName(PLAINTEXT),PLAINTEXT)), czxid (broker epoch): 247 (kafka.zk.KafkaZkClient)
kafka_1 | [2021-03-17 04:23:15,047] INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread)
kafka_1 | [2021-03-17 04:23:15,552] INFO [SocketServer brokerId=1001] Started data-plane processors for 1 acceptors (kafka.network.SocketServer)
subscription-consumer-transactions_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'transactions-subscription-results' or its partitions are not ready, retrying...
ingest-consumer_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'ingest-transactions' or its partitions are not ready, retrying...
relay_1 | 2021-03-17T04:23:16Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
subscription-consumer-events_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'events-subscription-results' or its partitions are not ready, retrying...
subscription-consumer-transactions_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'transactions-subscription-results' or its partitions are not ready, retrying...
ingest-consumer_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'ingest-transactions' or its partitions are not ready, retrying...
subscription-consumer-events_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'events-subscription-results' or its partitions are not ready, retrying...
subscription-consumer-transactions_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'transactions-subscription-results' or its partitions are not ready, retrying...
ingest-consumer_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'ingest-transactions' or its partitions are not ready, retrying...
subscription-consumer-events_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'events-subscription-results' or its partitions are not ready, retrying...
subscription-consumer-transactions_1 | 04:23:16 [WARNING] batching-kafka-consumer: Topic 'transactions-subscription-results' or its partitions are not ready, retrying...
snuba-subscription-consumer-transactions_1 | Traceback (most recent call last):
snuba-subscription-consumer-transactions_1 | File "/usr/local/bin/snuba", line 33, in <module>
snuba-subscription-consumer-transactions_1 | sys.exit(load_entry_point('snuba', 'console_scripts', 'snuba')())
snuba-subscription-consumer-transactions_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 829, in __call__
snuba-subscription-consumer-transactions_1 | return self.main(*args, **kwargs)
snuba-subscription-consumer-transactions_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 782, in main
snuba-subscription-consumer-transactions_1 | rv = self.invoke(ctx)
snuba-subscription-consumer-transactions_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
snuba-subscription-consumer-transactions_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
snuba-subscription-consumer-transactions_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
snuba-subscription-consumer-transactions_1 | return ctx.invoke(self.callback, **ctx.params)
snuba-subscription-consumer-transactions_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 610, in invoke
snuba-subscription-consumer-transactions_1 | return callback(*args, **kwargs)
snuba-subscription-consumer-transactions_1 | File "/usr/src/snuba/snuba/cli/subscriptions.py", line 138, in subscriptions
snuba-subscription-consumer-transactions_1 | SynchronizedConsumer(
snuba-subscription-consumer-transactions_1 | File "/usr/src/snuba/snuba/utils/streams/synchronized.py", line 106, in __init__
snuba-subscription-consumer-transactions_1 | self.__commit_log_worker.result()
snuba-subscription-consumer-transactions_1 | File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 432, in result
snuba-subscription-consumer-transactions_1 | return self.__get_result()
snuba-subscription-consumer-transactions_1 | File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
snuba-subscription-consumer-transactions_1 | raise self._exception
snuba-subscription-consumer-transactions_1 | File "/usr/src/snuba/snuba/utils/concurrent.py", line 33, in run
snuba-subscription-consumer-transactions_1 | result = function()
snuba-subscription-consumer-transactions_1 | File "/usr/src/snuba/snuba/utils/streams/synchronized.py", line 130, in __run_commit_log_worker
snuba-subscription-consumer-transactions_1 | message = self.__commit_log_consumer.poll(0.1)
snuba-subscription-consumer-transactions_1 | File "/usr/src/snuba/snuba/utils/streams/backends/kafka.py", line 404, in poll
snuba-subscription-consumer-transactions_1 | raise ConsumerError(str(error))
snuba-subscription-consumer-transactions_1 | snuba.utils.streams.backends.abstract.ConsumerError: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str="JoinGroup failed: Broker: Coordinator load in progress"}
snuba-replacer_1 | 2021-03-17 04:23:16,809 Caught ConsumerError('KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str="JoinGroup failed: Broker: Coordinator load in progress"}'), shutting down...
snuba-outcomes-consumer_1 | 2021-03-17 04:23:16,822 Caught ConsumerError('KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str="JoinGroup failed: Broker: Coordinator load in progress"}'), shutting down...
snuba-replacer_1 | Traceback (most recent call last):
snuba-replacer_1 | File "/usr/local/bin/snuba", line 33, in <module>
snuba-replacer_1 | sys.exit(load_entry_point('snuba', 'console_scripts', 'snuba')())
snuba-replacer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 829, in __call__
snuba-replacer_1 | return self.main(*args, **kwargs)
snuba-replacer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 782, in main
snuba-replacer_1 | rv = self.invoke(ctx)
snuba-replacer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
snuba-replacer_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
snuba-replacer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
snuba-replacer_1 | return ctx.invoke(self.callback, **ctx.params)
snuba-replacer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 610, in invoke
snuba-replacer_1 | return callback(*args, **kwargs)
snuba-replacer_1 | File "/usr/src/snuba/snuba/cli/replacer.py", line 133, in replacer
snuba-replacer_1 | replacer.run()
snuba-replacer_1 | File "/usr/src/snuba/snuba/utils/streams/processing/processor.py", line 112, in run
snuba-replacer_1 | self._run_once()
snuba-replacer_1 | File "/usr/src/snuba/snuba/utils/streams/processing/processor.py", line 142, in _run_once
snuba-replacer_1 | self.__message = self.__consumer.poll(timeout=1.0)
snuba-replacer_1 | File "/usr/src/snuba/snuba/utils/streams/backends/kafka.py", line 404, in poll
snuba-replacer_1 | raise ConsumerError(str(error))
snuba-replacer_1 | snuba.utils.streams.backends.abstract.ConsumerError: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str="JoinGroup failed: Broker: Coordinator load in progress"}
snuba-outcomes-consumer_1 | Traceback (most recent call last):
snuba-outcomes-consumer_1 | File "/usr/local/bin/snuba", line 33, in <module>
snuba-outcomes-consumer_1 | sys.exit(load_entry_point('snuba', 'console_scripts', 'snuba')())
snuba-outcomes-consumer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 829, in __call__
snuba-outcomes-consumer_1 | return self.main(*args, **kwargs)
snuba-outcomes-consumer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 782, in main
snuba-outcomes-consumer_1 | rv = self.invoke(ctx)
snuba-outcomes-consumer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
snuba-outcomes-consumer_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
snuba-outcomes-consumer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
snuba-outcomes-consumer_1 | return ctx.invoke(self.callback, **ctx.params)
snuba-outcomes-consumer_1 | File "/usr/local/lib/python3.8/site-packages/click/core.py", line 610, in invoke
snuba-outcomes-consumer_1 | return callback(*args, **kwargs)
snuba-outcomes-consumer_1 | File "/usr/src/snuba/snuba/cli/consumer.py", line 161, in consumer
snuba-outcomes-consumer_1 | consumer.run()
snuba-outcomes-consumer_1 | File "/usr/src/snuba/snuba/utils/streams/processing/processor.py", line 112, in run
snuba-outcomes-consumer_1 | self._run_once()
snuba-outcomes-consumer_1 | File "/usr/src/snuba/snuba/utils/streams/processing/processor.py", line 142, in _run_once
snuba-outcomes-consumer_1 | self.__message = self.__consumer.poll(timeout=1.0)
snuba-outcomes-consumer_1 | File "/usr/src/snuba/snuba/utils/streams/backends/kafka.py", line 404, in poll
snuba-outcomes-consumer_1 | raise ConsumerError(str(error))
snuba-outcomes-consumer_1 | snuba.utils.streams.backends.abstract.ConsumerError: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str="JoinGroup failed: Broker: Coordinator load in progress"}
ingest-consumer_1 | Traceback (most recent call last):
ingest-consumer_1 | File "/usr/local/bin/sentry", line 8, in <module>
ingest-consumer_1 | sys.exit(main())
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/__init__.py", line 164, in main
ingest-consumer_1 | cli(prog_name=get_prog(), obj={}, max_content_width=100)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 829, in __call__
ingest-consumer_1 | return self.main(*args, **kwargs)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 782, in main
ingest-consumer_1 | rv = self.invoke(ctx)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
ingest-consumer_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
ingest-consumer_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
ingest-consumer_1 | return ctx.invoke(self.callback, **ctx.params)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
ingest-consumer_1 | return callback(*args, **kwargs)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/decorators.py", line 21, in new_func
ingest-consumer_1 | return f(get_current_context(), *args, **kwargs)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py", line 66, in inner
ingest-consumer_1 | return ctx.invoke(f, *args, **kwargs)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
ingest-consumer_1 | return callback(*args, **kwargs)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/decorators.py", line 21, in new_func
ingest-consumer_1 | return f(get_current_context(), *args, **kwargs)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py", line 28, in inner
ingest-consumer_1 | return ctx.invoke(f, *args, **kwargs)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
ingest-consumer_1 | return callback(*args, **kwargs)
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/commands/run.py", line 487, in ingest_consumer
ingest-consumer_1 | get_ingest_consumer(consumer_types=consumer_types, **options).run()
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/sentry/utils/batching_kafka_consumer.py", line 257, in run
ingest-consumer_1 | self._run_once()
ingest-consumer_1 | File "/usr/local/lib/python3.6/site-packages/sentry/utils/batching_kafka_consumer.py", line 275, in _run_once
ingest-consumer_1 | raise Exception(msg.error())
ingest-consumer_1 | Exception: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str="JoinGroup failed: Broker: Coordinator load in progress"}
subscription-consumer-events_1 | Traceback (most recent call last):
subscription-consumer-events_1 | File "/usr/local/bin/sentry", line 8, in <module>
subscription-consumer-events_1 | sys.exit(main())
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/__init__.py", line 164, in main
subscription-consumer-events_1 | cli(prog_name=get_prog(), obj={}, max_content_width=100)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 829, in __call__
subscription-consumer-events_1 | return self.main(*args, **kwargs)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 782, in main
subscription-consumer-events_1 | rv = self.invoke(ctx)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
subscription-consumer-events_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
subscription-consumer-events_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
subscription-consumer-events_1 | return ctx.invoke(self.callback, **ctx.params)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
subscription-consumer-events_1 | return callback(*args, **kwargs)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/decorators.py", line 21, in new_func
subscription-consumer-events_1 | return f(get_current_context(), *args, **kwargs)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py", line 66, in inner
subscription-consumer-events_1 | return ctx.invoke(f, *args, **kwargs)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
subscription-consumer-events_1 | return callback(*args, **kwargs)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/decorators.py", line 21, in new_func
subscription-consumer-events_1 | return f(get_current_context(), *args, **kwargs)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py", line 28, in inner
subscription-consumer-events_1 | return ctx.invoke(f, *args, **kwargs)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
subscription-consumer-events_1 | return callback(*args, **kwargs)
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/commands/run.py", line 387, in query_subscription_consumer
subscription-consumer-events_1 | subscriber.run()
subscription-consumer-events_1 | File "/usr/local/lib/python3.6/site-packages/sentry/snuba/query_subscription_consumer.py", line 169, in run
subscription-consumer-events_1 | raise KafkaException(error)
subscription-consumer-events_1 | cimpl.KafkaException: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str="JoinGroup failed: Broker: Coordinator load in progress"}
nginx_1 | 34.87.118.87 - - [17/Mar/2021:04:23:17 +0000] "POST /api/1/store/ HTTP/1.1" 200 41 "-" "sentry.python/0.20.3" "-"
subscription-consumer-transactions_1 | Traceback (most recent call last):
subscription-consumer-transactions_1 | File "/usr/local/bin/sentry", line 8, in <module>
subscription-consumer-transactions_1 | sys.exit(main())
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/__init__.py", line 164, in main
subscription-consumer-transactions_1 | cli(prog_name=get_prog(), obj={}, max_content_width=100)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 829, in __call__
subscription-consumer-transactions_1 | return self.main(*args, **kwargs)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 782, in main
subscription-consumer-transactions_1 | rv = self.invoke(ctx)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
subscription-consumer-transactions_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
subscription-consumer-transactions_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
subscription-consumer-transactions_1 | return ctx.invoke(self.callback, **ctx.params)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
subscription-consumer-transactions_1 | return callback(*args, **kwargs)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/decorators.py", line 21, in new_func
subscription-consumer-transactions_1 | return f(get_current_context(), *args, **kwargs)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py", line 66, in inner
subscription-consumer-transactions_1 | return ctx.invoke(f, *args, **kwargs)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
subscription-consumer-transactions_1 | return callback(*args, **kwargs)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/decorators.py", line 21, in new_func
subscription-consumer-transactions_1 | return f(get_current_context(), *args, **kwargs)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py", line 28, in inner
subscription-consumer-transactions_1 | return ctx.invoke(f, *args, **kwargs)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
subscription-consumer-transactions_1 | return callback(*args, **kwargs)
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/sentry/runner/commands/run.py", line 387, in query_subscription_consumer
subscription-consumer-transactions_1 | subscriber.run()
subscription-consumer-transactions_1 | File "/usr/local/lib/python3.6/site-packages/sentry/snuba/query_subscription_consumer.py", line 169, in run
subscription-consumer-transactions_1 | raise KafkaException(error)
subscription-consumer-transactions_1 | cimpl.KafkaException: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str="JoinGroup failed: Broker: Coordinator load in progress"}
relay_1 | 2021-03-17T04:23:17Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 11.390625s
nginx_1 | 34.87.118.87 - - [17/Mar/2021:04:23:18 +0000] "POST /api/1/store/ HTTP/1.1" 400 0 "-" "sentry.python/0.20.3" "-"
nginx_1 | 192.168.64.1 - - [17/Mar/2021:04:23:18 +0000] "GET /api/0/relays/live/ HTTP/1.1" 499 0 "-" "-" "-"
snuba-transactions-consumer_1 | 2021-03-17 04:23:20,444 New partitions assigned: {Partition(topic=Topic(name='events'), index=0): 2}
snuba-consumer_1 | 2021-03-17 04:23:20,483 New partitions assigned: {Partition(topic=Topic(name='events'), index=0): 2}
post-process-forwarder_1 | 04:23:20 [INFO] sentry.eventstream.kafka.backend: Received partition assignment: [TopicPartition{topic=events,partition=0,offset=-1001,error=None}]
snuba-sessions-consumer_1 | 2021-03-17 04:23:20,578 New partitions assigned: {Partition(topic=Topic(name='ingest-sessions'), index=0): 0}
snuba-replacer_1 | + set -- snuba replacer --storage events --auto-offset-reset=latest --max-batch-size 3
snuba-replacer_1 | + set gosu snuba snuba replacer --storage events --auto-offset-reset=latest --max-batch-size 3
snuba-replacer_1 | + exec gosu snuba snuba replacer --storage events --auto-offset-reset=latest --max-batch-size 3
web_1 | 04:23:23 [INFO] sentry.plugins.github: apps-not-configured
snuba-subscription-consumer-events_1 | 2021-03-17 04:23:23,711 New partitions assigned: {Partition(topic=Topic(name='events'), index=0): 2}
snuba-subscription-consumer-transactions_1 | + set -- snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-transactions-subscriptions-consumers --topic=events --result-topic=transactions-subscription-results --dataset=transactions --commit-log-topic=snuba-commit-log --commit-log-group=transactions_group --delay-seconds=60 --schedule-ttl=60
snuba-subscription-consumer-transactions_1 | + set gosu snuba snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-transactions-subscriptions-consumers --topic=events --result-topic=transactions-subscription-results --dataset=transactions --commit-log-topic=snuba-commit-log --commit-log-group=transactions_group --delay-seconds=60 --schedule-ttl=60
snuba-subscription-consumer-transactions_1 | + exec gosu snuba snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-transactions-subscriptions-consumers --topic=events --result-topic=transactions-subscription-results --dataset=transactions --commit-log-topic=snuba-commit-log --commit-log-group=transactions_group --delay-seconds=60 --schedule-ttl=60
web_1 | WSGI app 0 (mountpoint='') ready in 14 seconds on interpreter 0x55c65a1a4ec0 pid: 25 (default app)
snuba-outcomes-consumer_1 | + set -- snuba consumer --storage outcomes_raw --auto-offset-reset=earliest --max-batch-time-ms 750
snuba-outcomes-consumer_1 | + set gosu snuba snuba consumer --storage outcomes_raw --auto-offset-reset=earliest --max-batch-time-ms 750
snuba-outcomes-consumer_1 | + exec gosu snuba snuba consumer --storage outcomes_raw --auto-offset-reset=earliest --max-batch-time-ms 750
web_1 | 04:23:27 [INFO] sentry.plugins.github: apps-not-configured
web_1 | 04:23:28 [INFO] sentry.plugins.github: apps-not-configured
relay_1 | 2021-03-17T04:23:29Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 17.0859375s
snuba-replacer_1 | 2021-03-17 04:23:29,540 New partitions assigned: {Partition(topic=Topic(name='event-replacements'), index=0): 0}
web_1 | WSGI app 0 (mountpoint='') ready in 18 seconds on interpreter 0x55c65a1a4ec0 pid: 24 (default app)
web_1 | WSGI app 0 (mountpoint='') ready in 19 seconds on interpreter 0x55c65a1a4ec0 pid: 26 (default app)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:31 +0000] "GET / HTTP/1.1" 302 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:31 +0000] "GET /auth/login/ HTTP/1.1" 302 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:31 +0000] "GET /auth/login/sentry/ HTTP/1.1" 200 11317 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
subscription-consumer-transactions_1 | 04:23:31 [INFO] sentry.plugins.github: apps-not-configured
subscription-consumer-events_1 | 04:23:32 [INFO] sentry.plugins.github: apps-not-configured
ingest-consumer_1 | 04:23:32 [INFO] sentry.plugins.github: apps-not-configured
snuba-consumer_1 | 2021-03-17 04:23:32,489 Partitions revoked: [Partition(topic=Topic(name='events'), index=0)]
snuba-sessions-consumer_1 | 2021-03-17 04:23:32,626 Partitions revoked: [Partition(topic=Topic(name='ingest-sessions'), index=0)]
snuba-consumer_1 | 2021-03-17 04:23:32,654 New partitions assigned: {Partition(topic=Topic(name='events'), index=0): 2}
snuba-outcomes-consumer_1 | 2021-03-17 04:23:32,663 New partitions assigned: {Partition(topic=Topic(name='outcomes'), index=0): 830}
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:32 +0000] "GET /_static/1615954993/sentry/js/ads.js HTTP/1.1" 200 33 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:32 +0000] "GET /_static/1615954993/sentry/dist/sentry.css HTTP/1.1" 200 26067 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:32 +0000] "GET /_static/1615954993/sentry/dist/app.js HTTP/1.1" 200 329932 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
snuba-sessions-consumer_1 | 2021-03-17 04:23:32,825 New partitions assigned: {Partition(topic=Topic(name='ingest-sessions'), index=0): 0}
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:32 +0000] "GET /_static/1615954993/sentry/dist/vendor.js HTTP/1.1" 200 611192 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:32 +0000] "GET /_static/1615954993/sentry/images/logos/default-organization-logo.png HTTP/1.1" 200 1666 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
relay_1 | 2021-03-17T04:23:33Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:33 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:33 +0000] "GET /_static/1615954993/sentry/dist/sentry-simple.9b8f81.woff HTTP/1.1" 200 13844 "http://34.87.118.87:9000/_static/1615954993/sentry/dist/sentry.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:33 +0000] "GET /_static/1615954993/sentry/dist/rubik-medium.867491.woff HTTP/1.1" 200 63096 "http://34.87.118.87:9000/_static/1615954993/sentry/dist/sentry.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:33 +0000] "GET /_static/1615954993/sentry/images/logos/apple-touch-icon-152x152.png HTTP/1.1" 200 3836 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:33 +0000] "GET /_static/1615954993/sentry/images/favicon.png HTTP/1.1" 200 998 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:34 +0000] "GET /_static/1615954993/sentry/dist/sentry-avatar.5e48e0.png HTTP/1.1" 200 14217 "http://34.87.118.87:9000/_static/1615954993/sentry/dist/sentry.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:34 +0000] "GET /_static/1615954993/sentry/dist/sentry-pattern.a141b8.png HTTP/1.1" 200 28158 "http://34.87.118.87:9000/_static/1615954993/sentry/dist/sentry.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:34 +0000] "GET /_static/1615954993/sentry/dist/rubik-regular.499961.woff HTTP/1.1" 200 61672 "http://34.87.118.87:9000/_static/1615954993/sentry/dist/sentry.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:34 +0000] "GET /_static/1615954993/sentry/dist/passwordStrength.js HTTP/1.1" 200 398071 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
snuba-subscription-consumer-transactions_1 | 2021-03-17 04:23:34,858 New partitions assigned: {Partition(topic=Topic(name='events'), index=0): 2}
subscription-consumer-events_1 | 04:23:35 [INFO] sentry.snuba.query_subscription_consumer: query-subscription-consumer.on_assign (offsets='{0: None}' partitions='[TopicPartition{topic=events-subscription-results,partition=0,offset=-1001,error=None}]')
subscription-consumer-transactions_1 | 04:23:35 [INFO] sentry.snuba.query_subscription_consumer: query-subscription-consumer.on_assign (offsets='{0: None}' partitions='[TopicPartition{topic=transactions-subscription-results,partition=0,offset=-1001,error=None}]')
ingest-consumer_1 | 04:23:35 [INFO] batching-kafka-consumer: New partitions assigned: [TopicPartition{topic=ingest-attachments,partition=0,offset=-1001,error=None}, TopicPartition{topic=ingest-events,partition=0,offset=-1001,error=None}, TopicPartition{topic=ingest-transactions,partition=0,offset=-1001,error=None}]
web_1 | 04:23:36 [INFO] sentry.superuser: superuser.logged-in (ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:36 [INFO] sentry.auth: user.auth.success (ip_address='113.161.239.29' username='huy.nguyen@hytekvn.com.vn' organization_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "POST /auth/login/sentry/ HTTP/1.1" 302 0 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:37 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "GET / HTTP/1.1" 302 0 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:37 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/organizations/sentry/issues/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "GET /organizations/sentry/issues/ HTTP/1.1" 200 6160 "http://34.87.118.87:9000/auth/login/sentry/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "GET /_static/1615954994/sentry/dist/sentry.css HTTP/1.1" 200 26067 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "GET /_static/1615954994/sentry/js/ads.js HTTP/1.1" 200 33 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:37 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/teams/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "GET /_static/1615954994/sentry/dist/app.js HTTP/1.1" 200 329932 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "GET /_static/1615954994/sentry/dist/vendor.js HTTP/1.1" 200 611192 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:37 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/?detailed=0' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:37 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/projects/?all_projects=1&collapse=latestDeploys' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "GET /api/0/organizations/sentry/teams/ HTTP/1.1" 200 1718 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "GET /api/0/organizations/sentry/?detailed=0 HTTP/1.1" 200 2993 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:37 +0000] "GET /api/0/organizations/sentry/projects/?all_projects=1&collapse=latestDeploys HTTP/1.1" 200 1101 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /_static/1615954994/sentry/dist/rubik-regular.499961.woff HTTP/1.1" 200 61672 "http://34.87.118.87:9000/_static/1615954994/sentry/dist/sentry.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/?member=1' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/internal/health/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/assistant/?v2' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/?detailed=0' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/teams/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/assistant/?v2 HTTP/1.1" 200 332 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/organizations/?member=1 HTTP/1.1" 200 866 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/internal/health/ HTTP/1.1" 200 356 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/projects/?all_projects=1&collapse=latestDeploys' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/organizations/sentry/?detailed=0 HTTP/1.1" 200 2993 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/organizations/sentry/teams/ HTTP/1.1" 200 1718 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/organizations/sentry/projects/?all_projects=1&collapse=latestDeploys HTTP/1.1" 200 1101 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /_static/1615954994/sentry/images/logos/apple-touch-icon-152x152.png HTTP/1.1" 200 3836 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /_static/1615954994/sentry/images/favicon.png HTTP/1.1" 200 998 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/broadcasts/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/projects/?collapse=latestDeploys&per_page=50' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/organizations/sentry/broadcasts/ HTTP/1.1" 200 2 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/organizations/sentry/projects/?collapse=latestDeploys&per_page=50 HTTP/1.1" 200 1101 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /_static/1615954994/sentry/dist/rubik-medium.867491.woff HTTP/1.1" 200 63096 "http://34.87.118.87:9000/_static/1615954994/sentry/dist/sentry.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/users/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/searches/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:38 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/organizations/sentry/searches/ HTTP/1.1" 200 275 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:38 +0000] "GET /api/0/organizations/sentry/users/ HTTP/1.1" 200 1086 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:39 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/recent-searches/?query=&type=0&limit=3' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:39 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/issues/?collapse=stats&expand=owners&limit=25&query=is%3Aunresolved&shortIdLookup=1&statsPeriod=14d' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:39 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/processingissues/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:39 +0000] "GET /api/0/organizations/sentry/recent-searches/?query=&type=0&limit=3 HTTP/1.1" 200 2 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:39 +0000] "GET /api/0/organizations/sentry/processingissues/ HTTP/1.1" 200 325 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:23:39.231406 [ 85 ] {6e2725865054d6b78207405edcd755c9} <Information> executeQuery: Read 2 rows, 276.00 B in 0.014 sec., 139 rows/sec., 18.86 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:39.231747 [ 85 ] {} <Information> TCPHandler: Processed in 0.015 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:39 +0000] "GET /api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1 HTTP/1.1" 200 460 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:23:39.272398 [ 85 ] {09f0fb80e03a5ce026584375ad10a0fe} <Information> executeQuery: Read 2 rows, 42.00 B in 0.010 sec., 190 rows/sec., 3.91 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:39.272733 [ 85 ] {} <Information> TCPHandler: Processed in 0.012 sec.
clickhouse_1 | 2021.03.17 04:23:39.373977 [ 85 ] {6ccbeae18f506ba8eca0b6bd705be1a2} <Information> executeQuery: Read 2 rows, 62.00 B in 0.012 sec., 160 rows/sec., 4.86 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:39.374988 [ 85 ] {} <Information> TCPHandler: Processed in 0.014 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:39 +0000] "GET /api/0/organizations/sentry/issues/?collapse=stats&expand=owners&limit=25&query=is%3Aunresolved&shortIdLookup=1&statsPeriod=14d HTTP/1.1" 200 1520 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:39 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/issues-stats/?groups=2&groups=1&query=is%3Aunresolved&statsPeriod=14d' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:39 +0000] "GET /_static/1615954994/sentry/dist/laravel.d94933.svg HTTP/1.1" 200 457 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:39 +0000] "GET /_static/1615954994/sentry/dist/default.cae653.svg HTTP/1.1" 200 421 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:39 +0000] "GET /_static/1615954994/sentry/dist/ibm-plex-mono-regular.f36c40.woff2 HTTP/1.1" 200 35212 "http://34.87.118.87:9000/_static/1615954994/sentry/dist/sentry.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:23:39.571844 [ 85 ] {659e27e83e6f0282a6c6d969c0db067c} <Information> executeQuery: Read 2 rows, 70.00 B in 0.008 sec., 254 rows/sec., 8.70 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:39.572354 [ 85 ] {} <Information> TCPHandler: Processed in 0.009 sec.
clickhouse_1 | 2021.03.17 04:23:39.634675 [ 85 ] {9d66760be68aba93e9d068630e0a142c} <Information> executeQuery: Read 2 rows, 70.00 B in 0.006 sec., 353 rows/sec., 12.10 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:39.634984 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
clickhouse_1 | 2021.03.17 04:23:39.676802 [ 85 ] {c37d135693a8a5e91768b0b7171fdeda} <Information> executeQuery: Read 2 rows, 72.00 B in 0.007 sec., 277 rows/sec., 9.74 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:39.677132 [ 85 ] {} <Information> TCPHandler: Processed in 0.008 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:39 +0000] "GET /api/0/organizations/sentry/issues-stats/?groups=2&groups=1&query=is%3Aunresolved&statsPeriod=14d HTTP/1.1" 200 1257 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 34.87.118.87 - - [17/Mar/2021:04:23:43 +0000] "POST /api/14/security/?sentry_key=909db9ca1a6f4b188bc97e88e28d002d HTTP/1.1" 200 0 "https://banle-timdaythay.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_2_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.90 Safari/537.36 Edg/89.0.774.54" "171.253.178.0"
relay_1 | 2021-03-17T04:23:46Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 25.62890625s
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:47 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:47 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:47 +0000] "GET /_static/1615954994/sentry/dist/ProjectsDashboard.js HTTP/1.1" 200 6683 "http://34.87.118.87:9000/organizations/sentry/projects/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:47 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/user-teams/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:47 +0000] "GET /api/0/organizations/sentry/user-teams/ HTTP/1.1" 200 1718 "http://34.87.118.87:9000/organizations/sentry/projects/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:47 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/teams/sentry/sentry/members/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:47 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/teams/sentry/ban_le/members/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:47 +0000] "GET /api/0/teams/sentry/ban_le/members/ HTTP/1.1" 200 1057 "http://34.87.118.87:9000/organizations/sentry/projects/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:47 +0000] "GET /api/0/teams/sentry/sentry/members/ HTTP/1.1" 200 1057 "http://34.87.118.87:9000/organizations/sentry/projects/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:47 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/projects/?statsPeriod=24h&query=id%3A2+id%3A1&transactionStats=1' method='GET' ip_address='113.161.239.29' user_id=1)
clickhouse_1 | 2021.03.17 04:23:47.709945 [ 85 ] {d358bb60752de7a2a57cd4450d1b448c} <Information> executeQuery: Read 2 rows, 56.00 B in 0.006 sec., 329 rows/sec., 9.00 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:47.710266 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
clickhouse_1 | 2021.03.17 04:23:47.749409 [ 85 ] {} <Information> TCPHandler: Processed in 0.004 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:47 +0000] "GET /api/0/organizations/sentry/projects/?statsPeriod=24h&query=id%3A2+id%3A1&transactionStats=1 HTTP/1.1" 200 2645 "http://34.87.118.87:9000/organizations/sentry/projects/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/projects/?collapse=latestDeploys&per_page=50' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/searches/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/users/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "GET /api/0/organizations/sentry/searches/ HTTP/1.1" 200 275 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/users/?project=2' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1&project=2' method='GET' ip_address='113.161.239.29' user_id=1)
clickhouse_1 | 2021.03.17 04:23:51.294199 [ 85 ] {e20a659b220269758b628c8ce99c321a} <Information> executeQuery: Read 2 rows, 276.00 B in 0.005 sec., 376 rows/sec., 50.72 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:51.295781 [ 85 ] {} <Information> TCPHandler: Processed in 0.008 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "GET /api/0/organizations/sentry/projects/?collapse=latestDeploys&per_page=50 HTTP/1.1" 200 1101 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "GET /api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1 HTTP/1.1" 200 460 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "GET /api/0/organizations/sentry/users/ HTTP/1.1" 200 1086 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "GET /api/0/organizations/sentry/users/?project=2 HTTP/1.1" 200 1075 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:23:51.359626 [ 85 ] {b14700e8db2ba8b0da3af58e739a508a} <Information> executeQuery: Read 1 rows, 145.00 B in 0.005 sec., 211 rows/sec., 29.91 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:51.360294 [ 85 ] {} <Information> TCPHandler: Processed in 0.006 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "GET /api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1&project=2 HTTP/1.1" 200 368 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/processingissues/?project=2' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/recent-searches/?query=&type=0&limit=3' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/issues/?collapse=stats&expand=owners&limit=25&project=2&query=is%3Aunresolved&shortIdLookup=1&statsPeriod=14d' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "GET /api/0/organizations/sentry/recent-searches/?query=&type=0&limit=3 HTTP/1.1" 200 2 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "GET /api/0/organizations/sentry/processingissues/?project=2 HTTP/1.1" 200 160 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:23:51.477050 [ 85 ] {32f2706c3629ba3d01ceadd22f54eecb} <Information> executeQuery: Read 1 rows, 21.00 B in 0.005 sec., 187 rows/sec., 3.84 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:51.477353 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
clickhouse_1 | 2021.03.17 04:23:51.539409 [ 85 ] {0d2e3cf013e658e9d49e22767327a4db} <Information> executeQuery: Read 1 rows, 31.00 B in 0.005 sec., 193 rows/sec., 5.85 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:51.539722 [ 85 ] {} <Information> TCPHandler: Processed in 0.006 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:51 +0000] "GET /api/0/organizations/sentry/issues/?collapse=stats&expand=owners&limit=25&project=2&query=is%3Aunresolved&shortIdLookup=1&statsPeriod=14d HTTP/1.1" 200 760 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:51 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/issues-stats/?groups=2&project=2&query=is%3Aunresolved&statsPeriod=14d' method='GET' ip_address='113.161.239.29' user_id=1)
clickhouse_1 | 2021.03.17 04:23:51.960431 [ 85 ] {0519057e186cff85635b8c4fe8944f75} <Information> executeQuery: Read 1 rows, 35.00 B in 0.005 sec., 201 rows/sec., 6.88 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:51.960693 [ 85 ] {} <Information> TCPHandler: Processed in 0.006 sec.
clickhouse_1 | 2021.03.17 04:23:51.999598 [ 85 ] {a25e54455da04553b2484c3dac1b5ac1} <Information> executeQuery: Read 1 rows, 35.00 B in 0.005 sec., 197 rows/sec., 6.76 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:51.999874 [ 85 ] {} <Information> TCPHandler: Processed in 0.006 sec.
clickhouse_1 | 2021.03.17 04:23:52.039625 [ 85 ] {cb4195a9c44ce6a1cba40b8010c8d2ac} <Information> executeQuery: Read 1 rows, 36.00 B in 0.005 sec., 199 rows/sec., 7.02 KiB/sec.
clickhouse_1 | 2021.03.17 04:23:52.039890 [ 85 ] {} <Information> TCPHandler: Processed in 0.006 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /api/0/organizations/sentry/issues-stats/?groups=2&project=2&query=is%3Aunresolved&statsPeriod=14d HTTP/1.1" 200 629 "http://34.87.118.87:9000/organizations/sentry/issues/?project=2" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /_static/1615954994/sentry/dist/AccountSettingsLayout~OrganizationSettingsLayout~ProjectSettingsLayout~SettingsIndex.js HTTP/1.1" 200 4699 "http://34.87.118.87:9000/settings/sentry/projects/be/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /_static/1615954994/sentry/dist/ProjectSettingsLayout.js HTTP/1.1" 200 5614 "http://34.87.118.87:9000/settings/sentry/projects/be/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /_static/1615954994/sentry/dist/AccountSettingsLayout~CommandPalette~HelpSearchModal~OrganizationSettingsLayout~ProjectSettingsLayou~456989bd.js HTTP/1.1" 200 29928 "http://34.87.118.87:9000/settings/sentry/projects/be/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /_static/1615954994/sentry/dist/AccountSettingsLayout~CommandPalette~GroupEventDetails~HelpSearchModal~OrganizationSettingsLayout~Pr~f4cffa64.js HTTP/1.1" 200 5786 "http://34.87.118.87:9000/settings/sentry/projects/be/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:52 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/projects/sentry/be/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:23:52 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/broadcasts/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /api/0/organizations/sentry/broadcasts/ HTTP/1.1" 200 2 "http://34.87.118.87:9000/settings/sentry/projects/be/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /api/0/projects/sentry/be/ HTTP/1.1" 200 28638 "http://34.87.118.87:9000/settings/sentry/projects/be/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /_static/1615954994/sentry/dist/ProjectGeneralSettings.js HTTP/1.1" 200 5318 "http://34.87.118.87:9000/settings/sentry/projects/be/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:52 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/users/?project=2' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 34.87.118.87 - - [17/Mar/2021:04:23:52 +0000] "POST /api/14/security/?sentry_key=909db9ca1a6f4b188bc97e88e28d002d HTTP/1.1" 200 0 "https://banle-timdaythay.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 11_2_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.90 Safari/537.36 Edg/89.0.774.54" "171.253.178.0"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /api/0/organizations/sentry/users/?project=2 HTTP/1.1" 200 1075 "http://34.87.118.87:9000/settings/sentry/projects/be/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:52 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/projects/sentry/be/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:52 +0000] "GET /api/0/projects/sentry/be/ HTTP/1.1" 200 28638 "http://34.87.118.87:9000/settings/sentry/projects/be/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:53 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:53 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:53 +0000] "GET /_static/1615954994/sentry/dist/ProjectKeys.js HTTP/1.1" 200 5026 "http://34.87.118.87:9000/settings/sentry/projects/be/keys/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:23:53 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/projects/sentry/be/keys/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:23:54 +0000] "GET /api/0/projects/sentry/be/keys/ HTTP/1.1" 200 1016 "http://34.87.118.87:9000/settings/sentry/projects/be/keys/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
relay_1 | 2021-03-17T04:23:58Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
nginx_1 | 192.168.64.1 - - [17/Mar/2021:04:24:00 +0000] "POST /api/0/relays/register/challenge/ HTTP/1.1" 200 455 "-" "-" "-"
nginx_1 | 192.168.64.1 - - [17/Mar/2021:04:24:00 +0000] "POST /api/0/relays/register/response/ HTTP/1.1" 200 51 "-" "-" "-"
relay_1 | 2021-03-17T04:24:12Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 38.443359375s
nginx_1 | 192.168.64.1 - - [17/Mar/2021:04:24:18 +0000] "GET /api/0/relays/live/ HTTP/1.1" 200 19 "-" "-" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:24 +0000] "POST /api/2/store/ HTTP/1.1" 200 41 "-" "sentry.php.laravel/2.3.1" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/broadcasts/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/users/?project=2' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1&project=2' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/searches/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/projects/?collapse=latestDeploys&per_page=50' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/broadcasts/ HTTP/1.1" 200 2 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/users/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/searches/ HTTP/1.1" 200 275 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/users/?project=2 HTTP/1.1" 200 1075 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/projects/?collapse=latestDeploys&per_page=50 HTTP/1.1" 200 1101 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/users/ HTTP/1.1" 200 1086 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:24:27.720996 [ 85 ] {2dcf997eef8e16d887bf4ea21af167a8} <Information> executeQuery: Read 1 rows, 145.00 B in 0.005 sec., 195 rows/sec., 27.64 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:27.721300 [ 85 ] {} <Information> TCPHandler: Processed in 0.006 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1&project=2 HTTP/1.1" 200 368 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/issues/?collapse=stats&expand=owners&limit=25&query=is%3Aunresolved&shortIdLookup=1&statsPeriod=14d' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/recent-searches/?query=&type=0&limit=3' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:27 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/processingissues/' method='GET' ip_address='113.161.239.29' user_id=1)
clickhouse_1 | 2021.03.17 04:24:27.764642 [ 85 ] {d603314c65b86ec2801c09e38b7b5ddc} <Information> executeQuery: Read 2 rows, 276.00 B in 0.006 sec., 331 rows/sec., 44.69 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:27.764947 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1 HTTP/1.1" 200 460 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/recent-searches/?query=&type=0&limit=3 HTTP/1.1" 200 2 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/processingissues/ HTTP/1.1" 200 325 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:24:27.830529 [ 85 ] {cdc597a4e716580b96b049670098f47e} <Information> executeQuery: Read 2 rows, 42.00 B in 0.007 sec., 298 rows/sec., 6.11 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:27.830905 [ 85 ] {} <Information> TCPHandler: Processed in 0.008 sec.
clickhouse_1 | 2021.03.17 04:24:27.899298 [ 85 ] {e6aea79bbf16e960364e0ee7c6ed8d6d} <Information> executeQuery: Read 2 rows, 62.00 B in 0.006 sec., 319 rows/sec., 9.67 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:27.900098 [ 85 ] {} <Information> TCPHandler: Processed in 0.008 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:27 +0000] "GET /api/0/organizations/sentry/issues/?collapse=stats&expand=owners&limit=25&query=is%3Aunresolved&shortIdLookup=1&statsPeriod=14d HTTP/1.1" 200 1520 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:28 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/issues-stats/?groups=2&groups=1&query=is%3Aunresolved&statsPeriod=14d' method='GET' ip_address='113.161.239.29' user_id=1)
clickhouse_1 | 2021.03.17 04:24:28.328331 [ 85 ] {6d523b06d6a6b47ae93eed5b831f4eb2} <Information> executeQuery: Read 2 rows, 70.00 B in 0.006 sec., 335 rows/sec., 11.47 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:28.328628 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
clickhouse_1 | 2021.03.17 04:24:28.367881 [ 85 ] {c15bf4bfed7a0a1f3360ff46fae94fa3} <Information> executeQuery: Read 2 rows, 70.00 B in 0.006 sec., 363 rows/sec., 12.43 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:28.368214 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
clickhouse_1 | 2021.03.17 04:24:28.408547 [ 85 ] {c37d135693a8a5e91768b0b7171fdeda} <Information> executeQuery: Read 2 rows, 72.00 B in 0.006 sec., 355 rows/sec., 12.50 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:28.408859 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:28 +0000] "GET /api/0/organizations/sentry/issues-stats/?groups=2&groups=1&query=is%3Aunresolved&statsPeriod=14d HTTP/1.1" 200 1257 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:29 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/organizations/sentry/issues/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:29 +0000] "GET /organizations/sentry/issues/ HTTP/1.1" 200 6160 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:29 +0000] "GET /_static/1615954994/sentry/js/ads.js HTTP/1.1" 304 0 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:29 +0000] "GET /_static/1615954994/sentry/dist/app.js HTTP/1.1" 304 0 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:29 +0000] "GET /_static/1615954994/sentry/dist/vendor.js HTTP/1.1" 304 0 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:29 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/projects/?all_projects=1&collapse=latestDeploys' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:29 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/teams/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:29 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/?detailed=0' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:29 +0000] "GET /api/0/organizations/sentry/projects/?all_projects=1&collapse=latestDeploys HTTP/1.1" 200 1101 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:29 +0000] "GET /api/0/organizations/sentry/?detailed=0 HTTP/1.1" 200 2993 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:29 +0000] "GET /api/0/organizations/sentry/teams/ HTTP/1.1" 200 1718 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "POST /api/1/envelope/?sentry_key=2010034a79ce4509a07d7f27bff1bb35&sentry_version=7 HTTP/1.1" 200 2 "http://34.87.118.87:9000/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/?member=1' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/internal/health/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/assistant/?v2' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/internal/health/ HTTP/1.1" 200 106 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/assistant/?v2 HTTP/1.1" 200 332 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/?member=1 HTTP/1.1" 200 866 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/projects/?all_projects=1&collapse=latestDeploys' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/?detailed=0' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/teams/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/projects/?all_projects=1&collapse=latestDeploys HTTP/1.1" 200 1101 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/?detailed=0 HTTP/1.1" 200 2993 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/teams/ HTTP/1.1" 200 1718 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/broadcasts/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/projects/?collapse=latestDeploys&per_page=50' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/broadcasts/ HTTP/1.1" 200 2 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/projects/?collapse=latestDeploys&per_page=50 HTTP/1.1" 200 1101 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/users/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/searches/' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/searches/ HTTP/1.1" 200 275 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:24:30.566989 [ 85 ] {8653b88d02df461af21a923d16942d61} <Information> executeQuery: Read 2 rows, 276.00 B in 0.005 sec., 393 rows/sec., 53.03 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:30.567287 [ 85 ] {} <Information> TCPHandler: Processed in 0.006 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/tags/?statsPeriod=14d&use_cache=1 HTTP/1.1" 200 460 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/users/ HTTP/1.1" 200 1086 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/recent-searches/?query=&type=0&limit=3' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/processingissues/' method='GET' ip_address='113.161.239.29' user_id=1)
web_1 | 04:24:30 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/issues/?collapse=stats&expand=owners&limit=25&query=is%3Aunresolved&shortIdLookup=1&statsPeriod=14d' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/recent-searches/?query=&type=0&limit=3 HTTP/1.1" 200 2 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/processingissues/ HTTP/1.1" 200 325 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:24:30.820104 [ 85 ] {4df0f0a083df4e14ffc9fded8e023682} <Information> executeQuery: Read 2 rows, 42.00 B in 0.006 sec., 346 rows/sec., 7.11 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:30.820416 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
clickhouse_1 | 2021.03.17 04:24:30.879855 [ 85 ] {15984a22d678bacd37c5d81c32dbc9d7} <Information> executeQuery: Read 2 rows, 62.00 B in 0.006 sec., 347 rows/sec., 10.51 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:30.880164 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:30 +0000] "GET /api/0/organizations/sentry/issues/?collapse=stats&expand=owners&limit=25&query=is%3Aunresolved&shortIdLookup=1&statsPeriod=14d HTTP/1.1" 200 1520 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
web_1 | 04:24:31 [INFO] sentry.superuser: superuser.request (url='http://34.87.118.87/api/0/organizations/sentry/issues-stats/?groups=2&groups=1&query=is%3Aunresolved&statsPeriod=14d' method='GET' ip_address='113.161.239.29' user_id=1)
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:31 +0000] "GET /_static/1615954994/sentry/dist/laravel.d94933.svg HTTP/1.1" 304 0 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:31 +0000] "GET /_static/1615954994/sentry/dist/default.cae653.svg HTTP/1.1" 304 0 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
clickhouse_1 | 2021.03.17 04:24:31.125645 [ 85 ] {623ee94aa463e56e105413c789865988} <Information> executeQuery: Read 2 rows, 70.00 B in 0.005 sec., 364 rows/sec., 12.45 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:31.125934 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
clickhouse_1 | 2021.03.17 04:24:31.163335 [ 85 ] {68348b1af6aec90a48d5027126441df0} <Information> executeQuery: Read 2 rows, 70.00 B in 0.005 sec., 373 rows/sec., 12.77 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:31.163624 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
clickhouse_1 | 2021.03.17 04:24:31.203248 [ 85 ] {c37d135693a8a5e91768b0b7171fdeda} <Information> executeQuery: Read 2 rows, 72.00 B in 0.006 sec., 348 rows/sec., 12.25 KiB/sec.
clickhouse_1 | 2021.03.17 04:24:31.203541 [ 85 ] {} <Information> TCPHandler: Processed in 0.007 sec.
nginx_1 | 113.161.239.29 - - [17/Mar/2021:04:24:31 +0000] "GET /api/0/organizations/sentry/issues-stats/?groups=2&groups=1&query=is%3Aunresolved&statsPeriod=14d HTTP/1.1" 200 1257 "http://34.87.118.87:9000/organizations/sentry/issues/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:86.0) Gecko/20100101 Firefox/86.0" "-"
relay_1 | 2021-03-17T04:24:37Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-17T04:24:50Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 57.665039062s
clickhouse_1 | 2021.03.17 04:25:03.499125 [ 86 ] {c3a43f97-1baa-4033-b62e-0f5cb91e552a} <Information> executeQuery: Read 2 rows, 958.00 B in 0.003 sec., 702 rows/sec., 328.79 KiB/sec.
clickhouse_1 | 2021.03.17 04:25:03.499342 [ 86 ] {} <Information> TCPHandler: Processed in 0.003 sec.
snuba-cleanup_1 | 2021-03-17 04:25:03,500 Dropped 0 partitions on None
clickhouse_1 | 2021.03.17 04:25:03.638111 [ 86 ] {} <Information> TCPHandler: Done processing connection.
relay_1 | 2021-03-17T04:25:34Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-17T04:25:48Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 60s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment