Skip to content

Instantly share code, notes, and snippets.

@peterbe
Created April 2, 2019 19:46
Show Gist options
  • Save peterbe/aedaccba8f98df77897a10bdbade19d7 to your computer and use it in GitHub Desktop.
Save peterbe/aedaccba8f98df77897a10bdbade19d7 to your computer and use it in GitHub Desktop.
MOZILLA/MDN/kuma master ✔
▶ docker-compose up
Starting kuma_mysql_1 ... done
Starting kuma_redis_1 ... done
Starting kuma_elasticsearch_1 ... done
Recreating kuma_api_1 ... done
Recreating kuma_kumascript_1 ... done
Recreating kuma_web_1 ... done
Recreating kuma_worker_1 ... done
Attaching to kuma_redis_1, kuma_mysql_1, kuma_elasticsearch_1, kuma_api_1, kuma_kumascript_1, kuma_web_1, kuma_worker_1
redis_1 | 1:C 02 Apr 2019 19:45:06.526 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
redis_1 | 1:C 02 Apr 2019 19:45:06.526 # Redis version=5.0.4, bits=64, commit=00000000, modified=0, pid=1, just started
redis_1 | 1:C 02 Apr 2019 19:45:06.526 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
redis_1 | 1:M 02 Apr 2019 19:45:06.527 * Running mode=standalone, port=6379.
redis_1 | 1:M 02 Apr 2019 19:45:06.527 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
redis_1 | 1:M 02 Apr 2019 19:45:06.527 # Server initialized
redis_1 | 1:M 02 Apr 2019 19:45:06.527 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
redis_1 | 1:M 02 Apr 2019 19:45:06.527 * Ready to accept connections
elasticsearch_1 | OpenJDK 64-Bit Server VM warning: Insufficient space for shared memory file:
elasticsearch_1 | 17
elasticsearch_1 | Try using the -Djava.io.tmpdir= option to select an alternate temp location.
elasticsearch_1 |
mysql_1 | Initializing database
api_1 | [2019-04-02 19:45:08 +0000] [1] [INFO] Starting gunicorn 19.7.1
mysql_1 | 2019-04-02 19:45:06 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
mysql_1 | 2019-04-02 19:45:06 0 [Note] Ignoring --secure-file-priv value as server is running with --bootstrap.
mysql_1 | 2019-04-02 19:45:06 0 [Note] /usr/sbin/mysqld (mysqld 5.6.43) starting as process 36 ...
kumascript_1 | internal/modules/cjs/loader.js:583
kumascript_1 | throw err;
kumascript_1 | ^
kumascript_1 |
kumascript_1 | Error: Cannot find module '/app/run.js'
kumascript_1 | at Function.Module._resolveFilename (internal/modules/cjs/loader.js:581:15)
kumascript_1 | at Function.Module._load (internal/modules/cjs/loader.js:507:25)
kumascript_1 | at Function.Module.runMain (internal/modules/cjs/loader.js:742:12)
kumascript_1 | at startup (internal/bootstrap/node.js:282:19)
kumascript_1 | at bootstrapNodeJSCore (internal/bootstrap/node.js:743:3)
api_1 | [2019-04-02 19:45:08 +0000] [1] [INFO] Listening at: http://0.0.0.0:8000 (1)
api_1 | [2019-04-02 19:45:08 +0000] [1] [INFO] Using worker: sync
elasticsearch_1 | OpenJDK 64-Bit Server VM warning: Insufficient space for shared memory file:
elasticsearch_1 | 1
elasticsearch_1 | Try using the -Djava.io.tmpdir= option to select an alternate temp location.
elasticsearch_1 |
api_1 | [2019-04-02 19:45:08 +0000] [9] [INFO] Booting worker with pid: 9
mysql_1 | 2019-04-02 19:45:07 36 [Note] InnoDB: Using atomics to ref count buffer pool pages
mysql_1 | 2019-04-02 19:45:07 36 [Note] InnoDB: The InnoDB memory heap is disabled
mysql_1 | 2019-04-02 19:45:07 36 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
mysql_1 | 2019-04-02 19:45:07 36 [Note] InnoDB: Memory barrier is not used
mysql_1 | 2019-04-02 19:45:07 36 [Note] InnoDB: Compressed tables use zlib 1.2.11
mysql_1 | 2019-04-02 19:45:07 36 [Note] InnoDB: Using Linux native AIO
elasticsearch_1 | [2019-04-02T19:45:08,042][WARN ][o.e.b.Natives ] unable to load JNA native support library, native methods will be disabled.
elasticsearch_1 | java.lang.UnsatisfiedLinkError: Failed to create temporary file for /com/sun/jna/linux-x86-64/libjnidispatch.so library: No space left on device
elasticsearch_1 | at com.sun.jna.Native.loadNativeDispatchLibraryFromClasspath(Native.java:962) ~[jna-4.4.0-1.jar:4.4.0 (b0)]
elasticsearch_1 | at com.sun.jna.Native.loadNativeDispatchLibrary(Native.java:922) ~[jna-4.4.0-1.jar:4.4.0 (b0)]
elasticsearch_1 | at com.sun.jna.Native.<clinit>(Native.java:190) ~[jna-4.4.0-1.jar:4.4.0 (b0)]
elasticsearch_1 | at java.lang.Class.forName0(Native Method) ~[?:1.8.0_171]
elasticsearch_1 | at java.lang.Class.forName(Class.java:264) ~[?:1.8.0_171]
elasticsearch_1 | at org.elasticsearch.bootstrap.Natives.<clinit>(Natives.java:45) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:105) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:195) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) [elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) [elasticsearch-5.6.10.jar:5.6.10]
mysql_1 | 2019-04-02 19:45:07 36 [Note] InnoDB: Using CPU crc32 instructions
api_1 | [2019-04-02 19:45:08 +0000] [10] [INFO] Booting worker with pid: 10
elasticsearch_1 | [2019-04-02T19:45:08,049][WARN ][o.e.b.Natives ] cannot check if running as root because JNA is not available
api_1 | [2019-04-02 19:45:08 +0000] [11] [INFO] Booting worker with pid: 11
mysql_1 | 2019-04-02 19:45:07 36 [Note] InnoDB: Initializing buffer pool, size = 128.0M
mysql_1 | 2019-04-02 19:45:07 36 [Note] InnoDB: Completed initialization of buffer pool
elasticsearch_1 | [2019-04-02T19:45:08,050][WARN ][o.e.b.Natives ] cannot install system call filter because JNA is not available
mysql_1 | 2019-04-02 19:45:07 36 [ERROR] InnoDB: auto-extending data file ./ibdata1 is of a different size 0 pages (rounded down to MB) than specified in the .cnf file: initial 768 pages, max 0 (relevant if non-zero) pages!
mysql_1 | 2019-04-02 19:45:07 36 [ERROR] InnoDB: Could not open or create the system tablespace. If you tried to add new data files to the system tablespace, and it failed here, you should now edit innodb_data_file_path in my.cnf back to what it was, and remove the new ibdata files InnoDB created in this failed attempt. InnoDB only wrote those files full of zeros, but did not yet use them in any way. But be careful: do not remove old data files which contain your precious data!
mysql_1 | 2019-04-02 19:45:07 36 [ERROR] Plugin 'InnoDB' init function returned error.
mysql_1 | 2019-04-02 19:45:07 36 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
api_1 | [2019-04-02 19:45:08 +0000] [12] [INFO] Booting worker with pid: 12
kuma_kumascript_1 exited with code 1
mysql_1 | 2019-04-02 19:45:07 36 [ERROR] Unknown/unsupported storage engine: InnoDB
mysql_1 | 2019-04-02 19:45:07 36 [ERROR] Aborting
mysql_1 |
mysql_1 | 2019-04-02 19:45:07 36 [Note] Binlog end
elasticsearch_1 | [2019-04-02T19:45:08,051][WARN ][o.e.b.Natives ] cannot register console handler because JNA is not available
elasticsearch_1 | [2019-04-02T19:45:08,053][WARN ][o.e.b.Natives ] cannot getrlimit RLIMIT_NPROC because JNA is not available
mysql_1 | 2019-04-02 19:45:07 36 [Note] /usr/sbin/mysqld: Shutdown complete
mysql_1 |
elasticsearch_1 | [2019-04-02T19:45:08,054][WARN ][o.e.b.Natives ] cannot getrlimit RLIMIT_AS beacuse JNA is not available
elasticsearch_1 | [2019-04-02T19:45:08,054][WARN ][o.e.b.Natives ] cannot getrlimit RLIMIT_FSIZE because JNA is not available
elasticsearch_1 | [2019-04-02T19:45:08,182][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [] uncaught exception in thread [main]
elasticsearch_1 | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Unable to access 'path.scripts' (/usr/share/elasticsearch/config/scripts)
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | Caused by: java.lang.IllegalStateException: Unable to access 'path.scripts' (/usr/share/elasticsearch/config/scripts)
elasticsearch_1 | at org.elasticsearch.bootstrap.Security.addPath(Security.java:450) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Security.addFilePermissions(Security.java:282) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Security.createPermissions(Security.java:246) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Security.configure(Security.java:119) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:228) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | ... 6 more
elasticsearch_1 | Caused by: java.nio.file.FileSystemException: /usr/share/elasticsearch/config/scripts: No space left on device
elasticsearch_1 | at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) ~[?:1.8.0_171]
elasticsearch_1 | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_171]
elasticsearch_1 | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:1.8.0_171]
elasticsearch_1 | at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) ~[?:1.8.0_171]
elasticsearch_1 | at java.nio.file.Files.createDirectory(Files.java:674) ~[?:1.8.0_171]
elasticsearch_1 | at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) ~[?:1.8.0_171]
elasticsearch_1 | at java.nio.file.Files.createDirectories(Files.java:767) ~[?:1.8.0_171]
elasticsearch_1 | at org.elasticsearch.bootstrap.Security.ensureDirectoryExists(Security.java:492) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Security.addPath(Security.java:448) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Security.addFilePermissions(Security.java:282) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Security.createPermissions(Security.java:246) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Security.configure(Security.java:119) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:228) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:342) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132) ~[elasticsearch-5.6.10.jar:5.6.10]
elasticsearch_1 | ... 6 more
kuma_mysql_1 exited with code 141
kuma_elasticsearch_1 exited with code 1
web_1 | [2019-04-02 19:45:11 +0000] [1] [INFO] Starting gunicorn 19.7.1
web_1 | [2019-04-02 19:45:11 +0000] [1] [INFO] Listening at: http://0.0.0.0:8000 (1)
web_1 | [2019-04-02 19:45:11 +0000] [1] [INFO] Using worker: meinheld.gmeinheld.MeinheldWorker
web_1 | [2019-04-02 19:45:11 +0000] [9] [INFO] Booting worker with pid: 9
web_1 | [2019-04-02 19:45:11 +0000] [10] [INFO] Booting worker with pid: 10
web_1 | [2019-04-02 19:45:11 +0000] [11] [INFO] Booting worker with pid: 11
web_1 | [2019-04-02 19:45:11 +0000] [13] [INFO] Booting worker with pid: 13
api_1 | [2019-04-02 12:45:14 +0000] [10] [ERROR] Exception in worker process
api_1 | Traceback (most recent call last):
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/arbiter.py", line 578, in spawn_worker
api_1 | worker.init_process()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 131, in init_process
api_1 | self.run()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 124, in run
api_1 | self.run_for_one(timeout)
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 61, in run_for_one
api_1 | self.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 68, in notify
api_1 | self.tmp.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/workertmp.py", line 43, in notify
api_1 | os.fchmod(self._tmp.fileno(), self.spinner)
api_1 | OSError: [Errno 2] No such file or directory
api_1 | [2019-04-02 12:45:14 +0000] [10] [INFO] Worker exiting (pid: 10)
api_1 | [2019-04-02 12:45:14 +0000] [9] [ERROR] Exception in worker process
api_1 | Traceback (most recent call last):
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/arbiter.py", line 578, in spawn_worker
api_1 | worker.init_process()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 131, in init_process
api_1 | self.run()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 124, in run
api_1 | self.run_for_one(timeout)
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 61, in run_for_one
api_1 | self.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 68, in notify
api_1 | self.tmp.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/workertmp.py", line 43, in notify
api_1 | os.fchmod(self._tmp.fileno(), self.spinner)
api_1 | OSError: [Errno 2] No such file or directory
api_1 | [2019-04-02 12:45:14 +0000] [9] [INFO] Worker exiting (pid: 9)
api_1 | [2019-04-02 19:45:14 +0000] [21] [INFO] Booting worker with pid: 21
api_1 | [2019-04-02 12:45:14 +0000] [11] [ERROR] Exception in worker process
api_1 | Traceback (most recent call last):
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/arbiter.py", line 578, in spawn_worker
api_1 | worker.init_process()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 131, in init_process
api_1 | self.run()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 124, in run
api_1 | self.run_for_one(timeout)
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 61, in run_for_one
api_1 | self.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 68, in notify
api_1 | self.tmp.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/workertmp.py", line 43, in notify
api_1 | os.fchmod(self._tmp.fileno(), self.spinner)
api_1 | OSError: [Errno 2] No such file or directory
api_1 | [2019-04-02 12:45:14 +0000] [11] [INFO] Worker exiting (pid: 11)
api_1 | [2019-04-02 12:45:14 +0000] [12] [ERROR] Exception in worker process
api_1 | Traceback (most recent call last):
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/arbiter.py", line 578, in spawn_worker
api_1 | worker.init_process()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 131, in init_process
api_1 | self.run()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 124, in run
api_1 | self.run_for_one(timeout)
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 61, in run_for_one
api_1 | self.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 68, in notify
api_1 | self.tmp.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/workertmp.py", line 43, in notify
api_1 | os.fchmod(self._tmp.fileno(), self.spinner)
api_1 | OSError: [Errno 2] No such file or directory
api_1 | [2019-04-02 12:45:14 +0000] [12] [INFO] Worker exiting (pid: 12)
api_1 | [2019-04-02 19:45:15 +0000] [22] [INFO] Booting worker with pid: 22
api_1 | [2019-04-02 19:45:15 +0000] [23] [INFO] Booting worker with pid: 23
api_1 | [2019-04-02 19:45:15 +0000] [25] [INFO] Booting worker with pid: 25
worker_1 |
worker_1 | -------------- celery@370e69a6096a v3.1.25 (Cipater)
worker_1 | ---- **** -----
worker_1 | --- * *** * -- Linux-4.9.125-linuxkit-x86_64-with-debian-9.8
worker_1 | -- * - **** ---
worker_1 | - ** ---------- [config]
worker_1 | - ** ---------- .> app: default:0x7f9345c77a50 (djcelery.loaders.DjangoLoader)
worker_1 | - ** ---------- .> transport: redis://redis:6379/0
worker_1 | - ** ---------- .> results: redis://redis:6379/1
worker_1 | - *** --- * --- .> concurrency: 4 (prefork)
worker_1 | -- ******* ----
worker_1 | --- ***** ----- [queues]
worker_1 | -------------- .> celery exchange=celery(direct) key=celery
worker_1 | .> mdn_emails exchange=mdn_emails(direct) key=mdn_emails
worker_1 | .> mdn_purgeable exchange=mdn_purgeable(direct) key=mdn_purgeable
worker_1 | .> mdn_search exchange=mdn_search(direct) key=mdn_search
worker_1 | .> mdn_wiki exchange=mdn_wiki(direct) key=mdn_wiki
worker_1 |
worker_1 | [tasks]
worker_1 | . cacheback.tasks.refresh_cache
worker_1 | . kuma.core.tasks.clean_sessions
worker_1 | . kuma.core.tasks.delete_old_ip_bans
worker_1 | . kuma.feeder.tasks.update_feeds
worker_1 | . kuma.humans.tasks.humans_txt
worker_1 | . kuma.payments.tasks.payments_thank_you_email
worker_1 | . kuma.search.tasks.finalize_index
worker_1 | . kuma.search.tasks.prepare_index
worker_1 | . kuma.users.tasks.send_recovery_email
worker_1 | . kuma.users.tasks.send_welcome_email
worker_1 | . kuma.wiki.tasks.build_index_sitemap
worker_1 | . kuma.wiki.tasks.build_json_data_for_document
worker_1 | . kuma.wiki.tasks.build_locale_sitemap
worker_1 | . kuma.wiki.tasks.build_sitemaps
worker_1 | . kuma.wiki.tasks.clean_document_chunk
worker_1 | . kuma.wiki.tasks.delete_logs_for_purged_documents
worker_1 | . kuma.wiki.tasks.delete_old_documentspamattempt_data
worker_1 | . kuma.wiki.tasks.delete_old_revision_ips
worker_1 | . kuma.wiki.tasks.email_document_progress
worker_1 | . kuma.wiki.tasks.index_documents
worker_1 | . kuma.wiki.tasks.move_page
worker_1 | . kuma.wiki.tasks.render_document
worker_1 | . kuma.wiki.tasks.render_document_chunk
worker_1 | . kuma.wiki.tasks.render_stale_documents
worker_1 | . kuma.wiki.tasks.send_first_edit_email
worker_1 | . kuma.wiki.tasks.tidy_revision_content
worker_1 | . kuma.wiki.tasks.unindex_documents
worker_1 | . tidings.events._fire_task
worker_1 | . tidings.tasks.claim_watches
worker_1 |
worker_1 | [2019-04-02 12:45:16,840: INFO/MainProcess] Connected to redis://redis:6379/0
worker_1 | [2019-04-02 12:45:16,899: INFO/MainProcess] mingle: searching for neighbors
worker_1 | [2019-04-02 12:45:17,202: INFO/Beat] beat: Starting...
worker_1 | [2019-04-02 12:45:17,206: INFO/Beat] Writing entries (0)...
worker_1 | [2019-04-02 12:45:17,263: ERROR/Beat] Database error while sync: OperationalError(2005, "Unknown MySQL server host 'mysql' (-2)")
worker_1 | Traceback (most recent call last):
worker_1 | File "/usr/local/lib/python2.7/site-packages/djcelery/schedulers.py", line 216, in sync
worker_1 | with commit_on_success():
worker_1 | File "/usr/local/lib/python2.7/contextlib.py", line 17, in __enter__
worker_1 | return self.gen.next()
worker_1 | File "/usr/local/lib/python2.7/site-packages/djcelery/db.py", line 56, in commit_on_success
worker_1 | with transaction.atomic(using):
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/transaction.py", line 158, in __enter__
worker_1 | if not connection.get_autocommit():
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 385, in get_autocommit
worker_1 | self.ensure_connection()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection
worker_1 | self.connect()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__
worker_1 | six.reraise(dj_exc_type, dj_exc_value, traceback)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection
worker_1 | self.connect()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 189, in connect
worker_1 | self.connection = self.get_new_connection(conn_params)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/mysql/base.py", line 274, in get_new_connection
worker_1 | conn = Database.connect(**conn_params)
worker_1 | File "/usr/local/lib/python2.7/site-packages/MySQLdb/__init__.py", line 85, in Connect
worker_1 | return Connection(*args, **kwargs)
worker_1 | File "/usr/local/lib/python2.7/site-packages/MySQLdb/connections.py", line 204, in __init__
worker_1 | super(Connection, self).__init__(*args, **kwargs2)
worker_1 | OperationalError: (2005, "Unknown MySQL server host 'mysql' (-2)")
worker_1 | [2019-04-02 12:45:17,299: INFO/Beat] Writing entries (0)...
worker_1 | [2019-04-02 12:45:17,304: ERROR/Beat] Database error while sync: OperationalError(2005, "Unknown MySQL server host 'mysql' (-2)")
worker_1 | Traceback (most recent call last):
worker_1 | File "/usr/local/lib/python2.7/site-packages/djcelery/schedulers.py", line 216, in sync
worker_1 | with commit_on_success():
worker_1 | File "/usr/local/lib/python2.7/contextlib.py", line 17, in __enter__
worker_1 | return self.gen.next()
worker_1 | File "/usr/local/lib/python2.7/site-packages/djcelery/db.py", line 56, in commit_on_success
worker_1 | with transaction.atomic(using):
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/transaction.py", line 158, in __enter__
worker_1 | if not connection.get_autocommit():
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 385, in get_autocommit
worker_1 | self.ensure_connection()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection
worker_1 | self.connect()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__
worker_1 | six.reraise(dj_exc_type, dj_exc_value, traceback)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection
worker_1 | self.connect()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 189, in connect
worker_1 | self.connection = self.get_new_connection(conn_params)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/mysql/base.py", line 274, in get_new_connection
worker_1 | conn = Database.connect(**conn_params)
worker_1 | File "/usr/local/lib/python2.7/site-packages/MySQLdb/__init__.py", line 85, in Connect
worker_1 | return Connection(*args, **kwargs)
worker_1 | File "/usr/local/lib/python2.7/site-packages/MySQLdb/connections.py", line 204, in __init__
worker_1 | super(Connection, self).__init__(*args, **kwargs2)
worker_1 | OperationalError: (2005, "Unknown MySQL server host 'mysql' (-2)")
worker_1 | [2019-04-02 12:45:17,305: ERROR/Beat] Process Beat
worker_1 | Traceback (most recent call last):
worker_1 | File "/usr/local/lib/python2.7/site-packages/billiard/process.py", line 292, in _bootstrap
worker_1 | self.run()
worker_1 | File "/usr/local/lib/python2.7/site-packages/celery/beat.py", line 553, in run
worker_1 | self.service.start(embedded_process=True)
worker_1 | File "/usr/local/lib/python2.7/site-packages/celery/beat.py", line 470, in start
worker_1 | humanize_seconds(self.scheduler.max_interval))
worker_1 | File "/usr/local/lib/python2.7/site-packages/kombu/utils/__init__.py", line 325, in __get__
worker_1 | value = obj.__dict__[self.__name__] = self.__get(obj)
worker_1 | File "/usr/local/lib/python2.7/site-packages/celery/beat.py", line 512, in scheduler
worker_1 | return self.get_scheduler()
worker_1 | File "/usr/local/lib/python2.7/site-packages/celery/beat.py", line 507, in get_scheduler
worker_1 | lazy=lazy)
worker_1 | File "/usr/local/lib/python2.7/site-packages/celery/utils/imports.py", line 53, in instantiate
worker_1 | return symbol_by_name(name)(*args, **kwargs)
worker_1 | File "/usr/local/lib/python2.7/site-packages/djcelery/schedulers.py", line 161, in __init__
worker_1 | Scheduler.__init__(self, *args, **kwargs)
worker_1 | File "/usr/local/lib/python2.7/site-packages/celery/beat.py", line 185, in __init__
worker_1 | self.setup_schedule()
worker_1 | File "/usr/local/lib/python2.7/site-packages/djcelery/schedulers.py", line 168, in setup_schedule
worker_1 | self.install_default_entries(self.schedule)
worker_1 | File "/usr/local/lib/python2.7/site-packages/djcelery/schedulers.py", line 263, in schedule
worker_1 | self._schedule = self.all_as_schedule()
worker_1 | File "/usr/local/lib/python2.7/site-packages/djcelery/schedulers.py", line 174, in all_as_schedule
worker_1 | for model in self.Model.objects.enabled():
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 250, in __iter__
worker_1 | self._fetch_all()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 1121, in _fetch_all
worker_1 | self._result_cache = list(self._iterable_class(self))
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 53, in __iter__
worker_1 | results = compiler.execute_sql(chunked_fetch=self.chunked_fetch)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 876, in execute_sql
worker_1 | sql, params = self.as_sql()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 441, in as_sql
worker_1 | where, w_params = self.compile(self.where) if self.where is not None else ("", [])
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 373, in compile
worker_1 | sql, params = node.as_sql(self, self.connection)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/where.py", line 79, in as_sql
worker_1 | sql, params = compiler.compile(child)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 373, in compile
worker_1 | sql, params = node.as_sql(self, self.connection)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/lookups.py", line 169, in as_sql
worker_1 | lhs_sql, params = self.process_lhs(compiler, connection)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/lookups.py", line 162, in process_lhs
worker_1 | db_type = self.lhs.output_field.db_type(connection=connection)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/models/fields/__init__.py", line 644, in db_type
worker_1 | return connection.data_types[self.get_internal_type()] % data
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/utils/functional.py", line 35, in __get__
worker_1 | res = instance.__dict__[self.name] = self.func(instance)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/mysql/base.py", line 174, in data_types
worker_1 | if self.features.supports_microsecond_precision:
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/utils/functional.py", line 35, in __get__
worker_1 | res = instance.__dict__[self.name] = self.func(instance)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/mysql/features.py", line 53, in supports_microsecond_precision
worker_1 | return self.connection.mysql_version >= (5, 6, 4) and Database.version_info >= (1, 2, 5)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/utils/functional.py", line 35, in __get__
worker_1 | res = instance.__dict__[self.name] = self.func(instance)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/mysql/base.py", line 385, in mysql_version
worker_1 | with self.temporary_connection() as cursor:
worker_1 | File "/usr/local/lib/python2.7/contextlib.py", line 17, in __enter__
worker_1 | return self.gen.next()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 591, in temporary_connection
worker_1 | cursor = self.cursor()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 254, in cursor
worker_1 | return self._cursor()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 229, in _cursor
worker_1 | self.ensure_connection()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection
worker_1 | self.connect()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__
worker_1 | six.reraise(dj_exc_type, dj_exc_value, traceback)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection
worker_1 | self.connect()
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 189, in connect
worker_1 | self.connection = self.get_new_connection(conn_params)
worker_1 | File "/usr/local/lib/python2.7/site-packages/django/db/backends/mysql/base.py", line 274, in get_new_connection
worker_1 | conn = Database.connect(**conn_params)
worker_1 | File "/usr/local/lib/python2.7/site-packages/MySQLdb/__init__.py", line 85, in Connect
worker_1 | return Connection(*args, **kwargs)
worker_1 | File "/usr/local/lib/python2.7/site-packages/MySQLdb/connections.py", line 204, in __init__
worker_1 | super(Connection, self).__init__(*args, **kwargs2)
worker_1 | OperationalError: (2005, "Unknown MySQL server host 'mysql' (-2)")
worker_1 | [2019-04-02 12:45:17,917: INFO/MainProcess] mingle: all alone
worker_1 | [2019-04-02 12:45:18,011: WARNING/MainProcess] celery@370e69a6096a ready.
api_1 | [2019-04-02 12:45:21 +0000] [21] [ERROR] Exception in worker process
api_1 | Traceback (most recent call last):
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/arbiter.py", line 578, in spawn_worker
api_1 | worker.init_process()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 131, in init_process
api_1 | self.run()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 124, in run
api_1 | self.run_for_one(timeout)
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 61, in run_for_one
api_1 | self.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 68, in notify
api_1 | self.tmp.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/workertmp.py", line 43, in notify
api_1 | os.fchmod(self._tmp.fileno(), self.spinner)
api_1 | OSError: [Errno 2] No such file or directory
api_1 | [2019-04-02 12:45:21 +0000] [21] [INFO] Worker exiting (pid: 21)
api_1 | [2019-04-02 12:45:21 +0000] [23] [ERROR] Exception in worker process
api_1 | Traceback (most recent call last):
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/arbiter.py", line 578, in spawn_worker
api_1 | worker.init_process()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 131, in init_process
api_1 | self.run()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 124, in run
api_1 | self.run_for_one(timeout)
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 61, in run_for_one
api_1 | self.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 68, in notify
api_1 | self.tmp.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/workertmp.py", line 43, in notify
api_1 | os.fchmod(self._tmp.fileno(), self.spinner)
api_1 | OSError: [Errno 2] No such file or directory
api_1 | [2019-04-02 12:45:21 +0000] [23] [INFO] Worker exiting (pid: 23)
api_1 | [2019-04-02 19:45:21 +0000] [32] [INFO] Booting worker with pid: 32
api_1 | [2019-04-02 19:45:21 +0000] [33] [INFO] Booting worker with pid: 33
api_1 | [2019-04-02 12:45:21 +0000] [22] [ERROR] Exception in worker process
api_1 | Traceback (most recent call last):
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/arbiter.py", line 578, in spawn_worker
api_1 | worker.init_process()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 131, in init_process
api_1 | self.run()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 124, in run
api_1 | self.run_for_one(timeout)
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 61, in run_for_one
api_1 | self.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 68, in notify
api_1 | self.tmp.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/workertmp.py", line 43, in notify
api_1 | os.fchmod(self._tmp.fileno(), self.spinner)
api_1 | OSError: [Errno 2] No such file or directory
api_1 | [2019-04-02 12:45:21 +0000] [22] [INFO] Worker exiting (pid: 22)
api_1 | [2019-04-02 19:45:22 +0000] [37] [INFO] Booting worker with pid: 37
api_1 | [2019-04-02 12:45:22 +0000] [25] [ERROR] Exception in worker process
api_1 | Traceback (most recent call last):
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/arbiter.py", line 578, in spawn_worker
api_1 | worker.init_process()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 131, in init_process
api_1 | self.run()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 124, in run
api_1 | self.run_for_one(timeout)
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/sync.py", line 61, in run_for_one
api_1 | self.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/base.py", line 68, in notify
api_1 | self.tmp.notify()
api_1 | File "/usr/local/lib/python2.7/site-packages/gunicorn/workers/workertmp.py", line 43, in notify
api_1 | os.fchmod(self._tmp.fileno(), self.spinner)
api_1 | OSError: [Errno 2] No such file or directory
api_1 | [2019-04-02 12:45:22 +0000] [25] [INFO] Worker exiting (pid: 25)
api_1 | [2019-04-02 19:45:22 +0000] [39] [INFO] Booting worker with pid: 39
^CGracefully stopping... (press Ctrl+C again to force)
Stopping kuma_worker_1 ... done
Stopping kuma_web_1 ... done
Stopping kuma_api_1 ... done
Stopping kuma_redis_1 ... done
@jtlz2
Copy link

jtlz2 commented May 12, 2019

@peterbe I have this problem too... Did you manage to fix it?

@jtlz2
Copy link

jtlz2 commented May 12, 2019

benoitc/gunicorn#407 - set worker-tmp-dir to something other than /tmp!

@peterbe
Copy link
Author

peterbe commented May 13, 2019

@jtlz2 I can't remember. I think I started docker-compose in a bad way.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment