Skip to content

Instantly share code, notes, and snippets.

@robzolkos

robzolkos/issue.md

Last active April 12, 2024 14:15
Show Gist options
  • Save robzolkos/753194dc7331d9b25f4108f230be00dc to your computer and use it in GitHub Desktop.
Save robzolkos/753194dc7331d9b25f4108f230be00dc to your computer and use it in GitHub Desktop.
Download ZIP
kamal deploy error
Raw
issue.md
  1. create new droplet, make sure domain points to it.
  2. clone repo https://github.com/robzolkos/turbonativedirectory
  3. bundle exec kamal setup

At this point the application is deployed and working

  1. Update a css class/change some text on placeholder home page
  2. commmit
  3. bundle exec kamal deploy

Deploy works fine...

  INFO [46363bb8] Finished in 0.213 seconds with exit status 0 (successful).
Releasing the deploy lock...
  Finished all in 118.1 seconds

Site is now 404'ing.

kamal app logs returns

=> Booting Puma
=> Rails 7.1.0.beta1 application starting in production 
=> Run `bin/rails server --help` for more startup options
A server is already running (pid: 1, file: /rails/tmp/pids/server.pid).
Raw
log.txt
9df2e50e64d5# bundle exec kamal deploy
INFO [16e56d99] Running /usr/bin/env mkdir -p .kamal on 157.245.93.20
INFO [16e56d99] Finished in 1.602 seconds with exit status 0 (successful).
Acquiring the deploy lock...
Log into image registry...
INFO [b0a34604] Running docker login registry.digitalocean.com -u [REDACTED] -p [REDACTED] as root@localhost
INFO [b0a34604] Finished in 1.232 seconds with exit status 0 (successful).
INFO [9cd08ce1] Running docker login registry.digitalocean.com -u [REDACTED] -p [REDACTED] on 157.245.93.20
INFO [9cd08ce1] Finished in 0.345 seconds with exit status 0 (successful).
Build and push app image...
INFO [3e2bd5d7] Running docker --version && docker buildx version as root@localhost
INFO [3e2bd5d7] Finished in 0.098 seconds with exit status 0 (successful).
INFO [4be167e9] Running docker buildx build --push --platform linux/amd64,linux/arm64 --builder kamal-turbo-native-directory-multiarch -t registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40 -t registry.digitalocean.com/robzolkos/turbonativedirectory:latest --label service="turbo-native-directory" --file Dockerfile . as root@localhost
DEBUG [4be167e9] Command: docker buildx build --push --platform linux/amd64,linux/arm64 --builder kamal-turbo-native-directory-multiarch -t registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40 -t registry.digitalocean.com/robzolkos/turbonativedirectory:latest --label service="turbo-native-directory" --file Dockerfile .
DEBUG [4be167e9] #0 building with "kamal-turbo-native-directory-multiarch" instance using docker-container driver
DEBUG [4be167e9]
DEBUG [4be167e9] #1 [internal] load build definition from Dockerfile
DEBUG [4be167e9] #1 transferring dockerfile: 2.42kB done
DEBUG [4be167e9] #1 DONE 0.0s
DEBUG [4be167e9]
DEBUG [4be167e9] #2 resolve image config for docker.io/docker/dockerfile:1
DEBUG [4be167e9] #2 DONE 1.0s
DEBUG [4be167e9]
DEBUG [4be167e9] #3 docker-image://docker.io/docker/dockerfile:1@sha256:ac85f380a63b13dfcefa89046420e1781752bab202122f8f50032edf31be0021
DEBUG [4be167e9] #3 resolve docker.io/docker/dockerfile:1@sha256:ac85f380a63b13dfcefa89046420e1781752bab202122f8f50032edf31be0021 0.0s done
DEBUG [4be167e9] #3 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #4 [linux/amd64 internal] load metadata for registry.docker.com/library/ruby:3.2.2-slim
DEBUG [4be167e9] #4 DONE 1.3s
DEBUG [4be167e9]
DEBUG [4be167e9] #5 [linux/arm64 internal] load metadata for registry.docker.com/library/ruby:3.2.2-slim
DEBUG [4be167e9] #5 DONE 1.3s
DEBUG [4be167e9]
DEBUG [4be167e9] #6 [internal] load .dockerignore
DEBUG [4be167e9] #6 transferring context: 745B done
DEBUG [4be167e9] #6 DONE 0.0s
DEBUG [4be167e9]
DEBUG [4be167e9] #7 [linux/arm64 base 1/2] FROM registry.docker.com/library/ruby:3.2.2-slim@sha256:6ff55a14560f94d6c199033e4aa90cc7f0b7afaea5a50bc91cfbc4905f366f39
DEBUG [4be167e9] #7 resolve registry.docker.com/library/ruby:3.2.2-slim@sha256:6ff55a14560f94d6c199033e4aa90cc7f0b7afaea5a50bc91cfbc4905f366f39 done
DEBUG [4be167e9] #7 DONE 0.0s
DEBUG [4be167e9]
DEBUG [4be167e9] #8 [linux/amd64 base 1/2] FROM registry.docker.com/library/ruby:3.2.2-slim@sha256:6ff55a14560f94d6c199033e4aa90cc7f0b7afaea5a50bc91cfbc4905f366f39
DEBUG [4be167e9] #8 resolve registry.docker.com/library/ruby:3.2.2-slim@sha256:6ff55a14560f94d6c199033e4aa90cc7f0b7afaea5a50bc91cfbc4905f366f39 done
DEBUG [4be167e9] #8 DONE 0.0s
DEBUG [4be167e9]
DEBUG [4be167e9] #9 [internal] load build context
DEBUG [4be167e9] #9 transferring context: 6.26kB 0.1s done
DEBUG [4be167e9] #9 DONE 0.1s
DEBUG [4be167e9]
DEBUG [4be167e9] #10 [linux/arm64 build 2/9] RUN curl -sL https://github.com/nodenv/node-build/archive/master.tar.gz | tar xz -C /tmp/ && /tmp/node-build-master/bin/node-build "18.17.1" /usr/local/node && npm install -g yarn@1.22.19 && rm -rf /tmp/node-build-master
DEBUG [4be167e9] #10 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #11 [linux/arm64 build 4/9] RUN bundle install && rm -rf ~/.bundle/ "/usr/local/bundle"/ruby/*/cache "/usr/local/bundle"/ruby/*/bundler/gems/*/.git && bundle exec bootsnap precompile --gemfile
DEBUG [4be167e9] #11 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #12 [linux/arm64 build 1/9] RUN apt-get update -qq && apt-get install --no-install-recommends -y build-essential curl git libvips node-gyp pkg-config python-is-python3
DEBUG [4be167e9] #12 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #13 [linux/arm64 base 2/2] WORKDIR /rails
DEBUG [4be167e9] #13 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #14 [linux/arm64 build 5/9] COPY package.json yarn.lock ./
DEBUG [4be167e9] #14 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #15 [linux/arm64 build 3/9] COPY Gemfile Gemfile.lock ./
DEBUG [4be167e9] #15 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #16 [linux/arm64 build 6/9] RUN yarn install --frozen-lockfile
DEBUG [4be167e9] #16 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #17 [linux/amd64 base 2/2] WORKDIR /rails
DEBUG [4be167e9] #17 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #18 [linux/amd64 build 3/9] COPY Gemfile Gemfile.lock ./
DEBUG [4be167e9] #18 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #19 [linux/amd64 build 1/9] RUN apt-get update -qq && apt-get install --no-install-recommends -y build-essential curl git libvips node-gyp pkg-config python-is-python3
DEBUG [4be167e9] #19 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #20 [linux/amd64 build 4/9] RUN bundle install && rm -rf ~/.bundle/ "/usr/local/bundle"/ruby/*/cache "/usr/local/bundle"/ruby/*/bundler/gems/*/.git && bundle exec bootsnap precompile --gemfile
DEBUG [4be167e9] #20 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #21 [linux/amd64 build 5/9] COPY package.json yarn.lock ./
DEBUG [4be167e9] #21 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #22 [linux/amd64 build 2/9] RUN curl -sL https://github.com/nodenv/node-build/archive/master.tar.gz | tar xz -C /tmp/ && /tmp/node-build-master/bin/node-build "18.17.1" /usr/local/node && npm install -g yarn@1.22.19 && rm -rf /tmp/node-build-master
DEBUG [4be167e9] #22 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #23 [linux/amd64 build 6/9] RUN yarn install --frozen-lockfile
DEBUG [4be167e9] #23 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #24 [linux/amd64 build 7/9] COPY . .
DEBUG [4be167e9] #24 DONE 0.1s
DEBUG [4be167e9]
DEBUG [4be167e9] #25 [linux/arm64 build 7/9] COPY . .
DEBUG [4be167e9] #25 DONE 0.1s
DEBUG [4be167e9]
DEBUG [4be167e9] #26 [linux/arm64 build 8/9] RUN bundle exec bootsnap precompile app/ lib/
DEBUG [4be167e9] #26 DONE 0.3s
DEBUG [4be167e9]
DEBUG [4be167e9] #27 [linux/amd64 build 8/9] RUN bundle exec bootsnap precompile app/ lib/
DEBUG [4be167e9] #27 DONE 0.8s
DEBUG [4be167e9]
DEBUG [4be167e9] #28 [linux/amd64 build 9/9] RUN SECRET_KEY_BASE_DUMMY=1 ./bin/rails assets:precompile
DEBUG [4be167e9] #28 1.483 yarn install v1.22.19
DEBUG [4be167e9] #28 1.553 [1/4] Resolving packages...
DEBUG [4be167e9] #28 ...
DEBUG [4be167e9]
DEBUG [4be167e9] #29 [linux/arm64 build 9/9] RUN SECRET_KEY_BASE_DUMMY=1 ./bin/rails assets:precompile
DEBUG [4be167e9] #29 0.694 yarn install v1.22.19
DEBUG [4be167e9] #29 0.732 [1/4] Resolving packages...
DEBUG [4be167e9] #29 0.772 success Already up-to-date.
DEBUG [4be167e9] #29 0.776 Done in 0.08s.
DEBUG [4be167e9] #29 0.879 yarn run v1.22.19
DEBUG [4be167e9] #29 0.904 $ esbuild app/javascript/*.* --bundle --sourcemap --outdir=app/assets/builds --public-path=/assets
DEBUG [4be167e9] #29 0.956
DEBUG [4be167e9] #29 0.956 app/assets/builds/application.js 235.5kb
DEBUG [4be167e9] #29 0.956 app/assets/builds/application.js.map 409.2kb
DEBUG [4be167e9] #29 0.956
DEBUG [4be167e9] #29 0.960 Done in 0.08s.
DEBUG [4be167e9] #29 1.065 yarn install v1.22.19
DEBUG [4be167e9] #29 1.098 [1/4] Resolving packages...
DEBUG [4be167e9] #29 1.139 success Already up-to-date.
DEBUG [4be167e9] #29 1.143 Done in 0.08s.
DEBUG [4be167e9] #29 1.246 yarn run v1.22.19
DEBUG [4be167e9] #29 1.267 $ tailwindcss -i ./app/assets/stylesheets/application.tailwind.css -o ./app/assets/builds/application.css --minify
DEBUG [4be167e9] #29 1.640
DEBUG [4be167e9] #29 1.640 Rebuilding...
DEBUG [4be167e9] #29 1.755
DEBUG [4be167e9] #29 1.755 Done in 146ms.
DEBUG [4be167e9] #29 1.761 Done in 0.52s.
DEBUG [4be167e9] #29 1.890 W, [2023-09-24T23:23:10.297417 #7] WARN -- : Removed sourceMappingURL comment for missing asset '/assets/application.js.map' from /rails/app/assets/builds/application.js
DEBUG [4be167e9] #29 2.036 I, [2023-09-24T23:23:10.443068 #7] INFO -- : Writing /rails/public/assets/manifest-b4bf6e57a53c2bdb55b8998cc94cd00883793c1c37c5e5aea3ef6749b4f6d92b.js
DEBUG [4be167e9] #29 2.036 I, [2023-09-24T23:23:10.443675 #7] INFO -- : Writing /rails/public/assets/manifest-b4bf6e57a53c2bdb55b8998cc94cd00883793c1c37c5e5aea3ef6749b4f6d92b.js.gz
DEBUG [4be167e9] #29 2.036 I, [2023-09-24T23:23:10.443877 #7] INFO -- : Writing /rails/public/assets/application-eb3ac02adaf65ac61b5875149de7788d0bd4051e729e3dbed6e4447a92fe02b1.css
DEBUG [4be167e9] #29 2.037 I, [2023-09-24T23:23:10.444279 #7] INFO -- : Writing /rails/public/assets/application-eb3ac02adaf65ac61b5875149de7788d0bd4051e729e3dbed6e4447a92fe02b1.css.gz
DEBUG [4be167e9] #29 2.037 I, [2023-09-24T23:23:10.444399 #7] INFO -- : Writing /rails/public/assets/application-92b22c49141b181a5f4f97b54d0dc70c528b38953b43b87af5a6c078f21a63d5.js
DEBUG [4be167e9] #29 2.038 I, [2023-09-24T23:23:10.445538 #7] INFO -- : Writing /rails/public/assets/application-92b22c49141b181a5f4f97b54d0dc70c528b38953b43b87af5a6c078f21a63d5.js.gz
DEBUG [4be167e9] #29 2.038 I, [2023-09-24T23:23:10.445829 #7] INFO -- : Writing /rails/public/assets/application.js-d8fe80a21b35b81c3d3c292f00861966c5c5ca0f6c4614cbfe030e0992f46346.map
DEBUG [4be167e9] #29 2.039 I, [2023-09-24T23:23:10.446080 #7] INFO -- : Writing /rails/public/assets/application.js-d8fe80a21b35b81c3d3c292f00861966c5c5ca0f6c4614cbfe030e0992f46346.map.gz
DEBUG [4be167e9] #29 2.039 I, [2023-09-24T23:23:10.446364 #7] INFO -- : Writing /rails/public/assets/turbo-4851a9a0b1d947e810dfd0448a72aef261d455183ebea681f4f28a73640a9ece.js
DEBUG [4be167e9] #29 2.040 I, [2023-09-24T23:23:10.447284 #7] INFO -- : Writing /rails/public/assets/turbo-4851a9a0b1d947e810dfd0448a72aef261d455183ebea681f4f28a73640a9ece.js.gz
DEBUG [4be167e9] #29 2.040 I, [2023-09-24T23:23:10.447748 #7] INFO -- : Writing /rails/public/assets/turbo.min-f309baafa3ae5ad6ccee3e7362118b87678d792db8e8ab466c4fa284dd3a4700.js
DEBUG [4be167e9] #29 2.040 I, [2023-09-24T23:23:10.447814 #7] INFO -- : Writing /rails/public/assets/turbo.min-f309baafa3ae5ad6ccee3e7362118b87678d792db8e8ab466c4fa284dd3a4700.js.gz
DEBUG [4be167e9] #29 2.040 I, [2023-09-24T23:23:10.447887 #7] INFO -- : Writing /rails/public/assets/turbo.min.js-8bc8f4a58d1c106d58dec8bef6c638ff12ff4d078f19d8ebd8c4277f4c9bc85a.map
DEBUG [4be167e9] #29 2.041 I, [2023-09-24T23:23:10.448085 #7] INFO -- : Writing /rails/public/assets/turbo.min.js-8bc8f4a58d1c106d58dec8bef6c638ff12ff4d078f19d8ebd8c4277f4c9bc85a.map.gz
DEBUG [4be167e9] #29 2.041 I, [2023-09-24T23:23:10.448140 #7] INFO -- : Writing /rails/public/assets/actiontext-cd5df1a46c8d7cba7d349d21902404d2f38e60a476d0669148b02fa3aa8a2d5b.js
DEBUG [4be167e9] #29 2.042 I, [2023-09-24T23:23:10.449037 #7] INFO -- : Writing /rails/public/assets/actiontext-cd5df1a46c8d7cba7d349d21902404d2f38e60a476d0669148b02fa3aa8a2d5b.js.gz
DEBUG [4be167e9] #29 2.042 I, [2023-09-24T23:23:10.449645 #7] INFO -- : Writing /rails/public/assets/trix-9d726c63bf503ba68adf3d1bea343c030494f01061abf524a4e743f686629201.js
DEBUG [4be167e9] #29 2.043 I, [2023-09-24T23:23:10.449698 #7] INFO -- : Writing /rails/public/assets/trix-9d726c63bf503ba68adf3d1bea343c030494f01061abf524a4e743f686629201.js.gz
DEBUG [4be167e9] #29 2.043 I, [2023-09-24T23:23:10.449747 #7] INFO -- : Writing /rails/public/assets/trix-91ad87f30d9c53c7b05f534dc3c9994e4e90d50dff03a7222c1326f342f9c223.css
DEBUG [4be167e9] #29 2.043 I, [2023-09-24T23:23:10.449787 #7] INFO -- : Writing /rails/public/assets/trix-91ad87f30d9c53c7b05f534dc3c9994e4e90d50dff03a7222c1326f342f9c223.css.gz
DEBUG [4be167e9] #29 2.043 I, [2023-09-24T23:23:10.449876 #7] INFO -- : Writing /rails/public/assets/stimulus-f75215805563870a61ee9dc5a207ce46d4675c7e667558a54344fd1e7baa697f.js
DEBUG [4be167e9] #29 2.053 I, [2023-09-24T23:23:10.460887 #7] INFO -- : Writing /rails/public/assets/stimulus-f75215805563870a61ee9dc5a207ce46d4675c7e667558a54344fd1e7baa697f.js.gz
DEBUG [4be167e9] #29 2.054 I, [2023-09-24T23:23:10.461403 #7] INFO -- : Writing /rails/public/assets/stimulus-autoloader-c584942b568ba74879da31c7c3d51366737bacaf6fbae659383c0a5653685693.js
DEBUG [4be167e9] #29 2.054 I, [2023-09-24T23:23:10.461526 #7] INFO -- : Writing /rails/public/assets/stimulus-autoloader-c584942b568ba74879da31c7c3d51366737bacaf6fbae659383c0a5653685693.js.gz
DEBUG [4be167e9] #29 2.063 I, [2023-09-24T23:23:10.470921 #7] INFO -- : Writing /rails/public/assets/stimulus-importmap-autoloader-db2076c783bf2dbee1226e2add52fef290b5d31b5bcd1edd999ac8a6dd31c44a.js
DEBUG [4be167e9] #29 2.063 I, [2023-09-24T23:23:10.470979 #7] INFO -- : Writing /rails/public/assets/stimulus-importmap-autoloader-db2076c783bf2dbee1226e2add52fef290b5d31b5bcd1edd999ac8a6dd31c44a.js.gz
DEBUG [4be167e9] #29 2.064 I, [2023-09-24T23:23:10.471139 #7] INFO -- : Writing /rails/public/assets/stimulus-loading-3576ce92b149ad5d6959438c6f291e2426c86df3b874c525b30faad51b0d96b3.js
DEBUG [4be167e9] #29 2.064 I, [2023-09-24T23:23:10.471420 #7] INFO -- : Writing /rails/public/assets/stimulus-loading-3576ce92b149ad5d6959438c6f291e2426c86df3b874c525b30faad51b0d96b3.js.gz
DEBUG [4be167e9] #29 2.064 I, [2023-09-24T23:23:10.471666 #7] INFO -- : Writing /rails/public/assets/stimulus.min-dd364f16ec9504dfb72672295637a1c8838773b01c0b441bd41008124c407894.js
DEBUG [4be167e9] #29 2.064 I, [2023-09-24T23:23:10.471924 #7] INFO -- : Writing /rails/public/assets/stimulus.min-dd364f16ec9504dfb72672295637a1c8838773b01c0b441bd41008124c407894.js.gz
DEBUG [4be167e9] #29 2.065 I, [2023-09-24T23:23:10.472122 #7] INFO -- : Writing /rails/public/assets/stimulus-autoloader-c584942b568ba74879da31c7c3d51366737bacaf6fbae659383c0a5653685693.js.gz
DEBUG [4be167e9] #29 2.066 I, [2023-09-24T23:23:10.473802 #7] INFO -- : Writing /rails/public/assets/stimulus.min.js-2cc63625fa177963b45da974806e7aee846cbf1d4930815733d0fdf3fb232325.map
DEBUG [4be167e9] #29 2.066 I, [2023-09-24T23:23:10.474005 #7] INFO -- : Writing /rails/public/assets/stimulus.min.js-2cc63625fa177963b45da974806e7aee846cbf1d4930815733d0fdf3fb232325.map.gz
DEBUG [4be167e9] #29 2.066 I, [2023-09-24T23:23:10.474072 #7] INFO -- : Writing /rails/public/assets/activestorage-210320b03bffc155ca1782c116437391c929c7c5b5c66ee4f4c7a826733070a1.js
DEBUG [4be167e9] #29 2.067 I, [2023-09-24T23:23:10.474123 #7] INFO -- : Writing /rails/public/assets/activestorage-210320b03bffc155ca1782c116437391c929c7c5b5c66ee4f4c7a826733070a1.js.gz
DEBUG [4be167e9] #29 2.067 I, [2023-09-24T23:23:10.474179 #7] INFO -- : Writing /rails/public/assets/activestorage.esm-1e3c46a0710fa7f44a7ced2fc61af4416147823859c9e65b69cd8a91811e678e.js
DEBUG [4be167e9] #29 2.067 I, [2023-09-24T23:23:10.474212 #7] INFO -- : Writing /rails/public/assets/activestorage.esm-1e3c46a0710fa7f44a7ced2fc61af4416147823859c9e65b69cd8a91811e678e.js.gz
DEBUG [4be167e9] #29 2.067 I, [2023-09-24T23:23:10.474259 #7] INFO -- : Writing /rails/public/assets/actioncable-b561134b2bfb0d095c5329001e894d6d433544b2a0f4276e0e50591afa62bb46.js
DEBUG [4be167e9] #29 2.067 I, [2023-09-24T23:23:10.474298 #7] INFO -- : Writing /rails/public/assets/actioncable-b561134b2bfb0d095c5329001e894d6d433544b2a0f4276e0e50591afa62bb46.js.gz
DEBUG [4be167e9] #29 2.067 I, [2023-09-24T23:23:10.474342 #7] INFO -- : Writing /rails/public/assets/actioncable.esm-642a147cbb90e93c6f2bcaeeb817a4a263aa4f971a6d95795835270bd8519dfd.js
DEBUG [4be167e9] #29 2.067 I, [2023-09-24T23:23:10.474382 #7] INFO -- : Writing /rails/public/assets/actioncable.esm-642a147cbb90e93c6f2bcaeeb817a4a263aa4f971a6d95795835270bd8519dfd.js.gz
DEBUG [4be167e9] #29 DONE 2.2s
DEBUG [4be167e9]
DEBUG [4be167e9] #28 [linux/amd64 build 9/9] RUN SECRET_KEY_BASE_DUMMY=1 ./bin/rails assets:precompile
DEBUG [4be167e9] #28 1.691 success Already up-to-date.
DEBUG [4be167e9] #28 1.700 Done in 0.23s.
DEBUG [4be167e9] #28 2.216 yarn run v1.22.19
DEBUG [4be167e9] #28 2.276 $ esbuild app/javascript/*.* --bundle --sourcemap --outdir=app/assets/builds --public-path=/assets
DEBUG [4be167e9] #28 2.747
DEBUG [4be167e9] #28 2.747 app/assets/builds/application.js 235.5kb
DEBUG [4be167e9] #28 2.747 app/assets/builds/application.js.map 409.2kb
DEBUG [4be167e9] #28 2.747
DEBUG [4be167e9] #28 2.772 Done in 0.57s.
DEBUG [4be167e9] #28 ...
DEBUG [4be167e9]
DEBUG [4be167e9] #30 [linux/arm64 stage-2 1/4] RUN apt-get update -qq && apt-get install --no-install-recommends -y curl libsqlite3-0 libvips && rm -rf /var/lib/apt/lists /var/cache/apt/archives
DEBUG [4be167e9] #30 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #31 [linux/arm64 stage-2 2/4] COPY --from=build /usr/local/bundle /usr/local/bundle
DEBUG [4be167e9] #31 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #28 [linux/amd64 build 9/9] RUN SECRET_KEY_BASE_DUMMY=1 ./bin/rails assets:precompile
DEBUG [4be167e9] #28 3.293 yarn install v1.22.19
DEBUG [4be167e9] #28 3.367 [1/4] Resolving packages...
DEBUG [4be167e9] #28 3.520 success Already up-to-date.
DEBUG [4be167e9] #28 3.529 Done in 0.25s.
DEBUG [4be167e9] #28 4.040 yarn run v1.22.19
DEBUG [4be167e9] #28 4.096 $ tailwindcss -i ./app/assets/stylesheets/application.tailwind.css -o ./app/assets/builds/application.css --minify
DEBUG [4be167e9] #28 ...
DEBUG [4be167e9]
DEBUG [4be167e9] #32 [linux/arm64 stage-2 3/4] COPY --from=build /rails /rails
DEBUG [4be167e9] #32 DONE 1.1s
DEBUG [4be167e9]
DEBUG [4be167e9] #33 [linux/arm64 stage-2 4/4] RUN useradd rails --create-home --shell /bin/bash && chown -R rails:rails db log storage tmp
DEBUG [4be167e9] #33 DONE 0.6s
DEBUG [4be167e9]
DEBUG [4be167e9] #28 [linux/amd64 build 9/9] RUN SECRET_KEY_BASE_DUMMY=1 ./bin/rails assets:precompile
DEBUG [4be167e9] #28 5.297
DEBUG [4be167e9] #28 5.297 Rebuilding...
DEBUG [4be167e9] #28 5.662
DEBUG [4be167e9] #28 5.662 Done in 415ms.
DEBUG [4be167e9] #28 5.683 Done in 1.65s.
DEBUG [4be167e9] #28 5.829 W, [2023-09-24T23:23:14.725768 #7] WARN -- : Removed sourceMappingURL comment for missing asset '/assets/application.js.map' from /rails/app/assets/builds/application.js
DEBUG [4be167e9] #28 5.942 I, [2023-09-24T23:23:14.840061 #7] INFO -- : Writing /rails/public/assets/manifest-b4bf6e57a53c2bdb55b8998cc94cd00883793c1c37c5e5aea3ef6749b4f6d92b.js
DEBUG [4be167e9] #28 5.943 I, [2023-09-24T23:23:14.840270 #7] INFO -- : Writing /rails/public/assets/manifest-b4bf6e57a53c2bdb55b8998cc94cd00883793c1c37c5e5aea3ef6749b4f6d92b.js.gz
DEBUG [4be167e9] #28 5.943 I, [2023-09-24T23:23:14.840826 #7] INFO -- : Writing /rails/public/assets/application-eb3ac02adaf65ac61b5875149de7788d0bd4051e729e3dbed6e4447a92fe02b1.css
DEBUG [4be167e9] #28 5.944 I, [2023-09-24T23:23:14.841288 #7] INFO -- : Writing /rails/public/assets/application-eb3ac02adaf65ac61b5875149de7788d0bd4051e729e3dbed6e4447a92fe02b1.css.gz
DEBUG [4be167e9] #28 5.944 I, [2023-09-24T23:23:14.841443 #7] INFO -- : Writing /rails/public/assets/application-92b22c49141b181a5f4f97b54d0dc70c528b38953b43b87af5a6c078f21a63d5.js
DEBUG [4be167e9] #28 5.944 I, [2023-09-24T23:23:14.841623 #7] INFO -- : Writing /rails/public/assets/application-92b22c49141b181a5f4f97b54d0dc70c528b38953b43b87af5a6c078f21a63d5.js.gz
DEBUG [4be167e9] #28 5.944 I, [2023-09-24T23:23:14.841724 #7] INFO -- : Writing /rails/public/assets/application.js-d8fe80a21b35b81c3d3c292f00861966c5c5ca0f6c4614cbfe030e0992f46346.map
DEBUG [4be167e9] #28 5.944 I, [2023-09-24T23:23:14.841791 #7] INFO -- : Writing /rails/public/assets/application.js-d8fe80a21b35b81c3d3c292f00861966c5c5ca0f6c4614cbfe030e0992f46346.map.gz
DEBUG [4be167e9] #28 5.945 I, [2023-09-24T23:23:14.842282 #7] INFO -- : Writing /rails/public/assets/turbo-4851a9a0b1d947e810dfd0448a72aef261d455183ebea681f4f28a73640a9ece.js
DEBUG [4be167e9] #28 5.946 I, [2023-09-24T23:23:14.843159 #7] INFO -- : Writing /rails/public/assets/turbo-4851a9a0b1d947e810dfd0448a72aef261d455183ebea681f4f28a73640a9ece.js.gz
DEBUG [4be167e9] #28 5.946 I, [2023-09-24T23:23:14.843929 #7] INFO -- : Writing /rails/public/assets/turbo.min-f309baafa3ae5ad6ccee3e7362118b87678d792db8e8ab466c4fa284dd3a4700.js
DEBUG [4be167e9] #28 5.946 I, [2023-09-24T23:23:14.844026 #7] INFO -- : Writing /rails/public/assets/turbo.min-f309baafa3ae5ad6ccee3e7362118b87678d792db8e8ab466c4fa284dd3a4700.js.gz
DEBUG [4be167e9] #28 5.948 I, [2023-09-24T23:23:14.845232 #7] INFO -- : Writing /rails/public/assets/turbo.min.js-8bc8f4a58d1c106d58dec8bef6c638ff12ff4d078f19d8ebd8c4277f4c9bc85a.map
DEBUG [4be167e9] #28 5.948 I, [2023-09-24T23:23:14.845940 #7] INFO -- : Writing /rails/public/assets/turbo.min.js-8bc8f4a58d1c106d58dec8bef6c638ff12ff4d078f19d8ebd8c4277f4c9bc85a.map.gz
DEBUG [4be167e9] #28 5.949 I, [2023-09-24T23:23:14.846744 #7] INFO -- : Writing /rails/public/assets/actiontext-cd5df1a46c8d7cba7d349d21902404d2f38e60a476d0669148b02fa3aa8a2d5b.js
DEBUG [4be167e9] #28 5.950 I, [2023-09-24T23:23:14.847126 #7] INFO -- : Writing /rails/public/assets/actiontext-cd5df1a46c8d7cba7d349d21902404d2f38e60a476d0669148b02fa3aa8a2d5b.js.gz
DEBUG [4be167e9] #28 5.951 I, [2023-09-24T23:23:14.848549 #7] INFO -- : Writing /rails/public/assets/trix-9d726c63bf503ba68adf3d1bea343c030494f01061abf524a4e743f686629201.js
DEBUG [4be167e9] #28 5.951 I, [2023-09-24T23:23:14.848988 #7] INFO -- : Writing /rails/public/assets/trix-9d726c63bf503ba68adf3d1bea343c030494f01061abf524a4e743f686629201.js.gz
DEBUG [4be167e9] #28 5.952 I, [2023-09-24T23:23:14.849194 #7] INFO -- : Writing /rails/public/assets/trix-91ad87f30d9c53c7b05f534dc3c9994e4e90d50dff03a7222c1326f342f9c223.css
DEBUG [4be167e9] #28 5.952 I, [2023-09-24T23:23:14.849396 #7] INFO -- : Writing /rails/public/assets/trix-91ad87f30d9c53c7b05f534dc3c9994e4e90d50dff03a7222c1326f342f9c223.css.gz
DEBUG [4be167e9] #28 5.952 I, [2023-09-24T23:23:14.849865 #7] INFO -- : Writing /rails/public/assets/stimulus-f75215805563870a61ee9dc5a207ce46d4675c7e667558a54344fd1e7baa697f.js
DEBUG [4be167e9] #28 5.953 I, [2023-09-24T23:23:14.849945 #7] INFO -- : Writing /rails/public/assets/stimulus-f75215805563870a61ee9dc5a207ce46d4675c7e667558a54344fd1e7baa697f.js.gz
DEBUG [4be167e9] #28 5.953 I, [2023-09-24T23:23:14.850069 #7] INFO -- : Writing /rails/public/assets/stimulus-autoloader-c584942b568ba74879da31c7c3d51366737bacaf6fbae659383c0a5653685693.js
DEBUG [4be167e9] #28 5.953 I, [2023-09-24T23:23:14.850144 #7] INFO -- : Writing /rails/public/assets/stimulus-autoloader-c584942b568ba74879da31c7c3d51366737bacaf6fbae659383c0a5653685693.js.gz
DEBUG [4be167e9] #28 5.953 I, [2023-09-24T23:23:14.850368 #7] INFO -- : Writing /rails/public/assets/stimulus-importmap-autoloader-db2076c783bf2dbee1226e2add52fef290b5d31b5bcd1edd999ac8a6dd31c44a.js
DEBUG [4be167e9] #28 5.953 I, [2023-09-24T23:23:14.850632 #7] INFO -- : Writing /rails/public/assets/stimulus-importmap-autoloader-db2076c783bf2dbee1226e2add52fef290b5d31b5bcd1edd999ac8a6dd31c44a.js.gz
DEBUG [4be167e9] #28 5.953 I, [2023-09-24T23:23:14.851049 #7] INFO -- : Writing /rails/public/assets/stimulus-loading-3576ce92b149ad5d6959438c6f291e2426c86df3b874c525b30faad51b0d96b3.js
DEBUG [4be167e9] #28 5.954 I, [2023-09-24T23:23:14.851258 #7] INFO -- : Writing /rails/public/assets/stimulus-loading-3576ce92b149ad5d6959438c6f291e2426c86df3b874c525b30faad51b0d96b3.js.gz
DEBUG [4be167e9] #28 5.954 I, [2023-09-24T23:23:14.851413 #7] INFO -- : Writing /rails/public/assets/stimulus.min-dd364f16ec9504dfb72672295637a1c8838773b01c0b441bd41008124c407894.js
DEBUG [4be167e9] #28 5.954 I, [2023-09-24T23:23:14.851623 #7] INFO -- : Writing /rails/public/assets/stimulus.min-dd364f16ec9504dfb72672295637a1c8838773b01c0b441bd41008124c407894.js.gz
DEBUG [4be167e9] #28 5.954 I, [2023-09-24T23:23:14.851929 #7] INFO -- : Writing /rails/public/assets/stimulus.min.js-2cc63625fa177963b45da974806e7aee846cbf1d4930815733d0fdf3fb232325.map
DEBUG [4be167e9] #28 5.956 I, [2023-09-24T23:23:14.853033 #7] INFO -- : Writing /rails/public/assets/stimulus.min.js-2cc63625fa177963b45da974806e7aee846cbf1d4930815733d0fdf3fb232325.map.gz
DEBUG [4be167e9] #28 5.956 I, [2023-09-24T23:23:14.853204 #7] INFO -- : Writing /rails/public/assets/activestorage-210320b03bffc155ca1782c116437391c929c7c5b5c66ee4f4c7a826733070a1.js
DEBUG [4be167e9] #28 5.956 I, [2023-09-24T23:23:14.853284 #7] INFO -- : Writing /rails/public/assets/activestorage-210320b03bffc155ca1782c116437391c929c7c5b5c66ee4f4c7a826733070a1.js.gz
DEBUG [4be167e9] #28 5.956 I, [2023-09-24T23:23:14.853364 #7] INFO -- : Writing /rails/public/assets/activestorage.esm-1e3c46a0710fa7f44a7ced2fc61af4416147823859c9e65b69cd8a91811e678e.js
DEBUG [4be167e9] #28 5.956 I, [2023-09-24T23:23:14.853417 #7] INFO -- : Writing /rails/public/assets/activestorage.esm-1e3c46a0710fa7f44a7ced2fc61af4416147823859c9e65b69cd8a91811e678e.js.gz
DEBUG [4be167e9] #28 5.956 I, [2023-09-24T23:23:14.853484 #7] INFO -- : Writing /rails/public/assets/actioncable-b561134b2bfb0d095c5329001e894d6d433544b2a0f4276e0e50591afa62bb46.js
DEBUG [4be167e9] #28 5.956 I, [2023-09-24T23:23:14.853689 #7] INFO -- : Writing /rails/public/assets/actioncable-b561134b2bfb0d095c5329001e894d6d433544b2a0f4276e0e50591afa62bb46.js.gz
DEBUG [4be167e9] #28 5.956 I, [2023-09-24T23:23:14.853770 #7] INFO -- : Writing /rails/public/assets/actioncable.esm-642a147cbb90e93c6f2bcaeeb817a4a263aa4f971a6d95795835270bd8519dfd.js
DEBUG [4be167e9] #28 5.956 I, [2023-09-24T23:23:14.853909 #7] INFO -- : Writing /rails/public/assets/actioncable.esm-642a147cbb90e93c6f2bcaeeb817a4a263aa4f971a6d95795835270bd8519dfd.js.gz
DEBUG [4be167e9] #28 DONE 6.0s
DEBUG [4be167e9]
DEBUG [4be167e9] #34 [linux/amd64 stage-2 1/4] RUN apt-get update -qq && apt-get install --no-install-recommends -y curl libsqlite3-0 libvips && rm -rf /var/lib/apt/lists /var/cache/apt/archives
DEBUG [4be167e9] #34 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #35 [linux/amd64 stage-2 2/4] COPY --from=build /usr/local/bundle /usr/local/bundle
DEBUG [4be167e9] #35 CACHED
DEBUG [4be167e9]
DEBUG [4be167e9] #36 [linux/amd64 stage-2 3/4] COPY --from=build /rails /rails
DEBUG [4be167e9] #36 DONE 0.9s
DEBUG [4be167e9]
DEBUG [4be167e9] #37 [linux/amd64 stage-2 4/4] RUN useradd rails --create-home --shell /bin/bash && chown -R rails:rails db log storage tmp
DEBUG [4be167e9] #37 DONE 0.6s
DEBUG [4be167e9]
DEBUG [4be167e9] #38 exporting to image
DEBUG [4be167e9] #38 exporting layers
DEBUG [4be167e9] #38 exporting layers 2.9s done
DEBUG [4be167e9] #38 exporting manifest sha256:c8dd922b96e93a1f5bfc45fae4aaf7dd79656dfd6d506f608e0aa9b5923c87c5
DEBUG [4be167e9] #38 exporting manifest sha256:c8dd922b96e93a1f5bfc45fae4aaf7dd79656dfd6d506f608e0aa9b5923c87c5 done
DEBUG [4be167e9] #38 exporting config sha256:7b829efd780a2329d031603886a93d6f7acf85ac8b0aac1317ee136655dd4497 done
DEBUG [4be167e9] #38 exporting attestation manifest sha256:82b866c1fc9f32cd840f879c90b24992eb5bc44d166a9be96c47ae67a848b87a done
DEBUG [4be167e9] #38 exporting manifest sha256:440dba749816ae3696ea606c5a300b833aef3641d904deb2869548bbbe90f9db done
DEBUG [4be167e9] #38 exporting config sha256:53c3da4f661e7a431b11572cb3e346d0676be75759e7b964ced048e12de0116a done
DEBUG [4be167e9] #38 exporting attestation manifest sha256:e2800435fc984c32f1cfc3ff877761923f59a2895d8ba157656d72ad010cdf38 done
DEBUG [4be167e9] #38 exporting manifest list sha256:04f08b9eb62ae4d7a70249188836425bac28474efc3eaa9a47a1934690f091b1 done
DEBUG [4be167e9] #38 pushing layers
DEBUG [4be167e9] #38 ...
DEBUG [4be167e9]
DEBUG [4be167e9] #39 [auth] robzolkos/turbonativedirectory:pull,push token for registry.digitalocean.com
DEBUG [4be167e9] #39 DONE 0.0s
DEBUG [4be167e9]
DEBUG [4be167e9] #38 exporting to image
DEBUG [4be167e9] #38 pushing layers 22.3s done
DEBUG [4be167e9] #38 pushing manifest for registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40@sha256:04f08b9eb62ae4d7a70249188836425bac28474efc3eaa9a47a1934690f091b1
DEBUG [4be167e9] #38 pushing manifest for registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40@sha256:04f08b9eb62ae4d7a70249188836425bac28474efc3eaa9a47a1934690f091b1 1.4s done
DEBUG [4be167e9] #38 pushing layers 1.0s done
DEBUG [4be167e9] #38 pushing manifest for registry.digitalocean.com/robzolkos/turbonativedirectory:latest@sha256:04f08b9eb62ae4d7a70249188836425bac28474efc3eaa9a47a1934690f091b1
DEBUG [4be167e9] #38 pushing manifest for registry.digitalocean.com/robzolkos/turbonativedirectory:latest@sha256:04f08b9eb62ae4d7a70249188836425bac28474efc3eaa9a47a1934690f091b1 0.6s done
DEBUG [4be167e9] #38 DONE 28.3s
INFO [4be167e9] Finished in 40.549 seconds with exit status 0 (successful).
INFO [fddeeffb] Running docker image rm --force registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40 on 157.245.93.20
INFO [fddeeffb] Finished in 0.175 seconds with exit status 0 (successful).
INFO [9778a098] Running docker pull registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40 on 157.245.93.20
INFO [9778a098] Finished in 6.873 seconds with exit status 0 (successful).
INFO [a3a57128] Running docker inspect -f '{{ .Config.Labels.service }}' registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40 | grep -x turbo-native-directory || (echo "Image registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40 is missing the `service` label" && exit 1) on 157.245.93.20
INFO [a3a57128] Finished in 0.167 seconds with exit status 0 (successful).
Ensure Traefik is running...
INFO [a7f2c21f] Running docker login registry.digitalocean.com -u [REDACTED] -p [REDACTED] on 157.245.93.20
INFO [a7f2c21f] Finished in 0.255 seconds with exit status 0 (successful).
INFO [a4e2c3d5] Running docker container start traefik || docker run --name traefik --detach --restart unless-stopped --publish 80:80 --volume /var/run/docker.sock:/var/run/docker.sock --env-file .kamal/env/traefik/traefik.env --log-opt max-size="10m" --publish "443:443" --volume "/letsencrypt/acme.json:/letsencrypt/acme.json" traefik:v2.9 --providers.docker --log.level="DEBUG" --entryPoints.web.address=":80" --entryPoints.websecure.address=":443" --entryPoints.web.http.redirections.entryPoint.to="websecure" --entryPoints.web.http.redirections.entryPoint.scheme="https" --entryPoints.web.http.redirections.entrypoint.permanent --entrypoints.websecure.http.tls --entrypoints.websecure.http.tls.domains[0].main="turbonative.directory" --certificatesResolvers.letsencrypt.acme.email="robzolkos@hey.com" --certificatesResolvers.letsencrypt.acme.storage="/letsencrypt/acme.json" --certificatesResolvers.letsencrypt.acme.httpchallenge --certificatesResolvers.letsencrypt.acme.httpchallenge.entrypoint="web" on 157.245.93.20
INFO [a4e2c3d5] Finished in 0.121 seconds with exit status 0 (successful).
Ensure app can pass healthcheck...
INFO [aebb3eaa] Running docker run --detach --name healthcheck-turbo-native-directory-c75d2004763f0c8cf374df6a81bfb74bbedeca40 --publish 3999:3000 --label service=healthcheck-turbo-native-directory -e KAMAL_CONTAINER_NAME="healthcheck-turbo-native-directory" --env-file .kamal/env/roles/turbo-native-directory-web.env --health-cmd "curl -f http://localhost:3000/up || exit 1" --health-interval "1s" --volume storage:/rails/storage registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40 on 157.245.93.20
INFO [aebb3eaa] Finished in 0.870 seconds with exit status 0 (successful).
INFO [f2e4500c] Running docker container ls --all --filter name=^healthcheck-turbo-native-directory-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [f2e4500c] Finished in 0.222 seconds with exit status 0 (successful).
INFO container not ready (starting), retrying in 1s (attempt 1/7)...
INFO [2fba8432] Running docker container ls --all --filter name=^healthcheck-turbo-native-directory-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [2fba8432] Finished in 0.210 seconds with exit status 0 (successful).
INFO container not ready (starting), retrying in 2s (attempt 2/7)...
INFO [859e7637] Running docker container ls --all --filter name=^healthcheck-turbo-native-directory-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [859e7637] Finished in 0.220 seconds with exit status 0 (successful).
INFO container not ready (starting), retrying in 3s (attempt 3/7)...
INFO [046f742d] Running docker container ls --all --filter name=^healthcheck-turbo-native-directory-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [046f742d] Finished in 0.260 seconds with exit status 0 (successful).
INFO Container is healthy!
INFO [bd5c1c64] Running docker container ls --all --filter name=^healthcheck-turbo-native-directory-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker stop on 157.245.93.20
INFO [bd5c1c64] Finished in 0.779 seconds with exit status 0 (successful).
INFO [77e0c00d] Running docker container ls --all --filter name=^healthcheck-turbo-native-directory-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker container rm on 157.245.93.20
INFO [77e0c00d] Finished in 0.456 seconds with exit status 0 (successful).
Detect stale containers...
INFO [979ff8a8] Running docker ps --filter label=service=turbo-native-directory --filter label=role=web --format "{{.Names}}" | while read line; do echo ${line#turbo-native-directory-web-}; done on 157.245.93.20
INFO [979ff8a8] Finished in 0.161 seconds with exit status 0 (successful).
Start container with version c75d2004763f0c8cf374df6a81bfb74bbedeca40 using a 7s readiness delay (or reboot if already running)...
INFO [5bff47c3] Running docker tag registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40 registry.digitalocean.com/robzolkos/turbonativedirectory:latest on 157.245.93.20
INFO [5bff47c3] Finished in 0.151 seconds with exit status 0 (successful).
INFO [d2c4adce] Running docker container ls --all --filter name=^turbo-native-directory-web-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet on 157.245.93.20
INFO [d2c4adce] Finished in 0.121 seconds with exit status 0 (successful).
INFO [92a6b5d1] Running docker ps --filter label=service=turbo-native-directory --filter label=role=web --filter status=running --filter status=restarting --latest --format "{{.Names}}" | while read line; do echo ${line#turbo-native-directory-web-}; done on 157.245.93.20
INFO [92a6b5d1] Finished in 0.132 seconds with exit status 0 (successful).
INFO [4b948708] Running /usr/bin/env mkdir -p .kamal/cords/turbo-native-directory-web-7dd7e63c6401e133e882789c9185f551 ; touch .kamal/cords/turbo-native-directory-web-7dd7e63c6401e133e882789c9185f551/cord on 157.245.93.20
INFO [4b948708] Finished in 0.106 seconds with exit status 0 (successful).
INFO [008d0863] Running docker run --detach --restart unless-stopped --name turbo-native-directory-web-c75d2004763f0c8cf374df6a81bfb74bbedeca40 --hostname 157.245.93.20-11c756b7c501 -e KAMAL_CONTAINER_NAME="turbo-native-directory-web-c75d2004763f0c8cf374df6a81bfb74bbedeca40" --env-file .kamal/env/roles/turbo-native-directory-web.env --health-cmd "(curl -f http://localhost:3000/up || exit 1) && (stat /tmp/kamal-cord/cord > /dev/null || exit 1)" --health-interval "1s" --volume $(pwd)/.kamal/cords/turbo-native-directory-web-7dd7e63c6401e133e882789c9185f551:/tmp/kamal-cord --log-opt max-size="10m" --volume storage:/rails/storage --label service="turbo-native-directory" --label role="web" --label traefik.http.services.turbo-native-directory-web.loadbalancer.server.scheme="http" --label traefik.http.routers.turbo-native-directory-web.rule="PathPrefix(\`/\`)" --label traefik.http.middlewares.turbo-native-directory-web-retry.retry.attempts="5" --label traefik.http.middlewares.turbo-native-directory-web-retry.retry.initialinterval="500ms" --label traefik.http.routers.turbo-native-directory-web.middlewares="turbo-native-directory-web-retry@docker" --label traefik.http.routers.domain.rule="Host(\`turbonative.directory\`)" --label traefik.http.routers.domain.entrypoints="websecure" --label traefik.http.routers.domain.tls.certresolver="letsencrypt" registry.digitalocean.com/robzolkos/turbonativedirectory:c75d2004763f0c8cf374df6a81bfb74bbedeca40 on 157.245.93.20
INFO [008d0863] Finished in 0.857 seconds with exit status 0 (successful).
INFO [988d58bd] Running docker container ls --all --filter name=^turbo-native-directory-web-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [988d58bd] Finished in 0.255 seconds with exit status 0 (successful).
INFO container not ready (starting), retrying in 1s (attempt 1/7)...
INFO [cdac8131] Running docker container ls --all --filter name=^turbo-native-directory-web-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [cdac8131] Finished in 0.243 seconds with exit status 0 (successful).
INFO container not ready (starting), retrying in 2s (attempt 2/7)...
INFO [c5a69678] Running docker container ls --all --filter name=^turbo-native-directory-web-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [c5a69678] Finished in 0.280 seconds with exit status 0 (successful).
INFO container not ready (starting), retrying in 3s (attempt 3/7)...
INFO [e36a39a0] Running docker container ls --all --filter name=^turbo-native-directory-web-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [e36a39a0] Finished in 0.269 seconds with exit status 0 (successful).
INFO container not ready (unhealthy), retrying in 4s (attempt 4/7)...
INFO [89d3bcb9] Running docker container ls --all --filter name=^turbo-native-directory-web-c75d2004763f0c8cf374df6a81bfb74bbedeca40$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [89d3bcb9] Finished in 0.273 seconds with exit status 0 (successful).
INFO Container is healthy!
INFO [0b12905f] Running docker inspect -f '{{ range .Mounts }}{{printf "%s %s\n" .Source .Destination}}{{ end }}' turbo-native-directory-web-aa528010e150fb95924f56541a76c523c4a8b673 | awk '$2 == "/tmp/kamal-cord" {print $1}' on 157.245.93.20
INFO [0b12905f] Finished in 0.211 seconds with exit status 0 (successful).
INFO [3a19a33d] Running /usr/bin/env rm -r /root/.kamal/cords/turbo-native-directory-web-18ae4ce9ed0920de5b6873325d595184 on 157.245.93.20
INFO [3a19a33d] Finished in 0.119 seconds with exit status 0 (successful).
INFO [980f505d] Running docker container ls --all --filter name=^turbo-native-directory-web-aa528010e150fb95924f56541a76c523c4a8b673$ --quiet | xargs docker inspect --format '{{if .State.Health}}{{.State.Health.Status}}{{else}}{{.State.Status}}{{end}}' on 157.245.93.20
INFO [980f505d] Finished in 0.175 seconds with exit status 0 (successful).
INFO Container is unhealthy!
INFO [b5446faf] Running docker container ls --all --filter name=^turbo-native-directory-web-aa528010e150fb95924f56541a76c523c4a8b673$ --quiet | xargs docker stop on 157.245.93.20
INFO [b5446faf] Finished in 0.180 seconds with exit status 0 (successful).
Prune old containers and images...
INFO [c127b524] Running docker ps -q -a --filter label=service=turbo-native-directory --filter status=created --filter status=exited --filter status=dead | tail -n +6 | while read container_id; do docker rm $container_id; done on 157.245.93.20
INFO [c127b524] Finished in 0.215 seconds with exit status 0 (successful).
INFO [77f526d5] Running docker container prune --force --filter label=service=healthcheck-turbo-native-directory on 157.245.93.20
INFO [77f526d5] Finished in 0.149 seconds with exit status 0 (successful).
INFO [cf4968b8] Running docker image prune --force --filter label=service=turbo-native-directory on 157.245.93.20
INFO [cf4968b8] Finished in 0.129 seconds with exit status 0 (successful).
INFO [acbc556f] Running docker image ls --filter label=service=turbo-native-directory --format '{{.ID}} {{.Repository}}:{{.Tag}}' | grep -v -w "$(docker container ls -a --format '{{.Image}}\|' --filter label=service=turbo-native-directory | tr -d '\n')registry.digitalocean.com/robzolkos/turbonativedirectory:latest\|registry.digitalocean.com/robzolkos/turbonativedirectory:<none>" | while read image tag; do docker rmi $tag; done on 157.245.93.20
INFO [acbc556f] Finished in 0.192 seconds with exit status 0 (successful).
Releasing the deploy lock...
Finished all in 85.6 seconds
@robzolkos
Copy link
Author

I think I started with a 512mb server and then doubled it. The issue I found was the initial deploy worked fine. But then subsequent deploys failed. Reason being that it keeps v1 of the app running, then boots v2 of the app, then when the health check on that passes it shuts down v1 and redirects traffic to v2. So the server needs to have enough memory to have both versions of the app running (even though its only for a short time).

@paulanunda
Copy link

Interesting. I had a 1gb server and hadn't deployed anything for a few weeks. I got a downtime alert overnight that resolved itself in 10 minutes. I figured it was a networking issue.
Then the next day, I got another overnight downtime alert and it never resolved itself. I checked the system load was fine, there was plenty of disk space, but the logs were full of A server is already running (pid: 1, file: /rails/tmp/pids/server.pid).

@robzolkos
Copy link
Author

sounds like a different issue. I guess one way to test the hypothesis is to temporarily increase the ram and see if the issue goes away. It does sound like a health check somewhere caused things to restart.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment